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ABSTRACT  a 

Testimony  and  exhibits  presented  at  subcpmmittee 

hearings  held  in  Washington,  C.C-,  from  July  31,  1979  through  October 
.11,  1979,  are  compiled  with  reference  to  two  proposed  bills  concerned 
with  standardized  a-dmissions  tests.  The  first,  the  Truth  In  Testing 
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admissions  testing  (which  affects  commerce)   to  be  odnducted  with 
sufficiert  notice  of  test  sub iect  matter  and  test  results,  and  for. 
ether  purposes.  The  second,  the  Educational  Testing  Act  of  1979, 
H.R.U9I49,  requires  certain  information  be  provL^ed  to  individuals  who 
take  standardized  educational  admissions  tests,  and  for  other 
purposes.  This  'document  contains  the  statements  and  exhibits 
presented  by '127  petsohs.  (Author/CTM) 


*  .  Bepf eductions  supplied  by  EDRS  ar.e  the  best  th.at  can  be. made.  * 

*  ^,  T    '  '        from  t,he  original  document.  •  ^      :  * 


TRUTH  IN  TESTING  Af  OF  1979;  THE  EDUCATIONAL 
TESTI&T  OF  1979 


CD 

car: 


:  ■  .  HEARlJfeS  V 

^  ^  .  .      BBFORE  THE  ^ 

SUBCOMMITTEE  ON  ELEMEMBY^  SI^MDARY, 
AND  VOMIOML  EDW^TlO/ " 

.  OF  TfeKBJ 

COMMITTEE  ON  EDUCi>friON  LABOR 
H0T18B  OF  RBPRE^Na^ATIV^ 

NINETY-SIXTH.  CON;GBESS 

88I0I 


■o 

00 


FIRST 

'h.R.  3^64 

TO  REQUIRE  ALL  EDUCATIONAL  ADMISSIONS  TESTING 
DUCTED  THROUGH  INTERS^Al^E  COMMERCE,  AND/ALL 
OCCUPATIONAL  ADMISSIONS  /TESTING  (WHICH^j^PFECTS 
COMMERCE)  TO  BE  CONDU0TED  WITH  SUFFTOIESt  NOTICE 
OF  TEST  SUBJECT  MATTfill/AND  TEST  REaULTS,  AND  FOR 

OTBER  PURPOSES 

AND 

LR.  4949  \ 

TO   REQUIRE   OBRTAl)^ /INFORMATION   BE   PROVIDED  TO 
INDIVIDUALS   WHO  /TAKE    STANDARDIZED  EDUCATIONAL 
ADMISSIONS;  TEStS,  AND  TOR  OTHER  PURPOSES 


PEARING)^  j^ELD  IN  WASHING*0N,  D.O.,  ON 
JULY  81;  AtOU^T  I  j  SEPTEMBER  10,  24;  OCTOBER  10 
/        AND  11,  197» 


/  ' 

Printed  tor  tbjs  um  of  the  Committee  on  Education  and  Labor 


U  S  Of  CflW  t  Ml  N  I  Of  Ht  Al  I  H 
I  OIK  A  I  ION  »  Wf  'l  f  AH  t 
NAIIONAl  iNSIimit  Of. 
[  t)UC  A  I  ION 


,  -.-I  '.  ■ 


erJc 


M  ■ 


mi',     i.  M  w 

■  t    »    V  t  :  ' 


.  «  t  .VI 


a. 


TRUTH  IN  TESTING  ACT  OF  1979;  THE  EDUCATIONAL 
TESTING  ACT  OF  1979 


HEARINGS 

^  BBFpRB  THE  • 

SUBCOMMITTEE  ON  ELEMEmRY,  SECONK 
AND  VOCATIONAL  EDUCATION 

OF  THO 

COMMITTBE  ON  EDUCATION  AND  LABOR 
HOUSE  OF  HEPRBSENTATIVES 

NINETY-SIXTH  CONGRESS 
rmsT  SESSION 

H.R.  3564 

TO  REQUIRE  ALL  EDUCATIONAL  ADMISSIONS  TESTINa  CON- 
DUCTED THROUGH  -  INTERSTATE  COMMERCE,  AND  ALL 
OCCUPATIONAL  ADMISSIONS  TESTING  (W^ICH  ArPBCTS 
COMMERCE)  TO  BE  CONDUCTED  WITH  SUmCIENT  NOTIOB 
or  TEST  SUBJECT  MATTER  AND  TEST  RESUI/TS,  AND  FOR 

OTHER  PURPOSES 

AND  .  ' 

H.R.4949 

TO   RBQUIRB    CERTAIN   INFORMATION   BE   PROVIDED  TO 
INDIVIDUALS    WHO   TAKE    STANDARDIZED  EDUCATIONAL 
ADMISSIONS  TESTS,  AND  FOR  OTHER  PURPOSES 


HEARINGS.  HELD  IN  WASHINGTON,  D,C.,  ON  . 
JULY  81;  AUGUST  1;  SEPTEMBER  10,  24;  OCTOBER  10 
AND  11,  1079 


Printed  for  the  use  of  the  Committee  on  Education  and  Labor 


U.S.  QOVBRNMBNT  PHINTINO^OFFICK 
5i-834  0  WABHINOtON  :  19R0 


ERLC 


CX)MMITTEE  ON  EDUCATION  AND  LABOR 


CAIIL  b.  PERKINS,  Kentucky,  Chairman 


'  FRANK  THOMPSON^  Jr..  New  Jersey 
JOHN  BRADEMAS,  Indiana 
AUGUSTUS  F  HAWKINS,  California 
WILLIAM  B.  FOR0.  Michigan 
PHILLIP  BURTON,  California     '  \ 
JOSEPH  M.  GAYDOS,  Pennsylvania j 
WILLIAM  (BILL)  CLAY.  MiBsouri 
MARIO  BIAGGI,  New  York 
IKE  ANDREWS,  North  Carolina 
PAUL  SIMON»  Illinoia  ^ 
EDWARD  P.  BEARD,  Rhode  Island 
'GEORGE  MILLER..  California 
MICHAEL  O.  MYERS,  Pennsylvania 
AUSTIN  J.  MURPHY,  Pennsylvania 
TEP  WEISS,  New  York 
BALTASAR  CORRADA,  Puerto  Rico 
DALE  E.  kiLDEE,  Michigan 
PETER  A.  PEYSER,  New  York 
EDWARD  J.  STACK,  Honda 
PAT  WILLIAMS,  Montana  ^ 
WILLIAM  R.  RATCHFORD*  Connecticut 
RAY  KOGOVSEK,  Colorado 
DON  BAILEY,  Pennsylvania 


JOHN  M.  ASHBROOK.  Ohio 
JOHN  N.  ERLENBORN,  Illinois 
JOHN  H.  BUCHANAN,  Jr!,  Alal>ama 
^JAMES  M.  JEFFORDS,  Vermont 
WILLIAM  F.  GOODLING,  PennsylvG^ia 
MICKEY  EDWARDS,  Oklahoma  a 
E.  THOMAS  COLEMAN,  Missouri 
KEN  KRAMER,  Colorado 
ARLEN  ERDAHL,  Minnesota 
THOMAS  J.  TAUKE,  Iowa 
DANIEL  B.  CRANE,  Illinois 
JON  HINSON,  Mississippi 
THOMAS  E.  PETRI,  Wisconsin 


SUBGOMMITTICb  ON  ELEMENTARY, ^^NDARY,  AN^ 


CARL  D.  PERKINS,  Kentucky. 

WILLIAM  D.  FORD,  Michigan  /    "     WILLIAM  F. 

IKE  ANDREWS,  Nortl)  Cart>lina     '  - 
^GEORGE  MIIXER,  California 
AUSTIN  J.  MURPiyfi  Pennsylvania 
BALTASAR  CORRADA,  Puerto  iRico 
DALE  E  KILDEBi  Michigan 
PAT  WILLIAMS.  Montana 
AUGUSTUS  f /HAWKINS,  California  / 
MICHAEL  p,  MYERS,  Pennsylvania  / 
RAY  KOGOVSEK;  Colorado 


JfOHN  H.  BUCl 
ARLEN  ERa 
DANIEL  B. 
JON  HINS6] 
JOHN  M/  Ad] 


iDUCATION 


^G,  Pennsylvania 
it  Jr.,  Alabama 
linneaota 
Jiiinois 
Bippi 
JROOK^Ohio, 


CONTENTS 


ttext  of  H.R.  8564   2 

Text  of  H.R.  4949  ;  ;   8 

HearingB  held  \n  Washington,  D.C.  on: 

.   Ju5r81, 1979  :  ;   1 

August  1. 1979  ;   819 

.    September  10. 1979   891 

September  24. 1979  :   681 

October  10.  1979  :  ;..  708 

October  11. 1979  „  :  ,   821 

Statement  ofr- 

Berendzen.  .  Richard,  president,  American  University,  representing  the 

American  Council  bn  Education,  accompwied  bv  Sheldon  Steinbacn  and 

Dou^UiA  Whitney  of  the  American  CSouncil  on  Educatioi^   586 

»  .  Bond,       Lloyd,  research  associate*  learning  research  and  development 

center,  University  of  Pittsburi^   897 

Gahow,  Dr.  Clark  it,  associate  professor,  histoiy  and  assistant  provost, 

Duke  Universitv,  consortium  on  financing  higher  education   905 

C^eron,  Donala,  assistant  executive  director  for  programs.  National 

*  Education  Association  »   718 

Casteen,  Dr.  John  T.,  HI,  dean  of  undergraduate  admissions.  University  of 

Virginia  i  ,   765 

Clawson,  Dr.  D.  Kay,  dean.  College  of  Medicine,  University  of  Kentucky ...  863 
'  Cooper,  Dr.  John  A.  D.,  president,  Association  of  American  Medical 

Colleges...  ;  .*.  ,  70  ' 

DeWinter,  Urbain  J.,  director  of  admissions.  College  of  Arts,  Cornell 

.  University.,  .....w  682 

Drexeler,  Kenneth,  president,  -student  government,  North  Senior  High  > 

School,  Great  Neck,  N;Y  .  900 

Erwin,  Frank,  •member,  advisory  panel  on  declining  test  scores  represent^  ^ 

mvng  American  Society . for  PerBon|ielAd[niinistration   772 

.  Fleishman,  1^.  Edwin,  past  presidept,  division  of  industrial  and  organiza- 
tional psycholosy,  American  Psychological  AseociAtion,  president,  Ad>  . 

vanced  Researcn  Resaurces  Organisation  791  j 

Gastfriend,  David,  chairman.  Medical'  Education  Conmiittee,  Ameri«i|i  / 

Medical  Students  Association      a  868f 

Geer,  William,  Jr.,  prihcipal,  Francis  W.  Parker  School,  Chicago,  Dl  ........i.  911 

Gibboiis,  Hon.  Sam,  a JS«i>re6entative  in  Congress  from  the  State  of  Flor- 

ida.5.  f:.  ;   81 

Gould,^Clifrord,  Deputy  Dijrector,  Federal  Personnel  and  Compensation 

Division^  U.S.  General  Accounting  Offioev..    704 

Goldstine,  Sheldon  R.,  Cleveland,  Ohio  «    626 

Graham,  Jlmoes  W.,  assistant  secretary.  Council  on  Dental  Education, 

American  Dental  Association   881 

Haber,  Jon,  oonisultant  on  standardised  testing,  Ufi.  Student  Association, 

accompanied  by  Andre  Burnett,  director.  National  Third  World  Student 

CoaHtion   858 

Hall,  Dr.  Judy  E.,  preaklent«lect,  American  Association  of  State  Pbychok 

ogy  Boards   796 

Halperin,  Senator  Dontfl^,  New  York  State  Senate   829 

.  (UI)  . 


ERJC  ^ 


IV 

Statement  of— Continued  ^         .  Pw 

Haney,  Dr.  Walter,  testing  expert,  accompanied  by  Allan  Nairn  ,   67 

Hargadon»  Fred,  chcurman,  board  of  trustees,  the  College  Board   60 

Hemdon,  Terry,  executive  director.  National  Education  Association   32 

^   Howe,  Dr.  Harold,  li,  vice  president  for  education  and  public  policy,  the 

Ford  Foundation   821 

JackBon,  Dr.  George,  National  Association  of  Black  Psychologists,  accompa- 
nied by  Alvis  Adair  ,  ,   .  860 

Keller,  Dr;  Garv,  dean,  graduate  school.  Eastern  Michigan  University, 
representing  the  Hispanic  Higher  Education  Coalition  ,   828 

LaValle,  Senator  Kenneth,  New  York  State  Senate  ;   323 

Lennon,  Roger  T.  assistant  to.  the  chairman  in  measurement,  Harcourt 
Brace  Jovanovich,  Inc  t   365 

Loewen,  James  W.,  director,  reseajrch  center  for  national  policy  review. 
School  of  Law,  Catholic  University  of  America  :  ...  545* 

Newsom»  Lionel,  member,  board  of  directors,  National  Association  for 
Equal  Opportunity  in  Higher  Education,  and  president.  Central  State. 
Univer^i^  (Ohio)  c     621 

Perrbne,  Vito,  dean.  School  of  Education,  University  of  North  Dakota...   449 

Pottinger,  Paul  S.,  executive  director.  National  Center  for  the  Study  of 
Professions  ^   472 

Rever,  Philip,  director^  Washington  office,  American  College  Testing  Pro-  • 
gram,  accompanied  by  Richard  Ferguson,  vice  president  of  ACT's  re- 
search and  developnient  division  j.   419 

Rice,  Lois  D.,  vice  president.  College  Board    i   60 

Rivera,  Dr.  Alvin,  Hispanic  Higher  Education  Coalition/.;   828 

Ruud,.  Millard  H.,  executive  director.  Association  of  American  Law 
Schools  i   335 

Shanker,  Albert,  president,  American  Federation  of  Teachers,  AFL-CIQ...    855  - 

Sinf\mons,  Althea  T.  L.,  director,  Washington  Bureau  of  the  National 
Association  for  the  Advancement  of  Colored  People   555 

Smith,  I.  Leon,  director,  professional  examination  service  ..i   642 

Snyder,  Frank,  McGraw-Hill,  representing  Associat/ion  of  American  Pub- 
lishers, accompanied  by  Roy  H.  Millenson,  AAP,  AVashington  office  !..  459 

Solomon,  Robert  J.,  executive  vice  president,  acting  president,  educational 
testing  service  /   77 

Sparling,  Virginia,  president.  National  Congrea^  o^  Parents  and  Teach- 
ers  :  :  ,  •.  I   392 

Weiss,  Hon.  Ted.  a  Representative  in  G)ongress  fi;bm  the  State  of  New  York .  ^  39 
Prepared  statements,  letters,  supplemental  materials,  et  cetera— 

Berendzen,  Dr.  Richard,  university  provost  an^a  president-elect,  the  Ameri- 
can University,  on  behalf  of  the  American/ Asisociation  of  State  Colleges 
and  Universities;  American  Council  on  Education;  Association  of  Ameri- 
can Universities;  Association  of  Catholic  Colleges  and  Universities; 
Council  of  Graduate  Schools  of  the  Uni^  States;  National  Association  ^ 
for  Equal  Opportunity  in  Higher  fklycation;  National  Association  of 
Independent  Colleges  and  Universities/ and  National  Association  of  State 
Universities  and  Land-Grant  CoU^e^;  prepared  statement  of   541 

Cahow,  Dr.  Clark  R.,  associate  pro^^r,  history  and  assistant  provost, 
.Duke  University,  prepared  statement  of   908 

Cameron,  Don,  assistant  executive  director.  National  Education  Associ- 
ation, prepared  statement  with  appendix   720 

■    Casteen,  Dr.  John  T.,  Ill,,  dean  of  udaergraduate^^dmissions.  University  of 
^rginia:  /  / 

Letter  enclosing  information  ^ferred  to   819 

Prepared  statement  of ..../....,:   768 . 

Chisholm,  Hon.  Shirley,  a  Representative  in  Congress  from  the  State  of 
New  York,  prepared  statement  of   24 

Clawson,  Dr.  D.  Kay,  dean.  College  of  Medicine,  University  of  Kentucky, 
prepared  statement  of/-  -  •  866 

Cooper,  Dr.  John  A.  D.»  president.  Association  of  American  Medical  Col- 
leges: 

Appendix  I  to  statement  ......j...  73 

"Educational  Toting  Service;  Finances— Where  the  Money  Conjes 

From  and  Vfrnre  It  Goes/'  paper  entitled   237 

"ETS  1978,  Ahiiual  Report,''  pamphlet  entitled  :  .  210 


Prepared  stateiriento,  letters,  supplemental  materials,  etc.— Continued 

Cboper,  Dr.  John  A.  D.— Continued  Pa«e 
Letter  from  Chairman  Perkins,  dated  November  9,  1979,  requesting 

additional  information   193 

Letter  to  Chairman  Perkins,  dated  August  10,  1979   191 

Letter  to  Chairman  Perkins,  dated  November  14, 1979   194 

Letter  to  Chairman  Perkins,  dated  November  28,  1979,  enclosing 

information  reouested..^..  ;   204 

Letter  to  House  buEcommittee  on  Etementary,  Secondary,  and  Voca- 
tional Edud^tion,  dated  November  13, 1979   195 

"Program  Research  Progress  Report,"  August  1979   249 

Dre^eler,  Kenneth,  president,  student  government.  North  Senior^  High 
■  School  Great  Neck  N.Y'.: 

Editorial,  '*The  Medical  CoUegiw  Flunk  This  Test,"  from  Newsday, 

July  23,  1979  ,   904 

'•Truth  in  Testmg,"  article  from  the  New  York  Times,  July  24, 1979 ...  904 
.  Erwin,  Frank  W.,  The  American  Society  for  Personnel  Administration,  . 

statement  pn  behalf  of...;..    779 

GastfrieQd,  David,  chairman.  Medical  Educatim  Committee,  American 
Medical  Students  Amxriation:  X  • 

Exhibit  A,  ''Academic  and  Personal  Predictors  of  Clinical  Success  in  , 

Medical  School"  ;   873 

f    Exhibit  B,  "Predicting  Supervisor,  Peer,  and  Self  Ratings  of  Intern 

Performance"   882 

Exhibit  C,  "Economic  and  Racial  Disadvantage  as  Reflected  in  Tradi- 
tional Medical  School  Selection  Factors"   886 

,  Geer,  William,  Jr.,  i^ncipal»  Friomcis  W.  Parker  School,  Chicago,  111., 

prepared  statement  with  attachments   914 

Goldstine,  Sheldon  I^.,  Cleveland,  Ohio,  letter  to  Chairman  Perkins,  dated 

September  24,1979  :   632 

Gould,  Clifford  I.,  Deputy  Director,  Federal  Personnel  and  Comjpensation 
Division,  U.S.  General  Accounting  Office: 

Prepared  statement  of    706 

"Recommendations  to  the  Director,  OfRce  of  Personnel  Management," 
article  entitled   717 

/Haber,  Jon,  representing  the  U.S.  Student  Association,  accompanied  by 
Andre  Burnett,  director.  National  Third  World  Student  Coalition,  U.S. 

Student  Association,  prepated  statement  of     352. 

Hall,  Dr.  Judy  E.,  president-elect,  American  Association  of  State  Psychol- 
ogy Boards,  ''Examination  for  Professional  Practice  in  Psychology,"' 

article  entitled   ^   80 1 

Hemdon,  Terry,  executive  director.  National  Education  Association,  pre- 
pared statement  of  -   321 

Howe,  Dr.  Harold,  II,  vice  president  for  education  and  public  policy,  the 
Ford  Foundation: 

Prepared  statement  of  a     825 

Prepared  statement  of  Dr.  Kenneth  B.  Clark,  distinguished  professor 

emeritus,  City  College  of  the  City  University  of  New  York   822 

Keller,  Dr.  Gary,  dean,  graduate  school.  Eastern  Michigan  University, 
representing  the  Hispanic  Higher  Education  Coalition,  prepared  state- 
ment oft......  '   833 

LaValle,  S<9nator  Kenneth,  New  York  State  Senate,  prepared  statement  of .  327 
Lo^wen,  Dr.  James  W.,  director  of  research.  Center  for  National  Policy 
'  Review,  School  of  Law,  Catholic  University  of  America: 

Additiopal  statement  of,  dated  September  24,  1979  ^   552 

Prepared  statement  of,  dated  August  15,  1979     548 

Magazine  and  newspaper  articles—  '  . 

Boston  Globe:  ^  ^ 

"Open  Test  Uw  Applaluded  Here,"  dated  July  16,  1979    667 

"Testing  the  Test-Makers,"  dated  July  19,  1979   671 

Chicago  Sun-Times:  "Demystify  College  Entrance  Exams,"  dated 

July  18, 1979  :   666 

Higher  Education  Daily:  "Howard  University  Study  Cites  Limits  of 
'      Standardized  Testa,"  dated  August  29, 1979..   675 


ERLC 


/  ■  VI  .  ^  .  ■ 

Prepared  dtatemento,  letters,  supplemental  inaterialsr  etc.— Continued 

Magazine  and  newspaper  articles— Continued  Page 
New  York  Times: 

"Test<k)aching:  Is  It  Worth  It?/'  dated  September  9,  1979    680 

'Test  Publishers  See  Dropping  of  Exams/  dated  October  8, 1979..  754 

"Truth  in  Testing/'  dated  July  24. 1979   ;   672 

'"Truth-in-Testing'  Measure  Focusing  on  a  Key  Industry/'  dated 

"      July  5, 1979   669 

New  York  Times  magazine:  ''The  American  Way  of  Testing/*  dated 

September  2, 1979   -676 

The  New  Republic:  ^ 

"ETS  Has  Good  Reason  to  Fear  New  York's  New  Truth  in- 
Testing'  Law,  Evening  the  Score/'  dated  August  25, 1979   672 

Why  Your  Daughter  Didn't  Get  Into  Law  School,  ETS'r  Star 

Chamber,"  dated  February  5, 1977   668 

Wabhingtoh  Post:  "Scoring  the  Admissions  Tests/'  dated  August  27, 

1974....  r   507  . 

MiPk&r,  Hon.  George,  a  Representative  in  Congress  from  the  State  of 

California,  prepared  statement  of  *     28 

National  Consortium  on  Testing,  list  of  members,  dated  June  1, 1979 .........  4^4 

Perrone,  Vito,  center  for  teaching  and  learning.  University  of  North 
Dakota,  appendix  to  the  prepared  statement  of,  dated  October  30, 

1978  ;  ;  V  ;   455 

Pike,  Dr.  Lewis,  testimony  before  the  New  York  State  Senate  and  Assem* 

bly  Higher  Education  Committees,  May  9,  1979,  Albany,  N.Y  ..:   683 

Pottinger,  Paul  S.,  Ph.  D.,  directqr.  National  Center  for  the  Study  of 

Professions,  Washington,  D.C.,  prepared  statement  of  *  ,   477 

Rever,  Philip,  director,  Washington  office,  American  College  Testing  Pro- 
gram, statement  of  ;  ;  ,  I  ^...v*...  428 

Ruud,  Millard  H.,  executive  director.  Association  of  American  Law  Schools, 

prepared  statement  of  »  ^  337 

Shanker,  Albert,  president,  American  Federation  of  Teacherd,  AFL-CIO, 

prepared  stetement  of  ,   852 

Simmons,  Althea  T.  L.,  director,  Washington  Bureau  of  the  National 
Association  for  the  Advancement  of  Colored  People,  accompanied  by  Dr. 
Anderson  J.  Franklin,  NAACP  Advisory  Committee  On  Testing  and 
professor  of  psychology  and  director,  center  for  academic  skills.  City 
College  of  CUNY: 

"NAACP  Report  on  Minority  Testing**   682 

Prepar^  stetement  of..   560 

.  Smith,  Dr.  I.  Leon,  professional  examination  service,  testimohv  of   647 

Snyder,  Frank,  publisher,  CTB/McOraw-Hill,  Monterev,  Calif.,  testimony  ^  * 

on  behalf  of  Association  of  American, Publishers,  with  attechment   466 

Solomon,  Robert  J.,  executive  vice  president,  acting  president,,  ^ucational 
testing  service: 

Attechment  1,  agreement  dated  July  1,  1974  between  the  law  school 

admission  council  and  educational  testing  service  ,   88 

Attechment  2,  membend  of  ETS  board  of  trustees  1974-79   94 

Attachment  3,  (retained  in  subcommittee  files) 

Attachment  4,  historical  change  of  fees  versus  inflation  ^   95 

Attechment  5.  commento  on  H.R.  4949  and  H.R.  8564  h   100 

Attachment  6,  some  implications  on  test  development  cost^  and  lest 

availability  of  national  test  disclosure  »....|^  1   107 

Atteqhmeiit  7,  principles,  policies  and  procedural  guidelines  regarding 

El^  products  and  services  I.   HO 

Sparling,  Virginia,  president,  >National  Congress  of  Parents  and  Teachers. 
"The  Testii^  Maze,  An  Evaluation  of  Standardized  Testing  in  Amiarica,'^ 

paper  prepared  and  published  by  the  national  PTA  i   896 

WalUich.  Michael  A.,  article  entitled  'Tests  Tell  Us  Little  About  (Talent," 

from  American  Scientist,  January-February  ld7!5  i   950 

Weiss,  Hon.  Ted,  a  Representative  in  Congress  from  the  State  of  Nc(W  York* 
prepared  stetement  of   48 

;  APPENDIX  • 

Allen,  William  E.,  D.D.S.,  chairman,  council  on  legislatioht  Ameri^  Dental 
AMOciation,  Washington,  D.C.,  letter  to  Chairman  Perkins,  dated  Octciber  11, 

1979  .....J.,   1141 


ERIC  4  ^  ' 


Ambach,  Gordon  M.,  prei^ident,  the  University  of  the  State  of  New  York  and  , 
commissioner  of  education: 

Letter  to  Mr.  ChaiUnan,  with  eiVfiloeures,  dated  October  17,  1979    966 

Prepared  statement  of  ;  *  ^^k..  959 

American  Educational  Research  Association,  prepared  statement  of  the,  with 
attachment  '.   li>45 

American  Nurses'  Association,  prepared  statement  of  the    1Q79 

American  Society  of  Clinical  Pathologist^,  prepared  statement  of  the,  with 
attachments  '  /  1014 

Bethuiie,  Hon.  Ed,  a  Representative  in  Congress  from  the  State  of  Arkansas,- 
letter  to  Chairman  Perkins,  with  enclosures,  dated  October  31, 1979..  1176 

Cave,  Carolyn,  Ph.  D.,  RRA,  executive  director,  American  Medical  Record 
Association,  Chicago,  111.,  letter  to  Chairman  Perkins,  dated  October  30, 1979..  1 174 

Corbett,  William  D.,  Wdtham,  Mass.,  testimony  of    1182 

Down,  A.  Graham,  exedltive  director.  Council  for  Basic  Education,  Washing- 
ton, D.C.,  letter  to  Chairman  Perkins,  dated  August  29, 1979     1120 

EckehhbfT,  James  E.,  M.D:;  dean.  Northwestern  University,  Chicago,  111.,  letter 
to  membere  of  the  Education  and  Labor  Committee,  dated  August  16, 1979  1113 

Federation  of  Associations  of  Schools  of  the  Health  Professions,  statement  of 
the  :  .:   999 

Floyd,  Edwin  E.,dean,  UniversiU  of  Virginia,  Charlottesville,  letter  to  Commit- 
tee on.  Education  and  Labor,  dated  August  17, 1979   ,  *   1117 

Ford,  Hon.  William  D.,  a  Representative  in  Congress  from  the  State  of 
Michigan,  letter  to  Chairman  Perkins,  with  enclosure,  <)ated  October«-24^  . 
1979  ........  1168 

Galvin,  C.  R.,  director.  Real  Estate  Commission,  Des  Moines,  Iowa,  letter  to 
Chairman  Perkin»,  dated  September  10, 1979   1123 

Glaser,  Robert,  president.  Division  of  Evaluation  and  Measurement,  American 
Psychological  Association,  prepared  statement  of    1080 

Green,  Bert  F.,  professor  of  psychology,  the  Johns  Hopkins  University,  Haiti- 
more,  Md.,  letter  to  Congress'of  the  United  Statep,  dated  October  17, 1979  114? 

Gustafson,  Delwin  K.,  president*  National  Association  of  College  Admissions 
Counselors,  Skokie,  lU.,  letter  to  Chairman  Perkins,  dated  October  23, 1979  .  1165 

Harmon,  George  M.^  president,  •  Millsaps  College,  Jackson,  Miss.,  letter  to 
CongressmanJIinson,  dated  September  7, 1979  a   1122 

Hemdon,  Robert  M.,  M.D.,  director,  center  for  brain  research.  University  of 
RcK^hester  "Medical  Center,  9^hest|r,  N.Y.,  letter  to  Chairman  Perkins, 
dated  August  17,  19T9   1116 

Hill,  Marilyn  J.,  associate  director,  placement  coordinator,  student  futures  and  < 
placement,  Carleton  College,  ^forthfield,  Minn.,  letter  to  Congressman 
Erdahl,  dated  September  14, 1979  »   1129 

Jackson,  William  F.,  D.V.M.,  president,  American  Veterinary.  Medical  Associ-  * 
ation,  prepared  statement  of.  *   1084 

Jervey.  Dr.  Harold  E.,  Jr.,  executive  director-secretary.  Federation  of  State 
Medical  Boards  of  the  United  States,  Inc.,  prepared  Statement  of   1065 

Kemis,  Marten  M.,  Ph.  D.,  deputy  executive  dean.  University  of  lUinois  College 
of  Medicine,  Chicago,  III,  letter  to  Chairman  Perkins,  dat^  August  16, 1979...  1115 

Kerr,  Clark,  chairman,  Carnegie  Council  on  Policy  Studies  in  Higher  Educa- 
tion, Berkeley,  Calif.,  letter  to  Chairman  Perkins,  dated  Au^t  14,  1979   11Q8 

KiemarL  Dr.  Owen  B.,  executive  director,.  National  Association  of  Secondary 
School  Principals,  prepared  stateinent  of.     IO4O 

Leymaster,  Glen  R.,  M.D.,  executive  director,  AmeriGa|Board  of  Medical 
Specialtiee,  Evanstoti,  III.,  letter  to  Chairman  Verytm  with  attachment, 
dated  October  9,  19»  ;   1188 

Madigan,  Hon.  Bdwald  R.,  a  Representative  in  Congress  from  the  State  of 
Illinois,  letter  to  Chairman  Perkms,  with  enclosure,  dated  Septeipber  19, 1979  1 131 

Mahaffey,  Fred  Pharm.  D.,  executive  director.  National  Association  of 
Boards  of  Pharmacy,  Chicago,  111.,  letter  to  Chairman  Perkiift,  dated  July  20, 
1979......   1106 

Mann,  Wallace  V.,  Jr.,  D.M.D.^  dean.  School  of  Dentistry^  University  of  Missis- 
sippi Medical  Center,  Jackson,  Miss.,  letter  to  Congressman  Hinson,  dated 
September  12, 1979  ,   1125 

Maraloo,  Pamela,  public  affairs  director.  National  League  for  Nursing,  New 
York,  N.Y.,  letter  to  Chairman  Perkins  enclosing  a  statetneot,  dated  Decem- 
ber 18, 1979  ,   1188 

Marquis,  Harold  L.,  acting  dean.  Emory  University  School  ofLaw,  Atlanta,  Ga;, 
letter  to  Chairman  Perkins,  dated  November  5, 1979   1 180 


VIII 

■  V  .  Page 

Mast,  Kathleen  A.;  RDH,  preeidenL  American  Dental  HygienifiU'  Association, 
.  Washingtoii,  D.C.Uetter  to  Chaihnan  Perkins,  dated  Au^t  20,  1979   1118 

McCotnbe,  Robert  M.,  Ph.  D.,  &terim  dean.  Eastern  Virginia  Medical  School, 
Norfolk,  Va.,  letter  to  Chairman  Perjdns,  dated  August  15, 1979  a....*  1112 

National  Board  of  Medical.  Examiners*  Philadelplua,  Pa.,  prepared  state- 
ment of  ,  V  v"......  1005 

National  Council  of  Architectural  Registration  Boards,  t)repared  statement  of 
the,  with  attachment  «   ;   1095 

National  League  for  Nursing,  New  York,  N.Y.,  prepared. statement  of   1075 

Nobles,  Lewis,  president,  Mississippi  College^  Clmton,  Miss.,  letter  to  Congress- 
man Hinson,  dated  September  13, 1979    >#  -  1127 

Pelczar,  Michael  J.,  Jr.,  president,  the  Council  of  Graduate  Schopls  in  the 
United  States,  Washington,  D.C.,  letter  to  Chairman  Perkina»  With  enclo- 
sures, dated  October  19, 1979  ^  ;   1145 

Scerba,  John  It,  Ph.  D.,  North  Miami,  Fla.,  letter  to  Chairman  Perkins,  dated  i 
October  24,  1979.....  :.   1172- 

Shannon,  David  A.,  vice  president  and  provost,  University  of  Virginia,  Char- 
;   lottesville,  letter  to  Chairman  Perkins,  dated  August,  14, 1979   1110 

Sjogren,  Dr.  Cliff,  director  of  admiMions,  University  of  Michigan— rAnn  Arbor, 
prepajred  statement  of  1001 

Stockton,  Jack  J^,  IXV.M.,  president.  Association  of  American  Veterinary 
Medical  Colleges,  prepsured  statement  of   1093 

Stratman,  Dr.  E^vid  G.,  director.  Campaign  for  the  Future,  prepared  statement 
of,   :  :  ,   1092 

White,  Donald  J.,  dean,  Boston  College,  Chestnut  Hill,  Mass.,  letter  to  Chair- 
man Perkins,  dated  October  22, 197S  ,   .'  :  1164 

•  Willcox,  Alfred  B.,  executive  director,  the  Mathematical  Association  of  Amer- 
ica, prepared  statement  of......*^..  «  ^   1086 

Wright,.Grace  Hi,  Ph.  D.,  r)9eearch  psychologist,  director,  validation  program. 
New  York  State  Department  of  CivU  Service,  letter  to  Chairman  Perkins 
enclosing  several  attachments,  dated  December  20, 1979   1185 . 

Zytowski,  Donald  G.,  Ed.  D.,  counselimr  psvchologist  and  professor  of  psychol- 
ogy, Iowa  State  University,  on  benalf  of  the .  American  Personnel  and. 
Uuidance  Association^  prepared  statement  of   1054 


TRUTH  IN  TESTING  ACT  OF  1979;  THE 
EDUCATIONAL  TESTING  ACT  OF  1979 

TUESDAY,  JULY  31,1979 

'  HquM  OF  Representatives, 
SuBa)MMnTEE  ON  EiJBMENTARY,  Secondary, 

AND  Vocational  Education,* 

COMMTTTEE  ON  EDUCATION  AND  LABOR, 

Washington,  B.C. 

;  The  ^subcommittee  met,  pursilant  to  ngtice,  at  9:30  a.m.,  in  room 
2175,  Ravbum  House  Office  Bmlding,  Hon.  Carl  D.  Perkins  (chair- 
^  man  of  the  committee)  j)re8idinl.  ■  ^ 

Members  present:  Represc^nla^     Perkins,  Hawkins,  Miller, 
Weissj.  Kildee,  Williams,  Goodling,  and  Erdahl. 
St^  present:  JoHn  F.  Jennings,  counsel;  Martin  L.  LaVor,  mi- 
ority  iehipr  legislative  associate.  \ 
[The  complete  text  of  H.R.  3564  and  H.R.  4949  follows:] 

:     •  .  (1) 
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To  require  all  educational  admiBsions  testing  conducted  throfigh  interstate  com- 
merce, and  all  occupational  admissions  testing  (which  affects  commerce)  to 
be  conducted  with  sufficient  notice  of  test  subject  matter  and  test  results^  and 
9      fpr  other  purposes. 


IN  THE  HOUSE  OF  KEPRESENTATIVES 

'  April  10,  1978 

Hr.<}iBBpNB  introduced  the  following  biU;  which  was  referred  to"  the  CoHtfnittee 
on  Education  and  L^ibpr         •  ^.^/^ 

\ 


A  BILL 

To  require  all  educational  admissions  testing  conducted  through 
interstate  conunerce,  and  aU  occupational  admissions  testings 
(which  affecls  commerce)  to  be  conducted  with  sufficient 
notice  of  test  subject  matter  and  test  results,  and  for  other 
purposes. 

1  Be  \X  enacted  by  the  Senate  and  House  of  Representor 

2  tives  of  the^  United  Stmtes  of  America  in  Congress  assembled, 

3  That  this  Act  may  be  cited  as  the  "Truth  in  Testing  Act  of 

6      *  Sbc.  2,  As  used  in  this  Act— 


8 


;  .  :  /    1  .  (1)  the  term  "educational  admissions  test'*  means  . 

2  ahy  test.of  aptitude  or  knowledge  which —  ^  : 

.\         3  '   (A) 'Is  administejred  to  individuals  in  two  or 

.4/  .  more  States,  V 

5  /  (B)  affects  or  is  conduc.ted  or  distributed 

r        J8  through  anjr  medium  of  interstate  commerce,  add 

V  V  7  '       .     (0)  is  used  as  part        of  the  basis  fdr  ad- 

i  mitting  or  denying  ad^sion  tQ  an  individual^  to 

9  .  / .  •  any  institutioji  pf  higher  education; 

,10  (2)  the  teiin  '^occupational  admissions  test  means 

- ,     -  *..;  ■  .  /  *  .  •  ^  '     ♦  '  ■  ,  ' 

41  any  test,  which  is  used  as  part  or  all  of  the  basis  for 

12  .a^ttiug  or  denying  admission  to  to  individual  to  any 

13  occupation  in  or  alfi^ting  interstate  commerce; 

14  (3) ..the  teilj^fW'V  incltilles  any  ajitito^  or 

15  achi6vement>ezamination,  whether  ^  ,  ^ 

16  '  includes  any  objective  mi4tiple  choice,  machine  scored, 

17  ^  essay,  practical,  performance,  or  demonstrpttion  exami-. 

18  nation; 

■     •  ^.  ■  * 

19*  (4)  the  term  "test  score"  means  thp  numerical 

2Q  vdue.  given  to  the  teBt  subject's  performance  on  any 

21  test;;  ■ 

.  22  (5)  the  term  "person'V included  individuals,  corpiH 

^         23  rations,  companies,  associations,  Grins,  partnerships, 

24  societies,  joint  stool  companies,  and  agencies  and  in- 

>  26  strumentalities  of  States  and  local  governments;  and 
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1  (6)  th^^  term  "institution  ofJhigher  education"  has 

2  the  meaning  Bet  forth  in  sectiim  1201(a)  of  the  Higher 

3  Education  Act  of  196M20  U.S.C.  114 

4  Sec.  3.  The  Congress  hereby  finds  and  declares  that— 

5  (1)  testing'  of  scholastic  aptitudes  and  achiever 

6  ments  has  become  a  principal  factor  in  the  admission  of 

•  ■  ^  . 

7  individuals  to  public,  as  well  as  to  private^  institutions 

8  of  higher  education  and  tliat  therefore  equal  bpportunil^ 

9  ty  under  the  law  requires  that  that  testing  be  conduct- 

10  ^  ed  in  a  manner  which  will  ensure  the  equal  rights  and 

11  fair  treatment  of  such  individuals; 

12  ^  (2)  testing  of  skills  for  entry  into  an  occupation, 

13  '  whether  of  a  professional,  firaft,  or  trade*  nature,  is  a 

14  critic£|,l  fac^QL^goveming  the  free  flow  of  individual 

15  skills  in  interstate  conrnierce  and.  seriously  affects  the 
1.6  .  Nation's  capability  for  economic  growth;  and 

17  (J)  the  rights  of  individuals  and  the  national  inter- . 

18  ests  can  be  protected  without  adversely  affecting  the. 

19  proprietary  interest  of  any  entity  administering  tests  by 

20  simple  requirements  governing  proper  prior  notice  to 

21  '  individuals  of  the  subject  matter  to  be  tested  and 

22  proper  subeequent  notice  of  test  results  and  their  uses. 

23  (  Sbc.  4/ It  is  the  purpose  of  this  Act  to  prohibit  the 

24  conductinjg  of  educational  and  occupational  admissions  tests 

25  unless  such  tests  are  administered  in  a  manner  to  protect  the 


1  rights  of  the,  mdividuals  tested  and.  to  grant  a  Federal  cause  - 

2  of  action  to  any  mdividual  adversely  affected  by  thb  adiiiinis- 

3  tration  of  any  such  test  in  violation  of  this  Act.  * 

4  Sec.  5.  It  is  unlawful  for  any  person  toladmimsiter  any 

5  educational  or^cupational  admissions  test  to^any  individual 

6  unless  such  test  is  administered  in  accordancri^  with  the  tre-" 

7  quirements  of  section  6  of  this  Act.  \       V  ; 

8  Sbc.  6.  (a)  Each  applicant  to  take  any  elucatiohU  or 

9  occupational  admissions  test  shall  be  provided  with  a  written 

10  notice  which  shall  contain —  ^    '  ^ 

11  (1)  a  detailed  description  of  the  area  of  knowledge 

12  or  the  type  of  aptitude  that  the  test  attempts  to  ana- 

13  lyze; 

14  (2)  in  the  case  of  a  test  of  knowledge;  a  detailed 

15  description  of  the  subjects  to  be  tested; 

1^  (3)  the  inarpn  of  error  pr  the  extent  of  reliability. 

17  *       of  the  test,  determined  on  t^  basis  of  experimental 

18  uses  of  the  test  and,  where  available,  actual  usage; 

19  \       (4)  the^'manner  in  which  the  test  results  will  be 

20  distributed  by  the  testing  entity  to  the  applicant  and  to 

21  other  persons;  and 

22  (5)  a  statement  of  the  airplicant's  rights  under 

23  subsection^(b)  of  this  section  to  obtain  test  results  and 

24  related  facts.  ^ 

\    '  '.  15 


.1  (b)  Each  ^individual^vho  takes  any  educational  or  occu- 

2  pational  admissions  test  shall,  at  the  request  of  the  test  Bub- 

3  ject,  promptly  upon  completion  of  scoring  of  such  test,  be 

4  notified  of — 

5  (1)  the  individual's  specific  performance  in  each  of 

6  '  the  subject  or  aptitude  areas  tested; 

7  (2)  how  that  specific  performance  ranked  in  rela- 

8  tion  to  the  other  individuals  and  how  the  individual 

9  ranked  on  total  test  performance; 

10  (3)  the  score  required  to  pass  the  test  for  admis- 

11  sion  to  such  occupation  or  the  score  which  is  generally 

12  required  for  admission  tp  institutions  of  higher  educa- 

13  tion; 

14  (4)  any  further  informktion  which  may  be  obtained 

15  •  by  the  individual  on  request) 

16  (c)  No  educational  or  occupational  admissions  test  which 

17  tests  knowledge  or  achievement  jtrathcr  than  aptitude)  shall 

18  be  graded  (for  purposes  of  determining  the  score  required  to 

19  pass  the  test  for  admission)  on  the  basis  of  the  relative  distri- 

20  bution  of  scores  of  othw  test  subje(tt;iB. 

21*  Sec.  7.  (a)  Whenever  any  person  has  adrpinistered  or 

22  there  ape  reasonable  grounds  to  believe  that  any  person  is 

^22^^^^boj^  to  administer  any  educational  or  occupational  admis- 

24  sions  test  in  violation  of  this  Aot,  a  civil  action  for  preventive 

.  25  relief,  including  an  application^  for  a  permanent  or  temporary 
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1  injunction,  restraming  order,  or  other  order,  may  be  institut- 

2  ed  by  the  iifcividual  or  individuals  aggrieved*  Upon  applica- 

3  tion  by  the  complainant^nd  in  such  circumstances  as  the 
^  4  court  may  deem  just^  the  court  may  appoint  an  attorney  for 

5  such  complainant  arid  may  authorize  the  commencement  of 

6  civil  action  without  payment  of  fees,  costs,  or  security. 

7  (b)  In  any  action  cbmmei)ced  pursuant  to  this  section, 

8  the  court,  in  .its  discretion,  may  allow  the  prevailing  party, 

9  other  than  the  United  Stated,  a  reasonable  attorney's  fee  as 

10  part  of  the  costs.  .* 

11  (c)  The  district  courts  of  the  United  States  shall  have 

12  jurisdiction  of  proceedings  instituted  pursuant  to  this  Act  and 

13  shall  exercise  the  same  vidthout  regard  to  whether  the  ag- 

14  grieved  party  shall  have  exhausted  any  q^dntinistrative  or 

15  other  remedies  that  may  be  provided  by-law. 

16  Sbo.  8.  This  AcV^ll  be  effective  with  respect  to  any 
17 ,  test  administered^  on  or  after  January  1, 1979, 
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require  certain  information  be  provided  to  individuals  who  take  standardized 
educational^tdmissions  testV  and  for  other  purposes. 


IN  THE  HOUSE  OF  RE^PRESENTATIVES 
July  24,  1979 

lir.  Weibb  (for  himself,  Mrs.  CHiSHOLMt  and  l(r.  Millbb  of  California),  intro- 
duced the  following  bill;  which  was  referred  to  the  Committee  on  Edupation 
and  Labor 


A  BILL 

^0  fequire  certain  information  be  provided  to  individuals  who 

/  take  standardized  educational  admissions  tests,  and  for  other 

^  purposes. 

'  1        Be  xl  enacted  by  the  Senate  and  H<^e  of  Repreaenta- 

2  tivea  of  the  United  States  of  America  in  Congress  a>ssembled, 

3  SHORT  TITLE 

4  Section  1.  This  Act  may  he  cited  as  the  "Educational 

5  Testing  Act  of  1979".         ^    '         *  . 

6  FINDINGS  AND  PURPOSE 

7  Sec.  2.  (a)  The  Congress  of  the  United  States  finds 

8  thafc-^ 
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.    ■  ■  •    2  ■  •  ^ 

I  (1)  education  is  fundamental  to  the  development 
'  2  of  individual  citizens  and  the  progress  of  the  Kation  as  ^ 

3  a  whole; 

4  (2)  there  is  a  continuous  need  to  isnsure  equal 

5  access  for  all  Americans  to  educational  opport\jnities  of 

6  a  high  quality; 

7  (8)  standardized  tests  are  a  major  factor  in  the  ad- 

8  mission  and  placement  of  students  in  postseconda^y 

9  education  and  also  play  an  important  role  in  individ- 
10  uals' professional  lives; 

II  (4)  there  is  increasing  conqiem  among  citizens, 

12  *  educators,  and  public  offidals  regarding  the  appropriate 

13  uses  of  standardized  tests  in  the  admissions  decision  of 
^     14  postsecondary  education  institutions; 

15  (5)  the  rights  of  individuals  and  the  public  interest 

^    16  can  be  assured  witboHllftangering  the  proprietary 

17  rights  of  the  testing  agencies;  and 

18  .  (6)  standardized  tests  are  developed  and  adminis- 

19  tered  without  regard  to  State  boundaries  and  are  uti- 
20 .  lized  on  a  national  basis.  '  \. 

/  21  (b)  It  is  the  purpose  of  this  Act— 

22/^  (1)  to  ensure  that  test  subjects  and  persons  who 

23  use  test  results  afe  fully  aware  of  the  characteristics, 

24  uses,  and  limitations  of  standardized  tests  in  post- 
26  secondaiy  education  "admissions; 

5M-03I4.O  -  80  -  2  1 


1  -(2)  to  make  available  to  the  public  appropriate  in* 

2  ,  formatidn  regarding  the  procedures,  development,  and 
8.  adminilstration  of  standardized  tests; 

4  .  (3)  to  protect  the  public  interest  by  promoting 

5  more  knowledge  about  appropriate  use  of  standardized 

6  test  results  and  by  promoting  greisiter  accuracy,  valid- 

7  ^  ily,  and  reliability  in  the  development,  administration, 

8  and  interpretation  of  standardized  tests;  and 

9  (4)  to  encourage  use  of  multiple  criteria  in  the 

10  grant  or  denittl  of  any  significant  educational  benefit. 

11  INFORMATION  TO  TEST  SUBJECTS  AND  POSTSECONDABY 

12  EDUCATIONAL  INSTITUTIONS 

13  Sec.  3.  (a)  Each  test  agency  shall  pro^de  to  any  test 


14  subject  in  clear, and  easily  understandable  language,  along 

15  with  the  registration,  form  for  a  test,  the  following  infbrma- 

16  tion:  . 


17  (1)  The  purposes      which  the  test  is  constructed 

■  • .  -        .       *  ■ 

18  and  is  intended  to  be  used. 

19  (2)  The  subject  matters  included  on  such  test  and 

20  .  the  knowledge  and  skills  which  the  test  purports  to 

21  measure.  \-  " 

,22  (3)  Statements  designed  to  provide  information  for 

23  interpreting  the  test  results,  including  explanations  of 
'  *         '    \>    ■  *  . 

24  the  test^  an'S  the  correlation  between  test  scores  s^d 
0-    '        ■'    ■  ^  ■■  ■  ^ 

25  future'success  m  schaols  and,  in  the  casd  of  tests  used 
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1-  for  postb^ccalaureate  admissions,  the  standard  error  of 

2  measurenjlnt  and  the  correlation  between  test  scores 

•4  and  success  in  the  career  for  which  admission  is 

4  sought. 

5  (4)  Statements  concerning  the  effects  on  and  uses 

6  of  test  scores,  including — 

7  (A)  if  the  test  ^re  is  used  by  itself  or  with 

8  other  information  to  predict  future  grade  point 

9  average,  the  extent,  expressed  as  fijercentage,  to 

10  which  the  use  of  this  test  scoriB  improves  the  scr 

11  curacy  of  pre^cting  future  grade  point  average, 

12  over  and  above  all  other  information  used;  and 

13  (B)  a  comparison  of  the  average  score  and 

14  percentiles  of  test  subjects  by  major  income 
V*    15  groups;  and  i 

16  (C)  the  extent  to  which  test  preparation 

17  ^ourses  injprove  test  subjects'  -scores  on  average, 

18  expressed  as  a  percentage. '  ^ 

19  (5)  A  description  of  the  form  in  which  test  scores 

20  Ayill  be  reported,  whether  the  raw  test  scores  will  be 


21  altered  in  any  way  before/ being  repon^pd  to  the  test*^ 

22*^  fiubjed^  and  the  manner, /if  any,  the  test  agency  will 

23  use  the  test  score  (in  raw  or  transfomied  form)  by  itself 

24  or  together  with  any  other  information  about  the  test 
^  25.  ^  subject  to  predict  in  any  way  the  subject^  futurq  acar 

'*'•*  .      ■  ' 

ErIc  2j 


demic  performance  for  any  postsecondary  educational 


2  institution. 


8  %    (6)  A  complete  description  of  any  promises  or 

4  /  covenants  that^the  test  agency  makes  to  the  test  sub- 

5  ject  with  regard  to  accuracy  of  scoring,  timely  forward- 

6  ing  or  score  repotting,  and  privacy^f  information  (in- 

7  eluding  test  scores  and  other  informBion),  relating  to 

8  the  test  subjects. 

9  (7)  The  property  interests  of  the  test  subject  in 

10  the  test  results,  if  any,  the  duration  for  which  such  re- 

11  suits  will.be  retained  by  the  test  agency,  and  policies 

12  regarding  storage,  disposal,  and  future  use  of  test 

13  scores. 

14  ;    (8)  The  time  period  within  which  the  test  sub- 

15  jest's  test  score  cwill  be  completed  and  mailed  to  the 

16  test  subject  and,  the  time  period  A^thin  which  such 

17  scores  will  be  mailed  to  test  score  recipients  designated 

18  by  the  test  subject.  , 

19  (9)  A  description  of  special  services  to  accommo* 

20  date  handicapped  test  subjects. 

21  (fO)  Notice  of  (A)  the  information  which  is  availa- 

22  bie  to  the  test  subject  under  section.  5(a)(2),,  (B)  the' 

23  rights  of  the  test  isubject  under^^  and  (0)  the 

24  procedure  for  appeal  or  review  of  a  test  score  by  the 

25  test  agency. 
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■  6  ■ 

1  ^      (b)  Any  institution  which  is  a  test  score  recipient  shall 

2  be  provided  with  the  information  required  by  subsection  (a). 

3  The  test  agency  shall  provide  such  information  with  respect 

4  to  any  test  prior  to  or  coincident  with  the  first  reporting  of  a 

5  test  score  or  scores  for  that  test  to  a  recipient  institution. 

6  (c)  The  test  agency  shall  immediately  notify  the  test 

7  subject  and  the  institutions  designated  as  test  score  recipients 

8  by  the  test  subject  if  the  test  subject's  score  is  delayed  ten 
d  calendar  days  beyond  the  time  period  stated  under  subsection 

10  (aK8)  of  this  section. 

11  BBP0BT8  AND  STATISTICAL  DATA  AND  OTHEB 

12  mFOBMATION 

13  Sec.  4.  (a)(1)  In  (nrder  to  farther  the  purposes  of  this 

14  ijlct/tbe  followmg  information  shall  be  provided  to  the  Com- 

15  missioner  by  the  test  agency: 

16  (A)  Any  study,  evaluation,  or  statistical  report 

17  pertaining  to  a  teiit,  which  a  test  agency  prepares  or 

,18        causes  to  be  prepared,  or  for  which  it  provides  data. 
*  •  ■  .        ■         .  * 

19  Nothing  m  this  paragraph  shall  require  submission  of 

20  any  reports  or  documents  containing  information  identi- 

21  fiable  with^  any  individual  tes^  subject.  Such  informa- 

22  tion  sh^  be  deletid  or  obliterated  prior  to  submission  . 
23.       to  the  Commissioner.       .  \  '  \ 

24  <   (B)  If  one  test  agencyiievelops  or  produces  a  test 

25  ^      and  another  test  agency i^poiiisors  or  administers  the 


1  SQ^e  test,  a  copy  of  their  contract  for  services  sha^J  be 

2  subinif.ted  to  the  Coiftoiissioner. 

3  (2)  All  data,  reports,  or  other  documents  submitted 
^suant  to  this  section  will  be  considered  to  be  records  for  pur- 
D^^ed  of  section  552(a)(3)  of  title  5,  United  States  Code. 

6  (b)  Withhrone  year  of  the  effective  date  of  this  Act,  the 

7  Conimissioners  shall  report  to  Congress  coneming  the  rela- 

8  tionship  between  the  test  scores  of  test  subjects  and  income, 

9  race,  sex,  ethnic,  and  handicapped  status.  Such  report  shall 

10  include  an  evaluation  of  available  data  concerning  the  rela- 

11  tionship  between  test  scores  and  the  CQmpletipn  of  test  prepa^  \ 

12  ration  courses. 

'  13         PEOMOTING'A  BBTTEB  UNDBB8TANDINQ  OF  TESTS 

14  -  Sec.  5.  (a)  In  order  to  promote  a  better  understanding 

15  .of  standardized  tests  and  stimulate  mdependent  research  on 

16  sudti  tests,  each  test  agency— 

17  (1)  shall,  withm  thirty  days  after  the  results  of 

18  any  standardized  test  are  releaised,  file  or  cause  to  be 

*■  .  . 

19  filed  in  the  ofBce  of  the  Commissioner— 

i.  ■  .■ 

.20  (A)  a  copy  of  all  test  questions  used  in  calcu- 

21  lating  the  test  subject's  raw  score; 

22  s  (B)  the  corresponding  acceptable  answers  to 

23  those  questions;  t^A 

24  .  (C)  all  rules  for  transferring  raw  scores^into 
264            those  Scores  Reported  to  the  test  suhjecl  and  post^ 


1  /  secondary  educational  institutions  toge^er  with 

2  an  explanatioti  of  such  rules;  and 

3  (2)  shall,  after  the  test  has  been  filed  with^Ae 

4  Commissioner  dbd  upon  request  of:  the  test  subject, 
;5  send  the  test  subject—^    '    -  * 

.  Q  '    \  (A)  a  copy  of  the  test  questions  used  in  de- 

7  termining  the  subject's  raw  score; 

8  .  (B)  the  test^  subject's  individual  answer  sheet 
9*  '  together  with  a  copy  of  th6  correct  answer  sheet 

-  .  -4 

10  to  the  same  test  with  questions  counting  toward 

11  the  telBt  subject's  ra^  s6ore  so  marked;  and 

12  *  -  (C)  a  statement  of  ^he  raw  score  used  to  cal- 
'  Id  '  *         culate  the  scores  already  sent  to  the  test  subject  if 

14  '  jsuch  requeist  has,be6n  made  within  ninety  days  of 

15  the  release,  of  the  test  score  to  the  test  subject. 

16  The  test  agency  lAay  charge  a  nominal  fed  for  sending  ouf 
17|  such  inf ormatioii  requested  under  paragraph  (2)  not  to  exceed 

18  the  marginal  cost  of  providing  the  information. 

19  (b)  This  section  shall  not  apply  to  any  standardized  test 

20  for  which  it  can  J^e  anticipated,  on  the  basis  of  past  experi- 

21  ence  (as  reported  under  section  7(2)  of  this  Act),  will  be  ad- 

22  miniitered  to'  fewer  than  five  thousand  test  subjects  national- 

23  ly  over  a  testing  year* 


1  (c)  Document^ submitted  to  the  Commissioner, pursuant 

2  to  this  section  shall  be  considered  to  be  records  for  purposes 
8  ""of  section  552(a)(3)  of  title  5,  United  States  Code. 

4  PEIVAOY  OF  TEST  8C0BE8 

6        Sec.  6.  The  score  of  any  test  subject,  or  aiiy  altered  or 

6  transferred  version  of  the  score  identifiable  with  any  test  sub- 

7  ject,  shall  not  be  released  or  disclosed  by  the  test  agency  to  ^ 

8  any  person,  organization,  association,  ^orporation,  post- 

9  secondary  educational  institution,  or  governmental  agency  or 

10  subdivision  unlesr^pecifiQally  authorized  by  the  test  subject 

11  as  a 'score  recipient.  A  test  agency  may,  however,  release  all 

12  previous  scores  rec^ved  by  A  itest  subject  to  any  cyrrently 

13  designated  test  score  recipient.  This  section  shall  Hot  be  con- 

14  strued  to  prohibit  relea^j^f  scores  and  pther  information  in  a 

15  form  which  does  not  identify;  the  test  subject  for  purposes  of 

16  research  leading  to  studies  and  report3  primarily  c(mcernitig 
XI  the  tests  themselves.  ^ 

,18  TESTING  COSTS  AND  FEES  TO  STUDENTS 

19        Sec;  7.  Ia  order  to  ensure  that  tests  are  being  offered  at 

^0  a  reasonable  aost  to  iest  subjects,  each  test  agency  shall 

21  report  the  following  information  to  the  Commissioner: 

22  (1)  Before  March  31,  1981,  or  within  ninety  days 

23  after  it  first  becomes  a  test  agency,  whichever  is  later, 

24  the  test  agency  shall  report  the  closing  date  of  its  test- 

25  ing  yean  Each  test  agency  ^hall  report  any  change  in 


the  dosing  date  of  its  testing  year  within  nmety  dayd 
after  the  change  is  made.  t   ^  ^ 

(2)  For  each  test  programi  within  one  hundred 
and  tweWy  days  after  the  close  '^f  the  testing  year  the 
test  iEtgency  shall  repofjt —  ^'  ■  -  ^ 

(A)  the  totd  numbgr^of  tinies .  the  test  was 
taken  during  the  testing  year; 

(B)  the  number  of "^st  subjects  who  have 
taken  the  test  once,  who  have  taken  it  twice,\and 
who  have  taken  it  more  than  twice^  during  the 
testing  year;  .  ^  ' 

(0)  the  nuinber  of  refunds  given  to  individ- 
uals who  have  restored  for,  ^ut  did  not  take,  the 
test; 

(D)  the  number  of  test  subjects  for  whom  the 
test  fee  was  waived  or  reduced; 

(E)  the  total  amount  of  fees  received  firom  ^ 
the  test  subjects  by  the  test  c^ency  for  each  test 
program  for  that  test  year; 

(1)  the '  total  ftmount  of  revenue  received  ^ 
from  eacfii  tost  program;  and 
^^0^iQ)  the  expenses  to  the  tost  agency  pf  the,^ 
^tostSi  including — 

./  (i)  expenses  incurred  by  the  tost  agency 
ior  each  tost  progriiju;    ^  \ 
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1-1 .,  , 

J.  (ii)  expenses  incurred  for  test  develop- 

,2  ^       ment  by  •  the  test  ageftcy  for  each  test  pro- 

3  ^  gram;  and  , 

4  (iii)  all  expenses  which  are*^  fixed  or  can 

..  «  ■ 

5'  be  fQgarded  as  overhead  expenses  and  not 

6  ^  associated  with  any  {est  program  or  with 

7  test  development;  *  * 

«  8  (8)  If  a  separate  fee  is  charged  test  subjects  for 

9|  adinissions  data  assembly  services  or  score  reporting 
10    *    services,  within  one  hundred  and  twenty  days  after  the 

11.  close  of  the  testing  year,  the  test  agency  shall  report — 

12  (A)  the  number  of  individuals  registering  for 

13  each  admissions  data  assembly  service  during  the 

14  *    testing  year; 

15  .  (B)  the  number  of  mdividuals  registering  for 
16'  ^  each  score  reporting  service  during  the  testing 

17  year;  .  * 

18  (0)  the  total  amount  of  revenue  received 

19  from  the*  in^viduals  by  the.  test^ency  for  each 
1.20  admissions  data  dsffembly  service  or  jscore  report- 

21  ing  service  during  the  testing  year;  and 

*  ■  ■  - 

22  '  (D)  tj^e  expenses  to  the  test  i^eney  for  each 

23  admissions  data  assembly  servic^  or  score  report- 

24  ing  service  during  the  testing  year. 


'      12  ^  . 

I  bboulaVions  anp  enfoeoement 

2*        Seo.  8.  (a)  The  Commissioner  shall  promulgate  regula- 

8  tions  to  implemAit  the  proviswns  of  this  Act  within  one  hun- 

4  dred  and  twenty  days  after  the  effective  date  of  this  Act.  Tiie 

5  failure  of  the  Commissioner  to  promulgate  regulations  shall 

6  not  prevent  the  provisions  of  this  Act  from  taking  effect.  '  ■ 

7  (b)  Any  test  agency  that  violates  any  clause  of  any  pro- 

8  vision  of  this  Act  shall  be  liable  for  a  civil  penalty,  not  to 
9^  jixceed  $2,000  for  each  violation,  • 

10        (c)  If  any  provision  of  this  Act  shall  be  declared  uncon- 

II  stitutional,  invalid,  or  inapplicable,  the  other  provisions  shall 
13  remain  in  effect;  * 

13  DEFINITIONS 

14  Seo.  9.  For  purposes  b^this  Act — 

15  (1)  the  term  "admissions  daia  assembly  service'' 

16  *      means  any  summary  or  report  of  grades,  grade  point 

17  averages,  standardized  test  scores,  or  any  combination 

18  of  grades  and  test  scores^  of  an  applicant  used  by  any 

19  postsecondary  educational  institution  in  its  admissions 

20  ^  process; 

21  >    (2)  the  term  "Commissionei^ means  the  Commis- 

22  sioner  of  Education;  / 

23  V  (3)  the  term  "postsecondary  educational  institu- 

24  ,  tion"  means  |tny  institution  prodding  a  course  of  study 
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beyond  the  secondaiy  school  level  and  which  uses 
Standardized  tests  as  a  factor  in  its  admissions  process; 

(4)  the  term  "score  reporting  service"  means  the 
reporting  ,of  a  test  subject's  standardized  test  score  to  a 
test  score  recipient  by  a  testing  agency; 

(5)  the  term  "standardized  test"  or  "test" 
means — 

(A)  any  test  that  is  used,  or  is  required,  for 
the  process  of  selection  for  admission  to  postsee- 
ondary  educational  institutions  or  their  programs, 
or 

(B)  any  test  used  for  prelimii^|^  preparation 
for  any  test  that  is  used,  or  is  required,  for  the 
process  .of  *selectioti  for  sCdmission  to  post- 
secondary  educational  institutions  or  their  pro- 
grams, I 

which  affects  or  is  conducted  or  distributed  through 
istny  medium  of  interstate  commerce,  but  such  term 
does  not  include  any  test  designed  solely  for  nonadmis- 
sion  placement  or  credit-by-examination  or  Any  test  de- 
veloped and  administered  by  an  individual  school  or  in- 
,  stitution  for  its  own  purposes  only;  . 

(6)  the  term  M|est  agency"  means  any  person,  or- 
■  ■  t    .    ■    *^  .        ■  *  ■  . 

ganization,  association^  corporation^  parti^ershipi  or  in- 


6^ 

3d 


dividual  which  develops,  8pon8orB|,  or  administers  a 
standardizedf  test; 

(7)  the  term  "test  preparation  course**  means  any 
curriculum^  course  of  study,  plan  of  instruction,  or 
method  of  preparation  giyen  for  a  fee  which  is  specifi- 
cally designed  or  constructed  to  prepare  a  test  subject 
forVpr  to  improve  a  test  subject's  score  on,  a  standard- 
ized  test; 

(8)  the  term  "tesV  program'-  means  all  the  admin- 
istrations of  a  test  of  the  same  name  during  a  testing 
year; 

(9)  the  term  "test  score"  means  tHe  value  given 
to  the  test  subject's  performance  by  the  test  agency  on 
any  test,  whether  reported  in  numerical,  percentile,  or 
any  other  form. 

'  (10)  the  term  "test  score  recipient"  means  any 
person,  organization,  association,  corporation,  postsec- 
ondary  educational  institution,  or  government^  agency 
or  subdivision  to  which  the  test  subject  requests  or 
designates  that  a  test  agency  reports  his  or  her  score; 

(11)  .  the  term  "test  subject"  means  an  individual 
to  whom  a  test  is  administered;  and 

(12)  the  term  "testing  ydaf"  means  ^the  twelve 
^calendar  months  which  the  test  agency  considers  eitiier 
its  operational  cycle  or  its^  fiscal  ^ear. 
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♦  .  .  tf» 

1  EFFECTIVE  DATE 

2  Seo.  10.  T|u8  Act  shall  take  effect  one  hundred  and 


8  eii 


ighty  day 


after  the  date  of  its  enactment. 


Chairman  Perkins.  The  Subcommittee  on  Elementary,  Second- 
ary, and  Vocational  Education  is  conducting  hearings  today  and 
tomorrow  on  two  bills  related  to  standardized  testing. 

The  first  bill,  H.R.  8564,  the  Truth  in  Testing  Act  of  1979,  was 
introduced  by  Congressman  Sam  Gibbon^.  This  legislation  would 
c^ect  educational  and  occupational  admissions  testing  conducted 
through  interstate  commerce.  The  bill  requires  thait  x^rtain  infor*^ 
mation  about  t^t  subject  matter  and  test  results  be  made  avcdlable 
to  pexwns  tfiddne  th^  tests. 

The  second  bill,  H.R.  4949,  introduced  by  Congressmcm  Weiss,  is 
known  as  the  Educational  Testing  Act  of  1979.  Thisnbill  would 
cover  all  tests  used  for .  admission  to  postsecondaryleducational 
institutions  and  programs.  The  Weiss  bill  also  reauireslhat  certain 
information  about  the  nature  of  the  test  be  supplied  to  test  takers 
prior  to  the  examination.  Moreover,  the  legislation  mandiates  dis- 
closure of  test  qu^ions  and  correct  answers  after  an  exami  has 
been  given,  upon  request  of  the  test-taker. 

Both  of  these  bills  raise  sonde  very  important  issues  regarding 
the  rights  of  persons  who  take  standardized  tests.  We.have  invited 


sons  familiar  with  and  involved  in  standardized  testmg  to  respond 
to  these  billSi  I  am  sure  the  testimony  today  and  tomorrow  wul  be 
most  helpful  to  the  members  as  we  consider  this  legislation. 

I  am  delighted  to  welcome  one  of  our  most  prominent  Members 
of  the  House  of  Representatives^  a  former  member  of  this  commit- 
tee, and  a  great  legislator,  the  Honorable  Sam  Gibbons. 

[Statements  submitted  by  Representative  Shirley- Chisholm  and 
Representative  George  Miller  follow:] 


Prbpared  Statement  op  Hon.  Shirley  Chishqlm,  a  Representative  in  Congress 
•  From  the  State  OF  New  York 

As  one  who  has  been  Involved  in  the  education  of  children 
prior  to  -and  throughout  tny  legislative  career,  I  am  particular^ly 
pleased  to. present  my  views  on  the  I1.R.4949,  the  Educational 

Testing  Act  of  1979,  an^  to  be '^soclated  with  thl0  leglslatioii 

.  '  '  ' 

as  one  of  its  cosponsors.    The  impact  that  standardized  tests    ,  ■ 

have  on  the  educational  futures  and  careers  of  millions  of 
Americans  is  not  a  subject  of  serious  debate;  standardized  ^ 
tests  dictate  to  a  very  substantial  degree  the  life  choices  of 
vas-t  numbers  of  our  citizens.    In  many  cases,  standardized  tests 
may  be  used  as  a  gatekeeping  device  for  access  to  educational 
opportunities.    Foif  these  reasons,  the  sponsors  of  the  Educational 
Testing  Act  believe,  that  it  is  impereltive  that  we  implement 
some  uniform  standard'  of  openness 4  which  will  serve  to  enhance 
our ^understanding  of  standardized  testing  and  imbue  a  funda- 
mental element  of  fairness  in  the  testing  process.  * 

There  have  been  a  variety  of  objectives  attributed  to  the 
sponsors  and  proponents  of  H*R*4^49,  along  with  much  misinforma- 
tion regarding  the  impact  of  the  bill  on  the  standardized 
testing  process*    As  writteh,  the  bill  will  have  no  direct 

impact  on  the  content  of  standardized  tests  or  t-ho  uooe-  of  — 

such  tests  in  the  admlBsions  processes  of  educational  insti-  . 
tutions*    The  legislation  can  neither  be  construed  as  a  tool 
to  regulate  the  testing  industry  nor  as  an  inappropriate 
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Federal  foray  into  the  admisBiOM  policies  of  colleges  and 
universities.    The  legislation  i\a  disclosure  bill,  no  more, 
no  less,  and  I. believe  that  it  is. vital  to  opening  up  this 
important,  educational  issue  to  broader  research  and  public; 
debate.  .         '       '  ~ 

I  want  to  emphasize  that  I  have  no  delusions  about  what 
this  legislation  can  accomplish.    We  are  all  awar«  of  the  ^ 
problems  and  controversies  that  have  surfaced  iuafrounding  the 
Impact  of  standardized  tests  on  minority  students,  and  the 
great  potential  for  cultural,  racial  and  ge^ographical  bias 
written  into  test  questions.    However,  .!  Want  to  make  it 
clear  that  in  •no'^way  do  I  envision  this  legislatipn  to  be  a 
placebo  for  the  problems  that  confront  minorities  and  other 
groups  that  may  face  inherent  biaseS'  in  the  examination  process. 

Fpr  too  long  testing  procedures  and  uses  have  remained 
l^hrouded  in  secrecy  and  ambiguity,  an  atmosphere  that  is  not 
conducive  to  the  educational  interests  of  our  children*    We  have 
heard  substantial  testimony  from  experts  in  the  testing  field 
•that  test  questions  and  answers,  validity  studies,  cultural 
bias  analyses,,  and  other  data  vital  in  ascertaining  the 
api^ropriateness  and  Impact  of  standardized  test  on  non-white 
and  non-urban  students  have  of tdn  been  kept  from  the  scrutiny 
of  independent  researchers,  who  se^  to  look  beyond  the  body  of 
knowledge  Currently  available.    Establishing  a  nationwide  policy 
of  openness  through  Enactment  eft  truth- in-testing  legislation 
is  a  necessary  first  stejp  to  approaching  the^  vital  issues  of 
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concern  to  those  who  may  find  themselves  adversely  affected  by  ^ 

a  process  which  is  presently  void  of  accountability. 

H.r;  4949  would  enhance  the  elimination  of  biases  in 

question  selecticyi  not  by/ government  decree,  but^  by  enabling 

>      ■       .         .  .  ' 

broader  and  more  objective  research  into  the  process  of  test 

y 

preparation  and  the  criteria  used  in  question  selectioo.  .  .  . 

*  .  .  ■ 

This  kind  of  independent  evaluation  is  almost  impossible  . 

at  present,  because  of  the  secrecy  in  which  the  industry  shrouds 

its  questions  and  answers,  studies,  and  procedures.    Our  bill 

will  guarantee  access  to  essential  material  by  requiring 

the  companies  to  open  their  analyses  of  test  results  to 

public  inspection,  '  .  ^ 

The  Subcommittee  has  heard  ample 'testimony  on  the  individual 
provisions  of  this  legislation,  and  I  will  therefore  be  brief 
in  my  statement  today.     I  would  like  to  have  the  following 
article,  published  in  the  Washington  Post,  October  27,  1979, 
and  authored* by  the  three  sponsors  of  H.R.  4949,'  entered  into  . 
the  record  with  my  statement.    This  piece  goes  into  s  more 
detailed  explanation  of  our  objectives  behind  this  legislative 
initiative  and  the  importance  of  specific  provisions. 

The  hearings  that  have  begn  held  to  date  on  this  legisla- 
tion indj.cate  that^here  is  a  dire  need  for  members  of  this 
Congress  to.  become  more  educated  about  the  extent  that  testing 


affects  the  lives  of  their  constituents,  and  the  problems  of 
extensive  usage  of  standardized. tests.     I  believe  that  the 
public  (kbatei that  is  beginning  to  develop  around  this  bill 
&a  a  renlt  off  Congressional  action  and  subsequent  media  coverage 
is  a  vital  and  heailthy  debate.     I  look  foward  to  the  growth  of 
this  debate  in  both  scope  and  interest  as  the  legislative  ptogretfs 
of  this  important  issue  continues. 

#    #    I    t  # 
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Prepared  STATEME^r^  of  Hon.  Georqb  Miller,  a  Representative  in  Congress  From 

THE  StAe  Of  CaUPORNIA         '  * 

MR,  CHAIRMAN,  FELLOW  MEMBERS  OF  THE  SUBCOMMITTEE,  I  AM 
PLEASED  TO  BE  HERE  TODAY  AT  THE  OPENING  OF  WHAT  I  HOPE  WILl 
BE  AN  INFORMi^TIVE  AND  CONSTRUCTIVE  LOOK  INTO- THE  WORLD  OF 
STARDARDIZED  TESTING,    BOTH  CONGRESSMAN  GIBBONs'  BILC^  H.R.  356^, 
AND  CONGRESSMAn/eISS'  BILL.  H.R. .'^9^9rARE.  USEFUL  TOOLS  FOR 
EXPLORING  THE  ROLE  THAT  STANDARDIZED  TESTING  PLAYS  IN  OUR   '  ' 
EDUCATIONAL  FUTURE. 

IF  EDUCATION  DETERMINES  THE  I^UTURE  FOR  AMERICANS, 
EDUCATIONAL  TESTING  LARGELY  DETERMINES  THAT  EDUCATION,    FROM  ^ 
IQ  TESTS  IN  GRADE  SCHOOL,  TO  MINIMUM  COMPETENCY  AND-  SAT  TESTS 
IN  HIGH  SCHOOL^  TO  GRADUATE  SCHOOL  ADMISSIONS  TESTS  AND 
OCCUPATIONAL  TESTS,  WE  SEEM  TO  BE  TESTED  FROM  CRADLE  TO  GRAVE. 
YET  THE  AVERAGE  AMERICAN  KNOWS  LITTLE  ABOUT  THESE  TESTS,  EXCEPT 
OF  THEIR  IMPORTANCE  .IN  DETERMINING  HIS  OR  HER  FUTURE. 

MANY  PEOPL^j  BOT?l  EXPERTS  AND  LAYPERSONS,  HAVE  RAISED 
SERIOUS  QUESTIONS  ABOUT  THE  VALIDITY  AND  APPROPRIATE  USES  OF 
STANDARDIZED  TEsl^wHOWEVER,  SINCE  AVAt'LABLE  KNOWLEDGE  ABOUT 
THEIR  CONTENTS  ABUSES  IS  GENERALLY  QUITE  LIMITED,  [J  IS 
VtRY  DIFFICULT  'FOR  EITHER  A  RESEARCHER  OR  A  TEST  "CONSUMER" 
TO  MAKE  AN  INFORMED  JUDGMENT  ABOUT  THESE  TESTS'.    THIS  iV  REALLY 


what  these  bills  are  all  about!  knowledge.  we  are  neither 
^  designing  tests/  nor  regulating  their  use.  we  are  not  giving 

the  federal  government  control  over  the  content  of  standardized 
•  'tests. 

;  •     these  bills  disclose  information—the  information  that  a 
test  taker,  as  a  consumer  of  that  product,  should  have  a  right 
.to  know.  when  i  go  to  a  bank  for  a  loan,  the  bank  must  tell 

W  aLl  my  OBLIGATIONS  AND  LIABILITIES/  AS  WELL  AS  Tjfe  BANK'S 

RESPONSIBILITIES  UNDER  THAT  LOAN  AGREEMENT.    WHEN  I  GO  TO 

BUY  A  TOASTER,  I  GET- A  GUARANTEE  THAT  PROVIDES  ME  WITH  CERTAIN 

QUALITY  ASSURANCES  AND  A  GRIEVANCE  PROCEDURE  IF  I  FEEL  WRONGED. 

WHEN  I  BUY  A  BOX  0F^  CORN  ^MES,  I  GET  A  FULL  LISTING  OF  THE 

box's  CONTENTS.    GIVEN  THE  SIGNIFICANT  ROLE  THAT  EDUCATIONAL 

TESTS  OCCUPY  IN  THE  EDUCATIONAL  LIVES  J)F  AMERICANS,  WE  SHOULD 

DEMAND  NO  less  FO^^ST.  CONSUMERS. 

HiR.1919  WILL  PROVIDE  THIS  INFORMATION  TO  TEST  TAKERS 

TO  HELP  THEM  DETERMINE  THE iROLE  THAT  THESE  TESTS  WILL  FULFILL 
J* 

IN  THEIR  EDUCATIONAL  FUTURE,     IT  WILL  ALLOW  STUDENTS  TO  KNOW 
HOW  THE  TESTS  ARE  REPORTED  TO  SCHOOLS,' HOW  RELIABLE  THE  COMPANY 
CONSIDERS  THE  TESTS,  WHO  WILL  GET  TO  SEE  THE  STUDENTS'  SCORES, 
HOW  STUDENTS  ACTUALLY  PERFORMED  ON  CERTAIN  QUESTIONS,  AND  HOW 
ACCURATELY  THE  JESTS  ARE  SCORED,    THE  BILL  WILL  MAKE  MANY  OF 


THE  STUDIES  THAT  (TEST  AGENCIES  HAVE  DONE  ON  THESE  TESTS 
AVAILABLE  TO  THE  PUBLIC  FOR  THE  FIRST  TIME.     IT  WILL  STRENGTHEN 
THE  PRIVACY  RIGWS  OF  TEST  TAKERS  BY  RESTRICTING  DISSEMINATION 


IGJ^S  0^ 


OF  STUDENT  TEST  SCORES  6EY0ND  INSTITUTIONS  AND  AGENCIES  CLEARLY 
DESIGNATED  BY  THE  TESTTAKER»     IT. WILL  ALSO  DISCLOSE  THE  COSTS 
OF  THE  TESTS »     IN  ADDITION^  IT  WILL  REOUIRE  THE  U^S.  COMMISSIONER 
OF  EDUCATION.  TO  REPORT  TO  THE  CONGRESS  ON  THE  VALIDITY  AND 
REUTIONSHIP  OF  TEST  SCORES  TO  VARIOUS  ECONOMIC  AND  SOCIAL  FACTORS. 

SOME* PEOPLE  HAVE  ASKED  WHAT  THE  RELEASE  OF  ALL  THIS 
MATERIAL  WILL  ACCOMPLISH.    WILL  WE  GET  IMPROVED  TESTS  THAT^ 
ARE  MORE  ACCURATE 'AND  RELIABLE/  THAT  ARE  FAIRER  TO  CERTAIN^ 
CLASSES  OF  T€ST  TAKERS^  THAT- PARENTS ^  EDUCATORS  AND  STUDENTS. 
CAN  TRUST?    MAYB^/.  BUT  MAYBE  NOT.     THAT  IS  UP  TO  THE  TESTING 
COMPANIES  AND  THE  AMERICAN. PEOPLE^  NOT  THE  FEDERAL  GOVERNMENT^ 
TO  DECIDE.     THIS  LEGISLATION  WILL  ONLY  SUPPLY  THE  VITAL 
INFORMATION  NEEDED  TO  HAVE  AN  INTELLIGENT  DEBATE  ON  THIS 
SUBJECT,     SECRECY^ND  A  LACK  OF  INFORMATION  ONLY  PRODUCE  UN- 
INFORMED OPINIONS  AND'MISTRUST  OF  THE  TESTING  COMPANIES  AND 
THEIR  TESTS.    THE  MORE  THAT  PEOPLE  KNOW. ABOUT  TESTING^  THE 
MORE  THEY  MAY  CARE  ABOUT  THE  RESULTS;  AND  THEY  ARE' BOUND  TO 
MAKE  MORE  INTELLIGENT  DECISIONS  OR  THAT  BASIS? 

ONE  OF  THE  FAMILIAR  SAYINGS  HER^  IN  WASHINGTON  IS^ 
"information  is  POWfRt"    If.  THIS  IS  TRUE>  THEN  AMERICA'S 
TESf  TAKERS  ARE  TRULY  POWEfiLESS,    THESE  BILLS  ARE  DESIGNED  TO  . 
G€T  TO  THE  HEART  OF  THIS  PROBLEM:    TO  GIVE  THE  CONSUMERS  OF 
THESE  TESTS  THE  RIGHT  TO  BASIC  INFORMATION  SfMILAR  TO  THAT 
W^UPjPLY  TO  OTHER  PRODUCT  CONSUMERS  IN  THIS  NATION.     IT  IS  TIME 
mGl'h  TEJ5T  TAKERS  THE  INFORMATION^  AND  THE  POWER>  TO  REGAIN 
CONTROL  OF  THEIR  EDUCATIONAL  LIVES. 


STATEMENT  OF  HON.  SAM  QIBBONS,  A  REPRESENTATIVE  IN 
\     CONGRESS  TROM  THE  STATE  OF  FLORIDA 

Mr.  Gibbons.  It  is  a  pleasure  and  privilege  to  be  here  today.  I 
want  to  say  I  first  bec'kme  interested  in  this  subject  many  years 
ago.  As  a  member  of  the  State  legislature  it  was  brought  to  my  * 
attention  as  long  ago  as  1953  that  there  was  a  great  deal  of  irregu- 
larity and  discrimination  brought  about  by  the  testing  for  such 
common  occupations  as  plumbing,  electrical  work,  contractor  work, 
and  things  of  that  sort.  I  thought  perhaps  it  was  sc^mething  unique 
to  my  ^rea  of  Florida,  but  I  found  out  as  J  grew  older  and  wiser 
that,  this  ^vas  a  problem  existing  in  a  great  many  places  in  the 
United  States.  ' 

Let  me  say  there  is  a  difference  in  thet)ill  I  sponsored  and  the 
Weiss  bill.  They  are  not  inpQmpatible.  I  drafted  my  bill  and  intro- 
duced it  long  before  I  learned  of  the  efforts  that  were  successfully 
concluded  in  New  York  for  which  I  understand  the  Weisa  bill  is 
patterned.  If  th?  committee  so  wishes  these  two  bills  could  be 
consolidated  and  enacted  together  or  parts  could  be  selected  and^ 
enacted  as  a  bill  that  tbe  committee  writes.  ♦ 

First,  let  me  talk  about  the  need  for  this,  Mr.  Chairman.  Thqre 
are  times  in  history  when  an  idea's  tihie  has  arrived,  and  certainly 
this  is  one  of  these.  It  is  perhaps  ironic  that  Hu^h  Carey  arid  I  sat 
next  to  each  other  on  this  committee  fof  6  years  and  worked  in  this 
Cpngress  for  Some  15  yeafs.and  that  both  of  us  have  come  toVthe 
same  cohclusiontabout  the  matter  of  testing,  that  . people  who  take 
tests  are  entitled  to  certain  yights,  an  opportunity  to  know  what  is 
in  the  test  and  an  opportunity  to  make  sure  they  have  proper 
rights  of  appeal  *after  the  test  has  been  given. 

Every  year  millions  of  American^  are'required  to  take  tests  that' 
have  significant  influences  on  theiv  educational  and  career  oppor- 
tunities—and  this,  Mr.  Chairman,  is  where  my  bill  differs  with  the 
Weiss  bill  These  tests  have  a  substantial  impact  .on  the  choice  of 
education  and  emplpyment.  But  those  taking  the  tests  have  little 
infortni^Lion  about  the  tests.  The  testing  industry  is  unquestioned 
and'iinaccoun table  to  iJons^mers^ 

Individuals  deserve  to  know  how  they  are  being  ratecjf  and 
judged.  It  is  time  that  the  Freedom  of  Information  laws,  truth-in- 
lending  laws,  and  truth-in-packaging  laws  be  applied  to  the  field  of 
education  and  profession  attesting  and  licensing.  Testing^  companies 
■and  professional  licensing  boards  should  be  subject  to  greater  pub- 
lic scrutiny.  There  is  a  need  to  provide  individuals  with  minimum 
safeguards  requiring  minimum  standards  of  due  process.  Actually 
that  is  what  this  bill  is  about,  it  Is  about  due  prpcess. 

Professional  licensing  tests  have  a  substantial  impact  on  the  free 
flow  of  professional  skills,  Such 'tests  almost  exclusively  determine 
entrance  to  over  60  occupations,  including  firefighters,  policemen,- 
real  estate  brokers,  electricians,  accountants,,  morticiai^s,  contrac- 
tor^, plumbers,  and  many  more.  Test  results  determine  access  to 
some  of  the  most  revered  professions:  Doctors,  lawyers,  foreign 
service  officers,  CIA  and  FBI  ag^ts.  The  T^;uth  in  Testing  Act  will 
not  eliminate  tests  or  lower  tha  quality  of^rofessional  services,  btit 
will  add  a  learning  element  to  the  testing  process  and  add  fin 
element  of  sunshine  to  professional  licensing  examinations.  Wnen  I 
tialk  aljwtt  sunshine,  I  really  ai^^lking  about  due  process  to  those 
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individuals  involvecj.  The  bill  will  improve  the  quality  of  testing  l>y 
making  such  examinations  subject  to  scrutiny  by  experts  and  the 
public.  It  .is  imperative  that  we  encourage  and  maintain  the  high- 
est standards  of  quality  in  the  delivery  of  professional  services 
while  mihiniizing  undue  restrictions  based  on  secret,  exclusionary 
testing  pi'actices. 

The  Truth  in  Testing  Act  basically  requires  that  any  test  which 
is  administered  as  a/r^uiremeht  for  admission  into  any  institution 
of  higher  education  or  any  licensed  profession  provide  detailed 
notice  of  the  test  smbject  matter  and  full  disclosure  of  the  examina- 
tion^results.  / 

The  bill  has  three  primary  objectives.  First,  it  is  an  attempt  to 
define  and  strengthen  consumer  rights.  The  bill  requires  examiners 
to  delineate  (1)*  what  the  examination  is  measuring,  (2)  a  detailed 
breakdown  of  the  subjects  to  be  examined,  (3)  the  margin  of  error 
in  the  test  scoring,  and  (4)  the  manner  in  which  t6st  scores  will  be 
distributed  tp.  third  parties.  May  I  say  parenthetically,  here,  Mr. 
Chairman,  that  many  of  the  agencies  already  do  this  and  have' 
pretty  detailed  breakdowns  of  that. 

The  second  purpose  is  to  add  a  learning  element  to  the  testing 
process  and  to  insure  that  the  goal  of  the  examination  is  education- 
al competence  and  not  discrimination  or  a  subterfuge  for  exclusiv- 
ity. This  is  accomplished  by  requiring  testing  boards  and  companies 
to  ^disclose  to  applicants  their  speciflc  performance  in  each^  subject 
area.  Where  the  test  is  used  for  SidmiBSion  to  a  licensed  occupation 
or  profession,  the  applicant  would  be  entitled  to  know  what  scores 
are  needed  to  pass  the  examination.  This  disclosure  would  help  the 
applicant  assess  his  performance  and  identify  subject  areas  needing 
improvement.  » 

Third,  the  bill  makes  it  unlawful  tb  administer  an  educational  or 
occupational  admission  test  which  measures  knowledge  or  educa- 
tional competence  to  be  graded  on  the  basis  of  a  relative  distribu- 
tion of  scores.  In  other  words,  let  me  illustrate.  Suppose  an  .exami- 
nation given  for  adniission  to  a  certain  profession.  Take  architec- 
ture as  an  example.  Suppose  before  the  test  is  given  or  after  the 
test  is  given,  they  decide,  well,  we  only  need  90  architects,  and  100 
took  it,  no  matter  how  good  they  are  we  are  only  going  to  take  90. 1 
do  not  say  that  is  actually  done  in  the  Vchitec^ure  field,  but  it 
seems  to  be  done  in  other  fields. 

So,  this  would  say  that  the  test  that  you  took,  there  should  be  a 
reasonable  level  of  competence  that  you  should  be  required  to 
have.  In  other  words,  your  paper  should  not  be  graded  up0n  a 
curve  and  just  some  of  you  thrown  away.  This  is  one  of  the  most 
controversial  provisions  of  the  bill.  It  prohibits  after-the-fact  or 
after-the-examinrftion  curving  of  test  scores  to  limit  the  number  of 
admissions  based  on  a  relative  distributiqn  of  scores.  In  other 
words,  they  test  you  on  what  you  know  rather  than  how  the  groUp 
performs.  Obviously  it  is  a  mistake  to  test  on  just  what  the  group 
knowi^.  You  may  have  a  sorry  ^roup  and  many  may  need  to  be 
denied^admission.  But  the  test  given  should  set  a  minimum  stand- 
ard of  what  is  reasonable  proficiency  for  somebody  to  take,  and  not 
just  ^aded  on  the  curve  and  mme  passed  and  some  thrown  away 
on  some  predetermined  notion  of  how  many  they  want  to  admit  to 
that  occupation  or  profession. 


The  enforcement  provisions  of  the  bill  require  no  apppropriation 
and  no  further  authorization  of  an  additional  bureaucratic  agency 
to  insure  th0  implementation  of  this  act.  The  Truth  in  Testing  Act 
merely  provide  a  test  applicant  with  access  to  t^e  Federal  court 
system  to  petition  for  declaratory  and  injunctive  relief  to  insure 
compliance  with  the  provisions  of  the  act 

Tests  and  other  screening  requirements  are  absolutely  necessary 
to  distinguish  the  cd>ilities  of  individuals  and  to  insure  high  levels 
of  competency.  However,  the  convenience  of  numerical  labels  mii^t 
be  balanced  against  the  necessity  to  insure  that  examinations  are 
used  for  determining  a  level  of  educational  and  professional  compe- 
tency. Certaiiily^  no  one  would  buy  a  car  or  a  house  without  ade- 
quate information;  but  thousands  of  students  and  others  must  take 
tests  each  y6ar  that  influence  their  entire  future  although  they  are 
denied  any  informatioi)  at)out  the  test  itself  A  poor  performance 
on  a  standardized  test  is  lijce  having  an  expensive  car  without 
gad— -you  cannot  go  aAywhere.  and  in  many  instances  you  do  not 
know  where  to  frn^  the  next  gas  station.   ,  . 

It  is  ironic  thai  a  country  which  stresses  pei|formance  and 
achievement  opts  for  convenient  numerical  test  scores  instead  of 
factors  such  as  judgment,  int^rity,  determination,  experience,  ide-  . 
alism,  and  creativity,  which  are  important  factors  in  measuring 
competent^  and  predictability. 

We  )^robably  cannot  reverse  the  heavy  reliance  on  standardized 
testing  but.  we  can  mandate  that  uniform  notice  and  disclosure 
reqiiiretnents  exist  to  add  a  learning  element  to  the  testing  process 
and  insure  due  process  to  all  individiials  who  are  required  to  take  a 
test  for  admission  to  a  college  or  an  occupation. 

I  urge  the  passage  of  this  bill  and  welcome  suggestions  on  how 
the  biU  can  be  improved  to  achieve  its  goal. 

Thank  you. 

Mr.  Chairman,  I  hope  you  will  seriously  consider  this  bill  and 
take  it  up  and  pais  it.       -  o  ;> 

The  other  day,  some  Member  of  Corigresr  sent  me  an  item  from 
the  Detroit  News;-  it  was  a  sto^y  about  the  admission  of  the  bar 
examination  test  in  Michigan  just  this  summer. 

Apparentlv,  someone  "in  Michigan  decided  that  a  lot  of  the  stu- 
dents should  bust 'the  exam,  far  fiigher  than  ever  before.  Some  of 
the  students  were  presumptive  enough  to  protest  that  they  were 
unnecessarily  discriminated  against,  ,  ■  . 

The  people  who  administered  the  test  in  Michigan  just  regraded  ^ 
the  papers  of  those  who  complained,  although  there  wa£f  no  miblic/ 
notice  that  you  had  the  privilege  of  complaining,  and  they  ^(aiSsed 
about  half  of  those  who  complained.  They  found  in  the  process  that 
even  the  titers  had  given  incorrect  aiiswers  to  the  ' questions. 
^  iTiat  is  one  of  many,  many  examples  that  takes  place  year  in 
and  year  out  around  this  country  having  to  do  with  standardized 
t^3ta.  It  is  time  we  take  an  active  intejrest  in  this. 

:  CSiairman  FtoKiNS.  Thank  you  for  your  presentation. 

I  see  quite  a  bit  of  difference  between  your  bip  and  the  Weiss 
bill.  I  peirsonally  feel  your  bill  wmild  not  be  as  objectionable  as  the 
Weiss  proposal  I  may  be  wrong.  But  the  thing  that  has  stood  in  the 
way  of  enacting  several  pieces  of  lejpslation  for  ytars  and  veaili 
/gone  by,  is  the  old  issue,  State's  rights.  Of  course  in  th€^  past 
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regulation  of  testing  has  always  been  left  up  to  the  States.  But  I 
am  wondering  whether  you  feel  the  time  has  now  Come  that  we 
sshduld  ignore  that  old  argument.  Do  you  feel  we  can  get  by  that 
aiigument  by  preempting  this  area,  as  you  have  suggested?  I  would 
like  to  hear  your  comments  along  that  particular  line.  That  is  the 
only  objection  I  can  see. 

Mr.  Gibbons.  Mr.  Chairman,  I  am  not  urging  that  the  Congress 
or  the  Federal  Goverrtnaent  take  over  licensing  or  admission  stand- 
ards. What  I  am  urging  is  that  the  Federal  Government  exercise 
its  responsibility  to  make  sure  that  there  is  the  simple  element  of 
due  process,  which  we  guarantee  to  all  people,  the  right  to  know 
what  you  are  being  tested  for,  and  the  right  to  knpw  that  your  test 
paper  has  been  properly  scored,  and  to  know  hoty  you  dia  on  that 
test.  ■  '  '  . 

I  do  not  go  as  far  as  Mr.  Weiss  and  as  far  as  the  State  of New 
•York  went  when  tliey  decided  you  not  only  hadi  to  give  general 
information  as  to  how  you  did  on  that  test,  but  to  say  as  they  have 
said  in  New  York^  that  you  must  give  the  questions  and  the  an- 
swers. They  go  t|iat  fai*.  Perhaps  the  committee  will  not  want  to  go 
that  far.  My  bill  does  not  go  that  far. 

So,  I  do  not  try  to  take  over  the  licensing  of  professions  or  the 
admission  of  students,  but  I  do  think  that  the  Federal  Government 
ought  to  set  standards  and  give  a  remedy  for  people  who  have 
taken  tests  so  they  wilPknow  that  the  test  accurately  reflects— or 
they  are  told  what  the  test  is  supposed  to  cover,  and  once  the  test 
has  beeq  given,  to  make  sure  in  the  subject  matter  areas  they 
know  how  they  did  in  those  subject  matter  areas.  * 

I  do  not  want  to  speak  against  the  W<eiss  bill,  because  he  had  not 
had  an  opportunity  to  be  heard,  but  I  do  realize  the  State  of  Ntew 
York  and  our  former  colleague  Hugh  Carey,  who  sat  on  thi§  com- 
mittee for  several  years  and  was  a  very  intelligent  legislator, 
thought  it  necessary  to  go  as  far  as  the  State  of  New  York  went. 

Governor  Carey  signed  that  bill  and  stated  his  reasons  for  sign- 
ing it.  I  have  great  respect  for  Hugh  Carey,  Congressmatn  Weiss, 
and^others.  My  bill  does  not.go  that  far. 

A|  I  say,  when  I  drafted  pny  bill  I  did  not  even  know  the  action 
in  New  York  was  pending  at  that  time.  # 
Chairman  Perkins.  Mr.  Miller.  ^ 
Mr.  Miller.  Thank  you,  Mr.  Chairman. 

Mr.  Gibbons,  I  want  to  thank  you  fdr  introduction  of  your  legisla- 
tion and  also  for  your  testimony  this  niorning. 

At  'the  bottom  pf  page  2f  you  say:  *  *  the  bill  makes  it 
unlawful  to  administer  an  educational  or  occupational  admission 
test  which  measures  knowledge  or  educational  competence  to  be 
graded  oh  tlie  basis  of  a  relative  distribution  of  scores. 

Will  you  ^explai^  to  the  committee  how  that  would  be  carried 
out? 

Mr.  Gibbons.  It  just  says  you  cannot  use  the  old  bell  curve  to 
determine  how  many  passed  and  how  many  failed.  You  have  to 
decide  how  much  competency  you  are  measuring  and  what  is  the 
minimum  competency  that  a  person  must  have  in  order  to  be 
v^dmitted.  When  you  grade  them  all  on  the  so-called  curve,  you  in 
effect  are  saying,  well,  if  we  haye  a  bad  lot  we  will  take  people  who 
are  less  qualified  than  if  we  have  a  goo(J  lot  from  which  we  are 


(fleeting.  That  does  not  seem  to  measure  competency.  It  seejj^s  to 
be  a  way  of  preventing  people  from  admission  even  though  xhey 
may  be  competent,  and  taking  incompetents  in  even  ,  though  they 
may  be  incompetent.  ^ 

;  In  other  words  the  test  givers  should  know-^or  someone  should 
set  in  adilince  what  is  the  minimum  amount  of  competency  on  thi^ 
test  that  we  are  attempting  to  measure,  then  those  who  attain  this, 
pass;  those  who  do  not,  do  not  pass.  Those  who  do  not  pass  have  a 
right  to  know  in  which  subject  matter  they  did  well  in  and  which 
they  did  not  do  well  in.  .  . 

Mr.  Miller.  In  the  determination  of  that  level  of  competency 
which  is  the  threshold,  I  assume  there  will  be  some  disclosure  as^to 
how  that  was  arrived  at  so  you  do  not  end  up  with  an  arbitrary  ; 
competency  level.  *  ^ 

Wr.  GraBONS.  If  we  are  going  to  put  so  much  relicuice  on  tests, 
the  test  givers,  the  people  who  do  this  as  a  profession,  should  have 
some  idea  as  to  how  much  competency  they  are  measuring.  * 

Essentially  how  as  I  see  it,  Mr^.  Miller,  they  are  not  measuring 
competency,  they  are  measuring  Competency  aniong  a  particular 
group.  If  you  give  a  test  to  100  people  and  you  say  we  are  only 
takiqg  in  DOj,  sayj^  for  admission  to  practice  architecture,  or  be  a 
chiropractor,  or  to  be  a  medical  doctor,  if  you  say  we  are  only  going 
to  pass  90  of  them,  no  matter  how  bad  they  are— it  just  does,  not 
make  sense. 

People  who  give  tests  ought  to  know  what  they  are  testing  for, 
and  they  ought  to  be  willing  to  say  in  their  test,  this  is  a  passing 
score,  not  just,  grade  it  on  the  curve  and  either  accept  or  reject 
those  who  dp  not  happen  to  fit  the  curve,  no  matter  what  they  may 
know« 

Mr.  MiLLKR.  Thank  you. 
CSiairman  Perkins.  }/lr.  Goodling. 

Mr.  Goodling.  I,  too,  would  say  to  my  distinguished  colleague,  I 
certainly  would  not  wed  thes^  two  pieces  of  legislation.  I  do  not 
have  nearly  the  problems  with'  your  legislation  as  I  do  with  Mr. 
Weiss'  legislation.  I  would  suggest  we  tread  lightly  and  see  what 
happens  in  New  York, 

You  Starr  pushing  these  ideas,  and  soon  you  Come  to  some  na- 
tional competency  exapi  for  promotion.  That  would  be  the  most 
destructive  thing  that  cou|d  happen.  If  you  get  into  a  national 
testing  program  you  have  to  get  into  &  national  curriculum  pro- 
gram in  order  to  nt  the  testing  program. 

Mr.  OiB^NS.  I  recognize  that,  but  that  is  one  of  the  things  my 
bill  tries  to  get  around.  Mine  is  a  due  process  bill. 

Mr.  GoopLiNCl.  I  suggest  you  do  not  yield  to  wedding. 

Any  testing  program  is  questionaole.  Take  an  essay  test,  for 
example.  I^uld  always  take  one  test  and  give^t  to  six  English 
teachers  and  come  up  with  six  different  ^ades. 

In  section  6(c)  it  says:  "No  test  shall  be  graded  on  the  ba$is  of  the 
relative  distribution  of  scores  of  other  test  subjects." 

I  am  nbt  quite  sure  what  that  means. 

Mr.  Gibbons.  No  occupational  or  admission  test  which  tests 
knowledge  or  achievement,  rather  than  lust  an  aptitude  test,  sh^U 
be  Ktawd  on  the  basis  of  relative  distribution  of  other  tests— -that 


is  a  way  of  describing  in  legalese>  you  cannot,  grade  them  on  the 
curve  for  knowledge  of  a  subject. 

In  other  words,  the  person  who  prepares  the  test  ought  to  know 
the  subject  matter  well  enough  to  designate  what  is  the  level  of 
competency  we  are  attempting  to  measure. 

They  ought  to  know  what  they  ale  testing  for,  and  they  ought  to 
know  what  the  minimum  requirements  are,  and  they  ought  to  let 
the  people  know  what  those' minimum  requirements  are^  and  not 
just  ta^e  the  good  lots  and  the  bad  lots  and  accept  people  who  are 
incompetent  It.  is  an  attempt  td  gef  around  the  grading  on  the 
Curve  which  is  a  lazy  man's  way  of  saying  well,  I  will  take  some 
out  of  this  lot^  and  the  rest  will  be  thrown  away. 

That  also  can  be  used,  and  can  be  used  very  effectively,  to 
exclude  and  can  restrict  entry  into  prof essions> 

Mr.  GooDUNG.  Let  me  specifically  aak  you  if  it  means  this:  the 
current  scpring  system  for  all  national  tests  takes  the  individual 
.sqore  and  presents  it  as  a  number  on  the  scale  established  by 
referehce  to  an  original  population  which  took  the  test,  and  then  a 
'y  percentile  rank.  Are  you  saying  this  should  not  be? 

Mr.  Gibbons.  That  should  not  be  the  determination  for  pass-fail. 
Certainly  people  should  know  how  they  ranked,  or  it  is  a  good  idea 
to  know  how  you  ranked,  but  it  should  hot  be  the  pass^fail  mark. 

Mr.  GooDLiNG.  What  would  be  the  standard? 

Mr.  GmBONS.  The  standard  for  passing  or  failing  a  test  would  be 
determined  by  the  test  giver  or  the  agency  using  the  test. 

Let  us  say  Educational  Testing  Service  has  ^developed  a  test,  I 
just  use  them  as  an  illustration,  for  a  specific  subject  matter;  and 
an  agency  in  my  area  decides  they  ere  going  to  use  it,  After  some 
consultation  with  Educational  Testing  Service,  they  can  determine 
what  is  the  minimum  score.  How  many  out  of  100  will  we  require  a 
person  to  pass,  but  how  matiy  out  of  say  100  on  a  numerical  scale 
is  competency  within  that  subject  matter.  If  50  percent  or  60  or  70 
percent  of  them  do  not  measure  up  to  that  competency,  they 
should  not  be  passed,  but  if  all  who  take  the  test  measure  up  to 
that  competency,  they  ^ould  be  passed. 

Mr.  GooDUNG.  Then  how  do  you  determine  which  ones  you  hire 
or  which  ones  you  take  into  a  class  with  limited  space? 

Mr.  Gibbons.  You  would  have  to  make  some  kind  of  other  deter- 
mination. 

Mr.  GooDLiNG.  Of  course  that  becomes'  veity  arbitrary,  then, 
when  you  do  that. 

Mi*.  Gibbons.  Well,  yes.  Everything  we  do  has  some  degree  of 
arbitrariness  to  it.  My  bill  just  says,  say  for  admission  to  a  profes- 
sion, in  a  pass-fail  situation— grade  it  on  what  the  person  knows, 
do  not  grade  th^t  person  against  the  other  people  who  may  be  in 
the  group.  If  you  griade  against  the  other  people  who  may  be  in  the 
group,  that  becomes  an  easy  way  to  limit  the  number  of  people 
who  can  practice  plumbing,  do  electrical  work,  practipe  law,  or 
practice  medicine,  or  do  any  of  those  things.  That  is  an  important 
part  of  my  bill.  I  ^lieve  that  people  should  be  able  to  be  admitted 
to  get  Out  diia  compete  in  the  market  based  upon  their  individual 
knowledge^  not  j^ome  arbitrary  curve  that  denys  them  the  opportu- 
^  ttity  to  get  out  ^i^d  compete.  ,  - 

•'  .•  •         V   \  ■      ■  • •..  ■  ■  '.• 


37  . 

Mr,  GOODUNG.  The  reason  I  am  pressing  these  issues  is  because  I 
cannot  imagine  the  kind  of  regulations  we  will  get  when  this  kind  \ 
of  legislation  gets  dowiitown. 

<»Mr.  Gibbons.  Well/ you  bring  up  a  good  point.  And  I  think  we 
should  be  careful  inj  our  committee  report  or  in  the  language  of 
this  report  to  detail  exactly  what  is  meant, 

I  want  to  grade  people  on  what  they  know  and  admit  them  to 
these  occupations  bctsed  upon  wllpt  they  know,  not  based  upon 
some  arbitrary  detfermination  as  tdJ^w  many  are  going  to.  pass  or 
how  many  are  goizig  to  fail,  regardlHiof  what  they  know, 

I^.  jOdoDUNG,  you  also  then  saying  you  would  strike  down 
any  of  these  specml  considerations  that  are  given  in  order  to  bring 
about  a  certain  amoimt  of  balance  &nd  so  on? 

Mr.  Gibbons,  You  are  talking  about  affirmative  action  programs 
and  things  of  that  sort? 
Mr.  GooDUNGi  Yes, 

Mr,  GiBBONsJMr.  Goodling,  this  does  not  go  into  that  subject 
matter,  althpum  I  feidize  that'  is  a  part  of  the  whole  process.  Test 
them  on  what  mevjknow,  ,  \ 

*  Mr.  GooDUNG-  Cme  other  question.  In  your  statement  you  said  ^ 
the  Truth  in  Ijesting  Act  basically  requires  any  test  admmistered 
as  a  requirement  for  admission  into  an  mstitution  of  higher  educa- 
tion or  any  lie  msed  profession  provide  detailed  notice  on  the  test 
subject  matter-  -I  do  not  have  any  problems  with  thaf, 

Mr.  GmBONE,  That  is  no  problem.  If  you  look  at  the  materiel 
Educational  Testing  Service  has  furnished  to  the  committee  mem- 
bers, they  genbrally  do  that.  It  is  the  nesft  part  they  do  not  do. 
They  do^ot  te^  you  after  you  take  the  testiiow  you  did, 

Mr.  GooDUNlG.  What  do  .  you  mean  by  full  disclosure  of  examina- 
tion results?  Mjust  they  hand  back  the  tesCs? 

Mr,  GmBONsj  No,  Th6y  would  say  in  our  brochure  describing  our 
tests  we  said  we  were  going  to  t^t  you  in  these  different  areas. 
Then  they  would  tell  you  how  you  did  in  those  areas.  Suppose  it 
was  a  case  of-^wipU,  I  am  most  familiar  with  law,  so  let  me  use  a 
legal  illustration— suppose  you  were  taking  aXlaw  exam,  you  did 
real  well  on  the  contracts  part,  and  you  did  pretty  well  on  the  civil 
procedure  pwt,  but  whpn  you  got  over  to  criminal  law  you  did  not 
d(J  worth  a  dam.  i  ^ 

Well,  you  ought  to  know  where  you  did  well  and  where  you  did 
not  do  well.  This  would  be  no  particular  problem  to  them,  especial- 
ly on  machine-graded  tests,  because  they  accumulate  that  infortna- 
tion  anyway,  I  believe-  Their  description  of  their  test  prethr  well 
describes  what  they  are  giving.  Maybe  Educational  Testing  Service 
would  d|  that.  \ 

I  watched  the  ''Today  Show  the''  other  day,  and  a  repr^^Bentative  . 
from  Educational  Testing  Service  was  (»r  there  with  the  National  i 
Education  Association.  Jane  Pauley  was  interviewing  them'  and 
thought  she  was  going  to  have  a  scrap  between  them,  mougl]^ 
Educational  Testing  Service  and  NEA  would  be  against  what  was 
jgoing  on  in  New  York.  To  her  surprise  iand  my  surprise^  they 
agreed  the  New  York  situation  was  nnp.  Well,  she  almost  had  no 
interview  there. 

Bul|Bducatipnal  Testing  Service  does  give  the  test-taker  a  pretty 
goodPpportunity  to  knbw  what  that  test-taker  is*  being  examined 
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for.  But  the  people  who  get  the  results  of  the  "examination  never 
discloseito  my  knowledge,  how  the  test-taker  did  in  those  examina- 
tions. 

Mr.  GoODLiNG.  I  do  not  think  Jane  Pauley,  NEA,  or  Educational 
Testing  Service  knows  what  they  have  done  in  NeAr  York.  With  the 
Weiss  bill,  we  darn  sure  better  wait  to  see  what  they  have  done  in 
New  York,   

Mr.  Gibbons.  As  I  say,  I  drafted  my  bill  before  I  heard  of  the 
weiss  bill.  They  are  not  incompatible.  What  I  was  saying  to  the 
committee  in  the  beginning,  if  you  decide  to  take  mine,  you  may 
want  to  incorporate  some  of  the  provisions  of  Weiss.  If  you  take 
Weiss  you  may  want  to  take  some  of  my  provisions. 

Mr.  GooDLiNG.  Let  me  say  in  closing  that  whatever  we  do,  I  want 
to  first  of  all  understand  what  the  real  purpose  of  the  legislation  is; 
not  necessarily  what  your  real  pi^rpose  is  but  the  real  purpose  of 
any  movements  of  this  nature.  I  can  see  an  awful  lot  of  detrimen- 
tal effects  coming  if  we  are  not  careful  in  what  we  pass  and  how 
we  word  it.  It  cannot  be  a  pressure,  for  instance,  for  Hispanics  and 
blacks,  because  we  know  the  percentage  of  ^ispahics  and  blacks 
entering  college  is  increasing.  I  have  to  know  whether  or  not  this  is 
a  drive  toward  a  national  competency  exam!  / 

Mr.  Gibbons.  No,  sir.  FranMy,  this  came  out  of  my  head,  without 
me  even  .knowing  there  was  any  kind  of  national  constituency  for 
it.  I  thinly  the  abuses  that  have  taken  place  in  testing  have  just 
come  together  and  finally  made  a  national  constit^^lwa^^,j^-1•.. 

J  think  it  incumbent  upon  this  committee  to  try  ofelvork  out  a 
sound  solution  to  a  problem  which  obviously  exists^  Mme  is  essen- 
tially a  dutf  process,  the  same  kind  of  due  process  you  would  give  to 
anybody  in  either  a  civil  or  criminal  matter  as  far  as  opportunity 
to  know  an^  to  examine  and  not  have  either  secrecy  used  against 
you  or  exclusiveness  used  against  you. 

Mr.  GoODWNG.  The  problefti  with  testing  is,  there  is  too  much  of 
it.  I  think  it  is  destructive,  especially  when  I  see  what  is  done  to 
first  and  second  graders.  *  • 

Chairman  Perkins.  Tell  me  if  I  am  correq^,  hut  as  I  look  over 
your  bill,  it  appears  to  me  it  w^uld  cover  certification  of  contrac- 
tors, and  also  real  estate  agents,  i.  * 

Is  it  your  view  that  we  ought  to  stick  closely  to  educational 
testing  and  only  in  thrf^ educational  area? 

Mr.  Gibbons.  No,  sir.  Mine^includes  both  educational  testing  and 
occupational-admission  testing.  Some  can  perhaps  make  an  argu- 
ment that  this  bill  should  have  gone  to  Interstate  ^nd  Foreigijj 
COpimerce  or  some  other  committee  in  Congress,  but  it  was  seifUtp 
your  committee  exclusively  because  frankly,  I  believe  we  live  in  k- 
conimon  market,  Mr.  CHairman,  and  we  need  to  do  the  best  we  can 
to  make  sure  it  functions  effectively  by  not.  having  these  kipds  of 
exams  that^ray  we  are  just  not  going  to  let  you  practice  in  our 
area.  No  matter  how  bright  you  are  we  will  fix  this  curve  or  exam 
up  some  way. 

Aaf  I  say,  I  first  ran  into  it  in  the  problem  qf  local  governme'ht 
when  I  was  incorporating  a  City  and  making  it  larger  than  it  had 
been.  The  people  outside  the  old  city  said  that  is  great,  Mr.  Gib- 
bons, But  we  will  never  be  able  to  do  our  plumbing  in  that  area. 
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Chairman  Perkins.  Let  me  interrupt  you.  The  second  bells  have 
rung. 

Mr.  Weiss,  have  you  questions? 

Mr.  Weiss.  No,  Mr.  Chairman.  r 

Chairman  Perkins.  If  not,  let  me  thank  you,  Mr.  Gibbons,  tor 
some  outstanding  testimony. 

Mr.  Weiss,  you  are  going  to  testify.  ,  . 

Mr.  Weiss.  I  am  delifhted  to  be  associated  in  this  noble  venture 
with  Mr.  Gibbons.  r ,  V 

Chairman  Perkins.  We  will  recess  andncome  back  and  hear  Mr. 
Weiss. 

Chairman  Perkins.  I)o  any  of  the  members  wish  to  ask  Mr. 
Gibbons  any  questions?  If  you  do,  we  will  put  him  back  on. 

All  right,  Mr!  Weiss,  we.  are  glad  to/ welcome  on6  of  our  own 
members  here,  a  member  of  the  .Committee  on  Education  md 
Ldbor.  " 

STATEMENT  OF  HON.  TED  WEISS,  A  REPRESENTATIVE  IN 
CONGRESS  FROM  THE  STATE  QflJ^EW  YORK 

Mr.  Weiss.  Thank  yeu,  Mr.  Chairman.    .  — 
I  am  going  to  highlight  my  stetemerit  and,  with  your  permission, 
I  would  like  to  request  that  the  entire  statement  be  admitted  into 

^ho*  record*  ^   '  * 

.  Mt.  Chairman  and  memb^  of  the  subcommittee,  I  am  grateful 
for  the  opportunity  to  testify  d^ay  on  the  Educational  Testing  Act 
of  197d,  H.R.  4949,  which  I  introduced  Julv  24,  along  with  Repre- 
sentatives Shirley  Chisholm  and  George  Miller. 

I  appreciate  the  chairman's  decision  to  hold  these  hearing  on 
both  this  legislation  and  H.R.  3564,  the  Truth  in  Testing  Act  mtro- 
duced  by  Mr.  Gibbons. 

While  the  specific  provisions  of  our  bills  differ  m  sotae  respects, 
their  overall  aim  is  the  same,  to  improve  the  accountabilify  of  the 
standardized  t«3ting  process  anfi  to  insure  a  greater  degree  of 
fairness  in  this  area. 

A  few  testing  companies  today  exercise  enormous  power  over  the 
educational  and  occupational  future  of  millions  of  Americans.  Th^ 
testing  industry,  despite  its  influence  over  vital  aspects  of  Individ^ 
ruals'  lives,  operates  in  a  most  unaccountabl€^fashion.  Like  utilities, 
testing  corporations  perform  a  public  function.  Unlike  utilities, 
they  are  almost  totally  exempt. from  public  scrutiny.  • 

Test  results  can  literally  change  the  course  of  a  p^erson  s  life.  A 
lioor  score  on  one  of  these  examinations  often  inhibits  or  stifles 
completely  an  individual's  academic  ambitions. 

The  tests  often  contain  biases  that  iresult  in  lower  scores  for 
certain  geographic,  racial  and  income  gtoUps: 

One  study  prepared  by  the  University  of  California  at  Berkeley 
shows,  for  example,  that  test  results  vary  according  to  the.  level  of 
fka^y  earnings,  wWle  another  studv  conducted  by  the  Association 
of  American  Law  Schools  reveals  that  minorities  sometimes  have 
lowiBr  scores  on  the  exams  because  of  inherent  biases  and  technical 
flaws  in  the  tests. 

Standardize4  tests  have  also  acquired  an  aura  of  omniscience  in 
which  they  are  regarded  by  test-takers  and  by  some  academic 


evaluators  as  the  single  most  important  indication  of  a  person's 
ability  to  perform  acceptaBly  in  a  particular  academic  setting. 

All  of  us  have  heard  about  cutoff  points  below  which  an  individu- 
al is  not  admitted  to  a  school,  and  we  are  likewise  familiar  with 
the  status  accorded  someone  who  has  scored  700  or  higher  on  a 
standardized  test. 

'I  inust  stress  at  this  point  that  ray  legislation  in  no  way  attempts 
to  dictate  what  questions  should  or  should  not  be  asked' on  a  test, 
npr  does  it  try  to  alter  the  admissions  criteria  developed  by  col- 
l(|ges,  graduate  and  professional  schools. 

j  Instead^  this  bill  attempts  to  make  test-takers  more  fully  in- 
formed about  the  standeirdized  exam  process,  and  it  aims  to  lend 
needed  emphasis  to  the  ways  in  which  these  tests  do  not  measure 
certain  traits  and  abilities. 

It  is  estimated  that  more  than  50  million  young  Americans  will 
take  up  to  three  standardized  tests  during  their  academic  careers, 
while  the  testing  industry  receives  at  least  $200  million  in  annual 
revenues. 

A  handful  of  agencies  and  companies  develop  and  administer  t*he 
standardized  exams  on  behalf  of  a  few  associations  or  councils  that 
indicated  what  and  wfcm  they  want  tested.  The  tests  which' these 
groups  produce  and  administer  include  the  scholastic  aptitude  t*t, 
SAT,  the  graduate  record  examination,  GRE,  the  law  school  admis- 

<v  sion.test,  LSAT,  the  medical  college  admission  test,  MCAT,  arid*  the 

^Miller  ,  analogies  test. 

Nljjlpre  than  2,000  colleges  rely  to  one  degree  or  another  on  the 
SAT  in  assessing  applicants.  Nearly  all  medical  ^and  law  schools 
employ  the  results  of  the  MCAT  aod  LSAT  in  their  admission 
procedures.  V 

The  way  in  which  these  tests  are  prepared  and  their  accuracy  is 
not  publicly  known.  The  testing  companies  treat  these  ^xams  like 
highly  classified  documents,  withholding  background  information 
from  both  test-takers  and  reputable  researchers. 

The  need,  for  investigating  the  test  development  process  and  the 
grading  procedure  is  acute. 

Why  is  it,  for  example,  that  the  Berkeley  study  I  mentioned 
earlier  shows  that  students  whose  family  incomes  are  below  $6,000, 
scored  92  points  lower  on  the  SAT  than  did  students  from  families^ 
earning  $30,000  or  more  a  year,  or  that  a  Berkeley  study  found 
that  high  school  students  with  high  j|:rade  averages  but  low  SAT- 
scores  did  just  as  well  in  college  jas  those  students  with  high  SAff 
results^  or  that  a  study  conducted  by  David  White  for  the  National 
Ck)nferfence  of  Black  Lawyers  indicates  that  on  the  average  126 
points  separate  the  scores  of  black  and  white  students  taking  the" 
LSAT. 

A  1979  Federal  Tirade  Commissioa  report  concludes  that  prepara- 
tory courses  for  Ihe  ^standardized  exams  do  indeed  tend  to  improve 
scores  in  spite  of  the  fact  that  the  testing  companies  deny  that  that 
.is  so.  One  such  course  is  said  in  the  FTC  report  to  hav«  resulted  in 
up  to  a  100-point  improvement  in  test  results. 
'  Until  recentli^,  for  example,  persons  taking  the  LSAT  on  more 
than  one*  occasion  had  their  scores  marked  with  an  asterisk  to 
indicate  that  they  were  repeaters/ A  computer  was,  however,  at  one 
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point  marking  with  an  asterisk  the  scores  of  several  persons  who 
weret&king  the ^ 

LdP  schools  were  thius  supplied  with  inaccurate  information 
about  an  individual  who  was  asked  oii  a  separate  form  whether/  V 
this  was  the  first  time  he  or  she  was  taking  the  LS AT.  / 
While  many  of  the  testing  agencies  ei\joy  tax-exempt,  nohprc^t 
status,  they  often  produce  what  can  only  be  considered  a  profit, 
that  is,  mcome  exceeding  expenditures^  f         .  / 

A  nonprofit,  tax-exempt  organization  has  a  profit  margiii  be-  i 
tween  22  and  27  percent  annually,  and  thdt  comes  out,  according  to 
„8ome  reports^  to  anywhere  between  $8  million' and  $3V&  million  a      }  ■ 

•  year.  .      .  ^  ■  ■        .  ■  '    /  ' 
The  Educational  Testing  Act*  of  1979  addresses  each  /of  these 

concerns  in  tive  basic  ways.  /  i 

First,  it  requires  4^hat  testing  agencies  include  on  the  registration 
form  for  the  exams  a  minimum  amount  of  information  about  the 
test's  purpose  and  methodology.  / 

A  testing  agencv  would,  under  this  provision,  state  in  clear^  lanr 
guage  the  aim  of  the  t^t,  the  skills  being  assessed,  the  exam's 
margin  o^  errbr,i  the  manner  in  which  the  score  will  be  reported 
and  when,  the  correlation  of  certain  data  between  grades  imd  test 
scores,  on  one  hand,  and  academic  and  career  performance  on  the 
other,  the  effect  of  preparatory  courses  on  test  scores,  appeal  proce*-  ^ 
dure  for  questioning  the  test  results  or  conditions,  and  other  relat-  • 
ed  information.  i 

Most  t^ing  a^ncies  currently  provide  ah  explanatory  manual 
along  with  the  r^dstration  fojm,  but  these  manuals  vary  according 
to  the  kind  and  quality  of  information  provided  from  test  to  test 
and  agency  ft)  agency.  My  bill  would  simply  insure  that  the  infor- 
mation is  uhiform  throughout. 

H.R.  4949  would  also  require  that  testing  agencies  share  with  the 
U.S.  Commissioner  of  Education  the  results  of  any  studies  or  statis- 
tical analyses  which  they  have  prepared  on  their  tests.  These  find- 
ings would  then  become  part  of  the  public  record  in  order  to  allow  | 
'  independent  study  of  these  r^ults. 

Tiiird,  the  legislation  requires  the' testing  agencies  to  pr 
.  Commissioner  within  30  days  after  a  test  is  administered  the  ques- 
tions used  in  dalculating  the  r^w  score  for  an  exam,  the°  corre- 
sponding answers,  and  all  criteria  for  transliiting  the  raw  score 
into  the  score  that  is  reported  to  an  institution*  < 

The  test-taker  would  also  be  permitted  under  this  provision  in 
the  bill  to  obtain  a  copy  of  his  or  her  answer  $h^et  ana  the  correct 
answers  upon  request  to  the  testing  agency. 

This  provkioii  would  likewi^  enable  independent  re^  - 
review  the  questions  and.  answers  used  in  specific  exams  and  there- 
by miggest  possible  improvements  in  t«t  methodology, 

Hiis  section  |of  the  legislation  would  also  niake  the  tests  more  ^ 
relevant  to  a  person's  particular  educational  objectives. 

*  It  Would  provide  it  with  a  detailed  accounting  of  results  in  each 
area,  the  test-taker  will  have  a  much  better  understanding  of  how  ^  — ^ — - — 
and  where  to  concentrate  improvement  efforts.  k 

I  Qiust  emphasize  here,  too^  that  the  legislation  requires  only  the 
release  of  questions  and  answers  used  in  preparing  the  raw  score^ 
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while  the  bill  also  exempts  from  this  provision  those  tests  adminis- 
tered to  fewer  than  5,000  subjects  during  a  testing  year. 

The  fourth  infigor  section  of  H.R.  494^  protects  the  privacy  rights 
of  trat-takers.  A  student  often  receives  no  assurance  that  test  re- 
sults will  not  be  shown  to  institutions  or  individuals  to  which  the 
test-taier  does  not  want  results  revealed. 

Finally,  the  legislation  stipulates  that  testing  agencies  must  file 
information  with,  the  Commissioner  of  Education  about  their  fee 
structures  and  expenditures.  This  pfE^vision  would  further  insure 
the  public  accountability  of  the  testing  industry,  large  segments  of 
whjich  enjoy  tax-exempt  status. 

I  l^lieve  that  the  Educational  Testing  Act  of  1979  represents  a 
vital  ax^d  overdue  reform  in  an  area  that  has  long  escaped  public 
scrutiny  and  wl^ch  exerts  a  most  powerful  influence  over  the  lives 
i^of  millioAik  of  our^^itizens. 

This  bm  wouldWceomplish  on  a  national  level  what  is  already 
being  initiated  by^the  States.  Both  New  York  fend  California  have, 
for  exaniple.  already\ehacted  trulit-in-testing  legislation  similar  to 
H.R.  4949.  In  New  York,  two  testing  groups  have  threatened  to 
boycott  the  State  unless  tney  are  exempted  from  provisions  they  do 
not  like.  Arrogance  sUch  as  this  only  underscores  the  need  for 
,  Federal  l^^lation.  I  . 

1  bppe  that  you  agree  that  there  is  a  strong  and  unmet  nfi|d  for 
truth  m^testing;  a  need  that  can  be  fulfilled  onlv  through  Inact- 
"ment  of  le^][ation  along  the  lines  I  have  discussed  today. 

Thank  you  vei:y  much*     .  * 

[Prepared  statement^of  Representative  Ted  Weiss  follows:] 


♦ 

Prbparso  SrATSMwrr  of  Hon,  Ted  Weiss,  a'Rbprbsentative  in  Congre^  From  the 

State  of  New  York 

\      "Mr*  Chairman  and  members  of  the  rubcomriittbe,  I  am 

grat^ul  for  the  opportunity  to'  testify  today  on  the  Educational 

\        •  ■ 

Te^ting^J^ct  of  1979  (H.R.  4949)  which  I  introduced  July  24  along 

^  \  . 

with  Repres^tatives  Shirley  Chisholm  and  George  Miller. 

I  appreciate  the  Chairman's  deci&ion  to  hold  the6e  hearingsn 
pn  both,  this  legislation  and  H.R.  .3564,  the  Truth  in  Testing  Act 
introduced  by  Mr.  Giixbons.    While  the  specific  provisions  of  our 
bills  differ  in  some  re'b^ects,  their  overall  aim  is  the  same  — 
to  improve  the  accountability  of  the  standardized  testing  process 
and  to  ensure  a  gteater  degreV.^  fairness  in  this  area. 

In  offering  this  bill,  I  h^e  attempted  to  reform  the 
testing  procedure  in  a  manner  consistent  with  the  basic  objectives 
of  our  educational  system.    Standardizisd  testing  should  facilitate 
the  individual  learning  process  and  at  thX^ame  time  serve  the 
broader tef fort  to  provide  quality  education  \o  our  people. 

Under  current  practices,  standardized  tes^s  do  not  meet  . 
either  of  these  objectives. 

A  few  testing  companies,  today  exercise'enormou^^ower  Over 
the  educational  and  occupational  future  af  millions  of  Americans. 
The  testing  industry despite  Mts  influence  over.Vvit^l  Aspects 
of  individuals*  lives,  opexfates  in  a  most  unaccountable  fashion* 
Like  utilities,  testing  corporations  perform  a  public  function. 
Unlike  utilities,  they  a r'e  almost  totally  exempt  f-r^m  public 
scrutiny.  | 

Test  results  can  literally  change  the  course  of  a  person's 
life^   A  poor,  score  on  one  of  these  examinations  often  inhibits 
qr  stifles  completely  an  individual's  academic  ambitions. 
Banesh  Hof^n,  a  Harvard  scientist  and  author  of  The  Tyranny  of 


Testing*  argues ,  for  example,  that  standardized  tests  ^'corrupt 

educatioDr"  foster  ** intellectual  dishonest^)^ "  penalize  ^depth,** 

and  reward  "supei^Mciality . 

In  addition,  the  tests  often  contain  biases  that  result 

in  lower  scores  for  certain  geographic,  racial  and  income  groups. 

One  study  prepared  by  thjB  University  of  California  at  Berkeley 

shows,  for  example,  tTiat* test  results  vary  according  to  the  level 

'of  fanTily  earnings*  while  another  study  conducted  by  the  Association 

or^  American  Law  Schools  reveals  that  minorities  sometimes  have 

lower  scores*  on  the  exams  ^cause  o'£  inherent  biases  and  technicaT  ^ 

flaws  in  the  testsV:    "  T  .  ; 

Standardized  tests  htve  also  acquired  em  aura  of  onmi- 

■      ■  .  ■  ■  ^ 
science  in  which  they  are  regarded  by  test-taker a  and  by  some 

academic  evaluators  as  the  single  most  important  indication  of 

a  person's  ability  to  perform  acceptably  in  a  particular  academic 

setting.     All  of  us  Jiave  heard  about  "cut-off  points"  below. which 

an  individual  is  not  admitted  to  a  school,  and  we  are  likewise 

familiar  with  the  status  accorded  someone  who  has  scored  700  or 

higher  on  a.  standardized  test^ 

I  must  stress  at  this  point  that  my  legislation  in  no  way 

attempts  to  dictate  what  questions  should  or  should  not  be  asked 

on  a  test,  nor  does  it  try  to  alter  the  admissions  criteria  developed 

by  colleges ||  graduate  and  professional  schools.    ^Instead,  this  bill 

seeks  to  Ihake  test-takers  more  fully  informed  about  the  standard^ed 

e^am  process,  and  it  ^ims  to  lend  needed  emphasis  to  the  ways  in 

which  these  tests  do  not  measure  certain  traits  and  abilities* 
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•  To  give  some  idea  of  €he  size^^scope.  and  power  of  the 

•    standardized  testing . industry ,  I  woui*  like  to  brief ly. describe  ^ 
pome  key  findings  by  Various  researchers. 

According  to  an  article  in  the  May  1 ,  .  1977  IJew  York  Time^,  " 
it  is  estimated  that  more  than  50  million  young  Americans  will 
take  up  to'^fehree  standardized  tests  during  their  academic  careers, 
while  the. testing  industry  receives  at  least  $200  m-illion  in 
.annual, revenues.  » 

A  handful  of  agencies  and  companies  de^i^elbp  and  administer 
the  standardized  exams  on  behalf  of  a  few  associations  or  councils 
that  indicate  what  and  who^n  they  want  tested.    The  agencies  and 
companies  include  the* American  College  Testing  Program;  the 
Educational  testing  Service;  Harcourt,  Brace  and  Janovich  and' 
Scientific  Research,  a,  subsidiary  of  IBM.    The  associations  and 
councils  include  the  College  Entrance  Examination  feoard ,'  the 
.  American  Asspciation  of  Medica-l  Colleges,  the  American  Dejptal 

.      v  .  '  . 

Association  and  ather  prof essibnal  entities .    Th#  tests  which 
.        '  ■       ^f.  '  ■ 

thqse  groups  produce  and  administer  include  the  Scholastic 

Aptitude  Test  (SAT),  the  Graduate  Record  Examination   (GRE) ,  th6 

Law  School  Admission  Test   (LJ5AT)  ,*  the  Medical  College  Admission  • 

^• 

Test  (MCAT)  and  ±he  Miller  Analogies  tefit,  ^ 

More  than  2000  colleges  rely  to  one  degree  or  another  on 
the  SAT  in  assess in^;'' applicants.    Nearly  all  medical  and  law     *  * 
schools  employ  the  results  of  the  MCAT  and  LSAT  in  their.' Ad- 


mission procedure^), 


The  way  li^  which  thfese  tests  are  prepared 


i'  and 


heir 


accuracy  are  not.  publicly  kh6wn.  /^he  testing  compan^s  treat 
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•these  exams  like  highly  classified  aacuments,  withholding  background  • 
information  from  both  test^itakers  and  reputable  researchers.'*,  (llhe 
testing  agencies  meanwhile  conduct  their  own  studies  on  the  validity 
..arid  accuracy  of' their  exams  :on  a  regular  basis,  but. the  findings 
of  these  analyses  are  not  available  to  "outsiders." 

Somfe  agencies  claim  that  qualified  researchers  can  have 
access  to  some  of  these  studies-  arjd  some  of  the  background  information 
on  test  preparation.     But  many  groups,  including  the  California 
Student  Lobby  and  the  New  York  Public  Interest  Research  Group, 
"  report  that  the  (Companies •  rules,  fo^  use  of  these  files  are  so 
restr^tive  as  to  prohibit  any  meaningful  research. 

The  need. for  investigating  the  test  development  process 
and  the  grading  procedure  is  acute.    Why  is  it,,  for  example,  that 
\he  Berkeley  '^tudy  I  Mentioned,  earlier  shows  that  students  whose 
.family  incomes  ate  below  $6,000  scored  92  {Joints  "lower  on  the  SAT 
than  did  ^udents  from  families  earning  $30,000  or  more  a  year? 

Is  it  ndt  at  least  a  cause  for  additional  research  that 
a  separate  Berkeley  study  found,  that  high  school  students  with 
high  grade  averages  but-  low  SAT  scores  did  just  as  well  ^n  college, 
aff  those  students  with ;hi^  SAT  results?  ^  . 

Ahd  is  it. not  most  alarming  that  a  study  conducted  by 
David  White  for  the  National  Conference  of  Black  Lawyers  indicates- 
that  on  the  average  "120  points  separate  the  scores  of  black  and 
whilfe  students  taking  the  LSAT? 

These. disturbing  fipdings  demonstrate,  I  believe,  the 

•  compelling,  need  to  open  up  the  t^esting  process  to  the  student, 

^  '  i 

parents,  educators  and  the  public  in  general. 


These  tests  purport  as  well  to  measure  general  aptjitude 
rather  than  specific  learning  techn^ues.    Why  t8'^then  thlpt  a. 
1979  ^*ederal  Trade  Commission  report  concludes  th^t  pr^parfii^ory 
■  course^ for*  the  standardized  exams  do  indeed  tend  to  improve 
scores?    Orte  such  course  is  said  in  the  FTC.  report  to  have  resulted 
in  up  to  a  100 -point  improvement  in  test  results. 

And  what,  about  the  errors  or  oversights  that  inevitably 
accompany  processes  such  as  these?    Because. of  their  secrecy, 
the'testing  companies  are  nqt  held  accountable  for  these  hiis- 
..  haps  despite  the  drastic  effect  they  may  have  on  an  individual's 
cajfee^» 

Until  'recently,  for  example,  persons  taking  the  LSAT 

on' more  than. one  occaaicM  had  their  scores  marked  with  an  * 

■   •  ■  ■  '  f 

asterisk  to  indicate  that  they  were  •'repeaters."    A  computer  was, 

however,  at  one  point  marking  with  an  asterisk  the  scores  of  - 

several  perso/is  who  w^e  taking  the  LSAT  for  the  first  time.. 

Law  schools  were  thus  supplied  with  inaccurate  information  about 

an  idivi^ual  who  was  asked  on  a  separate  form  whether  this  was  the^ 

first  time  he  or  she  was  taking. the  LSAT . ^ 

The  computer  error  was  eventually  corrected  only  beca\ise 

.of  an  inquiry  from  a  law  school  admission  off ice'r. 

Another  cause  for  public  concern  is  the  fee^evel  developed 

by  the  testing  industry.    While  many  of  the  tefitingVa^encies  enjoy 

taxmexpmpt,  nonpr9fit  status,  they  often  produce  what  can  only 

be  considered' a  prof it  —  that  is,  income  exceeding  expenditures. 

'The  New  York  Public  Interest  Research  Group  reports ,  for  example, 

that  the  Educational  Testing  Service  —  a  nonprofit , ^tax  exempt 
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organization',  has  a  "profit"  margin  be,tween  22  and  2-7  percent 
annually.         _  ^         ^     .  -  x  . 

It  would,  I  believe,  be  most  interesting  to  students 
and  families  to  learn  why  an  $8.00  orv^lS.OO  fee  is  necessary 
for  an  agency  located  on.a380racre  Princeton  campus  which  includes 
a  $3  millron  conference  center. 

The  Educational  Testing  Act  of  1979  addresses  each  of  these 
concerns  in  five  basic  ways. 

First,  i^  requires  that  testing  agencies  include  on  the 

registration  form  for  the  exairis  a  minimum  amoijnt  of  information 

abput  the  test's  purpose  and  methodology.     A-  testing  agency  would, 

under  this  provision,  state  in  clear  language  the  aim  of  the  test^ 

the  skills  being  assessed,  the  exam's  margin  of  error,  the  m:5nner 

in  which  the  score  will  be  reported  and  when,  the  correlation  of 

*  t 

certain  data  between  grades  and  test  scores  on  one  hand  and 
academic  and  career  performance  on  the  other,  the  effect  of  preparatory 
course^on  test* scores*  appeal  procedure  for  questioning  the  test 
results  or  conditions^.^  and  6ther  related  information. 

Mdst  testing  agencies  currently  provide  an  explartatpry 
manual  along  with  the  registration,  form,  but  th^se  manuals  vary 
according  to  the  kind  and  quality  of  information  provided  from 
test  to  .test  and  agency  to  agency.    This  provision  in  my  bill  .  - 
would  simply  ensure  that  the  information  is  uniform  throughout. 

H.R.  4949  would  also  require  that  testing  agencies  share^ 
with  the  U.S.  Connnissioner  of  Education  the  results  pf  any 
studie^feir  statistical  analyses  they  prepare  on  their  tests.     These  » 
findings  would  then  become  part  of  the  public  record  in  order  to 
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allow  independent  studijU^f  thefl|| results. 

Third r  the  legiiWation  r<iquires  the  testing  agencies  to 

pro^Se  th^  coininission^i  within  30  (JayjB  after  a  test  is  ad- 

ministerdd  the  que stiojH«i  used  in  ^calculating  the  raiw  9core  for 

an  exam,  the  correspoi^^j  ng  answers  and  all  criteria  for  trans- 
■    '         !' '  ■       •        ......  •  ' 

*ating.  the  raw  score  into  the  score  that  is  reported  to  an  ; 

J   ■       .  ' 
institcution.    The  testrtaker  would  also  be  permitted  under  thi 

\ 


prpvifiion  in  the  bilj.  to  obtain  a  cop^y  of  his  or  her  answer' 
sheet  and  the  correct  answers  upon  request  to  thte  testing  agency,. 

I  Some  of  the  mystery  surrounding  the  standatdiz^  testing 

procedure  would  be  ended  through  this  provision.     It  wo&.d  likewise 
^ enable  independent  researchers  to  review  -^he  questions  and  answers 
used  in' specif ic  exams  and  thereby  suggeW  possible  improvements 


Ifi  test  methodology. 


This  sectipn^of  the  legislation  w^uld  alsp  make  the.te^ts 
more  relevant  to  a  person's  particular  edubational  objectives. 
The  GRE*8,  for  example,  are  currently  broken  down  into  three  basj^ 
categories  —  verbal,  quantitative  and  analytical,*  The  testrtaker 
now  has  only  the  most  general  knowledge  of' individual  strengths 
and  weakni^sses  under  this  categorization  method.    After  tajciiig  the 
exam,  a  p^son  will  hot  have  learned  very  much  about  his  or  "her  ' 
own  abilities.     But  if  xprovidiad  with  a  detailed  accounting  of 
resul^ts  in  each  area,  the  test -taker  will  have  a  much  better  ujldejp- 
standing  of  how  and  where  to  concentrate  improvement  efforts, 

I  must  emphasize  here,  too,  that  the  legislation  rsquires 
only  the  release  of  questions  and  answers  used  in  preparing  the 

raw  score,  while  the  bill  also  exempts  from  this,  provis^^  those 

'■■.%■  ■  '  \ 

tests  Administered  to  . fewer  than  5000 'ffubjects  during  a^'  testing  year. 


ERiC 


This  particular  requitement" wil  1.-th bre fore  not  c^use  any  .sig- 

nificant  increa^s-'lTrexpenses  to  the  testing  agency  and,  by  ^ 

extension,  to  the  test-taker. 

The  costs  of  test  developmertt  are,  in  any  event,  proportionate 

ly  low  in  comparison  to  revenues  and^ther  expenses.    For  example, 

the  New  York.  Public  Interest  Research  Group  reports  that  only 

23  cents  of  the  $7.00  fee  chai^ged  for  the  1971  SAT  went  to  test 

question  development. 

The  fourth  major  section  of  H.R.  4 94 9^ protects  the  privacy 
■  .  ^  ■ 

rights  of  test-takers.     A  student  oftea  receives  no  assurance  that 

test  results  will  not  be  shown  to  institutions  or  individuals  to 

i 

which  the  test-taker  does  not  want  results  revealed. 

Finally^  th6  legislation  s€ipulates  that  testing  agencies 
must  tile  inf ormatioh^ith  the  Commissioner'  of  Educat^ion  about/ 
their  fee  structures  and  expenditures.     This  provision  would  further 
ensure  the  public  accountability  of  the  testing  industry,  large 
6egmen.ts  of  which  enjoy  tax-exempt  status. 

I  believe  that  the,  Educational  Testing  Act  of  197  9 
represents  a  vital  and  overdue  reform  in  an  area  that  has  long 
escaped  public  scrutiny  and|Whfch  exerts  a  most  powerful  in^. 
fluence  over  the  lives  of  millions- of  our  citizens,  t 

This  bill  would  accomplish  on  a  national  lievel  what  is 
already  being  initiated  by  the  states.     Both  New  York  and  California 
have,  for  example,  already  enacted  truth-in-testing  legislation 
similar  to  H.R,  4949.     In  New  YoVk,  two  testing  groups  hSve 
threatened  to  boycott  the  state  unless  they  are  exempted  from 
provisions  they  do  not  like.    Arrogance  such  as  tlfis  only  under- 

scprefi  the* need  for  federal  legislation.  *        .  " 

I  hope  that  <^ou  agree  that  ther^HTfe  a  strong  and  <unmet  . 

need  for  truth  in  testing,  a  need  that  can  be  ftlfill^d  only 

jbh rough  enactment  of  legislation  along  the  lines  I  have  dis- 

cuBB^d  today . 

Thank  you. 

"  •  ■   ■   .  ■  %  • 

'    60  - 


.    Chairman  Perkins.  Mr.  Hawkins?  . 

\.  Mr.  Hawkins.  May  I  commend  you  on  a  very  excellent  analysis 
^  of  the  situation,  a  Very  fine  presentation. 

May  I  ask  you  whether  or  not  the  proposaji  that  you  are  sponsor- 
ing would  preempt  States  or  whether  or  not  ^tates  such  as  Califor- 
nia would  be  covered? 

Mr.  Weiss.  I  think  preempt  probably  is  not  the  iright  word.  I 
think  what  it  would  dp  would  be  to  make  th6  F^ersd  standards 
applicable;  however,  any  State  which  wanted  to  apply  stricter 
standards  than  that  which  we  have  prescribed  Wo|ild  still  be  enti- 
tled to  dq  so,  _  \ 

Mr.  HaWkins«  You  mentioned  therjb  is  a  profit  toade  by  some  of 
the  testing  agencies.' 

In  those  instances,  what  happens  to  the  profits?  Are  they  distrib- 
uted or  in  any  way  plowed  back  to  the  testing  agencies' to  improve 
the  qucdity  of  the  testing  or  research,  or  just  what  does  happen? 

Mr.  Weiss.  Mr.  Chairman,  I  don't  think  that  any  of  us  on  the 
outside  really  know  that  for  sure,,  and  technically  they  ^e  not 
profits.  Thejj  would  be  profit  margins  if  they  were  with^a  non-tax- 
exempt  kind  of  an  organi^tio'n. 

We  do  know  thatt there  has  been  over  the  course  of  the  last  30 
years  or  so  in  the  case  of  the  Educational  Testing  Service,  the 
development  of  a  magnificent  center  in  Princeton,  N.J.,  withl  a 
hotel  and  various  other  accommodations. 

I  assume  in  one  way  or  another  those  moneys  are  Utilized  by  the 
service,  but  whether  they  are  essential  utilization  or  just  using  up 
the  money,  there  is  no  way  of  knowing  on  the  basis  or  ihe  informa- 
tion that  is  ^available. 

Mr.  Hawkins.  I  am  not  implying  anjrthing  undesirable  in  men- 
tioning it,  but  I  was  interested  in  the  extent  to  which  the  testing 
agencies  do  attempt  to  improve  the  quality  of  their  testing. - 

Has  there  been  aAy  study  of  how  the  testing  that  goes  on  by 
these  agencies  at  the  present  time  could  be  validated?  I  am  not  so 
sure  the  Cominissioner  of  Education  should  be  the  one  to  do  it 
necessarily,  or  whether  the  educational  establishment  itself  should  ^ 
in  Bot^e  way  set  up  some  method  of  validating  them,  but  is  there, 
amr  validation  that  goes  on,  any  approval  by  any  educational  group 
otner  than  those  involved  in  the  testing  itself  directly?. 

Mr.  Weiss.  Mr.  Chairman,  Mr.  Hawkins,  two  things  should  be  % 
saip:  One,  the  legislation  that  we  have  submitted^uld  not  author- 
izer  any  validaftion  by  the  Commissioner  of  Education. 
'  In  essence,  he  would  be  the  repositor  of  certain  records  that 
would  be  subnlitted  by  the  testing  services,  which  would  then  \m 
summarized  and  made,  available  to  the  public  at  l^rge,  but  woulcv 
not  re(|uire  or  authorize  him  to  do  anything  further  by  way  or 
validation. 

I  don't  think  that  there  is  any  validation  as  such,  except  perhaps 
by  the  scho61s  or  association  of  schools  and  colleges  which  in  es- 
sence, commission  the  tests,  but  there  is  such  an  interlocking  rela- 
tionship that  exists  beween  the  testing  service  and  l^tween  the 
people  who  commission  the  testing  service  to  prepare  the  test,  that 
it  id  hard  to  pay  objectively  that  ther^is  ihde|>endent  valuation. 

Some  outside  researchers  have  tried  to  determine  whether  in 
fact  the  tests  ^a^e  valid  oi-  ndt,  and  those  are  some  of  the  examples 

■  Vn  ■ .    •  ■  '  •  .  .  •  *  ■  ■ 
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^  which  I  waanble  to  cite,  but  most  independent  researchers  claim 
that  they  hale  not  had  access  to  enough  information  on  |t  considt- 
ent  enough  basis. 
Mr.  Hawkins.  As  I  understand  the  thrust  of  your  proposal,  the  ^ 
t  thrust  of  it  seems  to  be  in  the  procedurid  aspect  of  it.  ^ 

I  do  not  see  it  as  any  attettipt  to  interfere  with  the  actual 
questions  that  I  asked;  am  I  correct? 

Mr.  Weiss.  You  are  absolutely  right.  There  is  no  attempt  to  tell 
them  what  questions  they  ought  to  ask      how  they  ought  to 
•  prepare  the  questions.  What  it  simply  wants  is  full  public  account- 
ability, public  exposure;  of  the  questions  for  the  world  at  laige,  as 
*  well  as  for  those  who  are  taking  the  tests  now.  *  ^ 

Mr.  Hawkins.  Isn't  the  question^  that  is  asked  is  wh^e  the  bias 
real]^  prevails  and,  if.th^t  is  so,  in^what  way  would  thaf;particular 
bias  that  is  contained  in  the  quespon  that  is  asked,  |er  s  say,  of  a 
child  from  a  low-income  family  being  asked  a  type  of  question  that 
would  be  relevant  to  a  clyld  of  a  middle  class  family.  That  dispar- 
ity that  }B  there,  it  seems  to  me,  that  is  a  larger  area  in  which  the  ^ 
so^alled  problem  does  exist.  i 

Now,  in  what  way  would  any  of  thesfe  proposals  reach  that 
.  pai^icular  situation,  or  do  you  feel  that  it  should  or  should  not  be 
reached? 

Mr.  Weiss.  It  is  my  view  and  the  view  of  those  who  support  this 
kind  of  legislation  that  if  you  made  the  tests  and  the  test  results 
available,  along  with  the  correlation  studies  that  have  been  done 
by  tHe  testing  agencies  themselves,  independent  scholars  in  the 
field  would  then  be  able  to  analyze  the  tests  themselye's  and  deter- 
mine where,  in  their  judgment,  biases  have  crept  into  the  tests 
.  themselves. 

Again,  it's  one  of  those  instances  where  if  you  shed  enough  light 
oh  it,  that^  itself  will  allow  other  outside  objective  experts  to 
come  in  and  tell  the  testing  services  what  parts  of  their  methods 
mfi^y  be  flawed,  but  this  legislation  would  ^ipt  mandate  any  changes 
It  ail 

I  Mr.  Hawkins.  Thank  you  verj^  much. 
'  Chairman  Perkins.  Mr.  Goodling? 

Mr.  GooDUNO;  Mr.  Chairman,  I  have  so  many  questions  that  it 
woulH  take  hours  oC  hearing.  ,  . 

I  hope  we  will  have  a  lot  of  deliberation  on  Mr.  Weiss'  legislation 
,  before  we  move  wit^i  any  rapidity. 

I  specifically,  Mr.  Weiss,  would  like  to  wait  to  see  just  what  New 
York  has  done,  what  they  haVe-ctftated,  Whether  they  have  creaie^ 
a  monster  or  something  good.  ;  ^ 

.7   We  will  hot  know  that  for  a  while.  ^ 

Secpnd^the  National  Academy  of  Sciences  has  a  committee  on 
ability  or  testing  which  is  looking  into  the  rolg^  of  standardized 
testing  in  the  United  States, 
\        .  I  would  like^  see  their  results.  , 
\  Some  of  your  provisioni^in  my  estimation,  and  this  is  a  hurried  ♦ 

i        judgment,  of  course,  are  going  to  hurt  low-income  individuals  and 
.     minorities  particularly  if  you  st^rt  making  these  tests  availab^  to 
the  prep  groups.  The  people  Who  are  going  to  be  able  to  tjake 
advantage  of  that  ate  goingf  to  le  those  that  are  academically 
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aggressive  and  those  whp  have  ,the  money  to  pay  for  the  coaching 
dchools,  ^  cetera;  1 

\  So  I  h?ive  real  concerfis  that  the  very  intent  of  your  legislation 
Could  backfire  and,  of  course,  as  I  said  earlier,  I  am  always  con- 
cerned as  to  what  will  happen  when  it  gets  downtown. 

I  think  Mr.  Gibbons'  approach  has  some  merit.  It  needs  a  wrench 
to  tighten  it  very  tightly,  so  it  cannot  be  misconstrued  by  the 
bureaucracy  when  they  start  promulgating  regulations. 

Mr.  Weiss.  Could  I  respond  to  the  first  point  that  you  raised? 

Mr.  GooDUNG.  Yes.  i 

Mr.  Weiss.  You  know^one  of  the  problems  that  exists  today  is 
that  thos^^  who  have  the  wHerewithal,  those  who  h^ve  the  meariS'to 
do  it,  attend  ^he  coaching  [sessiona  right  now.  Jndeed)  one  of  the 
open  secrets  ih  the  fleld  is  that  thf^e  coaching  schools  hire  people 
to  go  in,  take  the  tests,  memorize  the  questions,  come  back  and 
report  to  the  coaching  school  what  questions  they  i'emember. 

They  then  give  practice  t^ts  incorporatiilg  the  coaching  sessions, 
incorporating  questions  which  in  essence  they  have  memorized,  but 
the  J'ank  and  file  student  who  does  not  have  the  kind  of  wherewith- 
al to  allow  him  to  pay  the  $120  or  whatever  dollars  it  takes  for  one 
of  those  coaching  i^ssions,  doed  not  get  the  benefit. 

What  my  proposal  wotild  do,  I  think,  woidd  be  to  equtUize  the 
system,  so  tlutt  there  would  be  no  advantcige  on  the  basis  of  what 
you  could  afford  or  what  you  could  not  afjford  by  way  of  coaching 
sessions.  "     ■         ;  / 

Mr.  GooDUNG.  Well,'  you  'ftre  making  it  available  for  thatf  pur- 
pwe.  But  that  does  then  give  them  the  opportunity,  because  who  is 
going  to  prepare  them,  teach  them,  train  themf^  / 

Are  they  not  going  to  have.to.  pay  for  those  services? 

Mr.  Weiss.  No.  ■  ^ 

Mr.  G00D14NG.  Are  they  going  to  teach  themselves?^         I  / , 
.Mr.  Weiss.  Again,  it  seems  to  me  that  once  you  make/them" 

j)Ublic  so  that  the  J^sts  really  are  available,  not  on  the  basip^ of  how 

much  you  can  anord  to  pay  for  a  private  coaching  session  or 

coachiing  group.  But  open  to  the  world  at  larke. 
There  are  such  organizations  and  individuals  in  thejscholastic 

krea  which,  I  think,  would  be  able  to  provide  the  kind  of  assistance 

thdt  is  needed. 

Mr.  GoODUNG.  Take  the  SAT,  |br  example;  it  doesn't  test  specif- 
ics.' 

Is  ^ere  any  need  to  have  a  million  different  SAT's  released 
thereby  forcing  the  testing  companies  to  write  new  ones?  Isn't  the 
release  of  a  general  idea  of  what  is  on  those  tests  and  some  ques- 
tions from  those  tests  enough?  *  ' 

Is  there  any  need  oh  a  genen^ized  test  such  as  that? 
%  Mr.  Weiss.  One  of  th6  questions  in  dispute,  is  precisely/what  does 
the  SAT  test?  '  ' 

Does  it  ta3t  scholastic  aptitude? 

Does  it  .test  cultural  ^earAing? 

Does  it  test  Bpeci^c  forms  of  information  which  are  available  to 
certain  parts  pf  the  public?  * 
Those^re:9ill  open  to  question. 

The  second  part  that  1  think  is  hot  very  welUcnown,  especially  in 
light  of  the  arguments  and  questions  I  heard  in  New  York,  is  that 


if  the  New  York  statute  stays  on  the  books,  the  costs  for  taking 
those  tests,  and  the  application .  fees  are  going  to  be  increased. 

Now,  because  it  will  have  to  develop  lots  and  lots  of  new  ques- 
tions, and  I  think  many  people  have  the  impression  that  the  sapie 
questions  are  given  over  and  over  agaip,  the  fact  is  that  acc^dmg 
to  the  educational  testing  service  people  themselves,  some  7(Kper- 
cent  of  the  questions  on  any  particular  test  are  new  questions;  % 

any  event  ^  .  '  .  , 

They  developed  new  questions,  and  so  the  question  really  is  who 
has  access  to  them? 

Should  everybody  have  access,  or  only  those  people  who  can 
afford  to  pay  the  cSaching  schools? 

Mr.  GtooDUNG.  What  I  was  saying  about  SAT's  was  that  not  that 
the  same  questions  were  given  over  and  over  again  but  I  am  saying 
the  same  general  approach  to  testing  is  the  same. 

I  don't  know  whether  or  not  there  is  an  unlimited  amount  of 
questions  that  you  can  come  up  with  time  and  time  and  time  and 
time  again.  But  you  see,  all  of  the  SAT  tests  that  have  been  used  in 
the  past  are  already  available  for  everybody  to  see  and  everybody 
to  use  and  everybody  to  prepare  from,  if  they  so  desire. 

Mr.  Weiss.  Well,  even  that  is  open  to  question  as  to  what  parts  qf 
them  are  open  and  mjder  what  circumstances. 

Mr.  pooDLiNG.  Well,  no,  it's  not  open  to  questions.  Those  tests 
that  have  been  used  are  available. 

Mr.  Weiss.  Mr.  Qoodling,  I  wish' that  were  absolutely  true,  but  it 

is  not.  ^ 

In  fact,  we  have  had  qualified  researchers  and  you  will  hear 
sovge  testimony  from  theni,  who  will  tell  you  the  difficulties  they 
.  have  had  in  getting  some  of  the  test  results. 

Mr.  GooDLiNG.  The  point  I  am  trying  to  make  is  that  I  don't 
know  how  you  can  help  an  individual •  by ,  releasing  every, test 
question  that  has  been  given  on  an  SAT. 

L-doii't  know  how,  first  o^  all;  you  could  ever,  sit  down  and 
prepare  for  any  examination  trying  to  go  over  every  one  ^f  those 
questions.  That  is  an  impossibility. 

I  am  saying  they  are  available  to  the  general  idea  of  what  an 

SAT  test  is  all  about.  On  page  4,  and  certainly  youL.c^  answer  the 

question  very  rapidly  yoUrself,  your  bill  says: 

T^^ie  need  for  investigating  the  test  development  process  and  the  grading  pi^oce- 
dure  l8  acute.  Why  is  it.  for  example,  that  the  Berkeley  study  I  mentioned  earlier 
shows  that  students  whose  family  incomes  are  below  $6,000  scored  92  points  lower 
on  the  SAT  than  did  students  from  families  earning  $30j000  or  mof^  a  year? 

You  know  all  the  answers  to  that  question.  What  is  your  legisla- 
tion going  to  do  to  improve  that  situation?  What  is  it  going  to  do  to 
change  the  readiness  of  that  child?  >Vhat  is  it  going  to  do  to  change 
the  situation  in  the  home  for  that  child? 

You  know  exactly  why  the  person  from  that  higher  income  in 
some  instances  and  not  all,  scores  better. 

What  does  your  legislation  do  in  any  way,  shape,  or  form  to 
change  that  home  situation,  that  cultural  situation? 

What  does  your  legislation  do  to  make  it  better? 

Mr.  Weiss.  I  don't  accept^he  premise,  Mr.  Goodling,  that  apti- 
tude tests,  not  fact  tests  but  scholastic  aptitude  tests,  of  necessity 


have  to  show  that  kind  of  a  range  bf  difference  of  92  points  on  the 
basis  of  family  income.  '  ' 

.  I  think  that  there  is  something  wrong  about  the  way  that  those 
tests  are  constructed.  You  ought  to  be  able  to  come  up  with  tests 
which  in  fact  tests  the  aptitudes  of  the  kids  taking  the  tests,  rather 
than  their  family  incomes. 

There  is  a  disagreement  between  us  as  to  whether  Or  not  these 
tests  are  giving  us  back  the  obvious. 

Mr.  GooDUNG;  What  does  your  legislation  ^o  to  improve  the 
possibility  of  youngsters  doing  better  to  improve  on  the  verbal  part 
of  the  SAT? 

Mr.  Weiss.  Again,  all  that  my  legislation  does  is  to  open  the 
process  to  the  world  at  large,  including  the  individuals  who  take 
the  test,  so  that  qualified  experts  in  the  field  can  review  them,  can 
look  at  them,  and  write  imd  analyze  and  make  reports  as  to  the 
I   methodology,  the  preparation  and  the  scoring  of  those  tests. 

My  le^lation  iiiJierently  does  not  do  anjrthing  bjeyond  that..  That 
is  all  that  the  legislation  does. 

Mr.  GooDUNG.  You  see,  and  you  have  heard  me  mentio^  this 
many  times,  I  have  a  real  fear  that  what  your  le^lation  could  do, 
coupled  with  a  new  Secretary  of  Education  and  a  new  bureaucracy 
downtown,  is  get  into  the  very  business  of  standardized  tests  and 
then  competency  examinations  coming  from  Washington,  D.C.  This 
would  certainly  be  totally  devastating  to  the  system  because  they 
would  have.lto  match  our  testing  program  fromlon  high  with  our 
curriculum.  .1 
Mr.  MuxEE.  Will  the  gentleman  yield?  / 
Mr.  GooDlJNG.  Yes,  sir.  / 
Mr.  Miller.  How  would  that  happen  with  this  bill? 
\      Mr.  GooDUNG.  I  am  tryipg  to  find  out  specifically  what  this  bill 
\  is  supposed  to  do.        '  / 

Mr.  Miller.  How  can  you  make  all  those  remarks  and  read  the 
V  bill  and  tell  mp  how  it  happens?  J  .  ' 

Mr.  GooDUNG.  Because  I  have  been  in  the  business  so  long  and  I 
\  have  seen  what  these  little  things  that  we  try  to  do  on  the  Federal 
\level  get  translated  into,  once  it  leaves  the  Congress  of  the  United 
States.  ; 

\  I  say  let's  see  what  the  New  York  system  does.  Let's  see  what 
the  Academy  of  Sciences  is  going  tacome  up  with  before  we  rush 
(^ff  into  some  kind  of  program  which  we  are  not  sure  will|  do. 
'  I  am  trying  to  find  out  exactly  what  your  legislation  is  supposed 
t0  do.  ^ 

vMr.  Weiss.  My  legislation  seeks  to  do  what  I  have  beefa  saying  all 
along,  that  is,  to  simply  open  it  up  so  that  everyboay  can  tell 
eitiactly  what  it  is  that  they  are  festing  and  what  the  scores  are, 
.  atid  so  on. 

The  interesting  thing,  is  that  there  have  been  misconceptions 
abbut  H.R.  4949.  I  think  that  partly  is  because  it's  only  a  week 
sinipe  this  "^ill  has  been  in  and  I  think  Mr.  Gibbons'  bill  has  not 
been  in  too^much  longer.  You  had  indicate  earlier  in  this  dialog 
I  tha\  you  thought  that  perhaps  Mr.  Gibbon^'  legislation  provides 
somje  more  safeguards  but  I  want  you  to  know  that  we  drew  this 
legislation,  H.R.  4949,  >very,  very  carefully  and  very  narrowly. 
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For  examplje,  there  is  a  provision  that  you  an^  Mr,  Gibbons 
discussed  as  t6  what  his  legislation  would  do  in  prohibiting  certain 
kinds  of  scoring.  J 

.My  legislation  does  not  get  into  that  at  dl.  I  lei  the  testing^ 
people  and  tho  universities  and  the  colleg^  do  Wiatever  they' 
wanty  prepare  A^hatever  questidns  they  want,  score  xhem  in  what- 
ever •  way  they|lwant.  All  that  I  am  saying  is  that  evfe -ybody  ought 
to  hive  the  right  to  know  what  it  is  that  they  are  doihj.  i  ^ 

Mr.  GoODLiNG.  Let  me  ksk  you  a  couple  of  specific  tilings  which  I 
understand  your  bill  is  supj^osed  to  do.  1 

Studies,  evaluations,  or  statistical  reports  pertinent  to  a  test^ 
which  is  prepared  by  a  test  agency,  require  specific  riames  ^within 
/studies,  an(^7so  forth,  to  be  protected,  this  is  what  the  Commission-  ^ 
er  of  Edufatiion  is  supposed  to  do.  - 

Specificmly,  what  do  you  have  in  mind  when  you  say  that  the 
Commissiooier  of  Education  to  be  provided  the  following? 
Mr.  WbiSS.  Yes;  what  we  are  asking- 
Mr.  G60DUNG.  And  then  what  is  it  to  do?  '  ■ 
'     Mr.  Weiss.  We  are  asking  that  tjie  Commissioner  of  Education  be* 
provided,  by  the  testing  service,  the  information  that' is  set  forth. 

We  want  the  Commissioner  to  receive  and  keep  and  hold  as  a 
matter  of  public  .record,  available  for  people  to  look  at,  studies, 
evaluations,  or  statistical  reports  pertinent  to  a  test  which  is  pre- 

*  pareo^by  a  test  agency.  . 

.  Ix  /doesn't  mandate  that  there  be  finy  new  reports  or  evalutions 
or  studies.  / 

It  says  that  those  that  are  prepared  ought  to  be  submitted  to  the 
Commissioner  of  Education  and  kept  there  as  a  matter  of  public 
recX)rd  so  we  don't  have  a  situation  where  sometimes  studies  are, 
conipleted  and  then  they  are  kept,  secret  or  not  released. 

What  we  are  trying  to  do  is  to  provide  that  the  specific  names  of 
thi(^se  who  took  tests,  for  example,  be  protected,  that  there  be  a 

•  right  of  privacy,  that  people's  names  ought  not  to  be  bandied  about, 
HOT  ^hat  their  scores  were,  and  so.  forth. 

A  copy  of  contract  for  services  between  test  agencies  should  be 
sciht  to  the  Commissioner  of  Education. 

It  requires  tiiat  the  Commissioner  of  Education  submit  a  report 
ol  the  material  which  h^  has  received. 
I'hatreally  is  all  that  is  asked  for. 
Mr.  Gooi)LiNG.  Let  the  press  one  other  area  quickly. 
!^n  you  tell  me  specifically  the  urgency  of  the  bill?  What  is  it 
thjfit  has  come  to  your  attention? 

hat  do  you  specifically  know  that  would  say  that  it's  very 
urgent  to  move  in  this  direction?  <  " 
hat^e  the  needs,  the  pressures? 
r.  ¥WiiSS.  Right,  right. 
I  \  think  that  if  you  had  discovered  that  a  Federal  agency,  the 
Office  of  Education,  and  the  Department  of  HEW,  Were  preparing 
andlconducting  teste  and  holding  back  resulte  or  releasing  them  in 
the  fashion  that  the  private  testing  agenmes  do,  you  would  have 
been\and  would  be*  up  in  arms  about  it.  Y6u  would  think  that  it's 
bureaucracy  running  a  riot  and  keeping  information  from  the  pub- 
lic. 
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What  has  happened  to  us  in  the  course  of  our  ongoing  legislative 
wotk,  and  especially  with  the  publicity  attendant  to  the  work  that 
was  going  on  in  New  York,  we  started  doing  ^ome  research-our- 
s^lves,  and  we  fpund  that  going  back  a  decade  at  leasts  there  have 
fc^n  very,  very  serious  questions  raised  about  the  testing  process, 
the  methodology,  and  the  isecreoy. 

,  We  decided  that  we  werernot  goiiig  to  get  into  the  question  of 

{)assing  judgment  On  whether  the  tests  are  or  are  not  valid^  but  we 
elt  that  we  had  an  obligation  to  submit  legislation  which  would 
open  the  process  up,  and  that  is  the  ui^ency  in  this  matter. 
It's  an  urgency  based  on  infonhation  that  we  have  developed. 
Mr.  GooDUNG.  I  am  tpring  to  get  a  little  deeper  than  that. 
I  am  trying  to  find  out  what  you  say,  is  an  urgency  to  open  it  up. 
What  is  the  urgenpy  to  open  it  up? 

What  have  been  the  (discriminatory  practices  in  the  past? 
'  Wh£it  is, it  that  makes  it  urgent  other  than  just  to  say  it's  urgent 
open  it.up?  ♦  ' 

Mr.  Weiss.  Mr.  Goodling,  like  you,  I  do  not  like  what  seems  to 
smagk  of  secrecy  in  the  public's  business,  and  I  consider  a  situation 
urgent  wliere  you  have  some  50  million  students  who  in  the  course 
of  their  academic  careers  a^e  subjected  to  an  aviarage  of  three  of 
those  standardized  kinds  of  te$ts  aiid  are  imable  to  see  the  results 
of  their  tests. 

With  all  V  the  questions  that  have  been  raised  about  the  meth- 
odology and  Miat  they  really  test,  I  don't  think  that  this  ought  to 
be  allowed  to\;pntinue.  I  have  a  built-in  sense  of  concern  about 
thdt  kind  of  ongoing  s^recy  and  I  think  that  we  ought  to.  allow  the 
breath  of  fresh  aik  to  go  in  on  this  situation.  That  is  all. 

Mr.  GooDUNG.  Can  you  tell  me  what  the  secrecy  is  in  the  SAT, 
for  instance?  What  is  the  secrecy? 

Mr.  Weiss.  For  example,  the  secrecy  is  that  a  student  who  takes 
one  of  those  tests  does  not  understand  Ithe  present  system  of  the 
right  to  request  of  the  people  who  prepare  and  administer  that 
test,  that  his  paper  with  the  raw  scores  be  given  back  to  him  or 
her,  fio  that  in  fact  the  test  taker  knows  how  they  did  on  the  test. 

Why  should  that  be?  A. 

Mr.  GooDUNG.  Well,  simply  because,  as  you  knoy^  v  you  are 
going  to  release  every  one  of  those  tests,  then  you  arengoilc  to  have 
to  prepare  ai  new  one  over  and  over  again,  iand  I  d<^^know 
whj^ther  you  can  keep  comyig  up  witl^i  good,  logical  questions  on  an 

Mr.  Weiss.  They  give  those  tests  sometimes  six  or  nine  times  a 
year;  70  percent  of  the  tests^  on  any  examination  are  new.  The 
question  really  is:  Shoitld  it  be  a  closely-held  secret  or  should  it  be 
open  tp  the  world?  '  » 

That  is  really  the  question.  ' 

Chairman  Perkins.  Let  me  say  to  my  distinguished  colleague 
from  Pennsylvania,  I  don't  want  to  cut  him  off  but  we  are  not 
going  to  get  through  itodav  if  we  go  ahead  with  questions  now. 

Mr.  GooDUNG.  We  should  take  a  lot  of  time  and  see  what  to  do.  I 
won't  take  anv.  more  time*.  \  i 

Chairman  PERKINS.  The  gentleman  almost  ran  20  iliinutes. 

Go  ahead,  Mr<  Miller.  ^ 

Mr.  Miller.  J[  won't  take  much  time. 


••  ■       ■ 58.  ■■  ■■  ■   •  ■ 

I  just  want  tp  tell  Congressman  Weiss  that  I  think  he  is  right, 
and  I  tHink  you  have  a  process  that  makes  a  number  of  determina- 
tions about  h6^  people  will  spend  the  rest  of  their  lives. 
'  We  heard  eaNier  from  Mr.  Gibbons  about  whether  or  not  people 
would  be  all6weA.to  engage  in  various-oS^yipations,  arid  no>y  you 
are  going  into  the  question  of  whethef  thej  will  be  allowed  to  enter 
various  colleges,  various  professional  schools  to  pursue  other  .occu- 
pations. 

rthink  that  the  point  is  that  when  you  have  an  entity  that  can 
make  those  kinds  of  determinations,  even  assuming  that  all  of  the 
determinations  are  valid  ajdd  can  be  supported  through  analysis 
the  procedures,*  the  people  who  participate  and  are  required/to 
participate— this  is  mt  something  that  is  optional— ought  to  kpow 
all  there  is  to  know  about  the  process. 

You  don't  tell  the  University  of  California  you  don't  feel  Uike 
taking  the  SAT's.  You  don't  tell  the  law  school  that  you  don't  vmit 
to  take  the  LSAT  because  you  feel  you  are  competent  to  go  to  la^ 
school. 

I  You  have  to  take  it,  and  in  that  case  the  people  who  engage  that . 
procesli  as  test-takers  ought  to  know  all  there  is  to  know  a|>out  the 
process  that  is  going  to  guide  their  lives,  and  they  ought  to  have  ^ 
the  ability  to  challenge  it  and  review  their  tests  and  they  ought-to 
be  able  to  sit  down  an^o  over  it  to  see  what  is  going  on. 

They  ought  to  be  abw  to  understand  the  manner  in  which  those' 
scores  are  developed,  the  biases  that  are  built  in  or  are  not  built  in, 
and  I  think  that  it's  very  import^t* for  this  kind  of  information. 

To  go  from  there  land  suggest  a  national  curriculum,  to  suggest 
national  testing  as  the  result  of  a  disclosure  bill,  I  think  is  simply 
to  set  up  strawmen  so  that  they  can  always  be  out  there  to  buga- 
boo the  biU,  and  I  don't  think  that  is  the  situation  at  all. 

First  of  all,  this  committee  would  never  go  for  it,  and  second,  it's 
not  related  to  this  issue. 

The  isst^e  is  disclc^ure  to  young  people  who  have  to  make  aca- 
demic determinations  and  who  want  to  know  how  those  detennina- 
tions  are  going  to  be  made^^for  them.  ^ 

I  would  be  delighted  if  the  author  of  this  legislation  would  point 
out  where  it  gives  the  basis  to  talk  about  national  testing,  national  - 
test  development  or  national  curriculum. 

I  just  don't  see  it  in  this  legislation.  We  ought  to  addf^ess  our- 
selves to  this  legislation,  and  I  don't  see  it  in  the  bill,  Ted,  and  I 
want  to  give  you  a  chance  to  respond  to  that,  because  it's  one  thing 
to  talk  about  it  but  it's  not  in  the  legislation,  as  I  read  it 

Mr.  Weiss.  You  are  absolutely  righ^,  Mr.  Miller. 

It's  not  in  the  legislation.  ,  ^ 

The  legislation  was  very,  very  carefully  dr£l wn . 

There  is  no  suggestion  of  any  national  tests,  and  there  is  nothing 
in  there  even  impacting  on  the  use  of  thes6  tests  made  by  the 
colleges  or  universities  or  the  professional  schools.  • 

AH  of  that  really  is  left  exactly  as  it  is.  All  that  we  are  saying  is 
that  we  ought  to  really  open  it  up  so  that  i)eople  see  it. 

I  should  also  remind  my  good  friend,  Mr.  Goodling,  I  share  some  . 
yof  his  concerns  about  liational  curriculae  and  national  department 
of  education,  and  so  on,  and  I  opposed  the  creation  of  tthe  Depaiv 
ment  'of  Education  and  have  b€*n  voting  it  in  the  Committee  on 
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'  v"    Government  Operations  apd  on  the  floor  of  the  House  ftfr  the 

'•\    I  think  that  the  danger/ sometimes  when  we  look,  at  labels,  IS 
thftt  we  allow  people  to  get  away  with  doing  things  ih  a  fashion 
which  we  would  never  in  a  million  years  allow  a  Government 
"    'a^ncy  to  do.  I^e  testing  companies. in  this  instance^  I  think,  are  in 
r  *:.    that  position.  '  '    u  j  v 

'-.  ''.i'  They  haVe  Msumed,  they  could  continue,  because  nobody  has 
qj^all^ngfed  them  to  do  things  in  a  fashion  which -would  never 
i  ■     cpiiidoni^' the  Government  agency. 
V./  '    Mr.  G^)OpUNG.  Would  the  gentleman  yield? 
\-\    Mr. MitiiER.  Sure.  ,     .  .  . 

'i     Mr^  GooijLiNa  You  should  certainly  include  the  ciVil  service  m 
:{ ""ypnt  legislation,  if  you  are  going  to  make  a  statement  like  you  just 
c  ''  i^^^  talk  about  what  we  will  allow  and  will  not  allow,, 

■  "  twheii  it  comes  to  Government  agencies  and  Government-connected 
-  V  •  .  ageijcies,  an^^p  on.  I  think  you  will  find  that  if  ever  thfere  is  a 
•flafce'.thaf  fteedfi  your  proposal  it's  probably  civil'service  testing. 

'  "o  '       fe0tX)DLiNG*  You  might  think  about  that.  ,  „ 

•«   -    Mfl'WBiss.  My  legi^tion  doesn't  even  address  the  area  that  Mr. 
iJ^GKblwnig'^^^^  1  t^e  occupational  testing. 

*  "  i .    All^hat  thia  "legislation  does,  because  I  think  you^  admonition  in 
«i    '«  isoW  regaijds  itf-a  very  Mse  one,  is  to  start  very  slowly. 
.^r-C    It  stalks  alwut -Admissions  t^^^  the  professionkl  schools, 

;  °  -0  V'ljand  the  iSFa^uate:  Schools  period.  That  is  it.  '     u  I 

«        oMt.'feooifyi^^^  responding  to  your  comment  that  we 

vWduldtt't^.^^^  a.thiiig.  to  be*  connected  with  the  Federal 

'  "V*  •  *  CMihnan  |*«RKINS  a  vote.on  the  Floor. 

•  v„'. ;  We^^^nll         fot  |0  jninutes  and  resume  the  hearing. 

/:.,i^»»iKafii!pPiiiiJ^  „  • 

f^^^Xmm^  come  back.  He  is  voting.  We  will 

•  wait  i  eojtiple  of  mi^h^  ^' 
Why  doesjii't  t^d  next  ppel  come  around?    ,  .  ^  . 

■  ^m^i^ilter  Haneyi' Ifestinfe  Dr-  -John  Ckwper,  president, 

Aspoaatiort  'pf  American  medical  Colleges;  Mr.  Fred  H^rgadon, 
cMim^^:mM  ^^^d^  College  Board,  accompanied  by 

v^" Robert  J.  Solomon,  erfcutive 
-      '^^  v^fe-  IW^deht  ani  adl^ig  pr^iileAi  Educational  Testing  Seitice. 
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STATEMENTS  OP  DR.  WALTER  HANEV,  TESTING  EXPERT.  AC- 
COMPANIED BY  AI.UN  NAIRN;  DR.  JOHN  A.  D.  COOPER, 
PRESIDENT,  ASSOCIATION  OF  AMERICAN  MEDICAL  COL- 
'  LEGES;  FRED  HARGADON,  CHAIRMAN,  BOARD  OF  TRUSTEES, 
THE  COLLEGE  BOARD,  ACCOMPANIED  BY  LOIS  D.  RICE, 
VICE  PRESIDENT;  ROBERT  J.  SOLOMON,  EXECUTIVE  VICE 
PRESIDENT,  ^ACTING  PRESIDENT,  EDUCATIONAL  TESTING 
SERVICE  ,  .J 

STATEMENT  OF  LOIS  D.  rICE,  VICE  PRESIDENT,  COLLEGE 

BOARD 

Ms.  Rice.  Mr.  Chairrhan,  my  name  is  Lois  D.  Rice,  and  I  am  a 
vice  president  of  the  College  Board. 

Unlike  many  other  occasions  when  I  have  appeared  before  you 
arid  your  Subcommittee  on  Postsecpndary  Education,  today  I  am 
not  the  witness. 

Instead  I  have  the  pleasure  of  introducing  the  witness  for  the 
College  Board,  an  organization  which  has  had  the  pleasure,  Mr. 
Chairman,  of  supporting  your  efforts  to  bring  about  a  more  just 
society  by  breaking  down  the  barriers  to  educational  opportunity. 

We  vv^alked  together  on  a  torturous  road  in  1972,  . and  without,  as 
you  know,  much  consensus  in  the  higher  education  community  to 
enact  what  is  now  the  centerpiece  of  Federal  support  for  postsec- 
ondary  education— the  basic  educational  opportunity  grants  pro- 
gram. ^ 

Chairman  Perkins.  May  I  make  an  observation  that  you  were 
very  helpful  in  that  \6ng  and  tedious  and  complicated  fight,  Ms. 
Rice,  and  I  certainly  appreciate  it. 

Ms.  Rice.  I  thank  you,  Mr.  Chaiwn?tn. 

Presenting  our  testimony  is  Fred  Hargadon,'  a  political  scientist, 
a  dean  of  admissions  and  now  the  elected  chairman  of  the  College 

Board.  -  ' 

Mr.  Hargadon  has  always  acted  on  his  beliefs.  He  has  devoted 
himself  to  educational  services  for  the  disadvantaged— to  upyvard 
bound  and  talent  search  programs  at  the  local.  State,  and  national 
levels.        *  .  A 

I  am,  therefore,  pleased  and  proud  to  introduce  him  to  the  com- 
mittee. He  is  perhaps  the  Nation's  most  quoted  admissions'  officer 
in  the  press,  but  one  who^  l^as  not  until  today  had  the  honor  of 
speaking  before  a  congressional  committee.. 

« 

STATEMENT  OF  FRED  HARGADON,  CHAIRMAN,  BOARD  OF 
TRUSTEES,  THE  COLLEGE  board: 

Mr.  Hargadon!  Mr.  Chairman  and  members  of  the  subcommit- 
tee, my  name  is  Fred  Hargadon. 

For  the  last  10  years  I  have  been  dean  of  admissions  at  Stanford 
University  and  prior  to  that  dean  of  admissions  for  4  years  at 
Swarthmore  College.  n        rr^  ^^ 

I  also,  currently  serve  as  the  elected  chairman  of  the  College 
Board.  ' 

I  Wblcome  this  opportunity  to  testify  on  H.R.  8564,  Representa- 
tive Qibbons'  Truth  in  Testing  Act,  and  on  Representative  Weiss' 
Educational  Testing  Act  of  1979,  H.R.  4949.  .  .  \ 
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Before  speaking  directly  to  the  specifics  of  these  bills,  I  would 
make  two  general  observations. 

First,  1  think  these  bills,  if  enacted  into  legislation,  would  signifi- 
cantly alter  the  historic  role  of  the  Federal  Government  in  educa- 
tion. They  might  actually  impede  the 'goal  of  equalizing  educational 
opportiinity^  a  national  goal,  and  the  historic.  Unchanging  goal  for  ^ 
.which  the  College  Board  was  founded. 

Second,  both  bills,  though,  in  different  degree  and  through  differ- 
ent'means,  would  put  the  Federal  Government  into  the  business  of 
regulating  testing  programs  and  admissions  practices'  in  ways 
which  run  the  risk  of  increasing  the  cost  to  Students,  educational 
institutions,  and  society-  as  a  whole. 

Tests  do  affect  the  lives  of  students,  althaj^gh  nowhere  near  as 
significantly  or  as  negatively  as  the  profjDnents  of  this  legislation 
would  have  us  believe.  In  fact,  when  it  cpmes  to  college  admissions, 
it  is  the  quality  of  students'  prior  educational  preparation  and  the 
quality  of  their  performance,  as  indicated  bv  the  grades  they  have 
re6eived>  which  play  a  greater  role  than  that  of  their  results  on 
College  Board  tests. 

Despite  this  fact,  it  is  tests  to  which  some  legislators, at  the  State 
and  Federal  level  have  recently  turned  their  attention. 

We  sympathize  with  the  quest  for  accurate  and  full  disclosure  of 
information  to  those  who  take  our  tests.  At  the  same  time,  we  are 
concerned  about  the  hazards  of  precipitous  legislative  action  and 
the  unanticipated,  unintended  effects  that  often  result  from  the 
Government  intervention  into  educational  affairs.' 

The  Buckley  amendment  is  a  prime  example.  . 

We  synipathize  with  the  stated  intent  of  the  framers  of  that 
measure,  ttie  Faii[iily  Educational  Rights  and  Privac)[  Act,  FERPA, 
of  1975.  But  the  legislation  touched  o^  an  agonizing  and  time- 
consuming  ordeal  of  statutory-  interpretation  and  regulation 
writing.  , 

And  despite  the  passion  that  inspired  the  legislation,  few  parent 
and  students  seem  to  know  or  care  about  the  procedures  which 
allow  them  access  to  information  in  student  files. 

The  legislation  now  before  tha  subcommittee  could  generate  the 
''same  kind  of  cumbersome,  costly,  and  sweeping  regulation,  and 
without  any  clear  documentatiq^  that  the  changes  it  seeks  are 
either  needed  or  useful. 

What  is  the  present  situation  in  undergraduate  admissions  test- 
ing? The  College  Board  is  responsible  for  testing  more  students  for* 
undergraduate  college  admission  than  other  organizations  com- 
bined, more  than  1.5  million  in  1978-79.  We  are  a  nonprofit,  volun- 
tary association  of  more  than  2,500  schools  and  school  systems, 
colleges  and  universities  and  -educational  associations.  Our  two 
main  activities  are  the  admissions  testing  program,  the  most  famil- 
iar part  of  which  is  the  Scholastic  Aptitude  Test— the  SAT— and 
the  College  Scholarship  Service— CSS— which  last  year  served  2.6 
million  aid  applicants. 

Since  the  fouXiding  of  the  College  Board  Tnore  than  75  years  ago, 
our  primary  commitment  has  been  to  promote,  not  to  retard,  access 
to  higher  education  in  bur  society.  In  the  years  following  World 
War  ll,  the  admissions  testing  pro-am  enabled  a  vast  expansion  of 
postsecbndary  education  by  providing  colleges  and  universities  with 
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an  additional  instrument  for  measuring  academic  potential  among 
our  young  peopje.  In  the  1950's  the  College  Board  niembership 
responded  to  the  heed  for  a,  more  equitablejj^distribution  of  fmaircial 
aid  by  pioneering  procedures  for  aS^arding  such  aid  according  to 
financial  need,  a  move  that  increased  educational  opportunities  for 
the  less  affluent  and  raised  the  level  of  participation  in  postsecon- 
dary  education  of  minority  students.  At  the  time  of  sputnik,  ^ith 
the  Nation  searching  for  higher  standards  of  excellence  foy  its 
young  people,  the  College  Board  initiated  the  advanced  placement 
program — a  model  for  providing  excellence  in  the  secondary 
schools  and  a  program  in  which  over  100,000  high  school. students 
participated  this  year.  *  / 

And  the  College  Board  has  developed  arid  sustained  these  efforts 
without  prodding  from  any  government. 

Also  without  prodding  froip  any  government,  we  proyide  thpse. 
who  take  our  tests  with  nearly  all  the  information  about  tests 
which  the  bills  before  you  todajK would  mandate. 

Consistent  with  section  6  of  H.H.  3564  and  section  3  of  H.R.  4949, 
the  College  Board  now  provides  detailed  information  to  students 
describing  the  tests  and  their  purposes,  what  they  do  and  do  not 
measure,  their  reliability,  their  predictive  validity,  the  student's 
performance  relative  to  other  students,  how  scoyes^.g^je  calculated, 
and  when  they  will  be  Reported  to  the  student  and  institutions.  We 
supply  all  this  information  and  more  about  the  SAT  and  achieve- 
ment tests  in  pamphlets  widely  available  to  high  school  students. 
Every  student  registering  for  the  scholastic  aptitude  test  automati- 
cally receives  the  publication  "Taking  the  SAT,"  which  includes  for 
practice  purpoies  a  complete  sample  of  a  real  test,  along  with  an 
answer  key,  explanations  of  questions  and  answers,  and  instruc- 
tions for  timing  and  scoring  the  test.  And  following  j  each  test 
administration,  every  student  also  receives  a  complete  and  careful 
explanation  of  his  actual  sc(^e,  which  i^  sent  only  to  institutions 
designated  by  the  test  talje/ High  schools  and  colleges  all  receive 
periodic!  College  Board  publications  explaining  the  SAT  and  the 
tecnnicfifl  limits  on  the  uses  of  "SAT  scores. 

Mr.  Chairman,  I  wish  to  give  the  committee  for  the  record  a' 
complete  set  of  materials  the  College  Board  voluntarily  provides  to 
students.  But  let  me  tell  you  how  students  respond  to  them. 

[Information  referred  to ^ove  is  retained  in  subcommittee  files.] 

Mr.  Hargadon.  In  a  1977  sample  survey  of  6,000-SAT  takers, 
conducted  by  the  Responsd  Analysis  Corp.,  we  found  that  48  per- 
cent of  students  read  all  orthe  pretest  information,  and  60  percent 
,  tried  to 'answer  all  or  most  of  the  practice  test.  Only  32  percent 
read  a^'or  most  of  the  post  test  interpretive  materials— wnich 
suggests  that  if  we  want  students  to  approach  the  tests  astfa  learn- 
ing exercise— one  of  the  stated  aims  of  the  legislation's  propo- 
nents—opportunities fgr  self-asse6sment  beforehand  are  likely  to  be 
more  effective  than  post  test  disclosure  and  review,  as  called  for  in 
H.R.  4949.  »  , 

The  sole  purpose  of  the  admissions  testing  program  and  the  SAT 
is  to  provide  a  supplemental,  but  'Common  measure  of  ability  for 
secondary  school  students  who  have  taken  different  courses  >  in 
different  high  schools  with  different  grading  pl^actices.  .  - 
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The  waste  of  resources  has  been  si^ificantly  minimized  at  most 
'  colleges  in  this  countrv.  It  used  to  be  colleges  would  take  anybody 
and  plan  to  flunk  out  half  of  their  students  by  the  summer  of  their 
fiifst  year.  This  does  not  happen  when  tests  are  us^d^  as  a  supple- 
mental topi  in  the  admissions  process. 

Over  the  years  there  have  been  charges  that  th^SAT  is  biased  " 
against  this  group  or  thati^group,  wWh  a  low  scorei>eing  the  evi- 
dence of  the  bias.  We  of  the  College  Board  have  of  course  been 
sensitive  to  such  charges,  i  for  it  would  be  a  cruel  anomaly  if  an  > 
asisociation  of  educational  institutions  devoted  to  increasing  access 
to  college  were  in  fact  putjting^  up,  instead  of  knocking  down,  bar- 
riers  to  Jiigher  education.  ;  . 

•  And  so  we  have  sponsored  almost  continuous  research  devotied  to 

*  detecting  and  rooting  out  any  bias  in  our  tests;  and  every  responsi:^ 
ble  evaluation  of  those  tests  for  20  yWs  now  shows  we  have 

,    '    succeeded.  Remember  that  the  SAT's  function  is  solely  to  help 
predict  academic  performance  in  the  first  year  of  college.  So  it 
should  come  as  no  surpriibe  that,  on  average,  students  from  families 
where  ^neither  parent  is  a  high  school  graduate,  and  where  there 
are  no  bools  in  the  house,  aiid  who  receive  poor  preparation  in 
grade  schooTand  in  high  school,  will  not  do  as  well  on  the  SAT  as 
;        test  takers  whose  parents  were  Ijoth  college  graduates,  and  i;he 
father  has  never  been  unemployed,  and  who' have  received  first- 
rate  preparation  ^om  kindergarten  through  the  12th  grade.  The 
SAT  takes  society  as  it  is,  not  as  it  ought  to  be.  If  disadvantaged 
groups  tend  to  ^iichieve  lower  scores,  and  the^  do,  the  sdlution  is  not 
^'•to  sho^ft;  the  /test  administrator,  but  to  do  something  about  the 
causes  of  disadvantage,  and  that  is  exactly  what  your  committee, 
•     Mr.  Ctiairinan,  has  been  attempting  to  do  through  the  Elementary 
and  Secondary  and  Higher  Education  Acts. 

Turiiitig  now  to  the  specific  subjects  of  today's  hearing,  I  want, 
.first  1^  discui^  H.R.  3564,  the  bill  sponsored  by  Mr.  Gibbons.  It 
prohibits  the  giving  of  any  educational  or  occupational  admissions 
y      I  te0t  unless  prescri^d  information  is  pi^vided  the  test  taker  before- 
>,     '  hand  and  unless  other  prescribed  information  is  furnished  on  r^ 
/quest  afterward;  forbids,  grading  such  tests  "on  the  basis  of  the  ^ 
/  relative  distribution  of  scores  of  other  test  subjects";  and  estab- 
"/     lishes  a  right  to  seek  Federal  judicial  relief  for  any'  actual  or 
/      threatened  violation  of  the  proposed  act. 

While  we  are  not^  sure  of  the  technical  meaning  to  be  given  all 
'    the  temis  in  itR.  3564,  to  the  extent  that  our  interpretations  are 
correct,  the  College  Board  already  provides  its  test  takers  with  all 
the  information  called  for  by  the  bill,  with  one  large  exception. 

That  exception  is  the.  bilVs  requirement  that  every  test  taker  bd 
told  the  "score  which  is  generally  required  for  admission  to  ihstitu- 
♦tions  of  higher  education."  There  is  no  such  s(jore.  It  is  simply— 
and  fortunately-^impossible  to  generalize  about  the  diversity  of 
admissions  standards  and  procedures  followed  by  hundreds  of  col- 
leges and  universities  using  results  from  our  admissions  testing 
program.  More  importantly,  the  College  Board  discourages  the  use  ^ 
.\        of  score  cutoffs  or  tjie  use  of  scores  in  isolation  from  a  variety  of 
other  considerations  in  evaluating  candidates  for  admission.  In 
/  .    fact,  one  of  ^ur  major  coiicerns  with  the  Gibbons  bill  is  that  this 
provision  might -focus-4in(Jue  attention  on  objective  criteria  and, 
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therefore,  have  a  chill Ag  effect  on  national  efforts  to  diversify 
student  bodies.  * 

la  sum,  with  the  exception  I  have  noted,  the  passage  of  H.R.  3564 
would  have  no  effect  oii  the  College  Board  and  the  1.5  million 
young  people  who  annually  take  our  tests.  But  I  do  not  want  to 
suggest  that  we  are  indifferent  to  its  enactments 

First,  the  Gibbons  bill  also  affects  every  test  used  "as  part  or  all 
^of  the  basis  for  admitting  or  denying  admission  to  an  individual  to 
ai^y  occupation  in  or  affecting  interstate  commerce,"  and  defines 
test^so  broadly  that  it  necessarilyjhcludes  all  kinds  of  State  licens- 
ing examinations,  frorii  doctor  to  lawyer,  from  plumbejf  to  cosme- 
tologis^,  frbm  real  estate  salesman  to  architect,  and  sofon.  We  are 
unaware  that  a  case  has  been  made,  riiuch  less  offered,  for  Federal 
regulation  qf  occupational  testing  on  the  scale  contemplated  by  the 
Gibbons  bill. 

Second,  even  though  H.R.  3564  in  its  workable  aspects  only  tells 
the  College  Board  to  do  what  it  is  alrqady  doing,  in  our  view 
harmlessness  is  hot  a  reason  for  passing  a  law.  A  bill  that  does  not 
do  anything  is  riot  worth  passing,  but  if  it  does  get  passed,  it 
becomes  the  predicate  for  later  legislative  proposals  mat  will  in- 
deed increase  Federal  control  over  the  doings  of  our  citizenry. 

We  also  urge  you\not  t6  act  favorably  oja  H.R.  4949,  the  Educa- 
tional Testing  Act  of  1979,  sponsored  by  Mr.  Weiss,  Mrs.  Chisholm, 
and  Mr.  Miller;  H;R.\4949  is  far  more  intilusive  than  the  Gibbons 
bill,  for  it  not  only,  directs  the  College  Boai^d  to  do  what  the  Board 
is  already  doing,  but  it.  orders  the  release  of  all  standardized  tests 
shortly  after  the  first  time  they  are  administered,  and  it  puts  the 
U.S.  Commissioner  of  Education  into  the  business  of  regulating  and 
evaluating  college  admissions  testing  programs. 

The  first  substantive  *ftart  of  the  Weiss  bill  is  section  3.  That 
section  prescribes  in  considerable  detail  just  what  a  testing  service  ^ 
must  tell  test  takers  ahedd  of  time.  By  any  reasonable  standard, 
our  pamphlet.  Taking  the  SAT,  which  goes  to  all  test  takers,  meets 
the  requirements  of  seCtiom3.  That  section  demai;ids  som6  informa- 
tion that  does  not  exist,  iot  example,  the  average  score  increase 
obtainable  by  attending  a  coaching  school.  I  think  Mr.  WeiSs  in  his 
earlier  remarks. did  not  ac(^urately  qudte  the  full  FTC  coaching' 
study.  We  still  believe  coachihg  has  iio  significant  effect— but  tech- 
nical pi^oblems  of  that  sort  cOuld  be  corrected  if  the  bill  other?vise 
warranted  passage.  So  our  serious  concern  about  H.R.  4949  does 
not  stem  from  its  section  3.     \  .  ^  ' 

Our  main  concerns  begin  With  section  4.  That  section  requires 
furnishing  the  U.S.  Commissiciner  of  Education  with  research  re- 
ports on  our  tests  and  with  copies  of  anv  servioje  contracts  we  may  • 
have  with  other  testing  organizations.  The  Commissioner  is  given  1 
year  to  prepare  a  report  to  Congress  on  the  relation  between  test 
scores  and  income,  race,  sex,  ethnidt^,  and  hWndicapped  status. 

Obviol|^ly  we  can  have  no  o^jfection  to  the  dissemination  of  re- 
search results  in  connection  with  our  testing  programs,  and  our 
reports  are  alrfeiady  available  to  the  Office  of  Education.  But  We  do 
not  understand  why  the  Congress  should  order  us  to  furnish  the 
Commissioner  witl^  a  copy,  for  example,  of  our  contract  with  the 
Educational  Testing  Service,^  any  idore  than  the  Congress  should 
ask  colleges  and  universities  to  file  with  the  Commissioner  their 


many  cpntracts  with  outside  agencies.  If  the  College  Board  and 
other  testing  organizations  are  to  be  singled  out  in  that  fashion, 
there  should  be  a  clearly  stated  public  purpose  for  doing  so;  and 
there  has  been  none  stated  in  this  instance. 

Section  5  requires  furnishing  the  U.S.  Commissioner  of  Educa- 
tion with  Copiep  of  all  standardised  tests,  plus  the  correct  answers 
and  other  data,  within  30  days  after  scores  on  such  tests  have  been 
released  to  test  t^ers.  The  material  is  specifically  to  be  made 
available  for  public  copying.  Additionally,  any  test  taker  is  to  be 
entitled,  on  reqi^est,  to  receive  a  copy  of  the  test  he  took  plus  his 
and  the  correct  answers.  He  may  be  charged  only  a  nominal,  fete  for 
such  service,  defined  in  the  bill  as  **not  to  exceed_the  marginal  cost 
of  providing  the  information."  The/requirement  of  filing  teats  with 
the  Commissioner,  and  for  sending  tests  and  answers  to  test  takers, 
does  not  apply  if  the  anticipated  number  of  annual  test  takers  for  a 
given  test  is  less  than  5,000.  v 

If  section  S-were  to  become  law,  the  vanbus  te^  sponsored  by 
the  College  Board  could  be  administered  only  once  before  their 
security  was  breached  and  their  validity  destroyed. 

At  present  we  make  the  SAT  available  more  than  20  times  teach 
year,  not  counting  the  dozens  of  individual  one-on-one  adminibtra- 
tions  for  handicapped  studente  who  must  choose  their  own  place 
and  their  own  timel  to  take  the  test.  If  we  are  to  make  public  the 
questions  used  on  these  tests  each  time,  then  the  cost  of  devc^lQping 
tests  each  year  would  necessarily  increase.  Test  disclosure  will 
increase  the  need  for  and,  therefore,  the  cost  of  test  development. 
'  Or  if  the  increased  test  development  costs  are  to  be  restrained, 
the  tradeoff  is.  to  reduce  the  opportunities  for  test  taking  by  the 
student  population.  I  would  like  every  rtudent  to  be  able  to  take 
home  his  test  form;  but  if  the  test  questions  are  to  be  made  availa- 
ble, every  ^^time,  to  those  who  take  the  tests,  'then  the  cost  yfll  go 
up,  and  the  opportunities  for  taking  the  test  will  go  down^  ' 

The  central  question,  then,  is  whether  that  tradeoff  provides  any 
substantial  gain  from  the  standpoint  of  student  interests.  We  be^ 
lieve  it  does  not.  •  f 

It  has  been  the  policy  of  the  College  Board,  throughout  its  his- 
tory, to  make; the  SAT  available  as  widely  as  possible  among  the 
country's  high  school  population  at  the  cheapest  possible  cost  and 
with  the  maximum  flexibfity  to  accommodate  the  special  needs  of 
students.  This  legislation,  proposes  a  different  principle  and  a  dif- 
ferent standard.  It  suggests  that  students  should  bl  preparted  to 
pay  more  or  to  have  teste  less  available  in  order  to  secure  the 
opportunity  of  reviewing  the  test  upon  receiving  their  scores. 

I  know  of  no  educational  argument  for  this,  and  it  is  not  at  all 
clear  on  what  b£|sis  the  proponents  of  this  legislation  reached  this 
conclusion.  Publication  of  test  questiohs  gives  them  undue;  empha- 
sis. Teachers  may  be  asked,  then,  to  "teach  to  the  tests,'' and  this^ 
legislation  will,  in  turn,  have  begun  to  influeitce  the  curriculum. 

We  are  not  certein  at  this  point  whether  the  test  researchers, 
^  technicians,  and  scholars  who  now  jointly  deVelpp  and  valickite  our 
'  tests  would  be  able  to  multiply  the  number  of  test  versions  while 
still  preserving  their  current  high  quality  in  terms  of  reliability 
and  validity.  But  we  are  certein  that  research  and  development 
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costs  would  have  to  rise,  and  that  the  higher  costs  would  inevitably 
.  be  reflected  in  higher  fees  by  all  test  takers^  \ 

Given  the  research  uncertainties  and  the  cost  certainties,  Con- 
gress should  look  long  and  hard  at  whatever  arguments  are  ad- 
vanced in  favor  of  enacting  section  5.  It  is  our  strong  view  that  the 
issue  is  not  yet  ripe  for  a  legislative  decision. 

We  are  also  troubled  to  somej  extent  by  the  constitutional  issue 
lurking  in  sectiqn  5.  After  all,  our  tests  do  constitute  a  valuable 
copyrighted  property  with  a  pr^ictable  useful  life.  The  filing  re- 
quirement of  section  5  would  substantialfy  shorten  that  life,  biit 
the  bill  neither  authorizes  nprjprovides  any  compensation  for  the 
property  it  would  take  away.  T 

Our  final  observation  about  Section  5  has  to  do  with  the  provi- 
sion directing  that  we  may  charge  only  a  ''nominal  fee*'  for  provid- 
ing additional  information  to  test  takers.  We  are,  as  I  have  rioted 
before,  k  nonprofit  association.  As  a  nonprofit  association,  we  pub- 
lish full  financial  statements  each  year,  and  further  detail  is  freely 
available  from  our  treasurer.  The  College  Board  has  neither  endow- 
ments nor  property;  its  revenues  and  expenditures  have  fallen 
within  2  percent  of  each  other  over  the  past  10  years. 

We  have  throughout  our  ^history  kept  our  service  charges  at  the 
lowest  possible  levels  and  we  will  continue  to  do  so.  For  example, 
in  the  academic  year  1978-79  the  charge  for  the  SAT  was  $8.25— up 
'from  $7.25  20  years  ago,  but  less  than  half  as  much  iri  real  terms, 
and  the  fee  is  waived  entirely  for  those,  who  cannot  afford  to  pay  it, 
and  this  was  done  for  32,000  test  takers  last  year  including  all  in 
Upward  Bound  programs.  JL  ^ 

We  do  not  believe  there  is  any  reason  for  the  Congr^s  to  pass  a 
law  regulating  the  charges  we  may  make,  or  mandating  th^t  some 
users  of  College  Board  services  will  pay  less  than  a^ir  ^are  of 
the  costs  of  those  services.  / 

Sectioii  6  prohibits  release  of  test  scores  unless  ^Specifically  Au- 
thorized by  the  test  taker.  The  Buckley  amendmfent  enfcted/in 
1974  contains  a  similar  provision,  but  with  an  exception  permittujK 
carefully  guarded  test  score  disclosures  for  test  validation  purpolR. 
We  suggest  that  the  Congress  does  not  have  to  legislate  again  on 
the  same  subject.  • 

According  to  section  7,  and  "In  order  to  insure  that  tests  are 
being  offered  at  a  reasonable  cost,''  all  testing  organizations  Would 
have  to  file  detailed  revenue  and  expense  information  with  the 
U.S.  Commii?sioner  eyery'year.  Presumably,  the  Commissioner  is  to  / 
make  a  judgment  as  to  whether  the  charges  to  test  takers  are 
reasonable. 

Finally,  the  bill  directs  the  U.S.  Cgmmissioner  to  issue  imple- 
menting regulations  within  120  days  of  enactment,  and  provid^  a 
$2,000  fine  for  any  violation  on  the  part  of  a  testing  organization. 

As  you  know,  the  Gmbjbns  bill  and  the  Weiss  bill  are  not  the  only 
legislative  proposals /With  r^pect  to  the  college  admissions  testitic  ^ 
process.  Califoinia  and  New  York  have  recently  legislated  in  the 
same  field,  and  other  State  legislatures  have  bee^p  asked  to  do  go. 
Most  of  the  publicity  on  tte  subject  has  focused  on  the  questio)a  of 
whether  a  test  taker  should  be  entitled  as  a  matter  of  /rkht  to 
obtain  a  (jopy  of  the  test  he  took.  There  are  arguraepts  oh^oth 
sides  of  that  issue,  and  one  of  the  two  main  points  I  want  Wmake 
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with  you  today  is  that  the  debate  is  not  ready  to  bp  settled.  We 
want  to  support  the  idea  of  test  disclosure,  but  we^^t  also  to  be 
sure  that  we  can  maintain  a  high  quality,  reliable,  and  valid  ad- 
nndssions  toting  program  at  the  least  possible  cost  to  those  who 
take  our  tests.  And  we  want  to  maint€un  a-lpvel  of  services  that 
insures  convenience  to  all  test  takers.  \ 

There  is  not  a  public  emergency  in  dbnnection  with  our  testing 
program  and  no  need  to  legislate  nurriedly  on  the  basis  of  slogans, 
misunderstandings,  and  incomplete  or  inaccurate  facts.  A  good  re- 
minder when  the  term  "public  interest"  is  used,  is  that  there  are 
in  fact  many  pu^ic  interests.  There  is  a  need  to  be  deliberate  and 
prudent  in  legislating  change  of  the  magnitude  contemplated  by 
H.R.  4949.  Cons^uently,  we  urge  that  you  let  this  issue  ferment 
for  a  while  yet,  ^  that  we  can  all  see  and  learn  from  the  experi- 
ence gained  in  connection  with  the  State  legislation  already  en- 
acted, and  so  thelC^llege  Board  and  other  testing  organizations  can 
have  time  to  explore  more  tlwroughly  the  feasibility  and  cost  of  a 
testing  aerogram  that  WOOld  .satisfy  both  the  proponents  of  test 
disclosule  and  the  proponents  of  a  testing  program  that  produces 
reliable  and  valid  results.  • 

]  The  other  main  point  I  wc^t  to  make  is  that  Federal  legislation 
iwith  respect  tonigher  education  is  k  particularly  sensitive  and 
Idelicate  matter.  C>ver  the  yeafe  the  Congress  in  general,  Mr.  Chair- 
man, and  your  committee,  in  parfiiulaTj  have  been  generous  to 
higher  education  in  the  United  States.  But  you  have  also  been 
quite  consistent  n  keeping  the  Federal  Government  out  of) the 
business  of  deciding  what  sh«^ll  be  taught,  how  it  shall  be  taufeht, 
who  shall  teach  it,  and  who  shall  be  taught.  The  bills  we  Have  been 
talking  about  thij.  morning  are  the^sitart  of^ederal  r^ulatipn  of 
college  adiAissions  testing  pro-ams,  Just  one  step  removed  ffom 
Federal]  regulation  of  college  admissions  themselves.  We  at  the 
College  Board  do  not  believe  you  have  thus  far  been  given  a  basis 
for  stpirting  down  that  road.  ^ 

I  thank  you,  Mr.  Chairman.  I  shall  be  glad  te^  answer  questions. 

Chairman  Perkins.  Without  objection,  we  will  defer  questions 
until  we  hear  from  all  members  of  the^anel. 

/ttie  next  witneds  is  Dr.  Walter  Haney,  testing  expert. 

Go  ahead.  Dr.  H|aney.  — 

STATEMENT  OF  DR.  WALTER  HANEY,  TESTING  EXPERT, 
ACCOMPANIED  BY  ALLAN  NAIRN 

Dr.  Haney.  My  name  is  Dr.  Walller  Haney.  I  am  staff  director  of 
the  National  ConsomunL  on  Testing  and  projectjiirector  at  the 
Huron  Institute  oflC&nibridM^  Mass.  I  am  pleased  to  have  the 
opportunity  to  come  b^ore  this  committee  to  offer  testimony  con- 
cerning the  legiAation  embodied  in  the  proposed  Truth  in  Testing 
Act  of  1979  (H.R.  3564)  sp^msored  by  Congressman  Gibbons,  and  th6 

Proposed  Educational  TestW  Act  pf  1979  (H.R.  4949>  sponsored  by 
k)ngres8men  Weis^  and  Muler,  and  Congresswoman  Chisholm.  Let 
^me  "make  clear  that  my  coimnents  this  mbmiig  represent  my  own 
^professional  and  personal  opinion,  and  do  not  neibessarily  reflect 
those  of  the  institutions  with\ which  I  am  affiliated.  Nevertheless,  h 
would  like  to  point  out  that  the  essential  goals  behind  these  propo^*  i 
(  als— namely,  to  increase  publijp  understanding  of  the  strengths  and 
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weaknesses  of  standardizeci  testing  and  assessment  and  to  improve 
•  testing  and  assessment  practices— are  ones  which  prpmpted  the 
;  founding  of  the  National  Consortium  on  Testing  In  1977! 
'  The  role  of  standardized  lasting  irf.  American  education  and  in 
American  society  generally  is  presently  both  highly  prominent  and 
increasingly  precarious.  Testing  has  cl6driy  been  a  growth  industry 
ovet  the  last  two  decades/ It  has  been  tied,  for  example,  to  increas- 
ing public  concern  over  accountability  in  education  and  £o  mush- 
roortiing  government  enthusiasm  for  program  evaluatioi|.  At  the 
same  time,  however,  therd  has  been  increasing  concern  over  the 
shortcomings  and  iir  effects  of  standardized  testing.  The  technical 
rationale  underlying  standardized  tests  is  subject  to  increasingly 
critical  scrutiny.  There  is  g^ovdng  worry  over  the:  distorting  effects 
of  testing  on  educational  goals  and  practices.  Mpre  and  more  peo- 
ple are  becoming  alerted  to  the  misuse  of  test  results  in  labeling 
children  in  unfair  and  discriminatory  manner.  The  two  legislative 
p!roposals  before  this  committee  clearly  reflect  this  increasing  pub- 
lic concern  over  standardized  testing  in  our  society, 

1  Before  commenting  on  the  specific  provisions  of  the  proposed 
legislation  I  would  like  to  interject  a  note  of  caution.  H.R.  4949 
would  require  reporting  of  a  wide  range  of  information  on  tests  and 
test  use  to  the  Federal  Government.  Some  of  these  proposed  re- 
qiiirements  strike  me  as  somewhat  ironic  since  it  is  fairly  clear 
tl^t  substantial  misuse  of  standardized  tests  over  the  last  decade 
has  not  simply  grown  out  of  the  practices  or  ptoliciea^  of  local 
edkicational  instit^Uphs  or  test  publishers  but  has  been  prompted 
in  significant  measure  by  reporting  requirements  of  Federal  and 
Sfcite  governments. 

leaving  expi:essed  that  general  reservation,  let\  me  focus  in  the 
remainder  of  my  remarks  on  what  I  think  may  be  the  most  impor- 
tant aspect  of  the  proposed  legislation — namely,  what  might  be 
called  the  sunshine  provisions  of  H.R.  4949— section  5 — which 
would  require  pid)lic  disclosure  of  test  contents,  and  upon  request, 
return  of  corrects  test  questions  to  individual  test  takers. 

As  I  am  sure  yoii  are  aware,  proposals  for  so-called  open  testing 
have  emerged  recently  in  legislative  initiatives  in  several  States, 
most  prominently  in  legislation  passed  in  New  York  this  year. 

Several  arguments  have  been  advanced  in  favor  of,  and  in  oppo- 
sition to,  snch  open  testing  proposals.  Since  there  is  not  time  today 
to  review  each  'of  these  several  arguments,  let  me  focus  on  what  I  . 
see  as  the  main  issue:  The  primary  argument  in  favOr  of  open 
testing  is  the  proposition  that  as  a  matter  of  simple  justice,  individ- . 
ual  test\takers  have  a  right  to  know -the  exact  manner  in  which' 
they  are  judged,  and  the  details  of  the  assessments- ^vbich  may 
affect  their  educational  opportunities  and  life  chances.  The  main 
arguments  in  opposition  tQ  open  testing,  which  as  far  as  I  can  tell 
,  originate  mainly  from  publishers  and  sponsors  of  currently  secure 
tests,  are  that  open  testing  would  disrupt  qurrent  procedures  for 
developing,  pretesting,  and  equating  tests.  In  part  these  argu- 
ments—that  open  testing  should  be  opposed  because  it  would  dis-  . 
rupt  secure  testing  procedures— strike  me  as  quite  ironic.  It  is  the-^ 
obyiou^ intention  of  the  open  testing  proposals,  to  do  just  that— 
namely,  to  disrupt  current  secure  testing  procedures! 
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Nevertheless^  let  me  deal  with  specifics  of  the  arguments  against 
open  testing.  Arguments  dealing  with  pretesting  and  equating 
tests  ai*e  essentially  irrelevanjt  to  H.R.  4949  since  the  bill's  currerit  ^ 
.  provisions  would,  as  1  unders&uid  it,  allow  for  maintaining  security 

Jith  respect  to  items  which  are  used  solely  fof  the  purposes  6f 
retesting  and  Equating,  and  which  io  not  contribute  directly  to  an 
individual  testftjdcer's  raw  scores.  The  main  argument  against  open 
testing,  apart /rrom  poi^ible  cost  issues,  seems  then  to  be  that  open 
tesi^iflg  would  diminish  the  validity,  rdiability^  and  general  techni- 
/  cal  \quality  o/f  tests  which  would  ^nder  op0n  testing  have  to  be 
developed  esAentidly  anew  for  eacn^est  administr^^^ 

One  critic/of  open  testing,  for  example,  has  asserted  that  "To  use 
materials  from  active  item  pools  *  *  *  would  invalidate  them  for 
future  reu^.'/  *  Such  flat  assertions  of  item,  invalidation  as  neces- 
sarily resultii^g  from  open  testing  are  simply  erroneous.  This  isi 
"  clear  from  the  fact  that  several  sorts  of  test  questions  are  currentlyf 
publicly  available  and  still  can  be  validlfi  used— essay  test  ques4 
tions,  and  publicly  released  items  from  National  Assessment  nom 
being  used  in  seyex^al  State  assessment  programs,  are  just  twa 
I  examples. 

As  a  result,  it  is  hot  appropriate  to  view  the  issue  of  test  vauda- 
tion  as  an  all-orrnothing  issue,  but  rather  to  ihink  in  terms  of  the 
conditions  under  which,  and  the  degree  to  which,  public  release 
Would  result  in  diniii^ished  validity.  I  can,  for  example,  mention 
three  possible  mechanisms  for  developing  tests  which  woiild  allow 
'  for  release  of  correct^  tests  a^ter  administration,  and  would  at  the 
same  time  minimize  threats  to  test  validity: 

First,  reliance  on  test  items  which  directly  measure  relevant 
iskills,  essMy  questions  for  example,  rather  than  indirect  indicators 
of  real  skills  as  is  the  case  with  multiple  choice  items; 
4.      Second/^development  of  item  generating  algorithms,  which  could 
produce  large  numbers  of  items  equivalent  in  terms  of  content; 

And  this  has  been  proposed  recently  by  several  people,  and  that 
*    is:  '  . 

Third,  development  of  large  test  item  banks  from  which  relative- 
^  ly  amaU  samples  of  iten^  could  systematically  be  drawn  so  as  to 
yield  alternative  test  forms.  Essentially  all  I  am  saying  here  is 
there  are  ced»in>  techniques  that  \^ld  be  use^  which  Would  mini- 
mize the  concerns  about  test  validity. 

A  second  perspective  to  which  I  would  like  to  draw  attention 
concerns  the  current  quality  of  secure  tfests.  *  ♦ 

Publishers  and  sponsors  of  such  tests  naturally  now  maintain 
that  the  procedures  for  developing  and  reviewing  their  instri^ents 
help  guarantee  high  quality, 
i  The  Educational  Testing  Service,  for  exanmle,  has  asserted  that 
actual  tests  for  virtually  all  national  testing  programs  are  availa- 
ble for  professional  scrutiny  and  have  been  for  many  years. 

The  Mental  Measurements  Yearbook  is  probably  the  most  fam- 
ous example  of  such  external  professional  review,  which  typically 


i  *  Carmen  Findley  and  Frances  Berdie.  "The  National  Asfiessment  Approach  to  Exercise  Devel- 

\  opment,"  Washington/DC:  Nation^  Center  for  Educational  Research  and  Development^  Oflice 
f       of  Education,  1970.  p.  5.  ^ 
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includes  scrutiny  of  teSt  questions\against  specifications  and  statis- 
tical reports.*  '  i  ^ 

But  I  would  point  out  tnat  in  la  speech  delivered  about  2  years 
ago  at  the  University  of  Iowa  m  Mardh  1977,  Oscar  K.  Euros, 
educator  of  the  Mental  Measurements  Yearbook,  put  forth  a  quite 
contrary  view.  \  . 

He  declared: 

The  information  available  to  permit  an  adequate  assessment  to  be  made  of  these 
secure  tests  Is  quite  unsatisfactory.  Although  our  reviewers  generally  receive  some 
in-house  material,  which  is  not  available  to  other  educators  and  psychologists,  even 
this  material  is  inadequate,^  .  . 

In  short,  the  assertion  by  proponents  of  secure  testing  that  cur- 
rent procedures  for  review  and  disclosure  of  information /on  such 
tests  are  sufficient  to  guarantee  high  quality  test  instru/nents  is ' 
challenged  not  only  by  open  testing  advocates  but!  also  by  the  very 
author  whose  work  has  been  cited  to  bolster  the  assertion. 

In  closing,  let  me  note  that  I  have  not  addressed  several  perti- 
nent issues,  dealing  with  costs  of  open  testing,  test  bias  and  test 
coaching,  for  example.  £ 

There  is  a  great  deal  that  could  be  said  about  these,  bijl  there  is 
really  not  time  for  me  to  communicate  my  thoughts  on  some  of 
these  issues. 

I  would,  of  course,  be  happy  to  answer  questions  on  these  issues. 

My  own  summary  view  is  that  if  ftne  accepts  the  validity  of  the 
proposition  that  individual  test  takers  have  a  right  to  know  the 
basis  on  wljich  they  are  judged  in  matters  that  will  affect  their 
educational  and  life  chances  in  significant  ways,  and  I  would  like 
to  make  clear  that  personally,  I  do,  then  issues  of  test  development 
and  technical  quality  need  not  stand  in  the  way  of  open  testing 
policies  designep  to  implement  that  r^ght.  / 

Thank  you. 

Mr.  Weiss.  Thank  you  very  much.  Dr.  Haney. 
The  next  witness  will  be  Dr.  John  Cooper,  president.  Association 
of  American  Medical  Colleges. 

STATEMENT  OF  DR:  JOHN  A.  D.  COOPER.  PRESIDENT, 
ASSOCIATION  0F  AMERICAN  MEDICAL  COLLEGES 

Dr.  Cooper.  Thank  you  very  much,  Mr.  Weiss. 

As  you  kffow,  the  association  is  a  nonprofit  educational  organiza^ 
tion  whose  membership  includes  all  125  medical  schools  in  the 
United  States,  their  teaching  hospitals,  representatives  of  their 
student  bodies  and  faculty  organizations,  including  all  medical  col-_ 
lege  admission  deans.  f 

The  association  sponsors  the  new  medical  college  admission  test, 
flew  MCAT,  on  behalf  of  and  under  the  surveillance  of  its  member 
schools^  Canadian  medical  schools  and  American  osteopathic  medi- 
cal schools  have  elected  to  also  make  use  of  the  test. 

Mr.  Chairman,  the  legislation  you  are  consicflring  today  is  uqj[vrit- 
tingly  consistent  .with  a  nationwide  effort  by  some  to  eliminate  or 
emasculate  standardized  testing.  This,  philosophy  is  sapping  the 
quality  of  education  in  this  country  at  all  levels. 


•Educational  Testing  Service.  "Memorandum  of  Opposition  [to  th6  1978  Lavalle  bill]."  Undat- 
ed [1978],  \\        >  » 

» Oscar  Bur^.  "Fifty  Years  in  Testing:  Some  Reminiscences,  Criticisij^s  and  Suggestions, 
JWiico/iono/ i?e«eoiT/ier,  July-AugU8H977,  p.  14.  '  ^ 


It  results  in  inflated  grades  and  leaves  many  high  school  gradu- 
ates functionally  illiterate.  The  strength  of  this  country  \Jill  not  be 
maintained  by  marching  to  their  deceptive  banner,  truth  m  testing. 
We  should  embrace  the  more  worthy  concept  of  truth  in  education 
which  standardized  testing  fosters. 

We  cannot  speak  for  the  effects  of  the  two  bills  on  general 
standardized  tests  such  as  cpllege  boards,  and  American  college 
.    testing  (ACT)  assessment.  However^  as  Mr.  Perkins  surmised,  we 
can  state  that  your  bill,  H.R.  4949,  the  Educational  Testing  Act  of 
1979,  we  believe,  is  more  intrusive  and  poses  a  serious  threat  to 
highly  specialized  tests,  such  as  the  new  MCAT. 
K  '    It  makes  allegations  about  standardized  testing  that  are  not 
-r-^^  consistent  with  the  situation  for  the  new  MC^T.  It  indicts  the  new 
MCAT  oif  the  basis  bf  suspicions  about  very  different  tests. 

The  association  has  no  quarrel  with  the  stated  purpNMes  of  the 
bill,  but  objects  seriously  to  the  way  in  which  these  goafe  are  used 
to  justify  what,  in  our  view,  is  unnecessary  and  counterproductive 
regulation  of  highly  differentiated  tests  such  as  the  new  MCAT. 

Indei,  section  2(b)  of  your  bill  could  well  have  been  derived 
'from  the  test  objectives  and  guidelines  for  the  development  and 
'  implementation  of  the  new  MCAT  examinations. 

In  my  testimony  I  intend  to  describe:     ,/  v 
Bffw  we  insure  test  subjects  and  those  who  utilize  te^t  resul^are 
\    ^made  fully  aware  of  the  characteristics,  prbper  uses  and  limi||B6ns 

of  the  test  (purpose  1  in  section  2(b));      /  j  , 

J.        How  we  make  available  extensive  public  infonnation  regarding 
r      the  procedures  for  development  and  administration  of  the  new 
MCAT  (purpose  2);  /  ai  i 

How  the  public  interest  is  protected  through  promotion  of  kriowl- 
eflge  about  the  proper  use  of  the  new  MCAT  and  the  multiple  steps 
'  we  take  to  assure  accuracy,  validity,  and  reliability  in  <he  develop- 
ment, administration,  and  interpreta^on  of  the  test  results  (pur- 
pose 3). 

The  committee  is  undoubtedly  aware  of  the  jMsociation  s  decision 
to  discontinue  administration  of  the  new  MCAT  examination  iii  the 
f  State  of  New  York  after  January  1980  under  the  requirements  of 
the  recently  enacted  law  in  the  State.  \ 

Our  opposition  to  this  bill  coniBs  only  after  long  and  careful 
consideration  of  its  impact.  In  our  judgmeiit,  the  impact  of  the  New 
York  law  and  these  bills  as  currently  structured  seriously  affect 
V    '  our  ability  to  maintain  the  integrity,  high-quality,  and  usefulness 
of  our  examination  as  one  criterion  in  the  highly  complex  process 
^\  for  evaluation  of  medical  school  applicants. 
^  This  admissions  process  must  assure  equity  for  the  applicant,  but 
this  is  not  all.  It  must  select  candidates  capable  of  attaining  the 
higft\level  of  spientific  undersfcE^ding,  human  ^compassion,  and 
clinical  perforniance  that  makes  them  worthy  of  the  trust  and 
confiden^ce  that  all  citizens  have  a  right  to  expect  in  their  personal 
physicians.  ^ 

The  principal  but  not  the  only  destructive  provision  of  H.R.  4949 
is  the  requirement  Ahat  a  copy  of  the  examination  and  correct 
answers  be  disclosed^fter  each  ttdministratlon  of  the  test. 


Our  problem  vni^  this  provision  is  that  test  item  specifications  to  . 
assure  relevance,  validity  and  accuracy  impose  major  restraints  for 
a  test  like  the  new  MCAT. 

These  specifipations  were  developed  by  a  very  extensive  effort 
which  began  ih  1972  and  cost  the  association  almost  $1.5  million. 
The  initial  step  in  this  program  was  the'  forging  of  consensus 
among  medical  school  deans,  admission  officers,  minority  affairs 
pflicers,  medical  school  faculty  and  students,  practicing  physicians, 
premedical  advisens  and  faculty  of  undergraduate  colleges  about 
the  desired  features  of  the  test  through  national  and  regional 
meetings.  -        '  , 

Each  group  presented  ite  own  independent  views  on  the  objec- 
tives to  be  achieved  in  a  revision  of  the  then  existing  MCAT  test 
and  the  characteristics  of  an  examination  that  would  most  nearly 
achieve  those  goals. 

A  3-day  conference  of  reprea^entatives  from  these  groups  provided 
a  forum  to  consider  vq^ous  viewpoints  and  perspectives  and  devel- 
op a  master  plan  for  proceeding  with  the  revision. 

The  master  plan  served  as  a  guideline  for  a  2^-year  effort, 
undertaken  under  contract  and  supervised  by  two  AAMC  appoint- 
ed advisory  committees,  one  made  up  of  representatives  from 
groups  involved  in  the  initial  consensus  development  arid  the  other 
pf  experts  in  the  field  of  testing. 

It  was  not  to  be  an  aptitude  test  which  Mr.  Weiss  seemed  con- 
cerned about.  It  was  to  consist  of  individual  sections,  devoted  to 
biology,  .chemistry,  and  physics,  each  designed  to  measure  both  the 
level  of  knowledge  achieved  in  these  disciplines  by  studente  and 
their  ability  to  apply  this  knowledge  in  problem  solving- 

Evaluation  of  problem  solving  ability  in  applicante  is  not  only 
valuable  because  it  is  an  important  attribute  of  the  physician,  but 
it  also  provides  an  insight  into  the  native  abilities  of  studente 
beyond  their  store  of  memorised  facte.  ^ 

The  content  of  the  questions  was  to  be  limited  to  those  areas 
considered  particularly  relevant  to  medical  education  and  medical 
practice  and  to  material  covered  in  first-year  college  courses  in  the 

suWecte.  I  / ,   ,    .  V 

These  are  the  restrictions  which  we  mamtem  severely  limit  the ' 

number  and  rate  of  development  of  test  questions,  not  as  Dr. 

Haney  fsaid,  because  of  the  problems  of  evaluation  or  equating^ 
Appendix  I  .  shows  the  high  correlations  obtained  between  the 

views  of  v§irious  groups  of  judges  on  the  criteria  esteblished  for  He 

teste.  » 
[Appendix  I  referred  to  follows:] 
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Dr.  Cooper.  From  the  specifications  developed  for  the  test  item, 
an  extensive  process  is  followed  in  preparing  questions: 

First,  they  are  written  by  faculty  experts  from  the  fields  of 
biology,  chemistry,  and  physics;  \        t  ^ 

Second,  they  are  reviewed  by  test  editors;*" to  assure  *that  they 
meet  specifications  for  relevance  and  level  of  difficulty; 
-  Third,  they  are  evaluated  in  developmental  try-out  tests  involv- 
ing small  representative" groups  of  students  who  not  only  answer 
questions  but  write*  their  impressions  of  each  question,  paying  spe- 
cial attention  to  potential  ambiguiMes  and  biases  and,  after  a  group 
discussion,  they  present  their  findings  to  our  test  editors. 

They  are  then  submitted  to  a  test  cojnmittee  for  review  of  rel- 
evance, accur&cy  and  lever  of  difficulty.  They  undergo  a  field  trial 
as  a  part  of  a  regularljjgiiKU^  MCAT  examination 

where  the  ^(hswers  are  rmFiSSs^  arriving*  at  the  reported  scores 
of  th^  candidates  but  toll^ther%alaate  levels  difficulty  of  the 
questlions  and  determine  b|i^^  un- 
detected problems,  inxjluding^M^ity  or  bias. 

It  is  only  after  this  v^y  'ejJrensive  program  which  occupies  18  to 
24  month?  to  develop  and  vdidate  questions  that  they  become  a 
scored  element  in  the^niBwMCAT  test 

We  have  also  developed  at  each  test  center  a  procedure  under 
which  students  takir^  the  test  are  abjie  to  bring  to  the  attention  Of 
proctors  any  concerns  they  have  about  particular  test  questions. 

The  proctor  has  immediate  access  to  the  national  coordinating, 
center  for  the  test.  Students,  are  also  encouraged  to  write  about 
their  concerns  and  criticisms  of  the  test  and  their  comments  are 
carefully  considered.  a  m 

I  apologize  for  this  detailed  description  of  how  the  nevf  MCAT 
was  developed  and  implemented.  I  thought  it  important  for  you 
arid  your  colleagues  on  the  committee  as  you  seek  'Truth  in  Legis- 
lation'' iand  truth  about  the  possible  differences  between  the  new 
MCAT  and  more  general  standardized  tests. 

I  cannot  speak  for  all  standardized  tests*  but  the  proposed  legisla- 
tion is  fatally  inconsistent  with  the  establishment  and  administra- 
tion of  this  test.  J- 

There  are  many  safeguards  to  assure  the  accuracy  of  the  grading 
"procedure  and  we  a  have  great  confidence  in  the  system  that  we 
have  put  in  place.  However,  any  student  concerned  about  the  grad- 
ing procedure  may  request  a  separate  hand  grading  of  their  answer 
sheet.  If  questions  persist,  they  are  offered  an  opportunity  to  per.:, 
.sonally  observe  a  third  grading  procedure.  %  - 
\  From  its  very  inception,  the  new  MCAT  was  designed  to  provide 
maximum  information  ta  students  well  in  advance  of  the  test.  The 
new  MCAT  manual,' available  for  $3.25,  provides  studehte  precise, 
specifications  for  the  subject  matter  to  be  covered  in  thrlee  areas 
tested,  biology,  chemistry,  and  physics,  the  level  of  difficulty,  first- 
yeai^  college  courses,  and  the  description  of  the  types  of  tept  items 
V  used  and  the  rationale  of  their  selection.   ^  •  ' 

The  manual  walks 'students  through  approxiniatiely  80  sample 
questions.  Finally, ^n  illustrative  test  of  over  200  questions  permits 
students  tto  evaluate  their  level  *of*prep?iration  without  the  need  to 
enroll  in  a  proprietary  Course.  ,        .         ^  .  * 
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^. "  ,  One  of  the  couqerns  identified  in  H.R.  4949  is  the  appropriate  use 
.  ahd  jamitati^s  of  standardized  tesfe.  The  only  way  we  can  see  lhat 
the  addresses  wiis  i$gue  is  to  destroy  the  enormous  usefulness 
of  a  ^Jlgtily  spebialltest,  stich  as  the  new  MC AT  .  test,  through  its 
disclosure  provisioil  and  cause  them  to  be  abandoned  by  medical 
schbol' Emissions  committees.     ^  ' 

We  have  an  extensive,  systemmatic  program  ta  inform  and  edu- 
cate those  using  the  test  results  on  the  limitations  and  appropriate 
^  \ftpplication  of  the  new  MCAT.  Detailed  technical  ^nd  practical 
•  information  is  set  out  in  the  new  MCAT  interpretive  manual  pro- 
^>4ided  to  all  medical  school  admisisigns  officers. 
9  Tin  addition,  annual,  regional,  and  national  workshops  are  held 
with  admission  officers  and  admission  committee  members  to  in- 
.    form  them  about  the  characteristics-^  and  projier  usejjf  the  exami- 
nation. These  workshops  also  provide  for  exchange  of^expefiences 
and  information  of  those  using  and  preparing  the  test. 

To  the  extent  that  there  are  concerns  that  the  new  MCAT  is  the 
only  criterion  for  admissions  decisions;  let  me  reassure  the  cdrnmit- 
tee,  ■ 

In/ a  separate  s^idy  at  the  University  of  Washington  on  admis- 
sions process  by  HambUrgh,  and  others— Journal  of  Medical  Educa- 
tion, voL  46,  No.  il— the- reference  is  given  that  new  MCAT  test 
results,  premedical  grades,  interview  ratings  and  letters  of  reconj- 
mendatiori  from  uridergraduate  faculty  members  are  given  approxi- 
mately equal  weight  in  medical  school  admissigni^  decisions.  ' 

Examination  of  MCAT  scores  of  applicants  gfccepted  to  medical 
schools  is  consistent  with  these  findings.  Between  25  and  30  per- 
cent of  applicants  scforing  in  the  fouf  highest  levels  of  the  various 
.  MCAT  subtesta;  that  is,  those  with  scores  from  12  to  15  on  the  15- 
point  scale  which  has  a  mean  of  8,  fail  to  gain  entrance  to  any 
medicial  school. 

On  the  other  hand,  between  9  and  13  percent  of  applicants  with 
scortes  in  the  four  lowest  levels — that  is,  scores  from  1  to  4— are 
j  admjtted.  . 

j  If  the  quality  of  the  new  MCAT  is  so  compromised  by  Govern- 
I,  ment  intrusion  that  it  is  no  longer  of  value.  What  are  the  alterna- 
tives for  choosing  among  applicants?  >Jh^ 
.  Shoum  adnfiissions  decisions  be  based  on  grades  wrned  in  Oollege, 
grades  that  vary  with  the  individual  standardsipf  »e  professor,  the 
difficulty  in.  content  of  courses  at  the  same^lewls  in  different 
institutions,  on  the  caliber  Of  other  students  in  the  class,  oo  the. 
system  of  evaluation  used  by  the  institution;  on  the  course  load  the 
student  is  carrying,  on  the  extent  of  his  outside  work,  and  so  on? 

If  for  these  reasons  unt^rgmduate  grades  are  considered  imper- 
fect criteria,  should  admissions  decisions  depend  only  orj  subjective 
.  impressions  of  creaflvity,  judgment,  determination,  capacity  for 
growth  or  idealism? 

Should  the  choices  rest  with  the  letters  of  recommendation  ar- 
ranged  by  the  applicant?  ^ 

It  does  not  ri^quire  long  exiperiencfe  on  an  admissions  committee 
to  conclude  that  the  only  defensible  strategy  to  fulfill  one's  respon- 
sibilities to  the  medical  school,  to  ail  applicants,  and  to  the  welfare 
of  the  public  is  to  iree  a  mosaic  of  all  of  the  available  criteria  of 
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which  standardized  testing  Is  an  important  one,  in  the  selection  of  / 
students.  '       \  '     .  .  I 

Since  the  new  MCAT  taps  so  wide  a  range  of  knowledge  ancl 
attributes  important  in  the  stbdy  of  medicine,  it  serves  as  a  valuia- 
ble  diagnostic  indicator  of  the  institutional  resources  that  would  h^ 
needed  to  support  a  candidate  to  become  a  well-trained  physi^^an 
should  that  candidate  be  admitted.  \  * 

This  is  especially  important  in  planning  programs  for  those  \yltl^ 
educationally  disadvantaged  backgrounds,  and  we  are  proud  of  tlie 
success  of  the  medical  schools  ixi  maintaining  those  students  in 
school  and  gi'aduating  them. 

It  is  claimed  in  the  introductory  remarkiS  to  H.R.  4949  that 
proprietary  preparatory  courses  use  questions  from  previously  ad- 
ministered tests  as  a  part  of  their  review  program.  No  evidence  to 
verify  such  rumors  ttias  been  obtained  by  enrolling  knowledgeable 
MCAT  personnel  in  these  courses. 

I  would  also  like  to  note  here  that  our  information  from  ques- 
tionnaires to  students  indicate  that  almost  the  same  percentage  of 
minority  candidates  take  proprietary  MCAT  preparation  course  as 
white  candidates.  '  \       '  ' 

A  major  issue  is  also  made  about  the  relationship  between  paren- 
tal income  and  standardized  performance.  If  test  performance  can 
be  expected  to  relate  to  educational  opportunity  and  if  educational 
opportunity  is  related  to  parental  income>  the  relationship  is  not 
surprising. 

The  new  MCAT  test  does  not  correct  inequalities  in  premedical 
education,  but  it  does  furnish  an  objective  basis  to,  call  for  educa- 
tional reforms  that  will  equalize  this  opportunity.  ' 

For  ei^ample,  it  is  not  possible  to  consn-uct  remedial  programs 
unless  a  reliable  indication  of  baseline  knowledge  is  established. 
Those  who^  purposely  or  inadvertently  promote  elimination  of 
standardized  testing  are  burying  their  heads  in  the  sand,  putting 
the  blame /in  the  wrong  place,  and  aiding  and  abetting  the  estab- 
lishment of  false  standards  and  the  continuation  of  inadequate 
preparation  for  educationally  deprived  young  people. 

H.R.  4949  also  charges  that  bias  is  inherent  in  standardized  tests. 
For  the  new  MCAT,  it  is  difficult  to  understand  how  the  universal- 

'  ly  accepted  facts  of  biology,  chemistry  and  physics,  or  their  applica- 
tion in  problem  solving,  can  be  biased  oh  any  social  designation, 
whether  it  be  racial,  sexual,  or  political. 

The  Russians  tried^to  injett  a  political  bias  into  genetics  with 
disastrous  results  for  Soviet  genetics  under  the^state-approyed  Ly- 
senko  doctrine.  However,  we  are  sensitiv^  to  the  possibilities  or 
cultural  bias  and  have  consistently^  maintained  an  extensive  review 
of  all  test  materials  by  minorities  and  woihen. 
.  An  analysis  of  pretest  questions  for  bias  has  been  an  important 

^'part  of  question  development.  Furthermore,  performance  charac- 
teristics oiF  different  groups  of  examinees  has  been  re^larly  pro- 
vided to  admissions  officers  as  a  part  of  .the  prograrp  of  information 
designed  to  enhance  proper  use  of  the  test. 

-  The  last  sections  of  H.R.  4949  specify  various  financial  disclosure, 
requirements.  We  believe  that  the  schedule  of  fees  for  the  new 
MCAT  that  now  requires  a  full  day  of  testing  Is  reasonable  and 
justified  on  the  basis  of  the  services  provided. 


,\Our  fee  structure  is  refularly  reviewed  by  our  executive  council, 
a'Wiy  with  representatives  of  the  deans,  faculties,  hospital  direc- 
tors, and  medical  students.  They  concur  in  the  establifhment  of  all 
fees.  V 

Though  we  oppose  the  passage  of  legislation  regulating  standard- 
ized testing  unless  there  is  a  much  clearer  denionstration  of  need 
to  extend  Government  regulation  into  this  area,  we  Tiitd  H,R.  3564 
less  objectionable. 

•  The  prohibition  of  developing  test  sc6res  based  on -the  perform* 
ance  of  other  test  subjects  causes  us  very  significant  problems. 
Unfortunately,  this  denies  admii^sion  committees  flexibility  in  re- 
lating their  criteria  to  the  pool  of  applicants  under  consideration. 
,  As  we  interpret  the  tests,  our  yieWs  are  slightly  change^  by  the  ' 
^testimony  this  morning  and  colloquy  between  Mr.  Gibbons  and  Mr, 
Groodling.  There  is  also  a  judicial  perception  that  applicants  with 
highest  qualifications  on  the  full  range  of  criteria  should  receive 
strongest  consideration  ifi  medical  school  admissions  decisions. 

In  view  of  o«ir  careful  assessment  of  the  legislation  you  have 
under,  cpnsideration,  we  strongly  urge  that  this  conimittee  not 
report^favorably  pn  either  H.E.  4949.  or  H.R.  3564.  ^ 

Altern4ively,  the  committee  should  provide  an  exception  for 
.  highly  specialized  tests  such  as  the  new  MCAT.  We  believe  that  the 
Cpit^ess  will  be  greatly  assisted  in  considering  this  complex  issue 
by  the  findings  and  recommendations  of  a  niajor  study  cUrrentlv 
undei:;way  by  the  National  Academy  of  Sciences-National  Research 
^Councirs  Committee  on  Ability  Testing. 

'  We  are  certain  tHat  the  report  of  this  prestigious  and  impartial 
panel  will  provide  valuable  insights  into  standardized  testing. 

Thank  you  very  much. 

Mr.  Weiss.  Thank  you  very  much. 

Our  next  witness  is  Mrr  Robert  J.  Solomon,  executive  vice  presi- 
dent, E^ducational  Testing  Setyice. 

'      ■    •  *  ■      /.        ■      ■      •  . 

statement;  of  R06EBT  J,  SOLOMON,  EXECUTIVE  VICE  PRES-. 
IDENT,  ACTlNiG  PRESIDENT,  EDUCATIONAL  TESTING  SERVICE 

Mr.  Solomon.  Mr.  Chairman,  my  name  is  Robert  J.  Solomon.  I 
serve  as  executive* vice  president  of  B*ic^ttional  Testing  Service, 
where  I  have  worked  in  various  positions  for  over  25  years. 

I  came  to  ETS  from  a  career  as  a  school  and  college  teacher  of 
histofjrand  social  studies  in  New  Yotk  City.  ^ 
'    My  first  job  at  ETS^Was  tn^t-deyelopment,  and  I  helped  devel- 
op teS^  used  in  college  and  postgraduate  admissions^ 

I  am^  grateful  for  this  opportunity  tp  ta}k  to  ym  today ^l^out^ 
further  proposedxhanges  In  tfesting.  ■  * 

We  ^a^e  submitted  written  t^timony  with  attachments.  I  wel- 
come this  opportunity  to  make  sohie  additional  remarks. 
M  should  first  like  to  summarize  the  position. 'Of  ETS  regarding  . 
the  legislation  that  is  being  proposed, 

*  The  proposed  legislation  reflects  the  legitimate  concerns  of  stu- 
dents, parents,  educator^,  ajid  all  i:hose  ijiterested  in  educational 
policies  and  practices.  We  are.  sympathetic  to  those  concerns  and 
undei*i3tand  the  rieed  to  respond  to  them.       •  ^ 

We  believe  thal^  m  the  past  few  years  We  have  responded  in  some  . 
measure  to  the  cp'nQerns.  The  discussion  and  debate  stimulated  by 


B7  ■  I- 


78 


proposed  legislation  in  some  States  and  in  the  Congress  indicates, 
however,  that  more  needs  to  be  done.  We  are  prepared  to  do  more. 

We  do  not  believe,  hpwever,  that  there  is  a  convincing  case  for 
Federal  legislation  at  this  juncture.  The  introduction  of  new  ele- 
merfts  of  contr^  over  education  should  not  be  undertaken  without 
utmost  pa  utioEL 

'  Some  provisions  of  the  proposed  legislation  will  create  serious 
problems  that  will  affect  negatively  the  quality,  cost,  and  services 
of  testing  programs.  We  recommend  several  actions  that  the  Con- 
gress, the  higher  education  community,  and  the  testing  agencies 
should  first  consider.       '  '  ^ 

We  hbpe,  and  we  are  prepared  to  initiate  constructive  efforts  to 
address  and  resolve  the  issues  with  which  we  are  all  concerned, 
including  disclosure  of  the  contents  of  major  admissions  tests  inso- 
far as  we  are  able  within  the  interrelated  constraints  of  quality, 
service,  and  cost,  v^e  hope  time  and  events,  including  our  actions, 
demonstrate  that  Federal  legislation  is  unnecessary: 

Legislation  recently  enacted  in  the  States  of  California  and  New 
York,  and  legislation  newly  proposed  by  Congressman  Gibbons  of 
Florida,  H.R.  3564,  and  Congressman  Weiss  of  New  Ybrk,  H.R. 
4949,  have  stirred  a  good,  deal  of  public  discussion  about  the  respon- 
sibUities  to  students*  of  testing  organizTations  such  as  ETS  and^  the 
colleges  they  serve.  / 

'  Many  things  have  been  said  in  the  heat  of  debate  by  critics  of 
testing  tliat  are  untrue  or  misleading,  arising  no  doubt  from  misun- 
derstanding about  a  complex -subject  too  little  understood  by  the 
public  at  large. 

The  main  concern  of  ETS  in  this  debate  is  to  assure  that  those 
who  may  make  legislative  decisions  about  testing  understand  the 
probable  impact  of  those  decisions  on  students,  on  educational  in- 
stitutions, and  especially  on  the  capability  of  testing  organizations 
to  maintain  the  qtmlity  of  the  tests  themseiSves.  .  '  \ 

Educationaf  tests,  especially  today  when^^rade  inflation  and  lack 
of  consistency  in  gradix^g  st^indards  from  sc^hool  to  school  are  wide- 
spread, constitute  very  important  instfumepts  for  maintaining  the 
quality  of  educ^itipnal  programs.  In  an  effort  to  increase  the  infor- 
mation about  tests  availafile  to  students,  a  goal  \ye  a^ETS  share, 
we  must  also  be  careful  not  to  damage  the  quality  /of  tests  and^ 
related  educational  standards. 

It  is  our  hope  that  open  discussion  of  many  aspects  of  testing  will 
dispel  some  of  the  misunderstandings  about  testing  and  that  out  of 
such  discussions  as  these  new  initiatives  can  be  planned  in  aji 
atmosphere  of  cooperation  and  problem  solving  which  will  benefit 
all  parties  concerned,  students  colleges  and  developers,  of  tests. 

0(ie  source  of  misunderstanding  is  the  relationship  of  ETS  to  the 
testing  programs  we  g^dmipister.  These  relationships  are  important 
•  in  order  to  understand^ the  context  within  which  this  testimony  is 
offerei^.  Virtually  all  of  the  admissions  testing  and  related  services 
conducted  by  ETS  are  done  so  under  agreement  with  organizations 
such  as  the  CfoUege  Board  and  the  Law  School  Admission  Council. 
[See  attachment  1  for  summaries  of  College  Board  ai^d  Law  Schoo] 
Admission  contract'.]  ,  ; 
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Each  of  thiese  policy  grouffe  is  representative  of  the  educational 
constituency  it  serves.  These  membership  organizations,  their  proc- 
esses of  election  and  their  governance  are  independent  of  ETS. 

The  decision  to  Use  ETS  services  rests,  in  each  instance,  with  the 
educational  institutions  and  their  representatives.  Moreover,  the 
ultimate  judgment  of  tl^  qua  ity  and  utility  of  testing  programs 
rests  with  the  educational  comftiunity  that  uses  the  services. 

On  a  day-to-day  basis,  ETS  as  operationally  responsible  for  the 
development  of  tests  for  these  client  groups,  and  for  the  adminis- 
tration of  tests,  scoring  the  answers,  and  reporting  the  scores.  In 
addition,  ETS  undertakes  research  and  development  necessary  for 
the  Qveati&n  of  vcdid  and  reli^ible  tests,  and  the  writing  and  produc- 
tion of  most  but  not  aU  proglram  publications. 

Although  ETS  staff  mav  provide  ^information  and  advice  on  mat- 
ters under  consideration  by  these  policy  groups,  final  decisions  are 
made  by  them.  For  these  reasons,  I  can  speak  for  ETS,  but  I  cannot 
speak  for  the  independent  bodies  we  serve,  whose  policies  are  de- 
termined by  them. 

ETS  is  not  only  accountable  to  its  client  groups,  but  is  also 
ultimately  responsible  to  a  board  of  trustees  drawn  largely  from 
the  leadership  of  the  educational  community.  [See  attachment  2J 
We  have  provided  a  list  of  those  trustees  for  the  last  5  years. 

This  body  provides  oversight  for  the  activities  of  the  organization 
and  is  a  qritical  source  of  external  direction  and  advice.  > 

ETS  was  established  by  the  educational  community  about  30 
years  ago  as  a  nonprofit  organization  to  serve  education  in  the  field 
of  testing  and  research.  However,  its  roots  go 'back  to  the  turn  of 
the  century  when  the  College  Board  was  first  formed  in  1900.  The 
situation  that  then  confronted  students  was  chaotic,  each  college 
had  its  own  entrance  examination,  often  covering  different  subject 
matters. 

The  development  of  a  uniform  system  of  college  entrance  exami- 
nations did  much  to  bring  order  out  of  chaos  and  extend  freedom  of 
choic^  for  students.  *  ' 

The\  ensuing  emergence  of  standardized  tests  designed  to  assess 
fundamental  outcomes  of  education,  such  as  reading  comprehen- 
sion, vjerbal  reasons,  and  mathematical  ability,  such  as  the  College 
Board's  scholastic  aptitude  test,  helped  to  advance  two  broad  social 
goals,  both  of  which  were  realized  to  a  remarkable  degree  b^n- 
nipg  in  the  1930's  and  1940's: 

First  the  enrollment  of  students  from  secondary  schools  un- 
known to.  the  colleges,  enabling  colleges  to  broaden  their  student 
b^ies  eventually  to  include  an  economic  and  social  mix  unprec- 
edented in  American  higher  education,  and; 

Second  the  development  of  the  comprehensive  high  school,  free 
from  the  narrow  tyranny'  of  the  traditional  college  preparatory 
curriculum,  and  organized  to  offer  a  wide  range  of  programs  to 
students  of  diverse  backgrounds  and  interests. 

In  the  1940's  and  1950's,  the,  national  testing  programs  developed 
for  various  -membership  associations  were  designed  f)rima]||^y  as  a 
means  of  helping  colleges,  universities,  and  proiessional  schools 
make  the  best  possible  match  between  the  mstitutiorr  and  the 
students  who  sought  admission.  The  design  of  programs  at  that 
tiln0  refiectied  the  prevailing  view  th^t  educational  decisionmaking 
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was  primarily  an  instihitional  prerogative  in  which  studenXs  them- 
selves had  relatively  little  voice. ,  \  ( 

The  1960's  and  1970's  haye  seen  a  reevalution  of  traditional 
institutional  altitudes  resirding  the  role  of  students  and,  addition- 
ally, major  changes  in  admissions  testing  and  related  services.  It 
was  only  25  years  ag(^,  for  example,  that  the  membership  of  the 
College  Board  voted  to  provide  scores  on  the  SAT  to  students. 

In  the  past  decade  particularly,  there  has  been  a  remarkable 
increase  in  the  quality  and  quantity  of  information  available  to 
students  about  admissions  tests, 

For  example,  full  copies  of  rec^t  forms  of  each  of  the  major 
admissions  tests  that  ETS  develops  are  routinely  made  available  by 
sponsors  of  testing  programs  to  students,  and  we  have  submitted 
copies  of  the  College  Board,  Law  Sehool  Admission  Council,  Gradu- 
ate Management  Admissions  Council,  and  the  Graduate  Record 
Ej^amination  Board.  [Attachment  3  has  been  placed  in  Subcommit- 
tee files.]  '     .  . 

Indeed,  our  goals  and  those  of  the  sponsors  of  the  tests  have  been 
threefold: 

One,  to  increase  the  flexibility  and  ease  with  which  students  and 
institutions  can  obtain  needed  testing  services  and  related  informa- 
tion; ^  ' 

Two,  to  provide  more  and  better  services  tailored  to  the  diverse 
needs  of  special  groups  of  students.  ^ 

For  example,  tests  in  Braille  and  large  type  for  visually  handi- 
capped students,  special  administrations  of  tests  for  students  whose 
religious  beliefs  preclude  Saturday  attendance,  and  special  admin- 
istrations of  tests  on  military  bases  for  Servicemen. 

Also,  you  will  be  pleased  to  know  over  the  past  25  years  the  fees 
for  SAT,  GRE,  LSAT  and  GMAT  have  increased  typically  only 
about  47  percent,  as  contrasted  to  a  191  percent  increase  in  the 
Consumer  Price  Index  for  the  same  period.  [See  attachment  4.] 

The  record  of  ETS  attests  to  its  commitment  to  the  goals  which 
underlie  the  intent'  of  laws  recently  enacted  in  California  and  In 
New  York,  and  the  bills  introduced  into  the  House  by  Congressmen 
Weiss  and  Gibbons. 

We  do  provide  a  broad  array  of  information  to  students  about* 
tests  and  their  appropriate  uses.  Dozens  of  publications  are  made 
available  to  students,  schools,  and  colleges  which  contain  most  of 
the  information  called  for  in  these  bills.  |  , 

We  take  scrupulous  care  to  see  that  the  construction '^nd  admin- 
istration of  tests  are  fair,  reliable,  valid,  and  unbiased. 

We  respect  the  rights  to  privacy  of  individuals,  and  have  devel- 
oped very  detailed  procedures  for  insuring  the  confidentiality  of 
data  retaiflBd  ii)  pur  operational  and  research  files. 

Nevertheless,  we  have  in  the  past  opposed  bills  such  as  the  one 
recently  enacted  in  New  york  because  many  of  their  special  provi- 
sions could  inadvertently  compromise  these  goals  or  otherwise  un- 
dermine the  quality^of  the  testing  programs. 

However,  I  do  not  wish  to  be  misunderstood.  ETS,  working  tor- 
gether  with  the  test  program  /sponsors,  will  make  every  effort  to 
comply  ^vith  the  provisions  of  the  legislation.  At  the  same  time,  we ' 
will  look  toward  clari^jcation  of  the  Maw  and  the  possibility  (ff 


constructive  amendments  that  may  yet  correct  some  of  the  unfortu- 
nate and,  hve  believe,  unintended  consequences  of  this  legislation. 

We  have  listened  carefully  to  the  debate  concerning  the  disclo-- 
sure  of  test  tjuestions  and  answers  to  students,  and  we  have  en- 
gaged in  earnest  conversations  on  this  issue  with  many  people  and 
groups  throughout  the  Nation  over  the  past  year.  We  are  sensitive 
to  the  arguments  for  extending  the  scope  of  our  Services  to  include 
disclosure  of  test  questions  and  feedback  on  individual  "student 
answers.  There  are  serious  problems  that  must  be  solved  in  meet- 
ing this  new  demand  for  service.  Nevertheless,  we  are  committed 
to  finding  ways  to  satisfy  the  understandable  desire  for  such  infor- 
mation, while  at  the  same  time  maintaining  the  quality  of  our 
tests.  To  do  this  we  need  time,  patience,  and  acclimate  of  coopera- 
tive, open  exchange— not  the  accusatory  and  dogmatic  climate  that 
has  clouded  the  debate  up  to  this  point. 

We  have  submitted  specific  comments  on  H.R.  3564  and  H.R. 
494^.  The  provisions  of  the  latter  bill  would  niake  it  extremely 
difficult,  if  not  impossible,  for  us  to  continue  to  provide  current 
levels  of  quality,  price,  and  service  to  all  students.  [See  attachment 
5.]  ^ 

Thes^  difficulties  are  illustrated  in  the  case  of  the  Graduate 
Record  Examinations  and  the  Graduate  Management  Admission 
Test  in  an  additional  submission  that  we  have:..made  available  to 
this  committee.  [See  attachment  6.] 

It  is  important  to  keep  in  mind  that  the  reason  test  development 
costs  have  been  a  small  proportion  of  total  program  costs  is  be- 
cause of  the  ability  of  program  sponsors  to  reuse  test  forms.  That 
would  not  be  so  under  H.R.  4949. 

For  example,  in  the,  graduate  record  examinations  progranri,  in 
addition  to  5  regular  Saturday  administrations  and  5  Sunday  ad- 
ministrations, there  were  this  year  116  administrations  in  9  large 
urban  areas. 

We  don't  see  how  such  administrations  could  cQjrjtinue  under  the 
provisions  of  H.R.  4949.  Also,  H.R.  4949  will  mak^mpossible  the 
score  equating  methods  now  used  for  all  the  major  admissions  tests 
administered  by  ETS  except  the  Scholastic  Aptitude  Test. 

To  force  a  change  in  this  essential  element  of  national  testing 
programs  represents  a  major  disruption  that  affects  all  aspects  of 
the  e^caminations,  Including  not  only  the  score  equating  but,  also, 
the  content  and  structure  of  the  examinations. 

Such  a  change  demands  careful  study  and  research.  In  addition, 
although  it  is  difficult  to  demonstrate  before  the  fact,  the  obliga- 
tion to  multiply  the  development  of  new  tests  severalfold  in  a 
relatively  short  time  would  threaten  the  quality  of  the  tests,  which 
is  essential  to  their  ultimate  validity.       .  ^   '  - 

The  development  of  good  standardized  tests'  is  a  painstaking, 
time-consuming  process  that  requires  the  combined  talents  of  tech- 
nical specialists  and  scholars. 

It  would  be  unfortunate  if,  in  the  haste  to  rectify  apparent 
shortcomings  of  testing,  we  believed  that  legislating  disclosure  of 
-  test  questions  was  a  panacea. 
/  There  is  no  better  illustration  of  the  need  for  clarification,  rather 
than  rhetoric,  than  in  the  question  of  whether  admission  tests  are 
culturally  biased.  This  is  an  important  question,  which  ETS,  .test 


sponsors,  colleges,  and  researchers  throughout  the  country  have 
studied  over,  the  ye^rs;  because  there  is  a  shared  concern  over  the 
substantial  variation  in  average  test  performance  among  groups. 

For  instance,  while  scores  for  whites  and  disadvantaged  minority 
groups  overlap,  a  typical  result  is  to  find  that  only  10  to  20  percent 
of  disadvantaged  minority  groups  score  above  a  point  that  is  aver- 
age for  whites,  that  is,  exceeded  by  50  percent  of  whites.-; 

These^differences  will  not  surprise  anyone  familiar  with  the 
inequalities  in  the  social,  economic,  and  occupational  spheres  of 
American  life.  Although  many  special  educational  programs  have 
been  developed  at  the  Federal,  State,  and  local  levels  to  repair  the 
effects  of  educational  and  social  neglect,  these  programs  and  other 
measures  cannot  change  so  quickly  what  years  of  malpractice  have 
perpetuated.  ... 

Nevertheless,  the  argument  is  . made  that  tests  of  academic  abili- 
ty are  biased  because  they  represent  middle  class  culture.  These 
tests  do  reflect  skills  and  knowledge  considered  important  in  the 
mainstream  culture,  in  many  jobs,  and  in  higher  education.  But 
tlie  fact  that  a  test  mirrors  the  common  culjture  is  a  poor  basis  for 
calling  the  test  biased. ' 

Investigators  who  have  studied  the  issue  agree  that  one  common- 
ly accepted  way  to  evaluate  whether  or  not  admissions  tests  are 
discriminatory  is  to  determine  whether  a  difference  in  test  scores  ^ 
between  groups  is  als9  reflected  in  a  corresponding  difference  in 
later  perftif^mance  in  college  or  graduate  school.  A  number  of  such 
studies  have  been  undertaken  on  our  test-s,  both  -^t  ETS  and  by 
researchers  elsewhere. 

The  results  have  been  quite  consistent.  Differences  in  test  score 
averages  across  groups  are  consistent,  with  differences  in  actual 
performance  in  college.  Tests  typically  predict  the  same  way  with 
/the  same  validity  for  whites  as  for  minorities. 

f  One  can  also  ask  whether  certain  types  of  test  questions  are 
discriminatory.  Test .  makers  must  avoid  questions  that  give  an 
unfair  advantage  to  one  group  over  another.  Test  questions  under- 
go formal  review  by  minority  staff  members  or  outside  reviewers, 
and  are  examined  for  possible  cultural  bias. 

Similar  reviews  are  made  with  respect  to  sex  bias.  After  some, 
years  of  experience  and  careful  attention,  we  feel  we  are  reasoa- . 
ably  successful  in  .  keeping  biased  items  out  of  tests. 

In  addition,  there  are  research  techniques  for  evaluating  wheth- 
er individual  questions  are  relatively  more  difficult  for  one  group 
or  the  other.  Sometimes  these  differences  are  not  easily  explained. 
For  example,  when  compared  with  whites,  black  students  tend  to 
score  somewhat  Iqwer  ori  mathematical  than  verbal  test  questions, 
though  the  former  are  ordinarily  considered  more  *'culture-free.'' 
Also,  women  are  inclined  to  do  somewhat  less  well  than  men  on 
geometry  questions,  but  thatofact  is  more  a  reason  for  reforming 
society  than  for  reforming  testing.  ' 

In  his  statement  introducing  H.R.  4949,  Congressman  Weiss  re- 
ferred to  a  1977  study  by  the  California  Postsecoridary  Education* 
Commission  reporting  a  difference  in  average  income  for  high- 
scoring  and  low-scoring  students.  Our  data  confirm  that^there  is 
such  a  statistical  relationship.  In  fact  the  particular  figures  cited 
evidently  came  from  axeport  prepar^ed  by  ETS  Cor  the  College 
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Board.  Such  information  has  been  widely  distributed  to  schools  and 
colleges  through  annual  reports  since  1972. 

The  fact  that  SAT  scores  are  related  to  students'  fmnily  incomes, 
is  often  misinterpreted  or  misunderstood.  The  relationship  is  far 
from  perfect  and  shows  up  only  in  theTaver^ifces  for  groups  of 
students.  Many  individual  students  fromdow-income  families  attain 
high  scores  and  many  individuals  from  affluent  families  attain  low 
*  scores.  h  ' 

While  the  test  does  show  differences  between  students  from  low-  g 
and  high-income  homes,  and  those  differences  are  distressing  and 
significant,  it  is  important  to  recognize  this  as  part  of  a  larger 
pattern.  It  is  unfortunately  true  that  many  measures  of  growth 
aiid  development  show  similar  relationships  to  socioeconomic  level. 

We  know  from  the  extensive  research  of  Project  TALENT  that 
-  socioeconomic  measures  of  family  status  have  a  definite  relation-  . 
ship  to  whether  stu(^ents  keep  up  with  their  age  group  or  fall 
behind  in  grade  placement  in  school.  Furthermore,  research  evi-  • 
dence  indicates  students  from  poorer  homes  make  Somewhat  lower 
grades  in  school  on  the  average.  Our  own  studies  in  individual  high  * 
schools  indicate  that  both  test  scores  and  grades  show  a  siniilariow 
positive  relationship  to  family  income. 

Income  is  also  related  to  other  vitar  signs.  In  families  of  low 
socioeconomic  levels  infant  mortality  is  much  higher.  Life  expectan- 
cy is  some  8  to  10  years  lower  in  the  lowest  as  compared  to  .the 
highest  economic  class. 

Do  these  statistical  relationships  between  income  and  othex  .im- 
portant measures  of  personal  development  of  quality  of  life  indi- 
cate that  those  measures  are  biased  against  poor  ,  people?  I  think 
not.  Such  data  simply  support  the  well-known  fact  that  we  still  live 
in  a  society  where,  there  are  shameful  discrepancies  in  health, 
growth,  and  achievement  resulting  from  unequal  opportunity.  Con- 
gress is  well  aware  of  these  social  inequitie^  and  has  sought  (; 
through  vigorous  legislative  pro-ams  to  mitigate  the  effects  of  V 
economic  deprivation.  -  ^1 

Tests  like  the  SAT  help  to  bring  these  problems  into^  focus  bd-  \ 
cause  they  provide  a  standard  yardstick  qf  developed  cognitive  | 
ability.  Tests  measuring  developed  abij[ities  of  proven  importance  to  \^ 
college  work  are  a  great  strength  to  a  fair  selection  system  because 
they  measure  skills  relevarit  to  intellectual  demands  on  the  stu- 
M  dent,  they  insure  that  all  students  nieet  the  sanie  standard,  and 
.{ they,  can  be  given  to  large  numbers  of  people. 

Nevertheless,  most  colleges  and  universities  are  properly  reluc- 
i  tant  to  rely  exclusively  on  admission  testfe  and  grades  in  selecting 
I  students.  Admissions  officers  appreciate  that  even  though  these 
.  measures  ^^e  the  best  predictors  of  academic  p^formance,  Ihe 
relationship  is  certainly  not  exact.  Furthermore,  institutions  have 
a  variety 'of  social  and  educational  objectives  for  which  t|iey  may 
consider  other  student  qualities  especially  relevant— for  example, 
special  tallnta,  experience,  accomplishments. 

The  outlook  for  additional  measures  that  ate  relevant  to  selec- 
tion diecisions  is  promising.  For  a  long  time,  ETS"  has  .  )argued 
against  undue  reliance  on  test  scores  and  in  favor  of  a  broader 
definition  of  talent  in  American  society.  We  have  been  engaged  in 
a  variety  of  projects  that  will  enable  educators  and  others  to  give 
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more  attention  to  the  varied  skills  and  accomplishments  each,  indi- 
vidual haa  to  offer.  These  include: 

^  A  cbbpera.tive  study  by  College  Boa|d,  ETS  and  nine  colleges  and 
universities  to  improveVthe  assessment  of  personal  qualities  in 
admissions. 

A  study  on  the  development  of  nontraditional  methods  of  assess- 
ing experiential  learning.  This  work  resulted  in  the  formation  of 
GAEL— The  Council  for  the  Assessment  of  Experiential  Learning 

in  Columbia,  Md.  V 

An  experiment .  by  •  the  Graduate  Record  Examinatioiits"  Board 
with  an  Inventory  of  Documented  Accomplishments  to  accompaft^. 
a  student's  application  to  graduate  ^chool.:  ■  v> 

The  answer  to  real .  educational  and  job  opportunity  lies  not  in 
setting  aside  careftil  objective  assessment  of  developed  abilities; 
Rather  we  must  be  open  to  all  forms  of  tateiit,  value  the  different  i 
contribiatipns  different  individuals,  can  make;  aifid:  take  the  time  to 
assess  those  capabilities  faii^ly,  ^  ^ 

It  is  our  hopte  that  legislMion,  if  it  is  needed,  will  gf'Q:vi^.  9Tit  of 
serious  study  of  the  facts  and  not  out  of  misanderstanding  and ' 
simplistic  rhetoric.  At  stake,  we  feel,  is  the  entiri?  system^  of  college 
admissions  which  has  served  this  country.w^ll.  W^h  ii^^w  un 
standing,  an^,  vigorous  search  for  fresh  approqich^^^eSting^ 
serve  our  Nation  even  better^  in  the  future. 

As  a  mfeans  of  fostering  a  new  beginning,  I  should  like  to  refer- 
ence'[^iee  Attachment  7]  and  call  your  attentipn  to  the  principles 
wWrfjh  ETS  believes  should  guide  the  exercise  of  its  own  responsibilf 
itie*to  students.  .  Thfes6  responsibilities  also  extend  to  the  larg^r 
goci^M  that  ultimately  muSt  judge  the  value  of  our  work.  During 

:  the  past  few  years,  ETI5  has  developed  sidelines  *  for  insuring  that 
its' Work  conforms  to  uniformly  high  standards  in  sev^n  g^reas.  of 
basic  "importance:  Accountability;  conMpritiality  of  data;  product 

'  accuracy  and  timeliness;  researcii  and  development;  tests  and  mea- 
surement; techniciai  quality  offests;  test  jase;  ana^  technical  assist- 
ance, tfidv^pe^  and  inatructiQ^^^  r     .  '       r   ^  „ 

o  fui#i^/>iecog:hizeg  that  te  a  concern,  m  alL 

aspects  6f >dmi$adns— biit  espeCmUy^^.  the  quaUty 
i)f  service:provided  by  test^^rti  agehcies  aAd  in  the^alHandJ^^ 

-t)f  tests  and- other  ihfprmatit^n^hy  seho^       colleges.  Wf^^ 
thafe,i^ese  twp^QlosdV  related'  areas  of^coiicern  on  th€f  part„  of 
students  cfth!  be  nwt'inor^  e^^tively  ifr  to  the  to  feasible 

•degre(&,  thch  |)r6dticts  of  the  festiftjg  pro^artjs  and  the  adm^^si^ns 
prbcess6s  of  schools  k|id  colleges  are  ppehrfiiUy  understood^ 
stripped  of  whatever 'ijmT^eces^ar^  Vestig^^s  of  myst^ 
scure  then\  from  studentS  ahdHhe  j^ubhc  As  this  committee  qdnisid- 
ers  H.R.  3564  andlr:R.-i949,  we  reSpectfiilly  urge  th^t  you  consider 
your  actions  in  the  light  ofiihe  effectiveness  of  testing  ageAci^^hd 
test  users  in  these  regards.  -  ,  J   /  ^    -  /     .  ■ 

As  a  demonstration  of  our  good  faith;  We;vvai  undeital^  46rt?iin^ 
initiatives  and  propose  others  for  cdiiSideratipn;     ?  ^   :       / : 

First,  in  response  to  the  New  York  legislation,  ET^  is  engaged  in 
serious  and  intensive  work  to  determine  how  we  can  comply  with 
the  law,  maintain  the  quality  and  integrity  of  the  tests,  afid  hold 

!  Printiples;  Policies  and  Procedural  Guidelines  Regarding  ^TS  Products  and  Services,  Educa- 
tional Testing  Service,  Princeton,  N,J.  (Rev.  February,  1979). 


service  reductions  and  cost  increases  to  a  minimum.  Fifty  members 
of  our  professional  staff  are  currently  involved  ifi  nine  task  forces 
studying  the  problems  we  face  and  idenffying  possible  solutions  .  ^ 
and  tradeoffs.  We  are  scrutinizing  every  aspect  of  our  work,  includ-  * 
ing  test  development,  test  administration,  equating  and  other  psy- 
chometric'concerns,  and  overall  o{>erational  implications.  Th6  re- 
sults of  our  work— and  those  of  other  organizations  similarly  cov-  i 
ered  by  the  New* York  law-^will  prove  helpful  in  light  of  Federal 
I      concern/ recommend  that  this  committee  view  the  NeW  York 
.\  exMrience  as  an  bppoct-unSty' to  assess  and  evaluate  the  impact  of 
■  sucif  legis^^^       rather  than  ru^K*  headlong  Jnto  national  legisla;. 
^ .  *  tioji  with  fill  of '  the  attendant  rislks  for  serious  damage  that  this 

•  (^ttrsftof  a^tibii  wi^^  ;  ;  - 

A ,     '     addition, #e  Would  tecoriSni^^ndHhat  the^^N^        Academy  of    /  . 
: :  /  S^^         whicji  is  currently*^  of  ability  testing,  • 

'  eXp^  to  this  •     ■■■ .  .. 

hearing:.  The  •  A  both 
\  :  ^chhi^  and"practical>  6f«pdsS%^^^  and  report  in  a  fixed 

:^    But  reasonabie  period  ■  of  tito^  pii  tlie  ef^  -  '  „  . 

X..,  "New.  York  legislation  anifl' on  agendes  have  doflenn 

'  these  t)yo  States.  ;.,This  wou^  - 
K>  j^evieW  ort^  h^nad  for  and  impact  of  legislation.  We  >yould  cooper- 
r;  iite  ftilly  >yi^h  s^^^^ 
^  in  addition  we^^  ori.Educa-    :  / 

V  v^tipn,  or  an  oi^ani^siatiori^.d^       representative  of  higher  educa- 

tion, appoint  a  Cpftimitesion,  on  Trat-  tJs^  to  estabHsh  guidelines  for 
?  v  U^^^^  proi>€fr:  u$e:i^^  &nd  universities:  The  ACE  has  *  «  • 

:      tak^tf  »iniiiar  leadership  to  strengthen  self-regulation  iii  other 
4    Areafi^f  higher  education.  This  approach  k  consistent  "with  higher  ' 

;"edu€^tio^^  regulate  itself  |s  a  means  of  resolving-*  y^  r^y;- 

^   educational  pniblem  o  ^  ^  ' 

Also,  we  will  all  otheif' Injterested  parties 

/    an  open  livorking  conference  on  testing  legislation.  The  purpos^i^  of  \ 
\:  -  ^tiie  conference  wilj  be  to  examine  the  potential  problems  of  ovef- 

lapping  legislation,  the  tiefed'for  model  l^slation,  ^nd  tPe  question    -    .  4  ^ 
tif  iM-eemptive  Federal  legislation .  Such  an  undertg^kingivill  require 
^,.the  participation^  of;  stiideYits,  legislators,  lawyer^,  and '  educators.  •  v 

V  /    Finally?  to  further  underscQre  0ur  commitment  to  the-firinciple  - 

.of  providing  greatjer  inform^tio       test  takers,  ETS  will  tecom-  ' 
-  ,  njieridlat^^^t^^       meeting  of  the  Niafiorial| Teacher*  Examinations 
CoUhcil^lhe^bMy  wWch  esl^^         the^licies  for  operation  of  \ 
the  NTE— that  by  >1980^J81s  or  ds^soon  as  possible  thereafter,  the 
^  contents  of  tfee  examinations  be  released  to  test 

telcere  for  at  least  one, of  the  tliree  national  administrations  each  : 
y^'"':^^.  ThuB  NTHJ  dates  back  to  the  late  1930's  and  is  used  in  teacher  : 
"  ^ ^ certificimon  4949\does  not  affect  NTO,  ^^9%^^^ 

*  twists  are  not  used  for.  no^fcggco^  :  ^ 
,  U  *bpjie?«4jfeat-b6gihh                 would  bienefit  from  havirfg: Jti^bre  % 

informiitibh  about  their  performance '(in  the  examinatiqriL  Further, 
we  would  p^pose  that^we  work  cooperatively  with  the  two  natiftn- 
al  teachfc  organizations,  tj^e  American  Federation  of  Teachers  and 
the  National  Education  ^sociation,  and  also  the  American  Associ- 
ation of  Colleges  for  Teicher  Education,  to  crftatfe  materifils  to 
accompany  the  disclosed  tt^st  content  which  woula  assist  beginning  . 

■  .    ■  '^-^ —  ^ ,  •  ■  .  . 


teachers  to  understand  better  their  performance  on  the  examina- 
tion. ■ 

One  final  observation.  Admissions  tests  for  higher  education; 
suclt  as  those  provided  by  ETS,  require  a  mutual  appreciation  on 
the  part  of  all  concerned  parties  of  the  special  relationships  among 
the  public's  right  to  know,  the  -university's  need  for  educational 
autonomy,  and  the  testing  organization's  obligation  to  sustain,  high 
professional  standards  in  it3  work.  We  believe  that  policies  consist- 
ent with  these  principles  will  further  insUre  that  testing  services 
continue  to  serve  the  public  interest.  If,  in  the  process,  we  can 
increase  public  understanding  of  admissions  testing  by  students  ' 
and  parents,  our  entire 'educational  system  will  benefit. 

Mr.  Weiss.  Thank  you  very  much.  We  appreciate  the  testimony 
which  all  of  you  have  given.  Apparently  because  there  are  a  num- 
^  her  of  suspensions  on,  we  will  be  over  there  for  at  least  20  rainuties, 
perhaps  as  much  as  a  half  hour.  What"!  would  suggest  that  you  do 
is  to  allow  you  to  catch  your  breath  and  we  will  resume  when  the 
vote  is  over,  which  will  be  in  about  a  half  hour. 

Thank  you  very  much.  ^ 

[Recess.] 

[Attachments  to  Robert  Solomon's  statement  follows:] 


ATTACHMENT  1 


The  attached  docuraertt  summarizes  the  agreement  dated  July  i,  1574 
between  the  Law  School  Admission  Coancil  (LSAC)  and  Educational  Testing.^ 
Service  (ETS).    This  summary  is  prbvided  on  request  to  Chose  who  wish  ^ 
to  know  about  the  contractual  framewpijk  within  which  these'two 
organization^  operate.     Individuals  Who  would  like  to  check  the 
summary* s  accuracy  may  inspect  a  copy  of  thh  agreement  (without 
specifications  schedules)  at  6ne  of  the  following  locations  by 
contacting  in  advance  the  indicafed  offitial: 

,  ■    John  S.  Kramer,  Esq. 

.  General. Counsel 
■  •  '  '  Educational  Testing  Service 

•   Rosedale  Road         ■  ' 

Princeton,  New.  Jersey  08540' 

■■/    ■  •■  .    ■  ■  ^ 

De^an  Frederick  M.  Hart.  ^ 

President,  Law  School  Admission.  Council 

^  School  of  Law  ' 

^  University  of  New  Mexico 

/  1117  Stanford  Drive.-  N.E,  '  f 

I  Albuquerque,  New  Mexico  371G6 
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AGREEMENT  DATED  JTJLY  .l,^lflK':BETWEEN  THE  LAW  SCHOOL  ADMISSION  COUNCIL 


AND  educa: 


L  TESTING  SERVICE  . 


DEEINlflONS 


.  Certain  sptclfic  terms  uaed  in  Che  agreem^n^are^Iisted  and  defined 
in  the  first  section.  ,  ^  '  s>  .  * 


a. 


ETS  SERVICES  AND  ACTIVITIES 
—  T    


ETS' 8  responsibilities  include  all  services  and .actl\ci ties  reasonably 
necessary,  incidental  or  customary  to  the  operation  of  thje<^L9AC  program, 
including  test  development:,  research,  test  adminls era t ions, ^$pAS  (Law  ^ 
School  Data  Assembly  Service),  y^dity  study  services,  candidate 
referral  services/ auxiliary  publications,  and  collection  of  can^^ate 
fees  and  lAcometf  •      ^  •.  '  .  '  . 

All  services  and  activities  are  to  be  perfotmed  to  the  reasonable 
satisfaction  of  LSAC.  "  ,  .  • 

It  is  recognized  that  LSAff*and  ETS  may  enter,  into  separate  agreement^ 
with  one  another  for  addiliioaal  services.  'Unless,  otheti^lse  specified, 
such  separate  agreements  automatically  incorporate  applicable  provisions 
of  the  agreement  with  'the  exception  of  compensation  and  payment  provisions* 

C.  .   POLICY  DIRECTION       .  • 

LSAC  determines  the  general  policy  governing  the  conduct  of  the 
services  and  activities,  including  the  setting  of  fees  anid  other  charges 
made  to  candidates.  "  .  .  ■ 
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COMPENSATION  AND  PAYMENT  •- 

.         ■  rV  . 

ETS  receivee  for  its  services  a  'Wic  price"  for  each  LSAC 
jjrogrmn  year,  which  consists  of  the  aggregate  of  actual  contract 
co3ts  plus  applicable. fees,  .ot  a  "ceiling  price",  whichever  Is  '  ' 

lower.    The  ceiling  price  for  each  program  year'is  the»^ggregate 
of  the  bid  prices  for  that  year,  determined  aa  follows: 

"  *■     ■  t  ^ 

1974-75  '     Based  on  1973-74  actual  costs^  adjusted 

.   ^.  .  ^        for  projected  volume  estimates,  plus  fee; 

.  I97S776  Bid  prices  for  all  services  (detailed  in 

•*  *   .  a  Schedule  attached  to  the  agreement) 

.1976-77  '  Based  on  1975-76  actual  costs,  adjusted 

for  projected  volume  estimates  and  inflation*, 
plus  fee;  or  the  basic  price  paid  Co  ETS 
*  for  1975-76  (adjusted  as  above),  whichever 

^  is  lower; 

'    1977-78  Based  oh  1976-77  actj^ial  costs,  adjusted 

for  projected  volume  es^imatesr  ^nd  inflation^ 
*         plus  fee;  or  the  basic  price  paid  to  EtS 

for  1976-77  (adjusted  as  above) ,  whichever 
is  lower..  *  ' 


The  agreement  also  provides  for  an  incentive  fee  to  ETS  in.  any  , 
program  year  that  actual"  costs  are  lower  than  the  ceiling  price* 

Basic  research  ^nd  development  costs,  on  which  ETS  receives ^^o 
fee,  are  included  in  the  above  contract  costs.  ^However,  pother  research 
and  special  projects  must  be  separately  agreed  to  by  liAC  and  ETS. 

After  the  fourth  operational  year  (1977-78) ,  the  ceiling  price  is 
to  be  determined  by  written  agreement  between  ETS  and  tSAC.  . In  the 
.absence  of  such  agrfeement,  Onresol^fed  matters  will  be  settled  by 
arbitration,  as  provided  in  a  separAte  section  of  the  agreement 
covering  arrangements  for  %uch  arbitration. 
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•  B*    FIWANCIAL  ACCOUNTS  "       *  "  ' 

All  fflonlttfl  collected  from  candidate  f eee  and  other  soui^^ces  of  LSAC 

program' income  are  the  exclusive  property  of  LSAC  aA4  are  deposited  in 

»        ■  ■ 

a  separate  LSAC*  pro granf  bank  account »  over  whlcK  LSAC  has  sole  control. 
REPORTS  AND  AUDITS  .  . 

ETS' submits  to  XSAC  monthly  financial  st.atements  covering  the  LSAC 
program,  and  also  provides  appropriate  performance  data.    LSAC  may 
,  conduct  an  audit  of  ETS  books  related  to  the  LSAp.  program^  and,  in^  > 
^addition,  receives  a  certified  copy  of  ai^  annual  independent  audit  of 
ETS  for  eaph  year  the  agreement  is  in  e'Ifect.     -    .  ^ 

G.    TERM  OF  AGREEMENT  .    i  \.  *  • 

The  Initial  term  of  the  agreeiaBntr  is  from  July  1,  1974  until  June  30/ 
1978,  subject  to  automat£'c  renewal  after\hat  date,  unless  .terminated ^as  * 
provided  under  termination  provisions.  .  ;  ^ 

►  H/  OWNERSHIP,  copyright  AND  OTHER  RIGHTS    -  •  ' 

LSAC  owns,  controls,  and,  where  applicable,^ has  copyright,  trade- 
'  name,  pr  patent  rights  in:    titles  and  acronymrf  used  now  or  Irt  the     -  .  \^ 
future  in  the  LSAC  program;  publications  developed  primarily  for  the 
LSAC  pnro gram;  reports  dr.  other  work  pjfoduct  of  research  produced  primarily 
for  the  LSAC  program; \matexial%,  forms,  data,  computer^systems  and  soft- 
ware* developed  primariW  for  the  L^AC  program;  and  test  ^.tems,  test  forms 
and  answer  sheets  .first  developed  or  used  primarily  for  the  LSAC  program. 
In  addition,  LSAC  may  tlequest  a  royalty-free  license  to  use  certain 
ETS-ownea  retired  Low  School  Program  test  materials,  .and  ETS  may  rec^uest 
of  LSAC  a  similar  licenie  to  use  retired  LS^^C  test  materials  ^developed 
by  ETS*    ETS  may  alio  use  for  other  purposes,  computer  systems  and  ^ 
associated  software  developed  primarily  for  I3AC,  upon  notification  to 
LSAC  of  its  intent  to  do  \so.  .  * 


I.    RESEARCH       ,  u 

ETS  Insures  that  principal  researchsrs  named  in  proposals  are  &lloouced 
^sufficient  amounts  of  work^tirae  to  effect  timely  completion  of  such 
projects,!  ando  that  no  such  principal  researchers  are  reassigned,  prior  to  • 
such  complejDion  without  written  authorization  of  LSAC. 

Written  reports  are  submitted  to  LSACtOf^the  progress  qt  and  costs 
incurred  in  connection  with  research^ conducted  by  ETS  under  this  or 
separate  agreements  with  LSAC.  '    t  ! 

J/    TERMINATION    ■      ■  ^ 

On  or  after  June  30,  1978,  the  agreement  may'be  terminated  by  either 
party  upon  written  notice  to  the  other  party  by  June  30  or  the  preceding 
year«    After  notice  of  termination,  ETS  is  to  make  reasonable  efforts  to 
reducfe  or  eliminate  any  services  or  activities  connecCecl. with  the  program 
when  LSAC  so  requests  ^n  wril-ing.    Provision.ifS  made  for  an 
orderly  transfer  of  responsibilities  to  a  new  contr^or^  if  such  a 
*  decision  is  made.        *  i 

K.,  CONSULTATION  AND  AMENDMENT  '  \       '■  ^ 

§rS  and  LSSVC  will  consult  freely  with  one  another  in  order  to  resolve 
.  any  problems  or  difficulties  which  may  arise  in  connection  Irith  the  LSAC 
program,  and  prior  to  initiating  any  arbltrati9n  or  litigation  relating 
to  the  agreement.    Either  patty  may  prpposf  an  amendment  to  the  agreement. 
In  B^ditlont  if».in  the  Judgment  of  LSAC,  it  is  desirable  to  reduce,  add 
to,  or  change  any  of  the  technical  or  operating  aspects  of  ^he  .LSAC  p rot- 
gram,,  or  to  cancel. any  8 inrvioee  or  activities^  other  than  LSAT  adminl^- 
t  rat  ions  and  LSDAS  (which  may  be  cancelled  otily  by  amendment  to 't  fie 
agreement) ,  and  the  parties  are  unable  to  agree  on  an  amendment  covering  . 
.  such  ,  changes  or  c^cellatione,  then  LSAC  may  direct,  euch  cliange  or 
cancellation  on  60  days  written  ootice'tp  ETS,  and  ETS  will  diligenbJ^ 


comply  wieh  an^  such  direction.    Unless,  otherwise  agteed,  the  effect 

f 

upon  prLce  for  services  will  be  settled  by  arbitration*    It,  in  the 
judgment  of  ETS,  the  direction  involves  a  x^uesticfti  affecting^  its  pro- ■ 
fessional  or  ethical  responsibility ,  ehen.  ETS  also  has  th^  right  to 
.submit  to  arbitration  the  question  of  whether  it  has  such  effect  and 
whether  ETS  must  comply  with  the  direction.  .  .  * 

L.    SECURITY  JWD  CONFIDENTIALITY 

ETS  is  required  to  implement  /ecxixity  and  test  administration  ^ 
procedures  to  ^sure  security  of  test  content,  proper  identification 

of  candidates  I  and  related  matters*    Any  breach  of  security  is  in- 

■  % 

vestigated  and. reported  to  LSAC* 

All  data  collected,  generated,  ^r  stored  by  ET^  primarily  for  the 
LSAC  program. is  to  be  stored  by  ETS  separately  from  data-  collected  for 
other  purposes  y  so  as  to  insure  complete  confidentiality ,  rebiriev- 
ability,  and  destructibility  at  all  times*    While  ETS  has  custody  o^ 
such  -data,  the  handling  aiid  storage  will  be  in  accordance  with*  the  ETS 
policy  on  confidentiality  of  data,  and  EtS  security  {Procedures*  LSAC 
. likewise  agrees  to  maintain  the  confidentiality  pf  such  data* 

M*  .  SUBCONTRACTS  AND  OUTS IPE  .  RESEARCH 

ETS  may  subcontract  work,  in  connection  with  the  LSAC  ^program,  but 
remaii^  responsibl^at  all  times  ^r  proper  performance  of  the  work* 
LSAC  retains  the  right  to  arrange  for  performance  of  research  projects, 
special  studies,  ajra  publications  by  third  parties*  . 

N*  ARBITRATION 

Aiiy  claim  or  Controversy  arising  out  of  or  relating  to  the  agreement 
;will  be  settled  according  to  the  rules  of  the  America^  Arbitration^ 
Association,  or  such  other  rules  as  the. Association  may  specify* 


0.    IMPOSSIBILITY  , 

•  A  limit  at  ion  of  liability  Is  provided  for  each  party  In  the  event  . 
It  Is  unable' to*  perform  Its  responsibilities  due  t^  Circumstances  beyond 
Its  control.  ■  .■ 

P.    NOTICES     ■       ■  ■ 

■  ,  .      —  « 

Designation  of  the  recipient  and  addreas  Is  provided  by  each  party 

for  any  notices  Concerning  the  LSAC  program  or  the  agreement. 

Q.    ASStCNMENT  .      .  *  ^ 

Neither  the  agreement  nor  any  Interest  In  It  may  b.e^asslgned  or  . 
transferred  by  LSAC  or  ETS  without  the  written  consent  of  the  other, 
party*  * 

R.    PRIOR  AGREEMENTS 

With  the  exception  of  certain  agreements  covering  research  projects.,, 
all  prior  agreements  between  LSAC  arid  ETS  are  terminated. 

S.    APPLICABLE  UW  ^ 

The  agreement  Is  to  be  co'nstrued  and  enforced  In  accordance  with  the 
laws  of  the  State  of  New  York. 

SCHEDULE  1  ,  ..." 

Contract  apeclficat Ions  for  the  program  year  197A-75  are  listed, 
including  detailed  descriptions  of  the  setvlceso  tp -be  provided,  prices 
for  services,  budgets i  and  similar  Information.  . 

SCHEDULE  2  v  . 

Contract  specifications  as  described  under  Schedule- 1  abovie  are 
listed  for  1975-76  and  beyond. 


.      ATTACHMENT  2 

MEMBERS  OF  ETS  BOARD  OF  TRUSTEES  1974  1979 
(AffilUtion  as  of        TIm  of  TruttiMhip) 


Ells  Absl 

Hatry  and  Horman  Chandlar  Profaaaor 
DtpartMnt  of  CoMunicati6n 
Stanford  Univeraity' 

Rbbtrt  E.  Ball 

Pri^^pal  and .  Vica  Chancallor 
MoGill  Univaraity 

M.  Anna  Cattpball 
CoHiiaaionar  of  Bducaation 
Nabraaka  Dapartmant  of  Education 

*  .  ■.      '  ' 

Thalma  T*  Dalay 
Cairaai^  Education.  Spacialiat 
Board  of  Education  of  Baltimora  County 

John  B*  Davia»  Jr. 
Praaidant 

Macalaatar  Collaga 

Alfrado  G*  da  loa  Santpa*  Jr* 
Vica  Chancallor  for  Educational 

Davalopnant 
Maricopa  County  Connunity  Collaga 

District 

Joaaph  W*  Fordyca 
Praaidapt 

Junior  Collage  Diatrict  of  St*  Louia 

F*  Shaldon  Hacknay 
Prafidant 

Tulara  Univaraity  of  LouiaianA " 

John  W*  Uannaaaay^  Jr* 

Prof assor  of  Managaaant  ' 

tha  Aaoa  Tuck  School  of  Buainaaa 

Adainistration 
Dartaouth  Collaga 

Kurt  M.  Uartxfald 
Traaaurar  \  ^ 

Aaharst  Collaga. 

■  \ 

Rogar  W.  Uayns  .  ^  . 

Prssidant 

Amarican  Council  on  Education 


,  Waynf  H*  Boltsaan 
Praaidant,  Hogg  Foundation  for 

Maht«l  Haalth 
Profaaaor  of  Paychology  and  Education 
Tha  Univaraity  ot  Taxas  at  Auatin 

Clark  Karr 

Chairaan  and  Staff  Diracto^ 
Carnagia  Council  on  Folicy  Studiaa  . 
in  Highar  Education 

Robart  J*  Kingat9n 
Praaidant 

Tha  Collaga *Board  . 

Juanita  Krapa 
Vica  Praaidant 
Duka  Univaraity 


q.  Pat«r  Magrath 
Praaidant 

Univaraity  of  Minnaaota 

Sidnay  ?•  Marland^Jr* 

Praaidant  ^      ■  . 

Tha  Collaga  Board 

Patar  Maaiko,  Jr. 
Praaidant 

Hiami^Dade  Comaunity  Collaga 

Gartruda  G.  Michalaon 
Sanior  Vica  Praaidant  . . 
Macy'a,  Nav  York 

Charlas  D^  O'Connall*- Jr  • 

Vica  Praaidant  and  Daan  of  Studanta 

tha  Univaraity  of  Chicagp 

Jack  W.  Paltaaon 
Praaidant 

Aaarican  Couj^cil  on  Educatlpn 
John  A.  Parkina 

Vica  Praaidant — Adminiatration 
Univaraity  of  California  at  Barkalay 
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MEMBERS  OF  ET$  BOARD  OF  TRUSTEES  1974  -  1979,  continutd 


A*  Ktantth  Pyt 

, .  Chi^actllor  . 

Dukt  Unlvtrtlty  ^ 

Sitttr  Jotl  lUuid  - 
PrMidtnt 
Alytrno  C611«g« 

.  Wilson  C.  Rll«»  I 

,  Suptrlnttndtnt  5x  Public  Xnttructlon  , 
St«tt  of  Cftllf  oMl«  f,' 

■  i   ■  '  . 

Paul  F.  Sharp  ' 

Px^isldant 

The  Unlvarti^y  of  Oklahoma 

Virginia  B  J  Smith 
Prasidant 
Vaaser  Collaga 

Staphan  H*  Spurr 

Prof asaor  I  <lyndop  B.  Johnson  School 
•   ■  of  Public  Affairs  ,    ,  . 

Iba  Univartity  of  Taxas  at  Austin 

William  W*  Tumbull 
Prasidant 

Educational  Tasting  Sarylca 

Albart  #•  14hitlng 

Chancallor  '  ^ 

North  Carolina.  Caxitral  Univarlity 

Charlaa  E*  Young 
Chancallor 

Univaraity  of  California  at  tos  Angalas 


ATTACHMENT  4 


HISTORICAL  CHANGE  OF  FEES  VS.  INFIATIOM^ 


4 


1954-55  .Inflation 
Fee  e  191.68% 


Adnlitiooa  Tastii^  Program  '  $  6^00  '  $17.50 

Graduatt  Hanagament  Admission  * 

Tast.  '                                .  10.00  29,15. 

■  .  *       .  '        ■'  * 

Qraduau  Racord  Examination  8.00  ■  23.33' 

Law  School  AdBlsslon  Teat  10.00  \29.15 


ERJC 


J 
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.  V.  ■ , 


ADMISSIONS  fEST^^G  RR06RAM 


18  - 

16:^ 


•  J. 


/  0  12.  r 

6  - 


1 955  *  '■  1960  7. '  965  ^ '  1 97.0   ' "  1 975   '  YQS^ 

^ASe  YEAR    .  ■  .       *  /      .  , 


M*  C(^UHCR  PRICE  IM>EXv 
000  CANDIDATE  l=^C       .  ' 


:erjc 
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roUCATIONAL  IeSTING^  SERVICE*  ' 
.    mtiCETOM,  NEW^JTERSEY  085A1 
COMMENTS  ON  H.R.  #949  AND  H.R.  3564 
'   JULY  31»  1979  0 


INTRODUCnpN    /      ^  .  . 

ETS'has  revlevi;d  the  two' legislative  proposals  and  lias  identified 

the  following  major  areas  of  condern  which  appear* to  us  to  create" problems 

.   which  could  b«  avoided.  r'^'     ^  • 

H\R.  S564  ^ 

Most  of  the  significant  ptoblems  in  this  legislation  are  related  to 
*/                                                                                  .     •  '  ■ 

Secti'dh  6,  and  those  problems  ate  of  foi^r^ kinds: 

/  .  '  ■  9  ' 

(1)  There  can  be  problems  of  interpretations  because  of  the  requirement 
'  that  (for  axamplik}  *'each  ai^licant. .  .shall  be  notified^'  (Section  6(a)(1))  or 
^kch  indJlkdu«ar«..sKall  be  notificTd."  (Section  6(t))  without  spd^ifying  a 
locus  or  reaponsiblity  for  providing  or  notifying.  * 

.  (2{)  Under  Section  6(b)(2),  an  individual  must  be  informed  as  to  how 
^  ^  she/he  "ranked  on  |^otal  teat  performance'*  as  well  as  "specific  performance 
in  each  of  the  subject  or  aptitude  areas  tested."    This  requirement  for 
"total  t^st  pcrf ormancfe"  would  cdnce ivab Iv  force  the  reporting  of  a  total 
score  for  such  tests  as'  thevGKE  Aptitude  test  (in  addition  to  the  currently 
separate  Vetbal^  Quant  1  tat ^"^e,  and  Analytical  scores)  despite  professional 
judgament  that  such  a  Tbtal  score  would  be  meaningless  or .subject  to 
gros6  mialntetpretation.  ^  ^ 

(3)  The  requirement  in  Section  6(b)(3)  that  Indlvfduals  be  informed  of 
"the  scofe  required  to  pass  the  test  for  admission  to  such  occupation^  or  the 
score  whidh  is  generally  required  for  admission  to  instlttitions  of  higher  . 


.110 


education"  creates  ti^  problems.    First,  for  most  admissions  activities, 
ETS  and  other  testing  agencies  already  state  publically  that  there  should  '  ^ 
hot  be  a  score  '/required  for  admission."    ETS  would  have  no  way  of  knowing, 
what  any  such  score  might  be  yere  it.  (wrongly)  required  by  an  institution. 
Second,  even  if  ETS  and  other  testing  agenciea  knew  of  each  specific 
"jrequired"  score  -  . whether  for  an  institution  of  higher  education  or  to/ 
admission  to  practice  in  an  occupation  in  a  given  state  -  it  would  still 
be  impossible  to  report  that  "score  which  is  generally  required'-  as 
opposed  to  each  specific  Tequiremeiit. 

W  Finally,  the  requirement  (Section  6((?))  that  ^o  test  "shall  be 
graded...  on  the  Kasis^of  the  relative  distribution  of  scores  of  other 
t^kt  subjects"  is  unclear  as  to  whether  the  current  scoring  system  for 
^11  national  t'ests'-  in  which  an  individual's  acore  is  presented  .aa  a 

"J  .   ■       i       ■  ■  1   ■  •  ^  '  '  ■  ^  ■ 

number  on  a,  score  scale  developed  thitou^h  rfeference  to  aa  original  population 
which  took  th^test,  and  is  frequently  interpreted  though  "percentile  ranks" 
which'  compare  that  performance  with  the  performance  of  other  individuals  - 
would  be  prohibited. 

H.R.  W9      .      -  '  , 

f  ■ 

^   Generally  speaking,  thia  bill  presents  problems  of  definition,  that 
go.  to  the  very  heart  of  testing,  and  a  major  effort  to  eiarify  terms  early 

•I  •  ■    .  I 

in  the  legislative  process  .will  avoid  Visunderstandings  at  a  later  time^ 

.    *-  •  ." 

*  should  the  bill  become  law. 


Another  general  problem  area  of  the  bill  ^  the  locus  of  responsibility 
-  for  the  different  sections  and  subsections. 


lit  needs  to  be  determined  whether  In  the  filing  requirement  and  the 

pubdlc  record  aspect  of  this  blllrthere  1^  a  possibility  that  It  represents 

a  position  that'  Is  In  part  In  direct  conflict  with  provisions  of  the 

■  *    '  .     \  ■  ■ 

Copyright  Law  of  1^6.  :  -         .  T  ' 

More  specific  concerns  Include:^  ^ 

(1)  With  one  exception,  the  result  of  ambiguous  language,  ^TS  supports 
the  Findings  and  Purposes.    Section  2(a)(3)  requires  that  ^'standardized, 
tests  should  equally  reflect  the  academic  ability  of  students,  regardless 
of  their  ethnic,  regional,  racial,  or  economic  background. If  that  state- 
ment means  that  tests  should  ..not.  be  systematically  biased  against  any 
student  or  group  of  students  because  of  ethnicity,  rate,  or  ecgnomlc 
background,  then  ETS  supports  the  statement.    If,  on  the  other  hand,,  it  . 
means  that  te^ts  shpuld  necessarily  produce  equal  mean,  scores  for  members 
of  such  Identified  groups,  or  equal  mean  -scores  for  all  test  takers,  then 
the  statement  represents  <an    unreasonable  and  untenable  position. 

(2)  The  current  language  In  Section  3  makes  an. erroneous  assumption 
"about  the  amount  and  kinds  of  "information  that  ETS  or  other  testing  agienqles 
gather  about  individuals  and  InBtitutions.    For  example,  a  testing  agency 
will  not  know,  and  therefore  cannot  report,  the  entrance  criteria  that 
institutions  use  or  what  factors  are  weighted  Ip  determining  admissions  at 
those  institutions,  the  Income  levels  of* all  people  who  take  th«  tests, 

or  the  careers  which  students  in  varying  academic  programs  ylll  enter. 
Furthermore^  while  ETS  Completely  supports* the  concept  of  prompt  score 
reporting,  the  language  in  this  section  falls  to  recognize  t ha there 


are  numerous  riasona  —  including  student  i|error,\  mail  delays, -or  in- 
vestigations oflpossible  chea'tlng  —  whichi| would  \routinely  prevent  tiniely 
reporting' of  all  8co|f8. 

(3)  Secticm  4  requires  EfS  an\i^ther  tj^sting  ^organizations  to 
obtain  and  pro^^de  the  Cpnmlssioher  with  cojllies  of\  any,  studies  based 
u^n  data  we  provide.  ^Because«ETS '"prQvides|data'Meach  time  we  report  . 

scores  to  institutions  or  departments  within llinstitVitions,  we.  could  be 

• '      '  11  "   •  I  '  ^ 

held  responsible  for  obtaining  and  reporting  \to  theTCommissioner  any  study 

biased  on  those odata,  even  though  we  night  notvibe  aware  of  th^  study's 

existence.    In  a  related  problem,  ^ven  when »ws|  consciously  provide  data 

for  a  research  study  (such  as  those  conducted  |by  thelNational  Science 

.  Foundation),  it.  would  be  difficult  for  ETS  to  fequirel  that  the  other 

organization  make  Its     report    public.    Also,  fhe  legislation  as  now 

written  does  not  distinguish  between  preliminar|  (di^aflt)  and  final  reports 

prepared  by  ETS,  or  distinguish  between  reports Lhich  ban  reasonably  be 

made  public  or  proprietary  data  that  may  be  surai^r;i2ed|    In  addition, 

while  this  section  protects  individually  identifiable  diata,  the  confidentiality 

of  institutional  data  is. not  adequately  protected 

requires  a  disclosure  of  contrscts,  despite  the  fltct  that  ETS  and  othW 
testing  organizations  frequently  compete  for  contlacts  to  compare  and 
administer  tests.    This  section  thus  creates  problems  concerning  appropriately 
propritttat7  information  for  all  testing  agencies.  Synder  the  Freedom  of, 

■'  ■  ■  .         ■      ^    .  ■  n.  ' 

Information  Act,  of  course,  an>|  perA^nettt  govemme||t  contracts  are  now 
aval labia. 


This  section  also 

! 


I  ft 


4 


>  A' 

(4)  In  Section  5,,  copies  of  individual  tests,  and  of  students' 
answer  sheets  and  the  correct  answers,  must       provided.  .While  ETS  can 
support  the  general  concept  of  test  disclosure  for  the  pui^poses  outlined 
*  in  the- legislation,  thf  Current  bill  as  drafted  does  not  provide  for  several 
exclos ions  which  appear  to  be  desirable  for  the  very  test-takers  ehat  l:he 
bill  is. designed  to  aid.  ■ 

One  &f  the  most  difficult  problems  posed  by    the  proposed  legislation  •* 
is  in  the  .area  of  score  equating.    Admissions  tests  are  offered  many  times 
during* the  yoar,  and  fairness  demands  that  a  score  earned  in  October  be 
comparable  to  a  score  earned  In  February,  and  a  score  earned  in  .197^  inust 
be  comparable' to  a  score  earned  id  1980.    Strict  interchangeability.  of 
scores  can  lje  achieved  only  by  precise  score  equating.    Thr^  different 
methods  of  equating  are  employed  at  ETS  in  the  testing  programs ■ aff^Qted 
by  the  proposed  legislation. 

y    Jhe  first,  used  on  the  Scholastic  Aptitude  Test,  Involves  giving  ^  ^ 
sime  equating  questions  to  two  groups  as  part  of  the. two  test  editions  to 
le  equated.    A  second  method,  generally  used  in  the  GR£  Aptitude  Test, 
the  Graduate  Management  Admission  Test^  and  the  Law  School  Admission  Test, 
involves  administering  two  or  more-  test  forms  (separate  editions  of  a 
test  -that  meet  the  same  test  specifications)  administered  in  alternfting 
order.    A  th'ird  method,  generally  used  in  the  College  Board  Achieviement  . 
.TeSt«  and  the  GRE  Advanced  Tests,  involves  imbedding  questions  from 
previous  editions  of  the  same  test  in  a  current  editioh* 


'   All  of  the/ methods  of  equating  rely  on  i6^e  use  of  previously  used 
but  secure  (not^dlsclosed)-  test  questions  whose  statistical  chafactetlstlcB, 
sych  as  the  lev^Jl  pf  difficulty^  have  been  firmly  jestabllshed, .  the       /  • 
equating  method  usied  In  the  SAT  can  still  be  employed  under  the  proposed^ 
leglslatloni  Since  sets. of  equating  questions  that  are  not  .used  In  cal- 
culating the  student's  scores  do  not  have  to  be  disclosed*         .  ^ 

■      ■    •    ».  ' "  .  * 

Nevertheless y  even  for  the  SAT,  the  disclosure  provlslonsAVlll 

.    t    ■'       ■  -    ■  . 

create  substantial  prQblems  for  all. tests  used  In  special  administrations 
yhere  the  students  are  neither  .sufflclejitly  numerous  or  representative 
to  ensure  reliable  equating,. 

For  the  other  major  tests,  however..  It  will  f>e  Impossible  to  use  the. 
equating  methods  that^are  In  use  now  and  which  have  been  employed  In. these 
programs  for  decades.    To  Introduce  a  different  equating  ipethod,^uch  as 
the  one  used  for  the  SAT,  represents  atnajor  change  that  ^fecta  all  aspects 
of  the  progriEun,  Including  publications,  test  administration  and  timing, 
and  test  foVm  and  structure.    Such  a  change  demand^  careful  study  and 
researcK  over  a  period  of  tline  so  that  continuity  In  the  meaning  of  the 
test  scores  will  not  be  jeopardized. 

Further »  the  requirements  to  disclose  ^e  contents  of  all  tests  which 
are  taken  by  more  than  5^000  peop>e  per  year  will  create  inordinate  hard - 
ship  on  the  process  of  providing  (1)  achievement  tests  for. small  numbers  of 
peoplevat  reasonable  cost,  (2)  alternate  arrangements  for  those  whose 
religious  beliefs  preclude  their  taking  tests  on  Saturday,  (^)  alternate 
(braiile/ceiBette.)  versions  of  tests  for  handicapped  studenjts,  ,(4).vaddltlonal 


testing  opportunities  on  special  dat^es  for  those  in  large  urban  .  • 
areas,,  and  (5)  special  testing  for  -the  miUtary  on  military  bases*  * 
Moreover,  the  apparent  requirement    to  provide , an  individual  with  his/her. 
own  (as  opposed  to  a  copy  of  hisyher)  answer  sheet  would  raise  serious 
questions  of  legal  evidence  in  the  event  that  disagreement  arose^  as  to 
the  correct  score  earned  by  that  individual ♦  ^ 

(5)  ETS  supports  both  the  intent  and  the  language  of^  Section  6, 
although  the^section  might  benefit  ^ora  inclusion  of  language  designed  . 
GO  protect  the  confidentiality  of  institutional  data.  . 

(6)  ^ile  ETS  supports  the  intent  of  Section  ^,  there  i^ay  be 
questions  concerning  the  appropriateness  or  legality  of  requiring  dis-  . 
closure  of  financial  information  at  the  level*of  detail  r^^^ired.  Of 
greater  importance,  there, are  several,  problems,  with  definitions  (e.§. , 
the  distinction  between  a  test  sponsor  an(i^  an  agency  with  which  the 
sponsor  contracts)  that  should  be  clarified  in  order  to  make  the  provisions 
of  this  section  workablfb.    Tinally,  some  of  the  specific  data  required   '  , 
(e.g.,  the  number  of  times  a  test  was  retaken  during  a  single  year)  is  ^ 
not  current 1^  collected. 

-  "     ■ , 

(7)  Some  of  the  defi-nltions  in  Section  10  are  ambiguous. 

I,  ,  ■ 

(8)  The  180  day  implementation  period  will  be  virtually  impossible, 

particularly  if  tfhe  legislation  is  passed  after  materials  for  a  given 
teting.yed'r  have  been  printed  and  dilfcributed  nationally. 


♦ 

>  •    ■  • 
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SOME  IMPLICATIONS  ON  TEST  DEVELOPMENT  COSTS  AND  TEST  AVAILABILITY  OF 


NATIONAL  TEST-  DISCLOSURE  • 


^.  Some  of  the  basic  problems  of  compliance  with  the  provisions  ofi   ,  ■ 

H,R,  U9U9  as  currently  writjbon  ore  directly  related  to  th*  requirement  for 

disclosure  of  all. test  forms,^   The  follovirig  examples  -  based  upon  the  ^ 

curreWi  administrative  patteims  of^the  Graduate  Management  Admission  Test 

(GMAT)  and  Graduate  Record  Examinatioi^s  (GRE)  Advanced  Tests  -  will  demonstrate 

several  of  th*  more  significant. problems,  .Similar  tests  -  the  Lav  School  ' 

Admission  test,  the  GRE  Aptitude  Test 'ipd  others  -  will  face  similar  problems, 

Both  the  GMAT  and  the  GR£  , Advanced' Tests  are  administered  nationally 

that  is  at  approximately  500  sites  across  the  country  —  on  both  Saturdays 

and* Mondays  tb  accommodate,  those  whose  religious  beliefs  preclude  their  testing 

on  Saturday,    As  the  bill  is  currently  written,  six  of  the  GRE  Advanced  Tests 

(achievement  tests  on  specific  s\xbjects)  would  exceed  the  5,000  limit;  thuff,* 

■"  ■  ■  .  ■.  ■         '   ■■  .  f 

these  tests  would  have  to  be  disclosed  after  each  administration.on  six 

Saturdays  and  five  Mondays  during  the  year.    Similarly  /  the  GMAT  would  have  • 

to  be  disclosed  after  each  administration;    four  Saturdays  and  four  Mondays, 


.Currently,  two  new  versions,  of  the  GMAT  are  developed  eSWh  year.    For  the 
f  .GRE  Advanced  Tei^  -  which  Involve  work  by  committers  pf  faculty  members  drawn 
from  the  appropriate  disciplines  -  only  one  new  edition  of* each  test  is  ^rently 
created  each  y^sjL    In  order  to  acdOnnod ate  •■service  patterns  for  national  and 

.  ■       ■    .  /   ■     ■  . 

other  administrations,  older  edit ions -of* the  t^sts  developed  in  prior  yearB 
are  relp^ated^  a  process  that  iCmade  possible /only  by  the 'fact  that  the^e 
older  editions  have  not  been  disclosed,  or  have  remained  "secure,"  This 


repetition  of  plder  editions  is  alao  cuiTently  uaed  as  a  key  method  tor~ 
quating  scores  from' one  test  administration  to  the  next. 

Costs  for  creating  a  nev  CR£  Advanced  Test  in  any  discipline  are  ' 
approxii^t^  $50,000  for  each  new  version,  €md  the  costs  of  each  version 
of  the  GHAT  is  approximately  $92>000,    As  can  be  seen  froid  the  Table  below, 
the  costs  of  creating  enough  'additional  forma  of  these  two  test?  to  permit 
the  current  national  testing  partem  using  '^secime"  forms  would  approach 
J$2>700*000  annually  for  the  six  GRfi  Advanced  Te^B  only  and  oyef  $500,000 
for  the  GMAT,  . 


Number  of 

Total        Ifiunb^rof      Additional  -Total    \    Number  CuVrent 

National   NeV  Forms       Neil  formis  to   Approximate       Additional  of  1979-80 

'Adminis-    Now^Created    ^ep  Current..  Cost  per  Cost  Test  Test 

trations    Annually        Pattern  New  Test  Form   Annually     Takers  Fee 


GMA7 


8 


$92,000 

 i— 


$552,000  .   185,000  $12,50 


ORE      10.         1  for  each  9  for  each 

\dvanced   Adminis-   or  6  total  of  6  tests 

TeBts    trations  ■  5U 
for  each 
of  6  tests 

■  60  .  , 


'$50,00pv      $2,700,000-  -70,000  $lU.OO 

for  6  . 
Tests 


As  is  appas^ent,  some  modification  in  the  national  service  pattern  would  in 
all  probability  have  to  be  considered  if  the  current  legislation  were  enacted. 
Regrettably,  although ^he  overwhelming  majority  of  test  takers  $xe  accommodated 
at  these  National;  administrations,  the  10  ORE  or  S'Ca^AT  adminis traltions 
represent  only  a  Aaall  proportion  of  the  total  numbej*  of  administrations 
<iffered.    For  example,  wheii  weather  or  other  problems  force  cancellation  of  a 


ll8 


national  test' administration  in  any  location,  a  free, makeup  administration  is 
offered  •  using  a  different-  test  f prm  f rom  that  used* on  Saturday.  '  During 
1978-79  •  makeup  tests  vere  offered  6n  r38  separate  da^es  for  the_JSRE  and  on  23 
separate  dates  for  the  (H*IAT  during  1978-79.*    Similarly,  the  ORE  program  offers 
its  tests' in  urban  areas  on  other  .than  national  test  dates  for  the  additional 
convenience*  of  test-'takers  in  those  areas;  these  so-called  "Special  Administrations 
wfcre  offered  on  a  total  of  1X6  different  dates  in  9  cities  dui*ing  1978-7?.  When 
■speoiai  CHE  testing  for  handicapped  students  (38  dates),  for  military  personnel 
-on  military  bases  '(1U3  dates),  and  testing  carried  out  on  individual  campuses  ■ 
(57  dates)  are  added,  the  true  potential  impact  of  universal- test  disclosure  oh 
the  need  for  different  test  forma  can  be  imagined.    Because  of  the  value  of  these 
many  alternate  arrangements including  testing  for  Sabbath  observer  a,  lar  the 
handicapped,  for  the  military,  and^.for  residents  of  urban  areas  -  we  would 
strongly  encourage  reconsideration  of  both  the  lan^age  and  the  .intent  of  the 
test  disclosure  section  of  this  la^  so  that  it  does  not  inadvertantly  le^d  to 

■     '  1  •        '  ■  ■ 

reduction  of  services  to  any  segment  of  the  population.  ^. 
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tPREFACE 


Educational  Testing  Service  (ETS)  is  a  private,  nonprofit, 
educational  organization  with  primary  involvement  in  the'  . 
areas  of  measurement  and  research.    In  collaboration; wit(^ 
a  wide  variety  of  institut^io^s  and  agencies,  ETS  provides 
programs,  research  and  services  for  the  identification 
and  recognition  of  individual  talents  and  seeks  to  - 
contribute  to  th^  expansion  of  opportunities  available 
to  all  individuals.  , 

I  ■  . 

ETS  recognizes  its  responsibility  to  the  individuals  and 
institutions  that  it  yServes*  ditectly  and  to  the  larger 
society  that^ultimately  must  judge  the  value  and  efficacy 
of  its  work.    This  responsibility^  is  implicit  in  the 
educationa^l  character  under  lAiiich  ETS  operates  and  is 
refrected'in  the  product^  and  services-  offered  by  the 
organization  6/ince  its^  inception  in  1947.    Periodic  and 
intense  self-examination  has. been  one  means  by  wAich^ETS 
has  attemptet^  to  assure  its  aontinuing  commitment  to  the 
broad  ccYnst itue'ncy  which  it  fferves.    As  a  step  in  that  ' 
continuing  process,  ETS  has  developed  these  Principles , 
Policies  and  Procedural  Guidelines  Regarding'  ETS  Products  , 
and  SeiHyices  (Guidelineg) ,  first  jpublished  on  August  1,  ^ 
19Z7.  •       .     .  .  ' 

The  Guidelines  are  designed  tWensure  that  ETS  products 
conform  to  uniformly  high  standards  with  respect  to'seven * 
areas  of  basic  importance:    Accountability,  Confidentiality 
of  Data^  Product  Accuracy"* and  Timeliness,  Research  and 
Development,  Tests  and  Measurement,  Test  Use^  and  Technicals 
Assistance,  Advice  an(|  Instruction.    The  fi|st  three  ^ 
sections  of  the  Quidelines  deal  with  issues  that  relate  to 
.alllETS  activities:    Accountability,  the  responsibilities 
of  Its  to  those  affected  by  its  activities;  Confidentiality 
of  Data,  the* rights  to  and  limitations  on  access  tD  data 
collected  by  ETS;  and  Product  Accuracy  and^Timeliness ,  the  • 
control  of  quaj^ty  and  performance  according  to  sche^Mled 
commitments.  A      ^        '  . 

The  remaining  sections  concern  issues  specifically  relating 
to  ETS'  main  endeavors:    Research  and? Development,  Tests  and 
.Measurement Test  Use,  and^  Tecljnical  Assistance,' Advice  and 
Instruction* 


The  Guidelines  al|le)npt  to  codify  standards  used  in  various 
ETS  programs  and  services  that  should  be  considered  far  more^ 
general  application  at^  more  formal  articulation..    ETS  has 
not  developed  these  Guidelines  bec^us'e  of  any  legal  n 
requirements.    They  were  not  devised  in  response  to  any 
stand^ards  published  by  ptofeiisional  organizations,  although 
ETS  endorses  the  goals  served  by  those  eiEforts,  These 
Guidelines  are  the  result  of  an  extensive  deliberative  process 
whicl^  biBgan  at  my  direction  in  1974.    More  than  150  members  of 
.the  tdtaff  have  participated  in  the  initial  development  of  the 
Guidelines  and  their  subsequent  review  and  revision.  The 
Guidelines  are  drawn  from  the  particular  circumstances  and 
needs  at  ETS  and  are  designed  to  reflect  its  institutional 
objectifies,    Because  of  their  origin  and  purposes,  the  . 
Guidelines  cannot  generally  or  usefully  be  applied  to 
organizations  whose  practices,  programs  or  set'yices  differ  \ 
from  tho^e  of  ETS. 

The  Gui(ieiines  includj^  three  types  of  statements,  which 
Yiaw^e  vafc-ying  degrees  of  generality  and  significance,  Th^ 
principle  that  should  underline'  ETS  efforts  in  any  given 
area  ijb  set  firs^t^  policies  to  govern  debis ion-making,  and 
desijsn/ed  to  foster  more  specific  goals,  are  set  forth  next; 
and  jpjtocediites  relative  to  the  conduct  of  specific  ETS 
activities  are  14i[t  deslribed.    However,  biecause  the 
guidelines  must  4pply  to  a  broad  'diversity  of  programs  aiTd  . 
services  with  differing  characteristics,  edch  procedural 
guideline  represents  only;  one  method  of  achieving  th^ 
objectives  stated  in  the  policies. 

Even  the  principles,  and  policy  st^itements  might  reasonably  ; 
be  expect ed^re>ch#ng(B  in  foc\is*or  coverage,  as  scientific 
developments  or  practical  experience  change  the  nature 
and  desn^ability  Of  vat'i'ous  goals.*  Thus,  the  Guidelines 
art  intended  to  encourage  and  not  deter  change  and 
improvement.    They  should  foster  the  development,  exploration 
and  use  of  alternative  approaches  that  hold  to  high  standards 
and  starve  important  ETS  policies. 

ETS  believes  that  the  Guidelines  can  contribute  significantly 
to  the  quality  and  utility  of  ETS  {products  and  services.  The 
Guidelines  have  been  distributed  to  executive,^  managerial  and 
professional  ati|ff  at  ETS  s^.  that  they  may  be  applied  in  the 
course  of  their  work  at  EtsJ   ETS  does  not  have  complete 
responsibility  or\4uthority,  of  course^  to  determine  how  the 
Guidelines  will  be  implemented  in  ETS  prbgramd^  ftjr  which 
policy  is.f -substantially  established  by  a  spbnsorj^g' group 
other » than  ETS.    ETS  has,  however,  taken  steps encourage 


i  ■ 
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'     and  assist  those  groups  to  iioplemeht  the  Guidelines  as 
•  ^    their  activities  relate  to  ET8.    New  activities  ET8  enters  . 
^      into  win  be  held  to  this  same  expectation*  ^ 

puting  the  first  year  after  their  introducAon,  the  Guide! inea 
^.   existed  in  provisional  form.    They  .were  used  in  ivaluatliig 

ail  ETS  programs  and  services,  and,*  where  a  substsiqtial  lack  -  " 
of  compliance  was  found,  steps  were,  taken  to  achieve  compliance 
'within  a  re^onable  time,  or  to  revise  particular  provisions 
to  reflect  more  accMrately  the  diversity  ani^' practical  demandiB 
of  ETS  operations*    This  ]>rdce^s  of  review  will  continue  as  part 
of^our  organization-wide  quHlity  assurance  effort  and  a  report 
wilt  be  given  to  the  Board  of  Trustees  tat  regular  intervals  .  We 
are  conttiitted  to  the  effort  to  apply  U  set  of  po9itive  criteria 
to  our  work  and,  taking  the  present  document  as  a  starting  point, 
^    we  wiJLl  go.  forward  with  the  continuing  process  of  improving 
;  those«criteria  and  consequently  the  programs  and  services  ETS 
*  provides* 


February  1,  1979 


Hlliam  W*  Turnbull 
President 
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ACCOUNTABILITY. 
Principle 


ETS  acknowledges  responsibility  fot  the  ^ 
effective,  stewardship  of  its  resourced 
to  the  New  ^ork  Board  oT Regents  which  ' 
has  issued  its  xorporat?  tharter;  rt)  the  \ 
governing  boards  that  sponsor  and  set  policy 
(or.  programs  or  services,  in  which  BT.S 
products  or  services  are  used;  to  thie 
individuals  and  conmitliees  that  advise  ETS 
wi^h  j-Mpect  to  . appropriate /policy  for  its  ^ 
programs;  to  the  institutioiU  and  agiencies 
that  use  ETS  products,  and  se|$[^es;  to  <. 
persons  who  take  ETS  tests  (and  parents  or 
guardians  of  minor  persons) »  submit  data  * 
for  use  by  JSTS  or  for  distribution  to 
bthersj  or  participate  in  research  and 
development  projects  conducted  by  ETS;  and 
to  the  professional  associations  that 
are  iponcerned  with  educational  and  psycho- 
logical, measurement  aT\d  re9earch. 

•  /    •  ■    ■    .  *  ' 

.  Polici«s  . 


A*    ETS  will  furnish  appropriate  information  to  those  to  whom 
*      ■        ■  «         li-         ♦    ■  ' 

it  is  responsible  so  they  may  make  informed ,  yidependent 

judgments  as  to  the  effectiveness  with  which  ETS  exercises 
its  stewardship.  ' 

B*    ETS  , will  seek,  consider  and,  as  appropriate,  act  on  the 
views  of  those  who  sponsor ,  use  or  ar^e  affected  by  ETS 
programs  and  services*  *  • 

C*    ETS  will  seek  to  obtain  advice  on  its  ^ctivities  and  . 
policies  from  qualified  men  and  vpmen  who  are  not 
eoEiployed  or  retained  on  a  r^gula^basis  by  ETS. and 
who,  are  drawn  from  appropriate  professional'  disciplines. 


i 


♦  V 
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major  philospphies  and  points  of  view,  different  geographic 
regional  and^ the  na jor  ethnic  groupa  Within  the  relevant 
populations 

ETS  will  aupport  th^  activities  of  professional  associations 
with  respect  to  developing  and  ira|>lement  in'g .  professional 
standards  pr  codes,  making  available  the  results  of  current 
work,  arid  fostering  peer  review  of  its  activities. 

Procedural ^Guidelines 


9  with 


Information  should  be  provided  to  sponsoring  organizations  wi^h^ 
which  ETS  has  contractual  relationships  in  a  form  that,  permiji 
evaluation  of  ETS"  services  in-terms  of: 
s)  quality; 

b)  timeliness;:  » 

c)  costs;  and 

d)  responsiveness  to  legitimate  coimnents  or 
criticisms*  ^ 

■Procedures  should  be  established  to  facilitate  communication 
with  sponsors  by; 

a)    meeting  at  leadt  annually  to  provide  information 
add  to  receive  comments  ot\  matters  affecting  ^ 
(he  operat  iond  wit|)  which  they  are  .cohclhrhed ; 
*     ■  . 

.  b)    defining  a  mutually  ajgreeable  process  to  be 
used  to  transmit  comments  from  sponsors  or 
otheVs  and  a  timC^eriod  within  which  the 
evaluation  of  CQpwT?nt8  will  be  Completed 
and  reports  of  sections  to  be  taken  by  ETS 
caft  be  expected.  . 

c)    making  available  periodic  opportunit ies*  for 
.   sponsors  to  express  opinions,  judgments  and 
I     counsel  conqerning  ttieir"actiyities  or  programs 
directly  to  ETS  officers  not  normally  responsible 
for  such  act  ivit'ies.  or  programs. 


3.  Procedures  .8houl<)  be  established  for  making  available  technical 
and  other  information  about  ETS  prcraucts  and  services  to  users 
so  that  they  may.  evaluate  the  app.r9^riaCSs  use  of  the  product 

.  or  service  and  communicate  comments  or  criticisms  to  ETS. 

4.  Procedures  should  be  established  to  communicate  with  or  provide 

information  to-  persons  who  use  or  take  ETS  tests,  who  submit 

t  .1 

data  for  use  by  ETS  or  for  distribution  to  others,  or  who 
participate  in  research  and  development,  projects  conducted  by 
ETS.    This  information  should  be  communicate/ by  ETS  or  the> 
sponsor,  in  such  a  way  that  these  persons . may  understand  their 
participation  with  respect  to: 


a)    fche  identity  and  scope  of  the  sponsor's 
responsibility; 


b)    the  nature  of  the  product,  service  or 
research  by  which  they  are  affected; 


c)  the  way  in  which  the  product,  service 
research  will  likely  be  used  by  educa 
institutions  or  others;  and 


l^^l 


d)    the  channels  that  have  been  established  for 
addressing  comments  or  criticisms^,  to  ETS 
or  to  the  sponsor  and  response  thereto. 


3.  .Organizational  and  program  .financial  information  should  be  ^ 
recorded,  processed  and  reported  in  accordance  with»  generally 
accepted  accounting  principles  and  under  appropriate  % 
safeguards  to  insure  accuracy. 

• 

%.    An  aniflial  report  that  provides  information  abbqt  organizational 
activities  and  finances  should  be  publishf^^^l^jri^JS  on^a  regular 
basis  and  made  available  to  any  person  pn/^e^u^^t  *' r. Program  / 
amf  project  reports ,  including  program  fiWanctali  information, 
should  be  fhade  available  in  a  manner  consistenr^' with  contractual 
>    undejrettandihgs :  .  .. 


Re(iuei|t9  for  information  that  !»  not.  Included  in  an  existing  • 
publication  should  be  canaideted  by  the  appropriate  sponsor  and  . 
by  ETS.    If  ita  disclosure  is'  consistent  wi^ff  applicable  iaw» 
with  ETS  and  sponsor* policy »  and  with  contractual  obligations 
governing  confidential  or  proprietary  information,  the 
inforipation  should  be  provided.    If  complying  with  a  request  ' 
for  information  results  in  a  cost  to,£TS  or  a  sponsor  or 
affects  t;he  normal  schedule. of  fulfilling  GTS*  responsibilities, 
ETS  may  provide  the  requebte^l  infotopation 'in  a  reasonable 
period  of  time  and  at  an  appropriate  price  for  the  services  . 
rendered.    Procedures  should  be  established^  as  appropriate, 
to  facilitate  reiiponses  to  these  requests. 

/     ■       "     ■     ■•.      ■  ■  ■  ■ 

Changes  in  federal  statutes,  regulations  and  case  law  that 
a£fe'ct  research  and  development,  testing  programs,  or  advisory 
and  instructional  services  should  be  monitored  to  insure  that 
feTS  activities  and  operations  are  in  pompliance.  as  relevant 
federal  laws  or  rules  change'..   Changes  in  other  statutes, 
regulations  and  case  l^^shoul-d  be  evaluated  as  appropriate  for 
the  s^roe  purpose* 

All  proposed  new  ETS  activities  should  be  reviewed  by  counsel  • 
•for  compliance  with  applicable  federal  law  and  state  law  as 
approprifite.    ETS  officers  and  staff  should  direct  the  attention 
of  legal  counsel  to  matters  that  might  affect  ETS  compliance* 

Advice  should  be  sought,  where  appropriate,,  from  men  and 
women  drawn  from  diverse  backgroundp,  interests  and  expei^ience 
(e.g.,  appropriate  professional  disciplines^  msjpr  philosophies 
and  points  of  view,  various  geographic  regions,  and  major  ethnic 
handicapped  tnd  other  relevant  subgroups  of  the  population  of 
interest)  who -are  qualified  to  make  a  contribution  to  the. 
direction  and  substance' of  ETS  programs  and  who  are  not  employed 
or  retained  on  a  r^g^^Ar  basis  by  ETS. 
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H.    Individuals  who  become  members  of  an  ETS  external  advisoiy, 
review^?^r  evaluftion  committee  should  be  iriformed  about,  the 
results  of  the  committee's  work  in  a  reasonable  period  of 
time.        .  ^ 

12.    A  r^easonabijf  accommodatiort  should'^  made  wi^ih  respect  to 
the  professional  responsibilities  of  the  staff  in  order  to 
permit  staff  rafembers  professional,  meetings,  to 

cont^i;ibute  to  the  development  of  professional  standards  or 
codes,. to  participate  in  and  benefit  frp^  the  ditseminatfon  of 
information  on  subje&ts.Jfe  professional  interest  and  to  stay 
abreast^of  current  conceiu\&  and  accomplishments  in  related 


fields. 


13.    ETS  should  have  eff^tive  procedures  for  peer  review  whenever 
will  contribute  substantially  to  {he  quality  of  ETS 

work. 


14.    ETS  should  have^ effective  and  equitable  procedures  for  handling 
questions  of  8cx?|^^- authent  icity  arising  in  connection  with  thfe 
adroinistrat ion  q€  tests.         ^   ^         •  » 


CONPXDEWTIALtTY  OF  PATA 


Principle 

fiTS  recognises  the  right  of  individuals  and 
initituti.onn  to  privacy  with  regarxl  to 
information  supplied  by  and  about  th#m  that 
;ntty  be  stored  in  data  or,  research  files  held  ^ 
by  ETS  and  the  concomitant  responsibility  to  0 
safeguard  information  in  its  files  from 
unauthorised  disclosure. 

Policies. 

ETS*will.  ask  individuals  16  provide  information  about  them-  ' 
selves  only  if  it-  is  potentially  useful  to  those  individuals*, 
necessary  to  facilitate  processing  of  data  or  serves  the 
public  interest  in  improving  understanding  of  human  performan 
Insofar  as  possible,  individuals  shlbuld  be  infoi^m^d  of  th^ 
purpose  for  which  the  information  is  req^uesjjtid. 

The  right  of  individuals  to  privacy  regarding  information 
about  them  that  may  be  stored  in  the  data  ot  research  files 
held  by  ETS  extends  both  to  processed  information,  such 
as  scores  based  on  test-item  responses^  and  the  raw  data  on 
whiph.  the  processed  information  .is  based. 

ETS  will  protect  the  confidentiality  of  data  supplied  by 
institutions  or  agencies  about  themselves,  and  so  identified, 
to  the  extent  that  such  confidentiality  does  not  conflict 
•with  ETS  obligationa  to  individuals.  ^ 

^TS  will  not  collect  or  maintain  ih  its  data  or  research 

.      ■  ■      .  .     0  ■  .    ■  ... 

files  any  critical  information  that  in.  its  judgment  cannot 
be  protectA  adequately  from  improper  disclosure.  ^ 


S,     ETS  wiU  encourage  the  organizatfqn.s^with  which  it  works  to  . 

a^pt  policies  and  procedures  that  adequately  protect  the. 

.    confidentiality  of  the  data  ^transferred  by  ETS  to  thpse 
organizations.  '       .  ' 

procedural  Guidelines  ; 

■  —w. — ■ 

l«    Information  about  an  individual,. which  has  been  identified  as 
such,  may  not  be  released  by  ETS  to  organizations  other  than 
thpse  for  which  the  information  was  collected  without  the 
consent  of  that  individual,    Ji  written  exception  may  be  madfe  in 
the  case  of  research  studies  during  which  the  Committee  on 
Prior  Review  of  Research  has  determined  that  release  of  the 
data  serves  a  public  need,  fhat  there  is  no  satisfactory  and 
.reasonable  alternative  way  of  obtaining  the  information,  that 
the  recipient  researcher  will  use  thedata.  in  appropriate  ways 
and  that  there  are  adequate  assurances  of  confidentiality. 

.  ■    *  .  -  * 

2,    Information  about  an  institution,  which  has  been  identified  as 

such,  may  be  released  from  ETS  only  in  a  manner  consistent  wibh 
a  prior  agreement  or  with  the^consent  of  the  institution  or 
with  the  approval  of  the  cognizant  ETS  officer  and  representative 
of  the  appropriate  aponsor  (if  any). 

^•o.'4pi  individual  should  be  a>le,  on  payment  o^  a  reas^^^le  ' 

fee,  to  authorize  the  disclosure  of  inforpiation  about  himself 
pr  herself  from  program  data  files  held  by  ETS  to  any  appropriate 
recipient,  provided  that  such  authorization  is  in  writing  and 
that  disclosure  is  not  inconsistent  with  other  ETS  or  sponsorN, 
policies  and  does  not  violate  the  privacy,  of  other  individuals. 
Identification  of  the  requester,  through  si^n^ture  and  data 
file  number,  or  other  appropriate/tJiethod ,  should  be  required- 
beforf  any  suchy<infor^at ion  is  released r 
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4.  in  an  emergency  and  when  i'tHsi  to  the  benefit  of  the  individual «  . 
an  authorisation  by  telegraraiAr  telephone  for  the  release  of 
personal  data  should  be  acceptable*  provided  that  such  authorizatic 
includes  adequate  ident ifying.  information  and  that  such  release 

is  not  inconsistent  with  other  BTS  or  sponsor  policies.  .  By 
prior  agreement  with  the  individual p  authorisation  by  a* designated 
agency. or  ins.ti^tution  should  also  be  acceptable.    In  auch 
instances p  the  individual  should  be  informed  that  the  disclosure 
Aas  taken  place. 

y 

5.  If  an  individual  is  not  competent  because  of  illneis'  or  other 
considerations p  information  about  that  individual  may  be 
released  from  data  files  only  with  the  consent  of  the  individual's 
p^arent  or  legally  appointed  guardian. 

.  6.    Unless  the  access  to  confidential  data  can  be -safeguarded ,  ETS 
should  not  participate  in  any  time*sharing  network,  data  bankp 
or  other  electronic  data  processing  or  storage  system  involving 
.  units  outside  ETS. 

7.  .  On  submission  of  appropriate  identifying  information  and 

payment  of  a  reasonable  fee,  an  individual  should,  be  dble  to 
obtain  information  about  himself  or  herself  in  BTS^held  data 
files  for  the  following  purposes:  '  to  ascertain  tiie  accuracy  of 
personal  or  biograiphical  data  and  to  request  verificationp ' 
within  a  reasonable  period  of  time,  of  tesi;„8Cores  or  ot^er 
processcvd.  information  from  tests^  questionnaires,  or  .chooi 

records,  provided  sqch  release  is  consistent  with  sponsor 

....  .  *■  . 

policies.  ^ 

8«    Pi^ocedures  shoufd  be  developed  for  systematically  eliminating 
from  data  filea.  information  that  ia  judged  to  be  out  of  date 
and,  hence,  of  minimal  value.  ' 


I 
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9.  Information  £rom  BTS-held  program  data  files  provided  by 
individuals  for.  a  designated  purpose  should  not  be  used  or* 
released  for  another  purpose  (such  as. a  validity  study  or 
research  project)  without  the  individual's  consent  excep^ 

^     .  when  used  6r  released  in  a  farm  that  cannot  t>e  identified 
with  tbe  individual.. 

.  "  * 

10.  ETS  should  refuse  to  provide  personally  identifiable  information 
except  in  accordance  wiph  these  guidelines  unless  served  with 

a  subpoena  or  other  court  order*    In  that  event,  ETS  should  make 
appropriate  efforts  to  quash  or  narrow  the  subpoena  or  order  or 
•     to  obtain  a  protective  order  to  minimize  the  exposure  of 
personally  identifiable  information.  - 

11;    At  ihe  time  information  is  collected  and  to  whatever  extent  » 

practical,  programs  should  inform  individuals  of  the  conditions 
surr'oMndifig  the  release  and  confidentiality  of  the  information* 
about  them. . 

12.  Individuals  should  be  identified  in  ETS  research  files  only  by 
/.  code  numbers.    Information  linking  the  code  numbers  to  names- 
should  be  kept  in  a  .secure  location  only  as  lon^  as  necessary 
for  purposes. such  as  follow-up  studies  or  collating  new  data,  • 
after  which  the  names  should  be  destrpyed. 

13.  .  Every  organizat  ion  with  whiich  ETS  works  should  be  informed 

of  the  confidential  nature  of  any  dat a  t^r ansferred  by  ETS  to 
that  organization  or  collected  by  the  organization  on  behalf  of 
^TS  ,.80  that  appropriate  procedures  can  be  employed  by  the 
recipieht  organization  to  protect  the  confidentiality  of 
^such  data*  ^" 
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PRODOCT  ACCURACY  AND  TIMELINESS. 
Principle 


The  accuracy  of  ETS'  principal  products  and 
the  timeliness  with, which  they  are  made 
available  ar^  inportant  parts  of  the 
reapon^ibility  ETS  has  undertaken  with 
respect  to  its  sponsors  and.  the  diverse 
public  it  serves.  •  \  t 


Policies 

/  ,•  .   ■<        ■        . '    ■■  ■ 

A.  ETS  will  establish  standards  of  accuracy  *and  timeUness  with 
respect  to  each  principal  product.. 

t  ■  ■ 

B.  ETS  will' use  quality  controls  that  are  adequate  to  assure  that 
its  standards  of  accucacy  and  timeliness  are  met;  / 

C.  ETS  will  make  realistic  delivery  commitments  and  reasonable 
effgrbs  to  meet  those  commitments.^ 

0.    ETS  will  sacrifice  the  timelinesi  of  the  d^livery'of  information^ 
if  the  desired  accuracy  of  that  information  is  substantially 
in  l^estion.  1  . 

E.  ETS  will  seek  t\)  inform  those  adversely  affected  if,  subsequent 
to  its  release  I  information  has  been  found  not  to  meet  ETS 
standards ^of  accuracy^ 

■     V  ■  ' 

F.  .   ETS  will  seek  to  inform  those  adversely  affected  if  th^re 

i^'a  probability  tt^t  there  will  be 'substantial  departure  from 
ETS  standards  of  timelineis  with  respect  to  a  principal  product. 
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Procedural  Guidelines  / 

■  — .  •  -.  .  '  .  1  ■ 

!•    Principal  products  should  be  identified  and  a  standard  of 

accuracy  using  units  of  measurement  appropriate  ta  the  type  of 
■  product  should  be  established  for  each.,  .  ' 

2,    When  apj#opriate|  quality  control  should  include  an  adequate 
and  ii»pendent  recomputation  and  a. visual  reexamination  of. 
'  ETS-'pfocessed  information  based  on  an  appropriate  sample  of 
C4yses  sufficient  to  identify  errors  within. 'the  limits  of  the 
•   applicable  standards  of  accuracy, 

0    '  .  ■ 

I  ^*    When  the  computational  natute  of  the  information  is  such  ^  

that  it  is  impossible  or  impractical  (o  determine  the  accuracy 
of  the  information  by  independent  recomputation;  staff  members 
who  are  terchnically  competent  to  do  so  should  assess  ita 
^  '  ''reasonableness**  as  a  part:of  quality  control, 

4.    There^  shoulcl  b6  a  quality  inspection  of  intermediate  products 
when: 


a)  the.  accuracy  of  variable  information  (e»g, 
parameter  data*  algorithms))  verified  by 
independent  recomputation  or  assesameilti 

>       influences  the  nature  of  an  BTS  process. or 

computation  4nd.  is' critical  to  the  prbcess  that 
generates  an  EXS  principal  product;  or 

b)  detection  and  correction  of  errors  would 
facilitate  meet ingi  the  delivery  commitment'^ 
on  the  principal  j^oduct;  or 


c)    the  nature  .b(,  the  principal  prolluct  is  such 
that  it  is  im'possible  or  impractical  to' 
determine  the  accuracy  of  the  information 
.  by  independent  computation  usi^itg  the.  source 
data. 


i 
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5.  .Quality 'control  Eor  principal  products  that  do  not  contain 

pjrocedsed  information  (such  a$  bulletins  of  information  or 
test  books)  should  incite  inspection  of  a  sample  prior  to 
•     release  of  the  products    If  the  product  is  released  from  an 
outside  vendor '(e.g. ,  outside  publisher)  or  a  sponsor's  agent, 
quality  control  should  include  inspection  of  thode  components 
of  the  principal  product  that  contain  criticoj  information  on 
BTS'provided  services. 

6.  Quality  control  of  information  giveri  'in  letter  or  telephone 
responses  >8hould  include  a  periodic  audit  of  a  sample. 

7.  Failure  to  nee t  standards  of  accuracy  and  timeliness  should 

■  be  reported  to  a  designated  BTS  stieiff  member  for  resolution. 

8.  A  principal  product  that  does  not  meet  established  standards 

of  accuracy  should  not  be  released  until  appropriate  corrective 
action  is  taken.^unless  release  would  be  for  the  benefit  of  the 
*   score  recipient  and  users  and  permission  to  release  i-s  given  by 
the  cognisant  BTS  officer. 

9.  If  an  error  is  found^  critical  information  already  released 
by  ETSp  the  correct  information  should  be  promptly  distributed. 

10.  Process  control  methods  (e.g. ,  a  predefined  schedule  including 
a  delivery  date  and  contingency  procedures  for  dealing  with 
volume  surge)  should  be  established  for  the  production  of  each 
principal  product  to  help  assure  its  delivery  by  the  scheduled 
delivery  cUte.^ 

11.  If  it  is  lilAly  that  there  will  be  a  sOb^tantial  departure  from 
BTS  standard^of  timeliness  with  respect  to- a  principal  product « 
those  who  would  be  adversely  affected  should  be  so  notified.  . 
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RESEARCH  AND  DEVELOPMENT 
.  Priilcifide      ^ . 


A  Continuing  program  of  research  and  development 
conducted  in  compliance  with  professional  standSt^ds 
with  respect  to  quality  and  ethical  procedures 'is 

.  necessary  jto  maintain  the  high  quality  and  social 
utility  pf  ETS- contributions  to  education.  This 
^    includes  basic  inquiry  to  increase  understanding 
pf  educational  proc.esses  and  human  developmeht; 
evaluative  and  applied  research  in  response  t(^ 

,  the  needs  of  the  educational  community;  and  research  . • 
•   and  development  to  improve  ETS-products  an|l  s£rvic«9.  . 
Publication  of.  the  result*  of  significant  BTS  research 
is  of  benefit  to  ETS  and  the  profession  because  .it 
permits  others  to  use,  build  upon  or  impjrove  ETS 

.  work. ■  '  ■  ' ,  ■     ■  ^  ' 

Policies  .  '  - 


ETS  will  devote  appropriate  research  efforts  to  Improving 

education  through  the  discovery  and  conceptual  integration   •  . 

of  n0i>  prinpiples  and  understanding.    This  research  wi IT  be  • 

aimed  4t  extending  knowledge  of  the  learner  and  learning  ' 

1>roce8seSy  of  learning  environments  and  edijcational  treatmertlts , 

pf  educational  institutions  and  of  the.  interacting  factors  ,^ 

tha^'  influence  human  development.  .  .  ^ 

BTS  will  (^eyote  appropriate  research  efforts  to.  the  improvement 
of  the  technical,  quality  of  ETS  ftroducti  and  services.  Amon^ 
the  important  issues  addressed  by  this  research  will  be  problems 
of  test  development,  reliability,  equating,  validity,  and 
roeaningfulness  pf  interpretat Idhi        >•>  ^ 

.         ■  .     ^  ■  '  •  ■ 

ETS  will  d<evbte  appropriate  research  and  development  »  ▲ 

efforts  to  the  identification  of  needs  of  the  educational 
coimnunity  aoci  tq  the  creation^  improvement  and  evaluatiqn 
of  instruments,  sy.stems  and  programs  of  service  that  . 
roe^t  these  needs.. 
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Procedural  Guidelines 

■  \ 


1.  .  00  miaintain  th^quality  of  operational  programs »  ETS  should 

^  '.'        /  /  .  .  .  .    •  ' 

engage  in  th^  following  activities: 


a)    study  and  research  on  the  test  development  process, 
^  including  systematic  development  and • evaluat ion 

of^jkew  item  types  and  approaches*, 

studies  to  determine  the  sources  of  significant 
differential  performance  of  sex,  ethnic,  handicapped, 
and  other  relevant  subgroups  on  ETS  tests; 


c>    periodic  evaltfflt ipn^of  current  approaches  to  aptitude 
and  achievement  measurement  to  determine  fairness, 
validity  and  appropriateness  for  significant  subgroups 
such  as  minorities  and  woi&en; 


d)    research  related  to  reliability  theory  .arid  practice, 
including  nl^tho^s  of  determining  the 'reliability  of 
•    classification  decisions; 


e)  /  study  of  the  equating  methods  presently  in--u»e  and 

development  of  improved  methods  as  limitations  in 'the 
appliciability  of  the  present  methods  are  observed;  artd* 

f)  ^  research  to  advancd  measurement  techniques  and  selection 

and  classif iciation  models  relevant  to  fairness  and  validi 

2.    Research  projects  should  be  undertaken  in  such  areas  ^s 
t        learning  and  cognition,  personality  and  social  influence, 

teacher  behavior  and  instructional  proces&es,  socialization 
and  human  development,  iknd  the  economics  and  sociology  of 
education  as  a  means  of  improving  educational  policies  al^d 
practices .  . 

*" 

"3.    Efforts  should  be  made  to  develop  instruments  and  progr^s 
of  service  in  areas  such  las  measurement,  institutional. 
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and . program  aaaeasmenfc  and  evaluation »  instruct i on » 
guidance,  financial  aid,  certification  and  licensing,  and 
technology  that  would  be  of  educational  and  social 
utility.  .  * 

4.  Proposals  for  research  to  be  conducted  by  £TS  and  involving 
:   human  subjects,  or  -  respondents  should  be  considered  by  the 

Committee  on  Ptior  Review  of  Research,  under  its  (procedures 
for  review/  to  verify  that  proper  arrangements^ have  been 
.    '  made  for  protection  of  the  welfare  and  rights  of  human 
subjects. 

5.  Riesearcherd  shpuld  rtot  conduct  research  project's  without  the 
consent  of  subjects  and  respondents.    In  the  case  of  y^^ung 
children,  the  consent  of  parents  or  a  legal  guardian,  or  of 
appropriate  institutional  representatiiyes ,  should^be  obtained 

6.  Eacl>  research  proposal  should  be  .  reviewed  by  one  or  more  .  ' 
persons  who  are  competent  in  the  field  within  which  the 
proposal  falls.  .They  should  be  satisfied,  that  professional 
standards  of  quality,  and  ethical  conduct  are  met. 

•.7.     Identifiable  data  should  be  released  from  ETS  to  researchers 
other  than  those  who  originally  conducted  the  research  only 
when  one  of  ^wo' conditions^hfi^ve  been  met: 


a)  :  Consent  to  jo  ^so  has  been  given  by  or  on  behalf  of 
the  subjects  or  fesponden^^s  or  by  those  who  have 


given  ConseA^  on  tfi^ear  behalfj^or 


b)^    the  Committee  on  Prior  Review  of  Research  has 

determined  that  release  of  the  data  serves  a  public 
/need,  that  there  is  no  satisfactory  and  reasonable 
altieriiative  way  of  obtaining  the  information,  that  the 
.recipient  researcher- will  use  the  data  in  appropriate  ' 
ways  and  that  ther^  are  adequate  assurances  of 
conf idCntiallty »  * 
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After  the  data-collection  phase  of  a  research  project  has  been 
completed,  Bubjects^should^ not  be  expected  to  provide  additioilal 
'data  for  a  follow-up  study  unless  such  participation  was  part 
of  their  original  agreement  to  serve  as  subjects,  or  their  . 
consent  for  follow-up  is  obtained  or  the  follbw-up  study  has 
been  appr<$ved  by  tife  ETS  Conanittee  on  Prior  Review  of  Research. 

r 

The  results  of  ineasurea  of  •pei'rforniance  baaed  oh  experimental 
situations  or  tests  the  inteifpretation  of  vhich  is  therefore 
tentative  and  whose  applied  Vise  is  not  yet  supportable  should 
not  b^  reporj^ed  to  subjects,' or  to  the  instituti^tns  providing 
the  subjects, 'unless  there  is  relatively  little  <i^anger  of  ^ 
misinterpretation  or  misuse  of  the  ittfdrmatioh  that  would 
be  harmful  to  those  individuals. or  institutions  or  unless  the 
use  is  pari/  of*  a  feasibility  study  or  experimental  ^bnditio.nv. 
Stipulations  regarding  nociissuance  of  such  reports  should  . 
be  made  to  participants  .in  advance  of  the  data  collection. 

<The  results  of  each  research  project  undertakectl^  with  respect 
t(|  a  particular,  ETS  program  or  service  should  be  available  for 
dissemination  unless  a  specific  need  to  restrict  publication  ' 
to  protect  confidentiality  or  for  other  program  purposes  is 
identified  prior  to  the  beginning  of  the  project  and  made  | 
known  to  the  appropriate  individuals.  .      .  J 

The  cpnfcif^acts  under  wh*icb  research  is  undertaken  for  ^gen|ies 
or  institutions  outside. ETS  should  permit  publication  of 
the  results  of  thOi  resoarch  Unless  a.  specific  need  to  protect 
the  research  results  is  identified  prior  to  the  begii^ning 
of  the  research  and  made  known'^  t'b' the  appropriate  individuals.  ' 

■  -  .     .      '  i 


4-  ••• 

•  •..  ■  .181 


"  TESTS  AND  MEASUREMENT 

♦ ;         .       *  *  .  '  ■  ■         ■•  y 

Thi« 'section  whict?- dealis  with  ETS  testing  activities 
is^dividlP  inta  seven^subsect  ions  that  - {ire  devoted  to  test  development  i 
test  lidministrat ion,  reliability,  scale  definiti^nll^  equat ing ,  score 
interpretation/  and  validity.     •  .    ~T  -  ^ 

*  ■ 

TECHNICAL  QUALITY  OF  TESTS 


erJc 


Peine  ijpjle 


High  standards 'of  quality  and  fairness  in 

constructing,  adminleteting,  reporting, 
.  interpreting  and  evaluating  ETS  tests  are 
.central  to  ETS*  capabil ity  to^function  . 

effectively  as  ah  educational  ^^vice  and 

research*  organization. 


plicies 


f 


ETS  will  strive  to  develop  tests  in  which  the  attributes  • 
measured,  procedures  followed)  and  criteria  used  will  be 
unbiased  with  regard  to  a  heterogeneous  group  of  examinees 
and  appropriate  to  the  use  for  which  the  test  is  designed.  .. 

EtS  w'ill  establish)  standards  for  test-administration  processes 
that  minimize  variations  in  test  performance  due  to  circumstances 
or  conditions  not  relevant  i&  the  attributes  being  measured. 


<j.      ETS  wi^l  establish  for  its  tests  a  high  degree  of  reliability 
(accuracy  of  measurement) 
the  purposes  of  the  test; 


'  (accuracy  of  measurement) ,  consistent  with  the  requirements  and 


/ 

/ 

/  ■ 


I 


■  J  ■    .  .  . 

Ef8  will  develop  scales  for  reporting  scores  in  S  rational 
fashion,  consistent  with  , the  re^quirements  and  the  purposes 
of  the  test,  ^ 

ETS  will  provide  equating  systems,  when  appropriate,  for 

the  perpetuation  of  scales  for  reporting  scores  at  the  highest 

level  of  precision , practicable,  '  ^. 

ETS  will  make  available  to  sponsors,  institutional  or  agency 
users  and  examinees  data  for  interpreting  scores  on  ETS  tests' 
that  foster  appropriate  use  of  those  scores, 

■  ■''  (■ 

Recognising  that  test  validation  is  a  responsibility  of  both  \ 
test  users  and  test  developers ETS  will  encourage  and  assist 
test,  users  in  their  validat ic^  efforts  and  will  itself  tnake 
available  tests  that'  are  designed  to  meet  profesaionally 
•  acceptable  standards  of  validity  provided  the  use  of  sMch  tests 
ia.  consistent  with  the  priisary . purposes  for  which,  the  tests 
were  developed «  '    .  • 

ETS  will  adhere  to  appropriate  professional  standards  such  a^* 
those  published  in  Standards  of  Educational  and  Psychological 
Testa  and  Principles  for  the  Validation  and  Use  of  Personnel 
Selection  Procedures,       '  .  \  , 
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nr.al  GuideXinep 


Section  I:    Te^t. Davelopment 


U    Policy. and  tubstantive  cdntribationa  to  the  teit  developioent 


rlbutloni 
frop^jaiii 


lif  i^  men  and  women  who  are 


proceaa  ahoula  be  obtained 


*  diveraie  backgrcginda  and  appropriate  specialties  Within  professional 
fi^elda  (e.gj,  various  kinds,  of  institutions  and  programs, 
relevant  ptuloaophifts  and  points  of  view,  and  major  ethnic:, 
handicapped/  and  other  relevant  subgroups  of  the  population). 

2*    Appropriate  background  information  for  uae  in  the  development 
of  a  teat  lahoUld  be  documented  at  appropriate  stages  in  the 
development  process  and  include: 


a)  the  >urpose  for  which  the  tes(  is  intended  to.  be  used; 

b)  the  nature  of.  the  population  that  will  take  the  test; 

^n)  >    the  relevant  procedural ,  financial  S  time  constraints 
that  will  influence  the  available  test  development 
methdda  and  their  likely  outcoraest ' 

.  ■      ■  ■'  " 

d)  for  <ichievement  tests,  the  kinds  of  curricula  for 

whic^  the  test  is. designed;  .  \ 

.     I-.;         ■ ...  ,  ■  ■  ■■,  .  ■  . 

e)  for  job-related  teatir,  the  elemeiits  in  t\aining  or 
emplo^ent  that  are  related  to  performance,  on  the.  job. 


For  each  t^at,  specif icatidn?  should  be  developed  knd  reviewed 
by  a  proceJa  thpt  provides  information  from  the  follpwing 
perspectivejfti  ''\ 


♦ 


\ 


content  and  akills'—'SpecificatiKma  should  include  the 
psychological,,  educational /or  other  domains  tp  be 
eampled;  the  reiattve  weight  to  be  given  to  each  domain; 
the  appropriate  level  of  proficiency  to  be  required 
within  each  domain;  a  balance  with  respect  tp  curricular 


b)      test  and  item  format— specif ications  should  include  the 
item  (question)  types  that  are  most  clearly  related  to 
content  or  skills  to  be  measured;  the  appropriate  level 
of  'lanfluage  or  reading;  requirements  regarding  clear  and 
comprenenaive  directions  and  sample  items  or  the  need  for 
a  sample  test;  and  whether  free-response,  nkuttiple*-choice 
I         or  other  machine  scorable  formats  can  be  used. 


^c)     p8ychometric-"*specif ications  should  include  the  level 
1        of  difficulty  of  the  test;  the  distribution  of  item  . 
i       difficulties  (when  pretested  items  are  used);,  guidelines 
\'  .     for  evaluating  the  homogeneity  among  items  within  a  test. 
\       and  the  relationship  between  subtests  ^r  tests;  equating 
requirementa;  number  of  items  and  tpmey  allotted. 

*     •••    ■  ■  ■   V     .  ■ .       . . .  , 

d)     nnsitivity-- apecifiAtions  for  tests  should  require 
nj^erial  reflecting  the  cultural  background  and 
[    conttibutions  of  womeni  roinoritiea^  and  other  subgroups*;  ■ 
I    specifications  should  also  require  a  balance  of  positive' 
\   aonnotationa  if  negative  connotations  are  made  m  any  « 
\  references  to  these  groups.  W  .  • 

j  /■  .    ;         .   ■    ■  ■ 

fifcej^t  for  testf  designed  to  measure  rate  of  performance,  the 
number  of  items  in  a  test  that  has  a  specified  time  limit  ^ 
shoul^  be  chosen  so  th^  time  is  not  a  decisive  factor  in 
performance f  at  least  for  the  large  majority^  of  examinees. 

Subject  matter  and  measuremfflit  specialists  Camiliai:  with  the  ^ 
purpose  of  the  test  and  withithe  characftBristics  of  the  intended 
popukition  shoul^i  review  the  test  items '  for  accuracy^  content 
appropriateness  tnd  the  adequacy  with,  which  the  items  sample 
the  domain. 


6. 
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7. 


The  individual  items  in  a  test  should  meet  appropriate  technical  . 

standards  i\|ch  as  those  contained  in  the  manuals  for  item  writer's 

used  in  the  test  <levelopii^nt  area. 

•  ■ 

Individual  test  itey  and  the  test  as  a  whole  should  be  reviewed 
to  eliminate  languagei  symbola  or  content  which  are  generally 
■considered  potentially  offensive*  inappropriate  for  major 
subgroups. of  the  test-taking  population  or  sery/ng  to  perpetuate 
any  negative  attitude  which  may  be  conveyed  toward  these 
subgroups.    Mo  item  in  any  test  should  include  words,  phtases  . 
or  description  that  is  generally  regarded  as  biased,  sexist  or  I 
racist  (e.g. ,  demeaning  iqodif  iers.  and  stereotypes) . 


8.    The  items  in  a  test  should  be  reviewed  by  editorial  specialists 
for  clarity t  accuracy,  consistency*  and;  v^hen  appropriate,  for 
conformity  with  standard  editorial  style. 


Tests  should  contain  clear  and  complete  directions.  Enough 
sample  problems  should  be  provided  in  test-program  publications 
^o  that  the  examinee  can  understand  thie  nature  of  the  task  and 
the  test-taking  procedures.    Where  there  is  a  need  to  prpvide  a 
general  orientation  to  testing,  as  when  testing  young  children, 
practice  tests— included  eitfier  in  descriptive  material  or  at 
the  time  of  test  administration — should  be  used. 

>■ 

IO4    The  typography,  directions,  and  arrangement  of  items  in  the 
.  test-bopklet  should  facilitate  the  task  of 'test-takers.  When 
appropriate,  tests  should  be  made  available  ^o  handicapped 
individuals' such  as  sightTdeficien^ (Candidates  through  tapes, 
readers  or  special  printing.  .       ..  v 


/ 


0 
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■■  -/A^' :  ■  ;  ■  ■■ 

II*    Methods  should  be  employed  to  eval-uate  the  appropriateness 
of  iteitos  before  their  operational  use  in  a  program  or  before 
the  reporting  of  scores*    Appropriate*  methods  include  pret^stingi- 
.  pjreliminary  item  analysis  (using  the  first  operational  use  of 
itemd  fts  an  opportunity  to  identify  inadequate  items)  or  V 
careful  review  of  the  results  of  administering  similar  items  to 
a  similar  population,'  In  assessing  the  appropriateness  of 
'    items. before  their  operational  use,  efforts  should  be  msd^  to 
include  representative  samples  of  the  operational  test-taking 
population.  \ 

12.  The  operational  use  of  each  test  ahoukl  be  followed  by  systematic  . 
item  analyses  using  appropriate  criteria  an(^  by  test  analyses. 
These  analyses  should  include  reliability,  in^ercorrelations  of 
sections  or  parts,  and  speededness. 

13.  Studies  relating  itejp  performance  to  subgroilps  should  be  ^ 
\  carried  out  for  new  or  substantially  revised  tests  when  there 
*  are  adequate  data  concerning  sufficient  samples  of  large 

•sub^roupis  whose  educat ion  and  experience  may  be  different  from 
the  majority  of  examinees. 

! 14.  .  Th#' specif icat ions  for  tests  in  ongoing  programs  should  be 

reviewed  for  relevance  and  appropriateness  before  each  new  form 
is  Created..   ETS  staff  and  advisers  should  consider  "whether 
changes  in  the  field,  discipline  or  curricula  require  a  reviTion 
of  the  specifications.  V 

13.    When  major  changes  are  made  in  test  specifications,  cons id^r|it ion 
should  be  given  to  the  implications  of  such  changes  for  score 
comparability  and  whether  it  is  neces8ary\tb  change  the  test 
name  or  othefwise' communicate  to  those  w)|o\  interpret  test 
\        scores  that  comparisons  wi'th  earlier  tests  may  be  inappropria^L 

i    ■      ■      '       ■  ' 
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When  test  forms  are  used  for  a  number «of  yea^s  in  a  program,, 
they  should  be  reviewed  periodically  for  their  appropriateness. 
The  frequency  of  such  review  should  b^  determined  by  the  amount  / 
of  change  occurring  in  the  population  of  test-takers  or  the  / 
subject  matter  domain.  ^Test  forms  that  are  found  to  be  outdated 
should  be  revised  or  witKdrawii_f rom  use.     t  ./ 


I 


I 


'  Procedural  Cuideiines 

4^  .  •      .  Section  2:    Tea^ ^Administration 

I.    Information  shbuld.be  made  available^bi^rospective  examinees 
.    and  (iri  sdltte  programs ,  to  .parent jjjf or  guatH^«  as  well)  in 

advance  of  the  test  administration  with  respcbt  to  tne  following, 
aa  appropriate: 

a)  the  purpose  of  the  test  and  what  it  measures; 

b)  the  nature  of  the  test- items  (includij^g  samples  of  typical 
item  types);  w 


c)  the  relevant  instructions  for  taking  the  test, 
.  including  instructions  for  guesgingi  changing 

answers,  and  strategy  involving  speed  and  accuracy  I 
in  taking  the  test;  * 

d)  identificatibn'rtfquirementS^d  the  consequences  of  not 
^       having  identification; 


#        1     e)      the  consequences  of  misconduct  by  the  test-taket; 


i)     background  and  experience  relevant  to  tes 


t  performance; 


*g)     the  location  of  test  centers,  the  test  dates  and 
special  testing  arrangements  that  can  b^  made; 

h)      the  procedures  for  registering  for  the  test  and 
changing  the  centers ; 


i)      the  structure  of  J^st  fees  and  fee  waivers; 

■  ■  ^  y  'X  ..  :  ■ 

j)     speeial  arrangements  ayiH.able  fon administering  tests 
.  to  handicapped  individuals;  \ 


/ 


;  erJc 
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k)      the  reporting  of  scores^;  ' 

<■         •     .'  **      *  ■  • 

1)      procedures  for  canceling  teat  scores  by  the  candidate  and 
.reasons  why  ETS  or  the  sponsor  of  the  test  might  cancel 
scores;  and 


t^  procedures  .for  registering  complaints.. 

Program  publications -should  be  reviewed  for  language  or 
deacripblons  generally  regarded  as  biased  and  offensive.    For  . 
example^  the  exclusive  use  of  masculine  pronouns  should  be 
'avoided. as  sht^ld  the  imf^lication  that  all  persons  in  a  given 
category  (for  iiVatance»  examinees,  supervisors,  counselors,  or 
teachers)  *ar^  either  femaled  or  males  (unless,  of  course,  the 
category  is  logic&lly\restricted  to  ynembers  of  a  single  sex).  ' 
Illustrations,  examplesNand  practice  items  irt  test-information 
publications  vhould  repre'Sihnt  males,  females,  minority  and^ 
^jority  groups,  and  individihQs  in  ways  that)- indicate  respect 
and  awareness  of  vfluable  contributions. 

'      A.  ■ 

The  facilities  at  which  teats  are  administered  should  hk 
places  that  are  convenient  for  the  majo^iy  of  examinees, 
nonsegfr elated  and  comfortable.    At  least  pifitrtions  of  those 
facilities  should  be  acceSvSible  to  and  responsive  to  the  needs 
of •  handicapped  ih<^ividuals.  ^ 

■     \  '         ■      .       .        .  ,  .  - 

ETS  shopld  enlist*  Hest-center'  supervisors  and  staff  with 
demonstrated  sensit^ivity  ,to  the  anticipated  sex  and  ethnic 
composition  of '.the  examinee  group,  based  on  prior  exper.ience* 
When  appropriate,,  persons  affiliated  with  institutions  attended 
by  significant  numbers  of*  those  examinees  should  be  included. 
Minority-group  supervisors  and/or  proctors  shguld  be  employed, 
and  test  sites  should  be  located  in  minority  communities 
whenever  appropriate  and  feasible. 


Test-c^ht^r  eupervieotB  and  staff  should  be  familiar  with 

the  pvo(;edure8  for  adminietering  a  a^andardized  teat  and 

should  be  provided  with  a  description  of  the  testing  program, 

a  description  of  the  candidate  population,  and  specific  instrui-' 

tions  for^  administering  the  test.     Instructions  concern  such 

subjects  as  the  duties  of  test  supervisors,  associate  supervisors, 

and  proctors;  the  receipt,  storage  arid  return  of  test  supplies; 

the  admit tanoe  ot, examinees  to  the  testing  rooms;  the  distribution 

of  t6st  mat^rials^  procedures  to  bC  followed  in  administering 

k  ■        ■  .  ♦ 

tests  to  handicapped  individuals*,  procedures  to  be  followed  in 

instalices  of  suspected  cheating;  procedures  to  be  followed  in 

other  cases  of  candidiate  misconduct;  and  procedures  tQ  be 

followed  in 'Case  of  emergency. 

'  *  . 

Test  performance  can  be  affected  by  the  psychological  atmosphere 
of  the  testing  center.-  Test  sup^itvisbrs  should  be  informed  of 
this  and  instructed  to  take  measures  to  avoid  an  adverse  situation*. 
For  example,  test  supervisors  should  be  instructed,  when  it  is 
appropriate  and  feasible,  to  have  minority-  as  well  as  majority-  • 
group  persons,  women  aa  well  as  men,  read  test  directions  and 
to  recognize  questions  from  examinees  following  an  impartial 
procejdure.  •  ^ 

ETS  should  provide  the  test  center  supervisor  with  directions 
to  be  read  aloud  to  examinees  before  the  test  begins!    These  ^ 
directions  should  include  information  relating  toT  procedures 
for  matking  answer  shejets,  timing  of  test  sections ,  strategies 
for  guessing,  time  and  duration  of  test  breaks  and  examines' 
.  use  of  unauthorized  aids-    Test  supervisors  should  check  to  see 
that  examinees  understand  their  task  and  the  procedures  to  be 
followed. 


I 

.  1 
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8.  Reaspnable  efforts  should  be  piade  to  eliminate  opportunities 

t6t  examinees  to  attain  scores  by  fraudulent  means  by  stipulating 
.requirements  for  identification,  assigning  examinees  to  areiats 
'and  requiring  appropriate  space,  between  seats.  .  ' 

9.  Appropriate  procedures  should  be, applied  after  the  test 

'      administration  to  identify  scores  of  questionable  authenticity, 
.  to. resolve  issues  of  authenticity  and  to  provide  for  prompt 
reporting  of  questioned  scores' found  to  be  authentic. 

10.  -  A  systematic  program  for  observing  test  adminisbr'ations  A 

should  be  conducted  by  trained  ETS  staff  members  pr  other 
qualified  individuals:    to  review  the  testing  procedures  with 
• the  test '  supeWisors ,  to  insure  appropriate  testing  conditions,  . 
to'iinsure  adequate'maintenanqe  of  test  security  at  thet  test 
centers  and  to  relay  questions  and  concerns  from  the  field  to 
the  appropriate  ^TS  office.  <  \  ' 

11.  Testing  programs  should  have  detailed  procedure^  tor  investigating 

.u        ■  '  ,   ,  , 

and  resolving  examinees*  complaints  of  irregular  test  administration 

or  score  reporting. 


12.  Comments  and  suggestions  should  be  solicited  from  supervisors 
by  such  means  as  the  Supervisor's  Comment  Sheet  and. meet vhgs 
of  supervisors .to  provide  ETS  staff  with  information  to 
improve  fut;.ure  administration?.  '  • 

'      t  '  .  ■  '  , 

13.  Supervisors  should  be  required  tp  record  and  report  to  ETS 

^  information  on  ^regularities  (such  ad    mist imifig,  .  defective 
materials,  power  failures  and  cheating)  so  tha^  ETS  can 
evaluate  the  possible  effect  of  ftuch  occurrences  oh  examinees* 
test  performance.  "     .  ■  .  .  ^  .  « 

14.  An  individual  who  has  taken  a  test  should  be  pVoy^ided.  ij^ormat loir^ 

•yat  will  be  helpful  in  interpreting  scores  on  that  rest. 

'       ■  ^  .'    ■*/       ■'■  ■ .  , 

'   /■       ■  '  ....  ■  .  ■ 
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•  Section  3i    test^ Rfeliability  ' 

When  test  scores  are  reported  to  institutional  or  ^agency  users  . 
or  to  individual  examinees,  information  about  the  reliability 
of  the  test  shpu.ld  be  documented  and'  shoulcl  include: 


a)  a  reliability  coefficient  and  an  overall  standard  error  of 
measurement,  (several  ind ices  may  be  prov.ided  if  more  than 
one  method  of  assessiifg  re^Liability  has  been  ^used ;  alternate** 
form  information  should  always  be  provided  if  available); 

'  '  •  ■  .       ■  . 

b)  standard  errors  of  .measurement  for  score  regions  if  decisions 
about  individuals  are  m4|^e  in  those  score  regions  and  if  the 

'.pverall  regions  and  the  ovierall  standard  error  are  judged 
inappropriate;  .  ^; 


c)  the  formula(s)  used  to  estimate  reliability  and /or 
appropriate  references;  • 

d)  a  '  just  if icat ion  of  the  method(s)  used  to  assess  reliability^ 

%     .  '    '  '  ■ 

e)  a  specification  of  the  major  sources  of  measuifement  error 
accounted  for  in  the  reliability  analysis;  . 


£)    a  specification  of  the  time  interval  between  Nestings  if 
alternate*fori]||  or  test-retest  reliability  is  used^ 

^)    the  number  of  observations,  the  m^an  and  st'atidard  deviation 
•    of  the  analysis  sample  (ranges  or  averages  are  acceptable 
in  cases  where  the  reliability  information  is  derived 
from  several  samples);  '     *      .  ■ 


h)    speerdedness  dat^;  and 


i)    correlations  of  subscores  within  the  sam^Stest  or  battery 
of  which  the  test  is  a  part.  \ 


.*         ' . 
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If  reporting  any  of  the  reliability  information  required  under 
Guideline  1  is  inappropriate,  the  reasons  should,  b.el  stated  in 
appropriate  program  documents^ and ,  if  possible,  alternate 
information  about  consistenciy.  should  be  provided'^    *  ^ 

Efforts  should  be  made  to  provide  reliability  information  in 
an  appropriate  form  to  the' examinee?  to  whom, the  scores  are 
reported .  ■ 

The  ineChodCs)  used  for  assessing  reliabil4ty  should: 

a)  take  into  account  the  most  common  sources  of  error 
.generally  considered  significant  for  test  interpretation 

(^•^•»  guessing,  instability  ov«r  time,  item  and  content 
variation,  and  rater  inconsistency):  and 

♦ 

b)  be  appropriate  to  the  nature  of  the  test,  in  oVder  not  to 
seriously  over-  or  underestimate  relial^ility i    '  • 

'     ■       *  •  ' 


Section  4:    Scale  Definition 


Raw.  scores  on  a  test  or  Bubteat^\(including  percentages  of 
q^jations  answered  (Correctly)  should  not  be  reported  by  ETS  for 
iSRvidual  ^xdminees  or  in  summary  form  for  groups  of  examinees 
except  under  either  of  the  following  circumstances;  . 


a)    when  it  is  ant icipated ' that  only  one  edition  of  the  test 
wiiy  be  offered  for  uae  in  the  foreseeable  future  or  it  is 
demonstrated  by  appropriate  empirical  procedures  that  raw  . 
scoreit  on  ail  the  editions  to  be  conl^ared  are  interchangeable; 
or  when  raw  Scores  on  that  test  edition  will  not  be  compared  ■ 
directly  with  raw  scores,  on  another  test  edition;  Or 


b)    when  reported  in  conjunction  with  a  scaled  spore  an<Lj,h. 

a  context  that  supports  appropriate  int^^rpretat ion,  such  ^ 
as  when  a  copy  of  the  test  itself  is  available  or  when 
individual  or  group  responses  to  individual  items,  depending 
on  whether  individual  or  group  performance  is  \^eing  assessed, 
are  a>^ailable. 


If  a  test  or  test  bj^ttery  yields  multiplie  scores  for.  an  individual 
and  scaled  scores  at'e  to  be  used  directly  (i.e.,  without 
reference  to  norms 'tables)  in  interpreting  performance  profiles, 
the  scales  should  foe  hormatively  defined  .and  each  should  be  .d.efine 
with  respect  to  the  same  population.  .     ■  '-^ 

When  different  tests  in  a  program  are  taken  by  different 
examinees  whose  scores  are^ to  be  directly  compared*  the  scales  ^  . 
'for  the  tests  should  take  At o  account  possible  differences 
^moAg  the' groups  of  examinees  who  take  the  various  tests* 


145 


4. 


Established  scBftes  '^hQuTSB  not  be  redjaiined  except  under  compelling 
circuro8tance8.|T  I?  a  scale  is  to  be  substantially  redefined, 
tljie  nuraerica.r  lvalues  should  be  changed  substantially  to  minimize 
the  possibility^  of  cOnfudion.  between  test  results  expressed  on 
the  revised  s^ale  and  results  expressed  on  the  original  scale« 
An  exception  b9  this  guideline  may  appropriately  occur  if.  the 
test  in  queStio^  is.  one  of  a  set  of  tests  for  which  k  sijngle 
range  of  numerica-1  values  (e.g.,  20-80)  is  us^d  and  |he  scales 
for  other  t&ts  fn  the  set  have  not  been .  redefined • 


A 


5. 


6. 


Scale  properties  that  affect  score  interpretation  and  use 
should  be  described  in  program  publications  avamable  to  the 
examinees  and  to  institutional  j^r  agency  users.  ' 


Technical  manuals  and  interpret iv^e  publications  for  institu- 
tional  or  agency  score  users  and  Waminees  should  indicate ,  in 
language  api$ropr late  to  the  audietl^ce,  whether  a  distributively 
based  scale^ is  intended  to  be  normative  or  nohnormat ive .     If  it 
is  intended  to  be  normative,  the  group  'should  be  described. 


7.  Whenever,  a  normatively  defined  scale  no  longer  convey^  useful 
normative  information,  a^l  published  descriptions  of . the-scale 
.jhpuld  be  changed  accordingly.  '  ^' 

..  ■  i  ■■       .  ; .      ■  .'■  ... 

8.  Program  publications  should  caution  score  r«c ipient s  (users  and 

"exagiinees)  that  scores  received  on  different  tests  that  are': 

i 

reported  on  scales  that  are  similar  in  appearance  may  not  be 
equivaleht*. 


/. 


.  / 
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Guidelines  9  throi^h  14  apjxly^rily  to  scales  established  after 
guidelines  ^l^&^efe^published  on  August  1,  1977,  '  . 

9.    If  a  scale  is  to  be  distributive,  the**  (Choice  between  a  normative 
and  nonnormattve  distributive  sca^e ^should  take  into  account.: 

.  ^ 

a)      the  extent  to  which  normative  interpretat 10%  with 
reference  to  a  particular  population  will  be 

^      appropriate  and  useful  for  all  exavinees  who' take 
the  test  and  for  all  purposes  for  which  the  scores 
are  intended/^^  be  used; 


b)      the  probable  time ^period  during  which  the  normative 
information  conveyed  by  the  scores  will  continue 
,i  to  be  descriptively  appropriate;  and 

'  .  ■  ■  .   ■    '         ■  .  ■■  • 

^Eh«L^easibili|[y  of  identifying  and  testing  a  suitable 
group^f^exaowiees-  on  which  to  base  a  nortpative  scale. 


10.    The  choice  between  a  distributive  and  n6nd istribut ive  scale 
shoU'ld  take  into  account  the  use  for  which  the.  test  was  \ 
intended  and  to  which  t;he  test  is^likely  to  be  put. 


1.1.    If  i|  scale  is  to  be  defined  with  reference  td  standards  of 
performance,  the  basis  for  estdbt'ldhingi' the  standards  sV^ould 
be  determined  empiri$:ally  OF  rationally  rather  tl^n  arbitrarily. 
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12.  The  conventional  grade-:  or  age-equivalent  score  (the  grade  or 
age  for  i?hich  a  particular  score  is  the  average)  should  not  be 
used  to  establish  the  score  scale  for  a  t^st  or  system  of 
tests.    This  typfe  of  score,  as  it  typically  has  been  derived, 
l^hould  be  avoided  altogether  as  a' basis  for  reporting  test 
performance^    However,  the  gr^ide  (or  age)  for  which  a  particular^ 
scaled  score  on  a  test  is  the  average,  referred  |o  here  as  a  . 
"grade  (age)  Tevel  indicator"  to  ^istinguish  it\from  the 

,      conventional  grade'-equivalent  (age-equivalent)  score,  may  \fe 
reported  to  help  in  jpcore 'interpretation,  if • the  practices 
customarily  followed  in  deriving  aiK|...-fi^s^nt ing  irade-equivalent 
^age-equivulent)  scores  are  modified  in  a^ordance  with  ETS 
eriterlia  that  obviate  the  technical  interprietive  problems  |^at* 
gradejequivalent  (age-equivalent)  scores  ideate.  \  ' 

I  * 

13.  The  choice  of  a  scale  sliould  take  into  accpurit.the  likelihood 

of  confusion  with  other  widely  M9ed,  scal^es. 

14.  In  establishing  the  number  of  diatinct  scale  values'  to  be  ' 
reported,  consideration  should  be  given  to  the  relative  importune 
of  the. need  to  avoid  erroneous  distinct^ions  among  individuals 

.    /  (by-reporting,  different  scores  for  individua^ls  whose  true 
scores  are  the  same)  4nd  the  need  to  maintain  distinctions 
that,  on  the  av^^^jge,  will  be  correct  (by  reporting  different 
scores  for  groups  of  individuals  whpse  average  true  scores  are 
diffeifent).  .  . 


■        ^1  • 

Procedural^Guidelines  * 
Section  5:    Equating  ^  , 

/  ■ 

Adequate  equating  should  precede  comparisons  of.  the  test 
performance  of  two  or  more  individuals  ot  groups  on  nonidentical 
items  or  sets  of  items  such  as  test  offerings  in  which  successive 
or  aLte^n/ite,  forms  are  used  interchangeably. 


Statistical  method?  selected  for  equating  should  be  lAed  only 
under  ^Circumstances  that  are  j|[onsistent  with  the  a^stimptians 
under  which  the  methods  have. been  developed.  / 
■         ■     .  '  '  / 

^  regular  and  continuing  testing  prograips^hat  are  available 
to  lisersi  integrated^  long-range  syst^i^s  of  equating  the  scores 
to  4II  successive  editions  of  the  jTest  should  be  used  and 
desc^^ibed  in. technical  publications. 

■    . .  1  •      '  y  ■  ■  ■  • 

For  those  .tests  that  ajp^of  fered  for  institutional  use  (as 
distinguished  from  .externally  administered  tests  offered  in 
testing,  programs^  of  which  only  a  limited  number  of  . forms 
are  availab^le,  equating  of  new  forms  should  be  based  on  specially 
desig^^d^ studies  in  which  e>^aminees  or  groups  of  examinees  a^e 
sel^ted  by  an  appropriate  sampling  procedure  to  take  the 
^alternate  forms  Or  alternate  sequences  of  forms. 

When  test,  forms  are  equated  with  the  use  of  common  (anchor) 
items,  the-  psychological  taslTaf  taking  those  items  (represented, 
for  example,  by  the  directions,  the  context  of  the  items  and 
the  speededness  of  the  part  of  the  test  in  which  the  items 
appear)  should  be  the  same  for  all  examinees. 
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When  the  commoo  iteWs  used  for  equating  are  not  representative 
of  the  tests  being  equated,  the.  grpups^f.  examinees  used  for 
equating  should  be  49  nearly  as  possible  equivalent . 


In  the  continuing  tel^ting  programs,  statistical  checks  (e.g., 
check  equating,  special/scale-stability  studies)  should 
be  employed  to  permit  regular  assessment  of  the  precision 
of  the  equating.         !.  •  .  • 
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Procedural)  Guidelines 


Section  6:     Score  Ipter^r^etat ion  \ 


li  Effective  test  use  and  iDeapijigful  score  interpretation  shoulj\^ 
/      be  supported  iind  Augmented' by: 

/b)  ,  the  development  of  appropriate  test  norms  based  on 

administering  tests  to  samples  from  a  defined  population 
V         ,  when  th^re  is  a  reasonable  expectation  that  a  large 

proportion  of  the  schools  or  other  units  selected  for  the 
')  norma  sample  will  agree  to  participate;  or,  r^* 

b)    a  rationally  developed  system  of  interpretation  shai^^ed  with 
score- recipients  when,  score  interpretation'  is  not  developed 
'         •  :  from  normative  data. 

2.  Tests  offered^or  s«le  and  described  by^  ETS  as  standardized 
tests  (as  distinguished  from  tests  offered  in  testing  progframs) 

^     should  liave  adequate  norms  or  other  information  for  use  in 
interpreting  test  results.  .  ^ 

■  ' 

3.  When  test  norms  are  developed  by  administering  tests  to  samples 
from  a  defined  population,  the  resulting  Qorms  should  be 
representative,  of  any  relevant  subgroup,  including  those 
defined  by  sex'or  ethnicity,!  in  proportion -to  their  frequency 
in  the  defined,  population.    Such  subgroups  may  be  deliberately  ^ 

[    over-sampled  for  more  precise  estimation  of  the  stati/stical 
characteristics  of  the- population  by  procedures  that  take 
overr&ampling  into  account..  Data  on  the  proportions!  in  the 
sample  and  in  the  population,  when  available,.  ^houJ^|  be  reported 
in  an  appropriate  techn^c^l  publication.  ^ 
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The  report  of  a  special  norms  study  should  provide'  informati 


on: 


I  a)    the  sampling  design; 

b)  the  participatioa  rate,  of  institutions, 
or  i;)dividual  respondents  in  the  sample| 

c)  characteristics  of  the  participating 
institutions  and  individuals;    '  \ 

■         .  ^ 

d)  weighting  systems  used  in  preparing 
norms;  and 

■      /    .  ■  ■   -  .  Jk. 

e)  estimates  of  sampling  variability  along 
with  Ai  afcknowledgraent,  yhen  necessary, 
that  such  estimates  do  not  take  into 
account  biases  arising  from  nonparticipation. 

When  descriptive  statistfcs  based  on  program  testiijig 

(as  distinguished  from  norms  based  on  special  normii  studies) 

are  published,  the  following  guidelines  should  be  Led: 


a) 


both  table  titles  and  descriptive 
material,  should  make  it  clear  tliat 
the  statistics  ar?  based  on  examinees 
or  participating  institutions  or 
other  using  agencies; 


b) .\  the  descriptive  material  should  define/the 

nature  of  the  group  {)/  identifying  tb« 
appropriateneas  of  the  sample  and  the^ factors 
that  relate  the  background  of  the  group  to  test 
performance,  and  4>y  acknowledging  explicitly  ' 
that  the  sample  is  self-selected; 

•  ■  -     /  ^  •  ' 

c)  when  possible,  rcpotts  should  be  prepared 

to  allow  comparisons  of  data  based  on  program 
ex|kBinee8  or  institutional  oharacteristics v 
wieh  rcflevant  data  on  variafles  from  other 
sources^  ' 


T 
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iwhen  infotmation  about  interpretive  data, 
lis  prepared  for  different  uaer  groupa, 
the  presentation,  whenever  practicalle, 
should  be  adapted  to  the  needs  and  '.  . 
background  of  eachVgroup. 


When  no^fas  are  developed  from  program  testing,,  the  age,laex 
and  etYjijiic  compdsitioiU  of  the- program  norms ^g^^  ^ould  be 
r  iu.ch  iT 


descrijtjf^d  wheneve 
is  available 


InV/sting  programs,  descriptive  dtatistics  should  be  compiled 
pe//odically  from  a  sample  or  entire  population  in  ordpr  to 
itor  the  participation  and  pertormance  of  males  and' females 
awn  f^m  diverse  backgrounds,  interests  and  experience  (e.g., 


informatioirt  ifbtTut  subgroup  membership 


or  ethnic  group,  handicapped  statua  and'wher  relevant 


11^ 


9v 


aubgroups  of  the  population  of  intere9t). 

If  norms  intended  for  use  in  the  interpretation  of  individual 
scores. are  presented  separately  for  males  and  females  or  for 
members  of  specilic  ethnic  ^oup8,"tKe 'irationale  should  be/ 
carefully  described.    Separ^e  »norms  may  be  justified  for 
scores  used  primarily  for  jgilii.dance  when  access  to  the  experiences 
needed  to  earn  a  high  scot e  is  clearly  related  to  subgroup 
membership  and  a.  more  direct  index  of  access  is  not  available. 
The  existence  of  score. differences  between  subgroups  does  not 
in  itself,  juptify  presentation  of  separate  norms.  -  \ 

1.  ■       >  ,  ' 

Descriptive  statistics  prepared  separately  for  subgroups  of  the 
relevai^  test-taking  population  but  nat  intended  for  use  in 
interpreting  individual  scpre^s  should  not  be  presented  in  a  way 
that  encoiirages  their  use  fot  such  a  purpose. 


/ 

erJc 
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(}.0*    Institutional  ox  agency  users  and  examinec^B  should  be  informed 
of  the  standard  error  of  measurement  of  a  score,  and  t^st^^  —^' 
interpretation  materials  should  point  out  the  1  imjJr;^  ions .  of 
.  .    test  scores  and  encburag4l|ico^Fe  users  to  -take  into  account  the 
•possible  scores  a^tes^  taker  might  achieve  on  retesting* 

11«    Statistical  data  used  in  score  iaCerpretat ion  should  be  revised 
annually  except  when  less  frequent  revision  is  judged  to  be 
appropriiate  as,  for  example,  when  norms. are  based  on  special 
'      studies,    A  statement  of  the  period  in  which  the  data  were  • 
collected  should  be  included  in  any  publication  that  presents 
the  data, 

■V   ■  ' ; 

13,    Institutional  or  agency  score  recipients  should  be  provided 
^*         with  interpretive  materials  designed  to  be  helpful  for  Using 
scores  in  conjunction  with  other  informat ion^  setting  cutting 
scores  where  appropriate ,  ^interpreting  the  scores  for  special 
si^bgroups  (e;g.}  ethnic  minorities,  males,  females,  and: 
handicapped  students),  conducting  local  normative  studies, 
and  developing  local  interpretative  materials,  . 
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,  '  Section  7:      Test  Validity 

ETS. should  provide  evidence  of  the  validity  of  its  tests  in'^ 
relation  to  the  principal  purposes  or  intended  uses^of  Che  . 
tests,    dne  or  mo.re  of  the  following  may  be  applicable: 

.      •■       "  • 

a)  whe^  test  scores  are  to  be  interpreted  in  terras  <rf  degree  , 
of  master/|^f.  the  knowledge,  skills,  or  abilities  of  a 
domain  rept'es^ted  by  the  test,  content  validation  evidence 
should  be*  provided.  .     \  •  '  \  . 

.   •  •  '       ■  .      '  .  .       i .  ' 

b)  when  tes|:  .scores  are  to  be  interpreted  in  terras  of  the        .  % 
prediction  o^  future  behavior »  criterion-related  validation 
evidence  should  be  provided. 

c)  wht^n  test  scores  are  to  be  interpreted  as  4  measure  of  a 
theoretical  construct^  construct  validation  evidence  should  - ' 
be  provided*^ 

Evidence  of  content  validity  should, be  based  (a)  on  a  careful 
d'eternination  And.  analysis  of  the  domain(s)  of  interest  and  of 
the  relative  importance  of  topics  within  the  domai|n,  and  (b)/on 
a  demonstration  that  the  test  is  an  appropriate  Sample  of  the. 
knowledge,  or  behavior  in  the  domain(s) .    A  report  on  evidence 
of  content  va).idity  should  present  descript iqns,  of  the  procedures 
employed  in  the  study,  including  the  number  and  qual if icatioTns 
of  experts  involved  in  the  analysis  of  the  domain  or  evaluation 
of  the  relevance  and  appropriateness  of  the  test.*  .  ' 

Construct  validation  should  be  based  on:    rational  and  empirical 
analyses  of  processes  underlying  performance  on  the  test 
in  question  includin^i  where  appropriate,  noncognitive  jas  welb  , 
as  cognitive!  functions.    Empirical'  evidence  relevant  to  the 


analyses  should^  include  resultsjof  investigations  of  the  degree 
to  which' test  scores  are  related  or  ^nrelated^ to  other  variables 
in  ways  implied  by  |:ntended  interpretations.    '  ' 


cyiteriori-*relirted  validation  should  be  used  only  when  technically 
//  ^      /  ■  ,     ■  *.  ■ 

sound  and  relevant  criteria  are  available  or  pan  be  developed 

and  when  other  conditions  affecting  feasibility  warrant  the 

study.  .  . 

a)  Criterion-related  validatipn  should  involve  as  many 

'       performance  variables  a^  necessary  to  permit  evaluation  of  • 
the  effectiveness  of  test  scores  for  predicting  the  types 
•of  b^avior  they  are -intended  to  measure. 

.7-    '  ■   .    ■         .  .  ■  ■  " 

b)  Criterion-related  validation  should  not  combine  variables 
to  form  a  single  criterion  measure  udless  Such  a  procedure 
is  justified  by  logical  considerations  or  empirical  evidence 
or  the  practical  requirements,  of  the-  intended  use  of  the  » 
results.  . 


c)    Criterion  data  s|;iould  be  collected  in  a  way  that  permits  an  ^  ■ 
.assessment  of  the  reliability  of  each  criterion  variable,* 
but  with  the  understanding  that  there  may  be  several 
sources  of  irrelevant  variation,  (sampling  of  criterixin 
content^  source  of  criterion  ratings  pr^data,  and  so 
forth).  .T 


Interpretations  of  correlations  between  test  scores  and  criterion 
varii\|>le8  should  take  into  account  such  factors  as  sample  size, 
criterion  relia{)ility,  po8s4.ble  restriction  in  the  range  pf 
scores  obtained  in  the  validity  study  sample,  aAd  other  contextual 
factors.  . 

The  method(s)  by  which  any  validation  is  accomplished  should  be 
fully  dQ(^u^ented such  documentation  should  include  appropriate  ' 
details  such  as  th&  nature  and  reliability  of  the' criteria,  a 
description^  of  the  fsubjects  used,  the. materials  surveyed  and  the  . 
<iualif ioat ions  of  the  experts  who  made'judgments  regarding,  the 
appropriateness  and  importance  of  test  contents 


1 


I 

*  .  * 
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Where  adequate  methodfi|are  employed  to  insure  equivalence  of 
scores  on  alternate  forms,  it  is  not  necessary  that  each  new 
.  fprm  be  validated.    New  va.lidation  studies  should  be'^made  if 
rev isied  tests  have  subst ant ial  changes ,  such  as  different  item 
types,  or  if  they  sample  a  revised  performai^ce  domain. 

When  appropriate  and  feasiiS^le,  the  validity  of  a  test  should  be 
investigated  separately  for  subsaraples  of  the  test-taking 
population. 

When  a  name  of  a  test  is  established,  it  should  not  imply  more 
than  is  justified  by  evidence  of  validity. 

Information  should  be  made  available  to  institutional  ando 
agency  users  that  would  be  of  assistance  to  them  in  planning 
^nd  conducting  local  validity  studies.  ■ 
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TESt  USE 


Principle 


Proper  and  fair  use  of  ETS  tests  is  essential 
to  the  -social  utility  andyprofessional  - 
acceptance  of  ETS  work*  .  , 


Policies 


'  "i  '  ■ 

A.    ETS  will  set  forth -clearly  to  sponsc^s^^nstitutional  or  agency 
usefsy  and.  .examinees  the  principled  of  proper  use.  of  tests  and 
.  laterpret^tion  of  test  results.  I 


B.    ETS  will  establish  procedures  by  which  fair  and" appropriate 
test  use  can  be  promoted  and  misuse  can  be  discouraged  or 
^eliminatedk 


Procedural  Guidelines 


1.    Program  publications  should: 


a)      describe  appropriate  uses  and  ^aution  against  potential 
misuses  of  program  tests; 


b)      explain  clearly  that  test  scores  reflect  past  opportunity 
to  learn  and  discourage  test  interpretat ion?  that  go 
beyond-  reasonable  inferences  from  test  performance;. 


c)      emphasize  that  an  individual's  test  score  should  fte * 
interpreted  in  the  context  of  other  infqrmat ion  ^bout 
him  or  her; 


"U)  ;    provide  approgridte  information  about  t^st  content, 
difficulty,  and  purpose  to  help  the  institutional  or 
'    agency . user  select  instruments  that  mdet  the  measurement 

requirements  of  .the  situation  ahd  avoid  selecting, 
.  requiring  or  using  inappropriate  tests;' 
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e)      invite  institutional  or  agency,  users  to  consult  with  the. 
progr^fil  sponsor  and/pr  ETS  about  thei^  current  or  intended 
'   .0889  of  ETS'developed  tests  ai^  identify  the  offices 
to  be  contacted  for  this  purpose: 

/  •.  ■    .  }     -  ■ 

.f)      summarize  result?  of  research  relevant  to;  the  u6e  of  the 

test  or  cite  references  in  which  such  results  ar^  reported;  ^ 

g)  describe  adequately  and  clearly  scale  properties 

that  affect^  acov^'  interpretation  and  use;       ,     .     '  ^ 

h)  .  advise 'insCitutiotial /or  agency  users  that  decisions  about 

the  application  of  single  01}  multiple  prediction  equations, 
based  on  dist  inguishinjjf  char^Bcterist  ics  such  as  sex,  >  «« 
ethnic  group  or  curricular.  emphasis  or  training,  should  be 
preceded  by  careful  exam^ation  of  social^  educational  and 
psychometdric  factors;        '  I 

i)  -     advise  institutional  or  agency  users  that  if  examinee 

gro.uping  based  on^test  scores  is  practiced,  provision 
should  be  made  for  frequent  review  of  group  assignments  to 
determine  actual- per formance; 

j)      stress  chat  pass-fail  or  cut-off  scores  escabrli^hed  for 
such  purposes  as  admission.,  credit.,,  or  certification, 
should  be  used  as  a  bqsis  for  decisionjmaking  only 
, if  the|  institutional  or  agency  user  has  a  carefully 
developed  rati*onale,  justification,  or  explanation 
.  o£  the'cutting  score  that  is  adopted;  and 

k)      encourage  inst itutionab  dr  agency'users  to  reexamine 

cut-off  score  4>oli^ejp period ical ly  to  minimize  or  eliminate 
I  possible  disproporfionate  exclusion  of  members  of  any  group 
I  such  as  men  and  women  d\. awn  from  diverse  backgrounds  (e.g.,.  .* 
major  ethnic,  handicapped  and  other  subgroups  of  the  population 
^    of  interest)  in  the  face  of  other  evidence  that  would  predict 
their  success  or  indicate  their  competence. 


Special  (nonprograi^)  publ ij^at ions  should  be  developed  and 
disseminated  by  ETS  to  promote  fair  use  of  tests  and  discourage 
misuse  of  tests.  I       .  .  ' 


Coini>la(int8  or  information  about  questionable  interpretation-^ or 
use  of  reported'  scores  should  be  investigated  by  means  of 
procediires  designied  fojr  detecting  misuse*  ^  Such  procedures  « 
should.be  documented,  and  records  should  be  kept  of  Uuch 
complaints  and  their  djisposition*^    .    .  /*fo 

In  cases  where  a  cleail  misuse  is  brought  to  its  attention, 
ETS  should  infprm  the  jSponfor  and  the  institutional  or  agency 
user  of  GTS*  opinion  ^s  to  the  misuse  and  seek  voluntary 
correction. of  the  mi8ij|se.^  If  reasonable  efforts  to  seek 
voluntary  correction  are  not  successftsl,  ETS,  in  conjunction 
with  the  sponsor,  should  take  steps  to  d^ermitie  whether  to 
continue  supplying  t^st^  or  reporting  scores  to  the  institutional 
or  agency  user. 
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TECHNICAL  ASSISTXNCE,  ADVICE,  AND,  INSTRUCTION 


Principle 


BTS  is  dedicated  not  ojdy  to  providing  measurement 
progrlims  and  conduct ii)slres«ai:^ch  but  also  to  promoting 
increased  understanding  of  measurement  and  t^st  use. 


Policies 


t^t  use. 


ETS  will  develop  and  offer  instruct iona'l  programs  in  the  area's 
Of  measurement ,  evaluation,  and  relatedj  r'esearch  through  such 
forms  as  p'ublicacions,  seminarsi  in-^-seryice  training,  intensive 
residence  courses,  workshops,  internships  and  confere/ices*  ETS 
may  undertakeX  these  activities- independently  or  in  cooperation 
with  other  agei^cies,  professional  groupoj  or  educational 
institutions. 


B.  ETS  will  provide  advice  and  informatron  on  measurement-related 
is^es  and  about  ETS  programs,  research  £^nd  services.  In  this 
activity,  ETS  will  work,  where  feasible,  in  collaboration  with 
other  professional  ^rgai^izat  ions '-that  shoy  a  cc^ncern  about 
measurement. 


> 


ETS  will  respond  promptly  to  requests  for  Advice,  instruction 
and  technical  assistanc^  related  both  to  pi^Ograifis  and  services 
offered  by  >  ETS  and  to  tne  related  areas  of  'edqcat  ional  measurement, 
eyaluation  and  research  A  I 


D.    Ets  wi.ll  conform  to  high  standards  .of' accuracy  and  professionalism 
in  its  advisory,  instructional  and  technical! assistance 
activities. 


■  /«  ■ 
•/  o 
'ERIC 
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ETS  will  provide  advice,  instruction  and  technical  assistance  ^ 
to  clients'  from  the  private  and  public  sectors  and  from  foreign  and 
domestic  government  agencies  to  the  extent  that  such  services 
are  consistent  vith  ETS  areas  of  expertise,  meet  accepted  professional 
and  ethicall  standards,  and  reflect  ah  understanding  of  and  reispect  for 
Cultural  differences,     '  .    .        .      ^  . 

ETS. will  endeavor  to  promote  increased  understanding  of  the 
purposes  and  procedures  of  testing  among  professional  groups 
and  in  the  public  sector;  ETS  wiH  make  this  effort  both 
independently  and  in  cooperation  with  other  organizations  that 
share  this  responsibility. 


Procedkiral  Guidelines 


ETS-8  offices  should  offer  advice,  instruction  and  technical 
.assistance;  the  staffing  for' such  services  should  be  determined 
by  the.  nature  of  the  s^i^vices  and  the  expertise  Required . 


The  special  requirements  of  audiencjes  with  varying  needs., 
interests^  cultural  backgrounds  and  levels  of  knowledge 
should  bie  considered  when  ET3  provides  technical  assistance , 
advice,  or.  instruction. 


New  developments  in  research  or  testing  should  be. considered 
when  technical  assistance,  advice  and  instruction  are  offered. 

Technical  assistance,  advice  and  instruction  offered  to  ■ 
institutions  ^r  agencies  shogld  include  guidance  on  how  to  use 
other  in/ormation  about  examinees  (such  as. previous  academic 
performance,  English  as^a  second  language,,  and  family  or 
cultural  background  factors)  in  conjunction  with  t^st  Scores* 

Comprehensive  collection^  of  reference  mater ials . relat ing  to 
tests,  measurement,  evalua.tlon  and  related  research  should  be 
developed maintained  iknd  made  available,  to  all '^TS  staff  • 
members  *and,  when  appropriate,  to  professional  groups  and 
individuals  Outside  the  organization..  '  j  ,  •  •  ' 


GLOSSARY 


Accuracy;    The  extent  to  which  a  principal  product  conforins  to 
its  specifications  or  correctly  reflectrthe  sourcip  data  within 
the  specified  limits  of  reliabil|.ty . 

Client;     (Sjs?  Sponsor). 

Content i  '  PermiLaion  granted  by  (in  individual  or  that  individuals 


patent  or  guardian  to  the  use.  or 
pennission  granted  Upon  receipt 


putpose  of  the  use  or  release  and  a  reasonable  explanation  of 


manner  in  whidh  the  results  will 


Critical  Information: 
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OF  TERMS 


release  of  data  h^ld  by  ETS;  such 
j>f|a  reasonable  explatiatioii  of  the 


the 


be  reported . 


Informatijn  that 'will  be  used  to  draw  important 
inferences  (a)  abbut .  the  sponsor^,  ETS-appointed  external  commit tee^, 
infltitutiohal  or  agency  user,  examinee,  subject  or  respondent, 
or  (b)  b'y  the  sponsor,  institutional  or  agency  uaer,  examinee, 
subject  or  respondent  and  which,  if|incorrect ,  could  be  harmful. 

Distributive  Scale;    A  8|:ale  that  is  defined  to  yield  either  a 
specified  score  distribution  or  a  specified  mean  and  standard 
deviation  for  a  particular  group  of  examinees. 

ETS  Board  of  Trustees;    The  ETS  Board  of  Trustees  is  the  governing; 
body  of  ETS.  'There  are  16  trustees.    thirteen»are  e^jected- for 
four-year  terms.    New  members  of  the  Boar<t  are  elected  by  current 
trustees.     Some  are  chosen  from  nominees  proposed  by  the  American 
Council  on  Education  and  the  College  Entrance  Examination  Board, 
two  of  the  founding  organizations  of  ETS.    The  presidents  of  the 
American  Council  on  Education,  the  College  Entrance  ExamiiAtioh 
Board  and  ETS  also  serve  as  trustees.. 


ETS-held  Program  Data  Files:     Information  about  individu^  an 
institutions  held  by  ETS  and  derived  frcyn  ETS-provided  jjfrvices' 
of  collection,  processing,  storage,  retrieval  and  diss^iination; 

ETS-held'^'ikesearch  Filet":     Intormat ion"  held  by  ETS  and  ^enerate| 
through  ETS-conAucted  research  intended  to  result  in  tWe  develop 
ment  of  new  or  improved  techniques  and  materials  for  application 
in  such  areas  as  classroom  instruct  ion, 'evaluation' of  progress 
toward  educational,  goals,  counseling  of  "students ,  and  decision-:- 
making  of  school  administrators..  - 


i 


Examinee;  /Vn  individual  who  takes  a  test,  developed  and  or  adqjinieteted 
by  ETS.         •  *  • 

Institugjtonal  or  ^Agency  IJpet:    An  organizational  recipient  of. 
ETS-pro?es8^d  or  produced  information. 

Intermediat e. Product t    Materials  that  are- not  released  externally, 
bub  ^that  are  necessary  to.  the  production  of  the  principal  produqt.  | 


7, 
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Glossary;  (continued) 

Wohdistributive  Scale:  A  scale  that  is  definc^d  without  reference* 
to  the  observed  test  performance  of  a  particul,ar  group.  * 


Nonnormative  Scale:    A  scale  that  is  based  on  the  performance 
of  any  con  vent  e^ntly  available  subgroups  f^f  examinees  for  whom 
the  test  is  appropriate.    A  .score  on  a  nonnormative.  scale  is 
not  intended  to  convey  inft^rmation  about' an  examinee's  standing 
in  relation  to  a  defined  population.' 

Normative  ScAle:    A  scale  that  .  is  baje^  on  the  test  performanc.e  , 
of  a  sample  or  Waminees«  selected  as  prescribed  by  a  specified 
design,  from  a  clearly  defined  population.    A  score  on. a  normative 
scalf  is  intended  to  convey  useful  information  about  the  performance 
of*  a  particular  examinee  in  relation,  to  the  performance  of. that 
population.  .    '    .  • 

Principal  Prbdiict:    ETS-produced  or  processed  materials  (e.g.,  / 
annual  reports,  perfocmatjce  data,  score  reports,  and  admissions  / 
tickKts)  .that  are  released  or'*  transmitted  to  a  sponsor,  ETS-appointed  ^ 
external  cpmmittee,  institutional  or  agency  user,  examinee,  subject  /• 
or  respondent,  pursuant  to  a  contract  or  published  commitment.  / 
respect  to  accuracy  and  timeliness,  are  applicable  ta 
Its."  / 


Standards  wi^h 
pirincipal'  produ 


Principles  for 


he  Validation  and'  Uae^^of  Personnel  Selection  Pi;ocedures, 


iKvision  of  Ind 
'  Associai: ion. 
1975. 


istrial-Organizational  Psychology,  Ainerican  Psychological 
on,  Ohio:  The  Industrial-Organizational  Psyiihologist , " 


Da  rt 


'8>r/Eiholog|.a 


Respondent :  An 
in  a  manner  and 
' subje9t8 

Sponsor :  Educa 
federal,  stat^ 
Hhich  contract 
governing! 

sta 


individual  who  provides  data  to  a  researt^  project 
for  a  purpose  diffeif^ati^  from  either  examinees  or 


iohaly  professional  or  occupational/ associations , 
>r  local  agencies,  public  or— {irivafcr^  foundations. 
*ith  fits  for  its  services.    ThiSyCategory  includes. 

boards,  membership,  and  appoint<4d  coinmittees  or 


^3tanda\ds  for  Equcational  and  PsychologfcaJ  Tests ,  American 
Psychological  Association  (APA),  Americai/Educational  Research 
Association,  ancn  National  Council  .on  Me^urement  in  Education, 
Washingtclp,  p.C.\  .  AfA,  1974. 


Subgroup  / )  A*  part 
according  fco  vari 
(b)  race  oi\  ethnic 
(d)  geograpjiip  16c 

■  ■  -A 


lation  which  is  definable 
'pbropriate,  e.gv,  by  (a)  sex, 
ihing  or  formal  preparation,  . 
^ome  level >  (f)  handicap,  (g)  oge,^ 


j     Glossary  (continued) 


1 


■Subject!    an  individual  wh(i  participate,^  in: an  ETS  'jlaboratory 
or  experimental  research  pi^o'j<sct.  *   — 

Testing  Program;    A  9et  of  ^ar  rangeme^ts  jdin.der  which  examinees 
ft^  scheduled  to  take  a  teeit  jnder  standardised  conditions  ^  the  ^ 
tests  are  supplied  with  ihstttjuct ions  for  giving  and  taking  theiOi 
.arjd  arrangements  are.  made  toti  scoring  the^  testS'^  reporting  the/ 
sciores»  and  providing  interpretative  information  as  part  of  a  I 
comprehensive  ongoing  service.    A  program  is  char^^cterized  by 
its  continuing  character  and  by  the  inclusiyeness  'of  the  services 
provided,  '       '       .  .  ^ 

Timeliness :  The  degree  to  w^ich  a  principal  product  jis  released 
or  delivered  to  its  recipient  within  a  predefined  schedule. 
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7-\Mr.  "Weiss.  I  appreciate  that  all  of  you  have  busy  schedul^  and 
you  have  already  devoted  the  better  part  of  the  day  to  this  hearing. 

will  try  to  proceed  ks  expeditiously  ais  the  floor  actiori  v^ll 
permit.       >.       •       I  .  r 

Let  me  a$k  a  somewhat  .general  question.  Kather  than  to  g0  into 
discussion  (if  the  philosophy  which  I  think,  given  the  nature  Qf  the 
subject,  is  certainly  in  order,  I  would  like  to  start  oiit  by  askihg  if, 
on  the  basis  of  the^  testimony,  there  is  any  factual  reason  why  the 
1  r^uirements  set  forth  in  4949,  and  almost  equivalent  information 
Wt  forth  /in  Mr.  Gibbons'  bill,  as  to  whether  the  preregistratiph-can 
be  included  in  the  legislation.  '  . 

\  Does  mat  present  any  insurmountable  problem  to  anybody? 
\  Mr.  Ij(ARQAj)0N.  I  think  I  indicated  that  with  one  excepjtion^  most 
ot  that/  information  is  already  provided.  I  suppose  this  may  hav6 
be6n  Mr,  \Gibbons'  bill,  which  commands  release  of  the  test  score 
that  gets  an  individual  into  a  given  school. 

Mr.  Weiss.  We  had  tried  to  undertake  on  the  basis  of  th6  ii  for- 
mation we  had,  an  analysis  of  whicn\  of  the  regulations  Ui  ider 
section  3  oip  4949  are,  in  fact,  included  in\ which  of  the  manuals!  We 
find  that  although  most  of  those  requireif^ents  are  included  in  some 
of  the  manuals,  I  do  not  think  any  of  them  really  are  included  in 
all  of  them  in  totality.  ,  \ 

For  example,  we  found  th^  requirement  of  how  background  infor- 
mation on  students  who  have  reported  seems  to  be  set  forth  in  the 
LSAT  mc^nual  and  the  ORE  manual,  partly,  but  not  in  the  others. 
The  score!  will  be  reported|— that  is  set  foi;th  in  the  LSAT,  but  not 
in  the  others.  " 

So  really,  although  the  information  is  available  to  some  extent 
on  some  of  the  tests,  the  purpose  of  the  legislative  requirement 
woula  be  to  provide  some  uniformity  of  the  information,  so  that 
even  those  tests  which  do  not  now  include  them,  but  which  would 
have  the  information  available,  would  also  be  requiried  to  submit 
information  which,  certainly  as  far  as  other  tests  are  concerned, 
have  not  been  found  to  be^onerous  requirements.  < 

Dr.  Cooper,  1  do  not  understand  your  reference  as  to  what  is  not 
repiarted.^,    ^  :  ^ 

Mr.  Weiss.  Section  3  of  4949^equires  registration  information. 
The  testiipony  we  have  gotten  fifOTn  almost  everyone  is  that  most  of 
that  information  in/some  way  or  another  is  reported  or  listed  on 
the  registration  forms.  But  pur  analysis  shows  that  if  appeArs  on 
some  registration  forms  and  not  oh  others.  The  prime  purpose  is 
not  to  indicate,  at  least  on  my  part,  that  none  of  that  information 
is  made  available  any  place,  but  really  to  provide  for  |  uniform 
requirement  for  that  information  to  be  set  forth. 

Dr.  Coopi^.  In  the  MCAT  test,  all  the  information  called  for  in 
your  bill  is  provided  eithier  in  the  mat^riM  sent  to  the  individual 
who  is  going  to  be  tested  or  in  the  student  MCAT  manual. 

I  do  not  think  there  is  a  single  item  not  included.  ; 

Mr.  Weii^.  Mrs.  Rice?  . 

Ms,,  Ricfi.  Insofar  as  we  can  understand  the  languiage.  but  there 
are  some  ambiguilies.  • 
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Now,  as  stated  in  our  testim^y,  w*  have  provided  all  this  infor- 
mation. I  might  mentioft  some  of  the  ambiguities  in  sections  3  and 
4,  which  requests  the  effects  of  alnd  Use,s  of  test  scores.  / 

We  do  not  always  have  that  inforpiation.  It  resides  With  the 
institutioa  that  uses  the  te^t.  We  advise  institutions  how-  to  use  our 
materials  and  tests  in  great  detail.  I  am  not  sure  exactly  what  you 
mean  by  "clarifying  uSes." 

'Also,  under  B(4)  you  mention  major  income  groups.  We  are  not 
sure  whether  you  mean  parental  pcome,  student  income,  or  just 
what  kind  of  financial  breakdowns  you  have  in  mind.  I  list  those 
simply  to  say  that  we  conform  to  all  those  requirements  that  we 
can  understand.  / 

Mr.  Weiss.  Again,  if  I  am  reading  it  correctly  as  *t6  that  section 
of  the  legislation,  wnat  you  are  saying  is,  not  for  the  most  part,  but 
the  exception  you  have  just  cij;ed,  not  that  you  cannot  provide  the 
information  or  that  it  is  onerous  to  provide,  but  in  fact  you  are 
saying  in  most  instances,  most  of  that  information  is  already  avail- 
able. Your  disagreement  is  really  a  policy^  disagreetiient  as  to 
whether  it  is  necessary  or  advisable  to.  make  it  ixeces/ary  that  be 
set  forth?  ' 

Ms.  Rice.  I  believe,  and  Mr.  Hargadon  probably  referred  to.  this 
better  than  I,  in  his  testimony,  there  is  no  need  for  legislation  in 
areas  where  there  is  already  voluhtary  compliance.  There  are  poli- 
cy differences,  indeed.  Mr.  Hargadon's  testimony  pointed  out  that 
we  had  irtuch  more  trouble  with  the  ensuing  sections  than  with 
section  3.  ' 

Mr.  Hargadon.  I  might  add,  Mr.  Weiss,  I  am  familiar  with 
undergraduate  admissions,  and  it  is  probably  worth  mentioning 
that  not  onw  does  the  use  of  testsi  vary  widely  among  institutions, 
but  within  Vne  same  university,  between  departments  at  the  gradu- 
ate level,  arid  other  departments.  In  this  bill,  section  3,  paragraph 
3,  the  correlation  is  sought  between  test  scores  and  future  success 
in  a  career.  I  think  the  answer  to  that  is  to  find  out  who  the 
student  intends  to  work  for.  I  would  think  what  people  determine 
as  success  in  the  career  one  follows  is  very  important  at  best,  and  I 
think  the  professional  schools  would  be  hard  put  ahead  of  time,  t© 
draw  a  correlation  between  the  test  score  iand  whatever  people 
might  agfee  on  is  success  in  a  given  career. 

I  really  do  not  see  how  we  could  meet  that  requirement. 

Mr.  Weiss.  I  think  that  is  to  ia  great  extent  correct.  On  the  basis 
of  our  research,  we  found  that  there  appeared  to  be  promises  made 
in  some  of  the  manuals  which  suggested  exactly  that  kind  of  corre- 
latid|!l<;^What  we  are  saying,  in  essence  is,  if  you  are  going  to  have  | 
that*  kind  of  suggestion  or  promise  or  half-promise /of  correlation* 
between  academic  success  or  career  success,  then  you  ought  to  be  . 
required  .to  set  forth  the  basis  for  making  #iat  kind  of  promise  or 
projection,  on  the  basis  of  past  results.  i 

Would  any  of  you  have  any  problem  with,  that? 

.Dr.  Cooper.  Mr.  Weiss,  as  we  wied  to  point  out,  admissions 
committees  for  medical  schools  multivariant  approaches  to 
evaluation  of  a  candidate.  We  do  pot  want  y^e  only  criterion  to  be 
any  on^  of  the  criferia  that  ara  used.  We  think  this  WQuld  be 
disadvantageous  to  th^  applicant  group.       .     ^  *  # 


in  medicine,  what  is  succesis  in  medicine?  Is  that  being  on  Park 
Avenue?  Is  it  working  in  one  of  the  conim unity  liospitals?  Is  it 
working  in  one  of  the  State  hospitals?  jWhat  is  the  success  in- 
medicine?  .     *  . 

We  have  an  extremely  low  attrition  rate.  Most  of  it  is  not  due  to 
academic^  failure  but  change  in  career  plans.  If  you  count  success 
until  the  students  finish  medical  school,  we  can  say,  all  those 
accepted  by  the  multicriteria^with  rare  exception,  those  attending 
from  IVz  to  4  years  do  finish  medical^hools  and  do  go  on  to 
residencies  and  do  go  on  to  practice,  I  do  not  know  how  you  would 
otherwise  measure  success  of  a  physician. 

Dr.  Haney.  Could  I  comment  briefly  on  that?  ^ 

I  did  not  have  the  impression  that  anyond  was  suggesting  that 
theFe  is  any  one  indicator  of  success  in  the  profession^f  medicine, 
nxuch  less  any  other  profession,  but  clearly  there  is  some  rCTom  for 
clarifying  the  dimensions  of  success  in  professions *iike  medicine  or 
law,  and  while  the  researcher  is  not  altogether  clear,  I  think  some 
of  the  research  showing  the  predictive  validity  of  admissions  tests 
in  terms  of  subsequent  professional  performance  as  rated  by  super- 
visors and  others,  is  very  illuminating  regarding  the  fact  that 
aptitude  tests  of  cef^in  sorts  do  not  predict  all  aspects  of  profes- 
sional success.  /  V 

Dr.  Cooper.  We  do  not  have  an  ^ptitude  te^.  It  is  a  medical 
college  admissions  test.  It  is  not  daimed  to  fee  an^^  not  an 
aptitude  test.  It  measures  certain/  knowledge  ithat^^je  student 
brings  with  him  and  his  ability  to  use  that  knowl^dge.^?'^ 

We  think  that  knowledge  is  related  to  what  is  a  good  physician 
but  this  is  not  an  aptitude  test,  and  you  and  you^  group  may  have 
simple  criteria  for  success  in  mec^icine,*  but  let  me  say  that  those 
who  have  worked  in  this,  field  ai;id  who  have  tri|ed  to  assess  this 
have  not  been  able  to  come  up  wi^  this. 

Dr.  Haney.  May  I  respond?  ,  \  ^ 

My  point  was  not  that  there  ai^e  simple  criteria  of  success.  It  was 
precisely  the  contrary/ that  thete  are  many  dimensions^of  Success 
and  that  admissions  tests  do  not  tajp  all  ofHhose. 

Mr.  Weiss.  Mr.  Solomon? 

Mr^  Solomon.  I  think  it  is  fair  to  say  that  admissions  test§  do  not 
often  correlate  well  with  futui#  cai^er  success. 

First  of  all,  they  are  not  intended  to.  Admissions  tests  are- intend- 
ed to  help  predict,  along  with  other Witeria,  how  one  fares  in  the 
educational  program  fof  which  one  is  being  considered. 

The  second  problem,  as  Walt  Haney  knows  as  well  as  I  do,  is 
that  the  problem  in  research  in  predicting  occupational  success  is 
that  there  is  virtually  no  agreement  as  to  what  is  meant  by  occupa- 
tional success,  and  the  only  <vay  which  you  achteve  any  kind  of 
^  research  design  in  order  toj  ascertain  tha^  is  by  very  carefully 
structuring  an  almost  artificial  situation.  ^  \ 

Is  a  lawyer  more  successful  if  he  helps  the  needy  in  the  ghetto 
ancj  earns  very  little  money  or  if  he  is  appointe4  to  the  Supreme 
Court  or  elected  as  a  Member  of  Congress? 

Who  is  to  judge  what  success  is,  especially  in  terms  of  all  the 
opportunities  Xmen  to  either  a  doctor  or  graduate  student  or  a 
lawyer  after  graduate  professional  school,  and  most  research  on 


predicting  occupational  success  is  founded  on  the  criteirion  problem, 

hot  on  the  ^)redictive  prdblem.  * 

•  Mr.  Weis$.  Dr,  Ck>oper,  I  have  a  news  release  that  was  issued  by 

the  organization  that  you  represent  as  of  July  17. 

.  The  headline  on  it  is:  "New  Yqrk  Law  Forces  Withdrawal  of  New 

MCAT  From  State."   " 

,   In  tie  body  of  that  I  quote  a  paragraph: 

^  Dr.  Oooper  said  the  New  York  law  would  make^it  difficult  to  maintain  high 
.  quality  testing  standards,  because  ^'there  is  a  limit  to  the  number  of  relative 
questions  that  can\  be  used  in  the  MCAT  which  has  six  subsections."  i 

He  explfluned  that  the  test  is  designed  to  help  predict  how _ well  ^^tudent  will 
pejrforiti  in  medicdtk:hool  and  later  as  a  practicing  physician. 

Dr.  GooPER.  This  is  not  an  aptitude  test.  It  is  a  measurement  of 
what  knowledge  does  that  ptudeht  bring  with  him  which  is  re- 
quired in  modern  medicine. 

Mr.  Weiss'  If  you  are  getting  into  \he  business  of  predicting,  and 
it  is  that  kiria  of  stjitement  which  appears  in  the  manuals  indicat- 
ing what  the  test  is  designed  to  do  but  what  we  are  sjaying  is  if  you 
are  going  to  make  that  kind  of  prediction,  then  we  want  to  know, 
the  student  has  the  right  to  know  and  the  public  has  the  right  to 
4^now  on  what  basis  you  are  making,  that  kind  of  prediction. 

If  y^oirdoo't  want  to  make  a  prediction,  in  fact,  as  Mr.  Solomon 
says,  and  as  I  thought  you  were  saying  before,  that  you  cannot 
really  make  that  kind  of  prediction,  OK,  then  either  don^t  say 
anything  or  say  that  you  can't  make  a  prediction,  but  if  you  are* 
going  to  make  a  prediction  like  that  you  will  be  looked  at  vto 
subst£mtiate  the  basis  of  that  prediction. 

Dr.  Cooper.  As  we  have  tried  to  point  out,  we  do  with  thife  very 
elaborate  pVocess  which  we  go  through  in  restricting  the  kinds  of 
questions  we  ask.  Those  questions  are  now  restricted  to  those  as- 
pects of  these  sciences  which  are  considered  to  be  relevant  to 
medicine  and  to  the  practice  of  meditinie. 

I  Went  through  a  long  recitation  of  the  very  careful  way  in  which 
that  was  established  for  this  test  over  a  pericJd  of  considerable  time. 
'  As  a  matter  of  fact,  the  correlations  which  are  in  the  written 
testimony  shqwed  the  agreenftent  amoitg  different  groups  on  the 
value  of  the  tests  in  establishing  those  kinds  of  knowledge  ahd 
skills  which  are  considered  to  be  essential  to  physicians. 

Itfwill  not  predict  whether  this  is  a  compassionate  physician'.  It 
will^not  predict  whether  this  physician  will  ta^e  Wednesda|k  and 
Thursday  and  Friday  afternoons  off.  It  will  not  predict  his  clmical 
Judgment.  .  $-\ 

-  There  are  a  lot  of  things,  about  a  physician  which  are  very 
difficult  to  measure  which  we  are  attempting  to  measure  but  Which, 
^ou  can't  make  up  the  qualities  of  a  physician  but  in  which  there 
is  no  claim  here,  a^jid  really  that  is  a  part  of  the  whole  predicting 
process.  ^ 

'  NJr.  Weiss.  What  do  you  mean  when  you  say  that  the  test  is 
designed  to  help  pr^ct  how  well  a  student  will  perform  later  as  a 
j)racticing  physician  r  • 

Dr.  Cooper.  With  regard  to  the  material  that  that  test  pleasures 
which  is  knowledge  in  sciences  and  the  ability  to  use  that  knowl- 
€(dge  in  problem  solving  which  are  essential  parts  of  a  physician's 
practice. 


■•  169  .  , 

Mr.  Weiss.  I  must  say  again  that  the  average  reader,  regardless 
of  what  his  level  of  aptitude  or  achievement  is,  reading  thfit  state- 
ment would  draw  the  coricMsion  that  your  test  in  fact  predicts 
what  kind  of  or  how  good  a  doctor  he  is  going  to  be.^ 

Mr.  Hargadon.  I  might  try  and  clarify  that. 

I  do  think  there  is  a  substantial  difference  between  indicating 
potential  or  probability  or  likelihood  of  the  ability  tO|perform  well 
as  a  doctor  arid  the  phrase  which  is  used  here  wnich  is  qtiite 
different,  and  !hat  is,  ''Success  in  the  career  for  which  admjssio: 
sought."^ 

I  guess  I  see  those  as  two  quite  different  concepts,  and  that  may 
lead  to  the  difficulty  we  have  here. 

Mr.  Weiss.  You  may  be  right,  that  I  think  that  the  utilization  of 
the  word  success  may  be  Vague,  but  I  dori  t  knb\V  how  that  is  cured 
by  using  predicting  performance  in  later  life,  later  career. 

It  seems  to  me  that  they  are  both  just  as  subjective,  and  we  may 
ultimately  agree  on  better  phraseology  to  use  in  there.  It  also  V 
^  seems  to  me  that  what  we  are  really  sajring  is  that  whatever  the 
'  language  is  that  is  used  in  those  registration  forms  or  manuals  to 
suggest  that  those  tests  are  in  some  way  going  to  be  able  to 
forecast  performance  in  the  future  in  a  career  or  in  school,  that 
you  really  ought  to  be  required  to  put  forth  a  correlation. 

Mr.  Hargadon.  I  think  it  would  be  helpful  to  us  at  some^  point, 
petihaps  irk  some  wj^tten  form,  to  note  specifically  which  manuals. 
You  just  quoted  frotn  a  press  release,  riot  a  manual. 
.  Mr.  Weiss.  We  will  put  it  together  for  you,  but  this  i#  the 
quickest  thing  We  could  put  our  hands  on  to  indicate  the  kinds  of 
things  that  have  caused  us  concern.  ^ 

Yes,  Mrs.  Rice? 

Ms. -Rice.  While  that  particular  requirement  may  be  relevant  to 
postbabcalaureate  admissions,  it  has  little  meaning  ifor  undergrad- 
uate a4missions.  . 
Our  tests  have  but*  one  purpose  onlyr^to  pr^ct  performance  in  ^ 

.  college  and  only  in  the  first  year  of  college.  Because  our  studies  , 
have  shown,  and  we  have  done  many,  that  the  prediction  of  Success 
in  the  fii^t  year  seems  to  be  predictive  *of  performance  over  the 
entire  Undergraduate  years.  ^  >  ' 

I  am  not  sure,  whether  you  are  suggesting  that  we  try  to  predict 

•  success  in  the  career,  if  tfce  student  knows  his  intended  field  of 
work.  I  am  gjire  you  are  not,  since  earlier  this  morning,  you  stated  . 
that  you  had  no  desire  to  change  the  content  of  tests.  .  I  think  that 
is  whai  you  saidi  this  morning  to  your  fellow  riiembers  of  the 
committee  when  you  were  sitting  at  this  table— I  have  no  desire  to  , 
influence  the  contents  of  the  tests.  .    '  * 

^    .Mr.  Weisjs.  Again^  I  say  to  you,  we  may  agree  on  different  Ian-  * 

-  guage  to  use  ih  tKere^  biit  >yhet}ier  it  is  future^  performance  or  « 
success  ^in  career;  if  you  ftre  talking  about  in  soma  way  ;feaugihg 
how  somebody  ii3  going  t9  •dd  in  school  .and  after  in  their  career,  if 
you  make  tMt  kind  of  projection*  you  ought  to  have  sojne  indica- 
tion of  the  correlation  between  the  test  and  the  ultimate  dutcome. 

^  I  am  not  wedded  to  any  p^icular  language,  bu<;^l  wari£  to  be 
su]|^t)iat  we^  don^t  have  prornl&^s  or  6Ug[^ested  promises  being  made 
whph  are  then  hot  correlatedlto  anjrthing.  V 


Dr.  Haney.  Gould  I  raise  a  perspective  hfere  in  that  as  I  testified 
this  morning  I  have  tremendous  reservation  aibout  many  of  the 
specffic  provisions*  here,  and  I  am  concerned  that  Jt  might  not  be 
terribly  fruitful  to  try  to  go  through  specific  provision  by  provision, 
that  it  would  not  be  terribly  fruitful  for  the  committee  or  for  us 
here,  and  that  perhaps  it  wduld  help  to  turn  our  discussion  to  the 
specific  sorts  of  problems  you  are  trying  to  get  at  rather  than  at 
the  specific  language  of  some  of  the  provisions,  and  that  I  know 
some  people  have  intentions  for  revising  these. 

If  that  sounds  like  a  reasonable  suggestion,  I  would  suggest  the 
possibility  of  inviting  the  young  man  who  has  recently  be^  look- 
ing very  closely,  I  know,  attesting  pracyces. 

Mr.  WEifis.  I  appreciate  that.  ' 

I  think  that  we  ^^^^|Mlg  to  really  proceed  with  the  witnesses 
whom  we  have  at  thi^ftlpi^bi^  ^ 

Dr.  Haney.  Fine.    ^  '  ^ 

Mr.  Weiss.  Mr.  Nairl|y^j^fflc,  has  b^ien  given  permission  to  sit 
witK,you  to  try  to  ^espc^S  but  not  to  give  additional 

testitnony  to  that  whjp h^hSralready  been  given. 

Dr.  Haney.  I  see.  '       .  '  ; 

Mr.  Weiss.  If  Mf.  Nairfl  wants  to  join  you  to  respond  to  any  of 
the  questions  that  we  may  have,  that  is  fine. 

There  has  been^some  question  raised  ^and  some  suggestions  made 
that  perhaps  the  thing  to  jio  is  to  wait  until  we  get  the  expferience 
of  New  York,  I  know  that  there  is  division  on  the  basis  of  the 
testimony  that  was  given  as^  to  the  various  attitudes  to>yard  the 
New  York  legislation,  even  though  therie  may  have  been  no  or 
limited  differences  of  opinibn  originally. 

GiVen  where  we  are  with  New  York  and  given  where  *we  are 
with  MCAT,  for  example,  I  guess  Dr.  Cooper,  the  question  is  really 
to  you,  but  it  really  affects  everyone  else  also,  because  in  this 
instance  it's  MCAT  and  it's  the  dental  tQst  people,  although  we 
have  also  seen  or  heard  some  possibility  that  the  law  school  admis- 
sions test  also  may  be  affected. 

That  is:  Those  who  administer  those  tests  may  decide^hajt  they 
don't  want  tp  play  with  New  York  either.  Now,  if  in  fact  what  we 
have  is  certain  broad  areas  or  critical  areas  within  the  State  being 
put  into  a  position  where  the  students  following  th^t  course  of 
study  will  not  be  able  to  take,  the  tfests  within  the  State  of^  New 
York,  that  really  put  us  in  the"  position  where  we  have  no  choice 
except  to  proceed  with  national  legislation,  so  that  you  can't  play 
one  State  off  against  another.  % 

Mr.  Solomon.  I  just  want  to  say,  as  far  as  I  knowl  to  the  best  of 
my  knowledge  the  law*  school  adniission  council  dfoeis  not  .  plan  to 
withdraw  from  N^w  York  State.  ^  V 

Nw,  there  may  be  something  that  you  know  that 
.been  infomed  about,  but  as  the  agency  which, does  the 
hot  have  any  sUch  4cnowledge.  ^ 

Mr.  Weiss.  Somewhere  around  last  Tuesday  or  Wednesday,  there 
was  a  newspaper  report  indicating  that  the  laW  school  people  were 
considering,  they  had  not  yet  come  to  a  judgment,  but  thejfc  were 
considering  the  possibility  of  following  the  lead  of  the  rhedical  and 
dental  schools.        *  ^  ■  ■        '  ^» 


have  not 
work*I  da 


Mf.  SoLOMON^Weft,  sir,  we  are  in  daily  contact  becatise  have 
to  bfe  with  fie  mw^school  admissions  council,  arid  I  do  not  knqjjjy  of 
thatMtevelopment,  ind  I  think  we  would  know  about  it. 
^  I  d|  know  *^^t  me  law  school  admission  council  is  exploring,  all 
the  OTiplicatiorS  ofthe  New  York  State  bill  and  trying  to  figure  out 
as  beist  they  can  wnftt  to  do.  i 

•  Mr.  Weiss.  Dr.  Cooper,  do  yotl  want  to  i^iake^  any  comment  orL.. 

that?  Doesn-t  New  Y(frk  find  itself  in  a  position  where  its  students 
in  New  York  who  want  to  ^tudy  medicine  or  dentistry  are  now  in  a 
'position  where  they  cantiot  take  tests  or  will  not  b^^able  to  after 

January  of  1980  for  admission  to  those  schools. 

*f  Dr.  Cooper.  As  I  wrote  the  Governor  and  Senator  LrfValle,  We 
jiaYe  continued  to  seek  ways  which  would  be  minimum  disturbance 
to  the  student's  ability  to  take  the  test  arid/ are  looking  for  some 
wa)^  in  which  it  can  be  done,  but  our  pro|)lem  is  that  the  number  of 
questions  wl^ch  we  can  raise  which  are  already  from  our  test 

•  editors  being  indicated  to  be  new  tests. 

Questions  being  developed  are  just  replications  of  the  oMvques- 
tioils>  and  the  limits  if  phrased  by  that  extensive  group  of  people 
who  helped  design  this  test  are  making  it  difficult  for  us  if  we  have 
to  expose  every  question.  ♦  . 

One  alternative,  of  course,  I  guess,  is  for  u^to  return  to  the  old 
MCAT  which  is  much  e^ier  to  write  questions  for  "in  large  num- 
Nbers*     * . 

^^S^g^Wl't  f^*"^  tnftt.  it.  wnnlH  hft  thft  kinr^  of  tftfit.  whifih  wnnld  Jftrvft 
the  purposes  of  that  new  MCAT,  anfl  that  is  the  reasoil  wfe  imder- 
took  the  very  extensive  kind  of  effort  that  we  did,  to  improve  the 
test  in  our  view  and  in  the  view  of  the  large  group  of  people  that 
participated  in  the  development  of  MCAT. 

Mr.  Weiss.  Unless  in  fact  New  York  State  changeis  its  process  or 
you  decide  to  change  your  mind  as  of  January  1  of  1980,  you  will 
not  be  administering  the  MCAX  in  New  York  State? 

Dr.  Cooper.  I  think  your  two  alternatives  are  the  only  alterna- 
tives, right.  *        \  * 

Dr.  Haney.  I  can  see  how  this  issue  might  come  up  in  the  short 
run,  but  I  am  vei^y  curious  to  ask,  how j  given  the  field  that  you 
rtientioned  this  morning,  that  the  fields  of  knowledge  that  the  new 
MCAT  covers,  I  believe  you ,  mentioned  chemistry,  physics,  and 
applications  in  medicine,  each  of  those?  :  ^ 

.    Dr.  Cooper.  Applications  in  problem  solving* 
^  *    Dr.  Haney.  And  the  applications  of  those  in  piedic^Ily-related 
fields,  leave  it  at' that  for  now,  those  are  huge  areas  of  human 
knoiyledg^  that,  while  npt  infinite,  perhaps^  are  so  extensive  as  to 
make  me  wonder' two  things: 

One,  even  if  thosp  bodi|s  ^^Lknowledge  are  finite,  surely  there  is 
enough  specific  informatron  enQompassed  in  the  course?  of  study  in 
typical  colleges  in  tRose  areas  to  allow  one  to  develop  qu^tions, 
appear  tor,  second,  ftiough,  if  those  bodies  of  knowledge  are  tha 
large,  it  raises  foj  me  a  question  about  the  relationship*  between 
the  finite  questijDns  you^^are  speaking  of  and  thiese  very  broad 
knowledge  are|p3  that  you  etlluded  t&  as  xhe  test  measuring. 

Dr.  Cooper./ AH  I  can  report  on  is  the  views  of  experts  in  the 
field  that  have  had  I  think,  #i  ^eat  deal  of  experience  in  those 
kinds  of  restrictions^  and  I  think  they  are  true.  i  ' 


We  certainly  are  not* in  the  position  of  wanting  to  thwart  legisla- 
tion or  not  to  serve  students,  i  We  are  in  the 'position  of  trying  to 
pjfovide  a  high  quality  good  test,  and  we  do  have  what  I  think 
would  be  generally  recognized  as  top-notch  people  in  ttie  develop- 
ment of  these  questions  and  in  advising  'us  on  limitafcons  of  the 
questions.  .  \( 

Mr.  Weiss.  Dr.  Gooper?  ^  \.  * 

Dr.  Cooper.  We  can  aSk  quQsticfti^  on  quarks  in  physics.  If 'w^ask . 
students  about  quarks  in  physics,  we  certainly  are  not  relating  that 
^physics  knowledge  to  what  is  essential  in  medical  education  and  in. 
medicine;  and  we  are  restricted  by  the  specifications  which  were 
drawn  up  b/  a  very  excellent  group  of  people  who  have  wide 
knowliedge  and  wide  competence  in  this  field. 

Mr.  Weiss.  Doctor  Cooper,  if  I  recall  your  testimony,  you  said 
that  your  org^iization  spent  about  %1V2  million  on  developing 
these  tests,  and  that  it  took  you  the  better  part  of  2  years  to  do  it. 

How  long  had  the  new  MCAT  been  in  effect?^ 

Dr.  Cooper.  Seven  tests  have  been  administered. 

Mr.  Weiss.  And  how  many  tests  do  you  give  a  year? 

Dr.  Cooper.  We  givfe  actually  four  tests  a  year  for  the  problems 
of  the  Saturday-Sunday  thing. 

There  are  really  two  major  dates  on  which  they  are  given  in  the 
spring  and  in  the  fall. 

.  Mr.  Weiss.  And,  are  you  saying  to  .me,  because  I  am  not  clear 
enough  in  my  understanding  of  it,  are  you  saying  that  you  use 
exactly  the  same  tests  in  each  seven  of  those  instances? 

Dr.  Cooper.  No,  sir,  but  we  are  now  coming^to  the  point  where 
we  ^re  going  to  have  to  recycle  questions.  ■  ^  .  ' 

We  have  just  started  the  new  test,  3hd  we  are  building  up  a  test 
pool  but.we  are  coming  to  th6  limits  of  how  large  that  test  pool  W}11 
be  and^present  estimates  are  we  may  not  be  able  to  go  more  than 
four  to  five  more  tests  before  recycling  occurs.  —  - 

If  we  have  to  expose  every  test,  then  we  Will  never  be  able  to 
catch  up  after  we  have  exposed  the  test.  ^ 

Mr.  Weiss.  Again,  just  so  I  understand  the  process  in  the  test, 
how  many  questions  are  on  each  of  the  tests? 

Dr.  Cooper.  There  are  350.  v 

Mr.  Weiss.' And  can  you  tell  me  how  many  different  ones  there 
are  on  the  tests?  Are  they  all  different  from  one  to  seven? 
Dr.  Cooper.  They  are  all  different. 

Mr.  Weiss.  Yoii  are  talking  about  a  pool,  to  begin  with,  of  some 
2,300  almost  questions?  ^ 
Dr.  Cooper.  That  is  correct  so  far. 

Mr.  Weiss.  Dr.  H^ney,  Hav^you  had  occasion  to  look  over  or  do 
you  have  any  personal  familiarity  ^ith  the  tests  that  have  been 
given  or  is  there  any  basis  for  believing  that  in  fact  those  tests  are 
m  such  esoterla  areas  that  there  could  not.be  a  shifting  around? 
^^r.  Haney.  Shall  I  respond,  and  you  can  respond  to  my  response, 
^  if  you  like.  *  * 

I  must  say  that  I  hav^  only  reajl  in  general  of  the  new'  MCAT, 
and  1  am  not  familiiar  ^/^tth  the  details.  ^ 

That  said,  I  would  like  to  raise  at  least  the  question  of  whether 
or  not  the  limited  pool  of  items  that  appear  to  the  people  who  have 
developed  the.  test  in  part  Represent  a  product  of  the  particular 


:\ '  p^rdcedures  used  to  devekDp  it,  and  whether  there  are  any,  possibili- 
ties  in  the  longer  run  for  getting  away  from  the  yes  or  no  dichot- 
omy that  Di  Cooper  represented  f?arlier?  # 
V:>      That  is,  if  there  could  be  other  ways  of  developing  equivalent 
itemil  in  a  Ipnger  term,  if  certain  test  developmeht  techniques  were 
•  adopted,  -but  it's  very,  hard  for  me  to  ask  that  question  without 
^  knowing  more  detail  about  the  criteria  by  which  the  specific  items 
\   ^  were  chosen. 

Mr.  Weiss,  Ddctor  Cooper?  '  '     '  \ 

Dr.  Cooper.  We  had  people  \hat  did  spend  a  great  deal  of  time 
■  lodking  at  this,  and  there  were  large  numbers  of  people,  both  as  I 
tried  to  point  out  in  the  testimony  from  the  exp(Brts  in  testing,  as 
well  as.  those  in  the  subsidy  varieties  of  the  title. 

It  isn't  that^the  questions  we  use  are  esoteric,  as  a  matter  idf  fact, 
quite  to  the  contrary.  They  are  questions^hich,  as  I  said,>we  could 
ask  about  quarks  in  physics',  but  this  would  be,  as  far  as  medical 
education,  would  be  esoteric.  / 

We^will  not  ask  those  kirids^of  questions.  The  questions  are 
limited  by  >he  specifications  which  try  and  draw  from  pnly  those 
aspects  of  biology  whch  are  considered  by  those  who  are  teaching 
medicinetertd  know  something  about  the  related  subject. 
.  We  are  trying  to  give  the  student  >he  opportunity  to  determine 
/  or  show  what  he  or  she  knows  in  the  particular  areas  which  are  of 
:  concern,  not  about  physics  generally  or  about  biology  generally 

"  and>  second,  only  firstryear  mursfts.  — — : — — :  

We  have' restricted  it  to  that,  because  we  don't  want  to  disadvan- 
tage a  student  who  takes  a  test  who,  because  of  his  particular 
interest  and  because  of  his  curriculum,  may  not  be  iable  to  have 
.  advahce  courses  by  the  time  he  takes  the  MCAT  test. 

We  don't  want  to  put  him  at  a  disadvantage  and  that  is  why  it's 
alse  limited  only  to  the  general  content  of  first-year  courses. 
That  v/as  determined  witt  faculty  of  underg^^aduate  school  and 
.  ^  premedii?al  advisors  from  uhcfergraduate  schools. 
\      Mr.  WEigs.  Mr;  Solomon,  in  the  course  of  his  testimony,  indicated 
the  procSSs  that  the  Educational  Testing  Service  engages  in  in  the 
devislopment  of  new  questions  on  a  constant  ongoing  basis. 

Are  you  saying  that  you  really  don't  do  that,  Doctor  Cooper,  that 
you  have  contracted  with  some  people  on  the  basis  of  the  best 
advice  and  input  that  you  get  from  people  familiar  with  the  field  as 
^^~1x^^the:  kind  and  areas  that  you  wanted  questions  aimed  at,  and 
' . .  then  they  catne  uprM^tt^^pol  of  2,5j|,  3;500  questions  or  what- 
ever, and  thAt  ybu  really  intendeH^orilie^moat^a^  use  that  as 
the  bhsic  reservoir,  or  do  you  also  have  the  kinM^ofimgoiBg^e^orts^ 
to  develop  new  Questions?    i  j  ^  • 

Dr.jC%)PER.  a  continuing  effort  to  d^elop  questions.  I  would 
also  like  to  pmtit  out  that  I  also  described  a  very  long  process 
between  the  time  those  questions  are  developed  by  test  wHtefs  and 
their  inclusion  into  MCAT. 
'  *  That  is  also,  with  the  number  6f  tests  we  give  a  year,  that  is  also 
a  bottleneck.  As  to  these  questions,  we  have  them  ^tested  in  a" 
variety  of  ways  before  they 'ever  become  il  scored  part  of  an  MCAT. 
That  is. also  a  problem.  • 

We  cannot  make  a  sinfele  MCAT  sa  long  to  include  all  of  the 
questions,  If  you'^^ave  to  keep  revealing  the  question,  then  the 
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student  really  has  to  answer  two  tests,  is\  worn  out  and  there  are 
technical  problems  about  where  do  you  pllace  the  questions,  at  the 
beginning,  the  end,  are  they  spread  through,  and  so  on. 

•  We  take  all  of  these  into  consideration^  but  the  real  issue  is  in 
order  to  develop  the  final  product  of  an  MCAT  test,  we  are  restrict- 
ed not  only  by  the  kind  of  question  that  can  be  developed  but  by 
the  process  to  assure  that  that  question  meets  the  specifications, 
doesn't  have  bias,  is  unambiguous,  and  so  on,  before  it  wm  be  put 
into  an  MCAT.  ' 

Mr.  Weiss.  You  are  not  suggesting  that  the  position  of  your 
experts  as  to  why  these  test  questions  and  tests  that  have  been 
developed  would  best  be  kept  in  a  nonopen  system  is  the  uniform 
opinion  of  experts  in  the  area  of  test  administration  and  test  ere- 
ation? 

Mr.  Solomon.  This  is  a  very  specialized  test.  It  is  not  like  all 
other  test^. ;  ^ 

Mr.  Weiss.  You  are  not  suggesting  that  experts  in  the  area  of , 
test  creation  and  research  on  tests  and  test  administration  are  in 
general  agreement  that  when  you  (come  to  a  specialized  area, 
whether  it-be  in  medicine,  dentistry,  Oceanography,  or  whatever,  so 
unique  that  in  fact  you  do  not  give  onen  te&ts?  , 

I  would  like  Dr.  Cooper  to  respor^r  / 

Dr.  Cooper.  We  maintain  control  over  Ihis  test.  I  haye  not  polled 
all  of  the  test  experts  in  the  world  with/regard  to  what  their  views 
are.  Very  few  Qf-them,  I  think,  as  in  tho  gqbc  of  Mr.  Hanoy  really 
know  what  the  MCAT  is  all  about. 

Mr.  Solomon.  The  pattern  of  administration  for  most  of  the 
programs  is  a  little  different  than  that  administered  for  MCAT.  In 
general, .  I,  nevertheless,  do  want  to  support  Dr.  Cooper  in  his 
assertion  that  test  development  is  a  laborious  process.  The  problem 
with  the  GRE  program,  I  will  name  one,  is  that  your  proposed 
legislation,  sir,  would  require  not  simply  the  development  of  a  f6w 
additional /ornlS,  but  if  we  were  to  maintain  the  service,  would 
require  the  development  of  a  multitude  of  forms.  As  I  pointed  out 
in  my  testimony,  we  now  in  the  GRE  program  have  special  admin- 
istrations on  116  dates  in  9  cities,  that  is  in  addition  to  5  Saturday 
administrations  land  5  j^nday  administrations,, in  addition  in  1978 
and  1979  there  were  makeup  tests  offered  on  38  separate  dat^,, 
that  was  164  different  occasions.  /  ^'v 

Your  legislation,  sir,  would  force -  us  to  reduce  the  number  of 
administrations.  Right  now  in  that  atea  for  the  GRE,  we  make,  I 
"believe,  -five  new  forms  of  the  GRE  aptitude  a  year.  There  is  a 
/limit,  whether  you  agree  or  not,  to  the  number  of  forms  that  can 
-Jbe  developed,  and  especially  in  the  achievement  area  where  the 
progr,ams  with  which  we  work  with  comjtnittees  of  scholars  and 
specialists  to  develop Jthose  programs.  They  are  not  developed  sim- 
ply in-hoUse  by  either  computers  or  people  who  grind  out  ques- 
tiohs. .  " 

As  far  as  the  programs  we  are  concerned  with,  even  though 
theVe  are  mord  administrations  a  year^  there  is- a  substantial  ijrob- 
.  lem.         '      ,  . 

.Mr.  Sims.  Mr.  Chairman,  I  am  Albect  Sims,  vice-president  foe 

*  programs  of  the  College  Board. 
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Your  reference  to  Bob  jlolomon-s  testimony  that  there  is  an 
ongoing  process  of  item  development  that  is  continuous  at  the 
Eklucatioiial  Testing  Service  is  not  quite  true  insofar  as  the  College 
Board's  program ns  concernedJit  costs  money  to  develop  these  tests, 
these  items.  We  have  estimated  on  the  average  that  it  costs  us 
close  to  $90,000  to  develi)p  a  new  form  of  the  SAT. 

In  our  admissions  toting  program,  we  have  15  subject  matter 
tests,  which  are  perhaps  mpre  analogous  to  those  used  by  the 
feiedical  colleges.  We  cited  the  fact— in  testimony  in  Albany,  N.Y.— 
that  if  we  were  to  expose  these  examinations  each  time  we  offered 
them,  the  cost  of  producing  new  examinations  wouW  be  so  high 
that  we  would  probably  have  to  abandon  the  achievement  tests. 
They  are  being  used,  less  than  they  were  being  used  for  admissions 
purposes,  but  there  are  still  some  300,000  students  in  the  Nation 
who  take  our  achievement  tests. 

It  was  in  the  light  of  that  testimony,  I  believe,  that  the  achieve- 
ment tests^were  taken  out  of  the  New  York  bill, The  New  Yorkj 
legislature  recognized  that  we  cpuld  not  have  afforded  to  develop 
those  achievement  tests  and  offer  them  in  New  York  State.' 

Mr.  Wei6s.  JNow  I  understand  that  you  have  some  familiarity 
with  this  question  of  cost  in  test  preparation.  Will  you  give  us  your 
reaction  to  the  argument  we  h^Ve  heard  today  and  previously  as 
well.  . 

 — How  much  of  an  additional  exponso  would  be  requi^^ed  in  otder 

-    *  to  develop  all  these  additional  questions  if  indeed  the  test  became 
an  open  test? 

Mr.  Nairn.  On  the  cost  issue,  there  was  an  important  piece  of 
information  documented  by  ETS,  studies  conducted  in  1971-'72  and 
corroborated  by  later  budget  information  from  ETS. 

Of  the  fee  paid  by  §  student  for  a  test,  although  it  varies,  roughly 
5  to  6  percent  of  the  fee  paid  by  the  student  actually  goes  to  the 
cost  of  test  development.  This  cost  of  test  de^lopment  is  to  be 
*  compar«i  with  a. proportion  in  excess  of  22  to\27  percent  which 
goesUo  the  profili  margin  of  the  test  companies.  The  22  to  27 
percent  figure  is  applied  specifically  in  the  case* of  the  College 
Board,  rather  of  the  SAT.  ^  / 
'  I  can  cite  some  specific  figures  on  that.  In  197^-78,  according  to 
CJoUege  Board  budget,  the  revenues  for  the  admissions  testing  pro- 
gram, which  includes  the  SAT,  $19,205,998"  The  expenses  for 'the 
admissions  testing,  $14,901,491.  This  amounts  to  .a  surplus  of  rev- 
enues  over  expenses  of  $4,244,497,  which  comes  out  to  about  22; 
percent.  In  .other  years  that  surplus  has  ranged  up  to  27  percent. 

Now  I  will  be  glad  to^discuss  this  with  the  EITS  and  College 
Poard  officials. 

^  Mr.  Sims.  I  would  like  to  have  an  opportunity,  to  respond  to  you. 

Mr*  Nairn.  This  22  to  27  percent  margin  it  should  be  noted  is 
^^Tmly*  the  suibJ«s  erytgred  by  the  College  Bodrd  on  the  SAT.  The 
'  expense  figures  are  thoSe  paid  to  the  ETS,aboye  expenses  incurred 
by  ETS.  Per  the  arrangement,  ETS  receives  6pqipln8ati#i  for  ex- 
penses incurred  and  on  top  of  that  tMey  get  a  fee,'  which  according 
to  ETS  internal  budget  records  for  1977  runs  in  the  range  of  10  to 
.  I    ^2  percent  -  ' 
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So  you  have  theN^TS  cost  and  the  ETS  fee  which  together  repre- 
sent the  expenses  paid  by  the  College  Board.  On  top  bf  that  th^ra  is 
the  22  percent.  " 

In  discussing  .the  cost  i^sue,  there  has  been  argument  that  the 
profit  margin  for  ETS  is  lower.  They  say  it  runs  in  the  range  of  1 
percent.  The  way  they  come  up  with  these' figures,  they  include- 
expenditures  for  Aontest  programs.  There  is  a  certain  cost  for 
producing  the  SAT.  There  is  a  certain  income  that  generates  a 
surplus  which  is  spent  dn  regional  offices,  general  administrative 
expenses,  et  cetera. 

After  spending  this  monev  0D|9ther  expenses,  they  may  occasion-  . 
ally  have  a  cash  surplus  left  o^r.  This  is  what  they  publicly  quote 
as  the  profit  margin  for  the  Whole  corporation.  That  may  be  true 
for  the  whole  corporation,  but  the  point  you  have  to  ask  is  how 
much  does  it  cost  to  produce  tms  test. 

Ms.  Rice.  I  hate  to  interrupt   ^        ^      -  ^ 

'  Mr.  Weiss.  Allow  me  to  conduct  this  hearing.  As  soon  as  he  ip 
through  I  will  call  on  you. 

Mr.  Nairn.  The  College  Board  is  22  percent,  and  over  and  above 
that  we  have  the  ETS  fee,'which  runs  in  the.  range  of  10  percent. 

Chairman^  Perkins.  Mr.  Solomon. 

Mr.  Solomon.  One  hardly  knows  where  to  begin. 

•First  of  all,  Mr.  Nairn  is  correct.  He  correctly  quotes  ETS  docu- 
ments  when  he  says  there  were  reports  in  1971  or  thereabouts  that 
the  cost  ot  test  development  wm"^6^ percent  or  whatever  tigure  was 
sliQwA.  Indeed,  as.  I  tried  to  say  In  my  testimony,  because  all  of  the 
major  programs  we  serve  make  very  substantial  use  of  existing  test 
forms,  because  the  Coljj^ge  Board  for  example  this  year  budgeted 
for  the  development  of  24  aptitude  and  achievement  tests,  but 
provided  in  the  year  service  to  students  147  different  testing  occa- 
sions, which  means  by  sihiple  arithmetic  they  had  to  have  six  times 
.'the  number  of  forms  in  stock- as  the  number  of  new  t^orms  devel- 
oped, indeed  one  can  keep  the  dost  of  t^st  development  down  to  6  to 
10  percent  of  coat. . ,  >  ^  ^  -  . 

But  if  you  simply  increase  the  number  of  forms  developed  by 
sixfold  or  fourfold,  you  increase  the  numerator,  and  the  numerator 
is  now  24  percent  or  40  percent?  and  clearly  if  you  do  that,  one  has 
to  increase  the  denominator  in  order,  to  meet  th6  increase  in  the 
numerator. 

Mr.  Nairn  would  argue  that  is  not  necessary  begfause  he  quotes 
from  the  College  Board  budget  which  shows  a  difijerence  between 
^revenue  and  expense.  What  Mr.  .Nairn  conveniently  does  is  to  • 
eliminate  all  the  other  services  to  students  including  validity  serv- 
^ices;  whichuyou,  .Congressman  Weiss,  believe  there  ishould  be  plenty 

.voTj'^  :.  >  ■  ■■  _  ■  — 

;    Yoircan  r^ad  bur  audited  statement.  Any  reader  of  that. will  see 
•that  indeed  there  is  net  income  from  testing  programs,  but  it  is 
hardly  just,  used  for  things  like  administratio^ji.  One  will  note  in^ 

•  this,  there  is  a  very  substantial  research  and  development  pro- 
gram. In  fact,  -the  bulk  of  our  net  income  from  testing  programs 
goes  to  R.  &  D.,  and  I  might  say  by  the  judgment  of  many  research- 
ers it  is  one  of  the  most^  outstanding  R.  &  D;  programs  in  the 
country.  ^  ' 

Mr,  Weiss.  DiSs  you. make  copies *of  whatever  annual  reporta— 
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Mr.  Solomon.  It  is  pu|)lished  and  sent  to  tens  of  thousand^  of 
people.  J 

,Mr.  Weiss.  Would  you  make  it  available  to  membera  (rf  the  . 
committee?.  ^  -^-^^ 

Mr.  Solomon.  Yes.  , 
[Information  referred  to  above  appears  at  end  of  this^ay's  pro- 
ceedings.] ^  \  ^ 
Chairman  Perkins.  Mr.  Sims. 

Mr.  Sims.  On  the  ye^ir  ended  June  30,  1978—1  believe  Mr. 
Nairn's  statemeonit  was  in  reference'  to  that— he  quotes  figures  from 
a  summarization  of  expenses  and  revenues  contained  in  tKat  state- s 
ment.  Just  tb^ve  you  a  perspective  on  this,  in  that  j^ar  the  total 
revenues  of  the  College  Board  wer^  $52,450,000  and  the  total  ex- 
penses were  $51,848,000,  with  a  net  of  $650,000.  Now  the  figures  : 
specifically  that  he  quotes,  the  $19— against  the  $15  million,  are 
simply  artifacts  of  the  way  in  which  the  comptroller  reports  C!ol- 
le|e  Board  expenses.  .  -  .  .\ 

1  point  out  f 0  you,  he  made  reference  to  regional'  office  oper- 
ations. We  havB  an  extensive  regional  office  operation.  It  provides 
services  to  our  clients,  it  answers  questions,  delivers  materials,  it 
holds  dvorkshops,  provides  training  for  people  in  the  schools  and 
colleges  needing  to  be  familiar  v/ith  the  admissions  testing  program 
and  the  changes  in  it  each"  year.  There  was  over  $3  miirion  in 

v^xpenses  in  our  regional  offices!  A  large  amount  of  that  is  given 
over  to  the  testing  program.  We*  are  an  association,  and  as  Mr.^ 
Hargadon  pointed  out  to  you  in  his  earlier  testimony,  we  are  a 
group  of  colleges,  schools,  universities,  school  systems,  and  so  on.  It 
takes  some  money  to  support  a  cooperative  enterprise  such  as  this. 
It  is  a  fair  charge  against^  the  various  programs  of  the  College 
Board.  I  think  it  is  spurious,  Mr.  Chairman,  to  quote  the  kind  of 
figures  Mr.  Nairn  has.  The  fact  is  we  are  a  nonpro|jJ  organization. 
We  have,  over  the  79  years  of  existence  of  this  orgam2^oii,  gotten 
a  total  surplus  which  is  hardly  adequate  in  ter^  of  pur  outside 
consultants  and  auditors  for  the  contingencies  which  tKis  Board 

^must  face.  It  is  absurd  that  we  are  making  profits  on  this  kind  of 
program.  '  * 

Mf.  Weiss.  Mrs.  Rice. 

Ms.  Rice.  I  am  sorry  to  have  interrupted.  I  wanted  to  let  ypu 
know  that  Mr.  llargadon  has  to  leave,  and  since  he  does  have  to 
leiave,  you  may  wish  to  address  soirfe  questions  to  him  

Mr.  Weiss.  This  is  an  organizational  questioDi^ which  I  ask  so  that 
I  can  understand  more  clearly ^^tbe  nature  of  the  association  ^d^ 
the  relationship.  Could  you  describe  for  me  the  relationship  of  ETS 
to  the  College  Board?  Is  it  a  subsidiary,  a  total  independent  agen- 
cy? Then  Mr.  Sims  spoke  about  your  clients,  and  ^  I  correct  in 
assuming  your  clients  really  are  for  the  most  part  the  same  people 
who  are  the  .boards  who  comprise  thepbard? 

Mr.  Hargadon:  I  will  try  tdr  answer  that.  They  are  independent 
institutions,  as  I  indicated.  W^  have  a  contract,  with  ETS,  a  sum- 
mary of  which  is  included  in  the  materials  being  passed  On  to  you. 
We  contract  with  ICTS  for  services.  The  colleges  and  schools  are 
/interested  in  certain  kinds  of  tests  available  Jto  students,  and  we 
Contract- with  ETS  in  the  making  of  those*  tests.  We  also  have  our 
own  panels  and  examiners  who  make  up  the  tests,  review  the.  tests. 
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but  it  is  a  relationship  where  we  contract  with  ETS.  to  provide- 
many  services^  and  we  pay  them  a  fee. 

We  also  reward  ETS  for  efficiency,  partly  because  the  aim  of  the 
College  Board,  contrary  to  whatever  mystery  must  apparently  sur- 
round it  in  some  people's  minds,  is  interested  in  providing  tests  ^t 
a  relatively  inexpensive  rate  for  a  large  number  of  students  around 
the  country,  all  of  which  has  led  to  students  passing  successfully 
from  one  level  of  education  to  another. 

Mr.  Weiss.  I  am  sure  yCu  are  not  suggesting  the  only  reason  they 
a^e  passing — r 

Mr.  Hargadon.  As  a  matter  of  fact,  I  am  suggesting  that^  other 
than  the  GI  bill,  the  development  of  national  test^  of  this  sort  have 
been  the  most  democratizing  thing  to.  take  place  in  this  country.  I 
,  am  suggesting  that. 

"  What  really  surprises  me  about  the  focus  on  tests  are  two  things: 
One  is  the  as  yet  undocumented  and  unsubstantiated  phrases 
which  are  thrown  around  as  to  the  wide  abuse  of  tests. 

I  would  think  the  committee  would  be*  very  interested  in  showing 
the  publican  j)£-uSi  the  documentation  of  the  so-called  wide  abuse 
of  tests,  either  by  colleges  or  anybody  else. 

Second,  all  of  us  in  colleges  know— and -it  can  be  documented — 
that  all  of  the  millions  of  tests  given  in  the  elementary  and  second- 
ary schools  and  all  the  grades  given  there  carry  far  greater  weight 
on  what  happens  to  a  student's  going  on  to  higher  education  than 
do  admissions  test  scores. 
j       Obviously,  this  legislation  does  not  mean  to,  open  ^up  all  the  tests 
/     and  grades  to  legislative  scrutiny  or  legislation.  It  is  in  that  sense 
that  the  College  Board  has,  through  its  testing  program,  has  been 
able  to  reach  out  to  every  region  in  this  country  to  tap  talent 
.     among  young  people  regardless  of  whether  or  jxot  their  paren# 
/         wenl  to  college,  regardless  of  whether  they  are'' attending  a  one- 
/         room  school  or  a  high  school  in  Beverly  Hills,  That  can  easily  be 
/  documented.  ,  - 

There  is  no  question  that  the  vast  number  of  people  going  on  to 
higher  education  in  this  country  is  matched  by  no"^her  country  in 
the  world,  nor  is  the  diversity  of  students. 
Mr.  Weiss,  Because  of  the  tests? 

Mr.  Hargadon.  The  tests  have  played  a  very  valuable  role  fos- 
tering diversity.  The  tests  play  a  valuable  role  in  that  they  protect 
a  student  against  arbitrary  actions  of  a  teacher  who  happens  not  to 
like  him:  If  he  shows  up  with  a  D  in  chemistry  but  shows  up  with 
an  800  on  a  chemistry  test,  you  know  it  may  be  because  he  may  not- 
have  been  liked  by  a  particular  teacher  in  that  course. 

You  know  there  ^are  students  with  natural  ability  even  though 
every  other  measure  may  show  they  have  not  attended  a  good  set 
of  schools  previously.  The  tests  made  it  bossible  for  me  before 
coming  here  to  read  the  files  of  a  40-year-old  applicant  and  to  be 
able  to  enter  her  to  college.  It  relieves  colleges  of  haying  to  lean  on 
only  one  variable,  her  grades,  25  years  earlier. 

Mr.  Weiss.  You  are  suggesting  in  the  response  that  you  gave, 
that  is  what  is  under  challenge  here,  are  tests.  It  is  jiot  tests.  It  is 
the  secrecy  surrounding  the  tests  that  is  under  challenge,  and  I  do 
not  know  why  any  of  the  benefits  you  have  described  As  flowing, 
from  tl^e  creation  and  establishn^nt  of  national  tests  would  at  all 
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be  reduced  if,  in  fact,  you  did  not  have  this  secrecy  surrounding 
thejn. 

Mr.  Hargadon.  I  may  draw  too  many  fine  distinctions,  but  I  do 
draw  a  distinction  between  the  use  of  the  wotd  ^'secrecy''  and 
.  "security'' for  a  test.  ,  T       (  , 

Sottietimies  I  wonder  jjf  people  are  not  trying  tc5.have  tests  so  open 
that  in  fact  evCTyorie  will  score  100.  The  fact  is,  tests  are  tests,  and 
*  they  do-. not  test  mu^h  if  you  have  the  answers  ahead  of  time.  If 
somebody  says  here  is  what  I  am  goiHg  to  test  you  on,  what  kind  of 
test  is  that?  So,  there  is  a  sense  of  security  in  which  you  are  trying 
to  measure  abilities  among  students.  After  all  we  did  say  in  ours* 
statement  that  on  the  one  hand  we  will  try  to  work  to  see  if  it  is 
not  possible  to  meet  the  ideal,  which  is  to  have  everybody  take  tTie 
test  home'  after  they  have  gotten  their  score  and  so  forth.  And  on 
^  the  other  hand,  to  promote  the  validity  and  security  of  the  test  so 
that  it  is  a  fair  test  and  not  rigged  by  somebody  ahead  of  time,  by 
somebody  who  has  gotten  copies.  It  would  be  nice  to  haVe  6verv- 
thing,  but  there  are  tradeoffs.  The  College  Board,  will  probably 
work  very  hard  to  see  if  it  is  not  possible— since  our  main  interest 
is  to  get  students  into  college,  not  to  keep  them  out — to  see  if*it  is 
not  possible  to  meet  as  closely  as  we  can  the  kinds  of  concerns  you 
express  in  your  bill,  but  we  also  ask  you  to  recognize  the  kinds  of 
Concerns  expressed  by  those  who  do  after  all  have  expertise  in  this 
area  of  testing. 

Mr.  Weiss.U  appreciate  that.  I  have  twp  kids  who  dbnsider  I  ani 
old  fashioneq  at  times,  and  in  listening  to  your  response  I  Was 
wondering  if  in  fact  that  does  not  apply  to  others  than  mvself.  As 
long  ago  back\as  when  I  was  going  to  law  school,  open-book  exami-.' 
nations  were  not  unusual.  There  is  a  school  of  thought,  and  I  am 
not  suggesting  it,  tjiat  says  quite  successfully  what  you  are  trying 
to  test  is  thinking  and  thought  processes;  that  you  do  not  necessar- 
ily have  to  rely  on  memory  but  you  can  provide  the  tools  to 
implement  thought  processes.    ^  _ 

Mr.  Hargadon.  I  -cannot  agree  with  you  more.  I  sent  out  a 
memo,  widely  circulated  last  fall,  indicating  that  it  would  be  grebt 
if  the  secondary  schools  gave  essay  examinations  while  students 
were  still  at  that  level  so, they  wouj^  Hot  hesitate  to  write  when, 
they  get  to  college.  l  am  not  a  great  multiple-choice  person.  We  all- 
want  the  kind  of  qualities  that  you  have  suggested.  At  least  we 
would  like  to  be  able  to  perceive  and  recognize  them,  but  there  is  a 
very  practical  matter.  I  give  opien-book^  exams  at  my  classes  at 
Stanford,  but  the  faculty  and  students  opn^^ate  Under  an  honor  cocle 
system.  We  do  not  have  a  national  honbr  code  system  for  taking 
tests.  .  '  ;  *    .  '  ^  * . 

Mr.  WEI9S.  Again^  giving  what  has  to  be  an  opap  secret,  to  wit 
the  fact  that  there  are  tutor ing^  schools  which  speflalizevin  getting 
hold  of  "the  questions^  then  preparing  their  kids  with  the  e^riswers,  I 
just  wonder  why  you  think  those  tests  are  so  secure,  why  in  fact 
yoU  do  ridt  agree  they  are  secure  for  a  lot  of  people,  but  for  a  lot  of 
people  there  is  k  built-in  advantage  because  of  the^ystem. 

Mr.  Hargadon^  Maybe  vou  know,  I  do  not  knoAV,  and  I  will 
simply  guess  that  of  the  millions  of  testtakers  in  this  country  every 
^  year,  particularly  the  SAT,  only  a  small  fraction  have  gone  to  a 
coaching  school.  The  argument  could  be  if,  in  fact,  a  few  can 
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I  breach  security^  then  there  ought  not  to  te  any  secuHty  at  aliri^d^ 
mot  accept  that  argument.  I  do  -ask  you  to  consider,  in  all  the 
Publicity  about  the  coachi^ng^s^hoolg/ the  possibility  of  what  some 
people  term  a  coaching  school  may  turn  out  to  be  10  weeks,  4  hours  . 
a  week,  of  teaching.  That  does  not  say  anything  about  whether 
abilities  are  developed  in  those  schools  or  not.  It  may  say  some- 
tnin^  ^abpy t  jvhat  is  not  being  done  in  the  secondary  schools  t.urns 
but  tb  be  teaching  for  money  over  a  loi^g  time  in  the  coac&iPhg 
sdhools.  There  is  \quit6  a  difference  between  this  anj^l  «wliat  they 
tdid  to  imply  in  their  ads;  namely,  there  is  a  techni£[tfeia!^^^^^^ 
the  coaching  schools— can  teoach  you  oh  the  tecliniquie.    '  i        < ...  .  T. 
•    Mr..  Weiss.  I  don't  know  if ^ you  have  any  ^studies,  which  ;suppbH 
thit  conclusion  but,  regardless  of  which,  way  it  really  iSr^ 
kirAd  of  argument  in  the  abstract  tfiait  I  can^  ^^^in,  bec.auSe  I  cen  .  J 
tainly  caniiot  prove  to  you  that  in  fact  that  ,  rhay  apt  bi^  the.'^E^ase,  ^ 
but'  it  certainly  disproves  tiie  proposition  that  in  fglct  att6n4ing 
thedb  schools  in  ho  way  influences  which  is  what  some  of  the/^  ^ 
sugjaestiohs  that  have  -been  pade,  that  it's^  Ju3t  tibi'  possible  for  .  . 
peopje  to  be  coached  for  these  examinations,  '  ■'   :  c     ^  .  -  ' 

Mr.  Hargadon.  I  am  going  to  have  tQ  ex^cuse  hiyself.  J  am^'gQin^ 
to  try  to  arrange  an  operation  for  my  l^-yearHb^  dbctpr^^^* 
whom  i  •  hope  knows  a  lot  about  rnedical^sciertce  ^arid^^y^^^   little^  v^^^ 
about  quarks.  ^  ^        "         '     .     ^  \y 

Mr /Weiss.  Thank  you  very  much  for  ypiir  pstrticipatioi^;      ;  . 

I  appreciate  your  patience  with lis.        •  J  1     ^  ° 

Mr.  Wairn.  I  wo      like  to  comment  on  the  response  of  iMr. 
Sbfomon  and  Mr.  Sims'  argument  about  costs,  and  T  would/like  to  // 
begin  by  bringing  in  an  opinion  of  a  third"  party,  namely,  ForbeS;  • 
business  rnagazirie^  w^     I  iani  sure  thi^  miembers^of  the  cqrnmittee  v 
"are  famiuar  . with;  ••  ./     ^      "   •       -^^  '  v  "  "  - 

•  In  1976  they  did  ah^^^a^^^^  on  the .  finances  bf  ETS,  entltlec|;,  - 
"Tleasur^  of  Nortprofitablh>/^  :     ^  ;  1^ 

.^^^  According  tq;Por)iie&i:.nphpr^^^^  Bducatibnal  $ 

;Tes£ddg' Service;,  in  l^ot^  - gh^pses  Up  aS  a  tough,  aggressive  andc^eve^n  .  | . 

^dyneMio'gV^V^^tB^  '^^^ -^HL""    " "  ■       '  ■ " 

If  jPrincc^toA,  New  JeFS^j^^JWutational'^i^^^^^  [ 
-and.  notra  seJjfcorit^ined  taj^^e^  organization,  it  wo^T^rp^^^y  have  ' 

^ng  since  en3erged>s'*one  of  the^'darUng?  oF-^  '-f  -y  <x 

The'vkno^^t^ledgp  indiis^^^  premise  tiian  pfierforih- " 

-altice,  bufv.  ETS.haj?  deimori^riat^  all  the  performance  any  promot^.lcould  ,vvish<  Over 
Ihe  pa^t,30  yeafe  ifc;has  easily'rackeSd-up  k  re^erjl  as.  otve  of  the  hott^sA  little  gfbwtlt  ^ 
compattjes  In  UB,  bu$ine8s.         *  '! ,   -  ■   -  ^     -   ~        -  " 

ETS  has  hot,  tfirbugHijjrQ^fi^ 
pool  of  retaiHfed-earnihgs.     ;  "  ^  r  ^  i 

The  article  Vontinaes  ' with  nexte^^ 
of  the  growthlin  retained  earnings, ^         of  BTSv.I  "^WW^  suggest: 
that  ETS  hag  been  able  to  acquireTtWs  ^fi^  by  ^ 

system  of  charges  for  its  tegl  which  iVsom^wbat.diff^ 
described  by  Mr.  Solompn  a^d  Mr  Simis,^  ,  .  j ' 

In  fact,  as  Forbes  points^ put^  very  large  prfefit  margins  are  ob-  * 
tained  in  the  specific  testing  programs  that  the  ETS  Jadministers. 

As  I  discussed  before,  there  is  a  22-percent  profit  margin. 

They  go  on  to  discuss  the  way  the>i  spend  these  profits,  and  they 
argue  that  the  way  they  spend  those  profits  are  worthwhile.  That 

...  <  •         ■  .  •' 
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A,  .    ^         •■  .  \ 

may  or  may  riot  be  the  case,  but  the  point  is  ETS  ^nd  the  College 
'  Boaixi  are  given  their  nonprofit  charter^  for  the  specific,  purpose  of 
administering  testing  programs.  I 
That  is  the  primary  purpose  for  their'iexistehce  as  a  corporation. 
'The  questioii'that  pertains  to  this  legislation  is  how  much  does  it 
cost  to  ^administer  the  tests,  ajj^how  much  iricome  are  they  getr 
ting?^ 

They  are  geijerating  substantial  profits  in  the  administration  of 
each  pfithese  tests.    .      "  ~  . 

.     Mr!  Sotomon  "went  on  Ao  suggest  that  under  cohditions'of  a;truth 
';   iprtoitir^  bill,  the  .test  development  costs  .would  multiply  so  much 
'T  that  th^ar^  ^         far  out  <MFj)raportipn  •to  what  they  are  now. 
F^r  ll^'^icql^nittg:  ieg^lsl^^  to  Senator  LaValle 

8i)ecific  Isti^jiates  Of  how  H^^^^  incre^e  test  develop- 

>  -In  the : Waae  pf  tl^e'SA^i -for^am^^   ETS- eatitnated  by  its  own 
-  methods  iHai'lbe  bilr-  ^oialsl  'mctease.  SATF '  development  costs  by 

'vl^m^nM^r  ---'^  -T.y--  -  •  ;.■ 

V     This  iamgvmte' ^  leSss  th^  of  profit  margin 

"'"■•!on  the  SATprograiii;         ^  ■ 
t^  --  V.Mr/1W^^s^.  Nationally' 6^^ 

-  order  to  comply  with  th?  provisions  of 

■p^tht  ffeYf^  Y<Jf3^  as  the  provisions  of  ^oiir  bill, 

iflB  far  ay  dMttsttre  apply  in  both 

■.■^■•^^cases,.8^■.M■ff:^&^ES  '  ■  ' 

■  We  cMd  argue  .a  hun^r,  of;Ways;:tlu5lt^  estirjfiate  is  inflatedv  IJtiJt,, 
■l  "aax)rdinK  to  their  w    itwould  amount  to  $ijnill'ibn.^"^^^^ 

You  would  have  to  obtain  and  look|  at  those  kinds  of  figures 
ac*bB$  the  boaVd.  for  aU^  otJier  test  programs  in  order  to  fully,; 

' r"''-ddcujiii^t. this jssue.  V  „■  ■;'■'•'■-■  •  -, 

.  :  "^That  Wnd  0^^^  is  not  iriidti^ed  iri  the  ETS  .annual 

\ repoH  which  subrtiit/ "  "  V  ^  , 

"   ^  If  the  cpihmitteir  is  Interested  in  the  fiii&hcial  ipsue,  they  Should  - 
:i3j)&i>  ETS  project  operating  stiitemeht  V/ljei*  they  .for' their  "  « 

^';:„Qwn  intemjal  accounting  purposes  list  specific  ejcp^nses  as  .well  ap"      '  ^ 

p>pfit  ift^  .  *        :       :  \ 

: '';„^^Withthett"PndK  09  hand  as  wefl  as  information^Qh 

'  ■  rewhue^f  fitotti  each  specifio' testing  prdgram^ypi  (wuld  the|i4ook  jat 
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/Mr.  WEieClkfjn^ Solomon?  :  :-'-<rJ-  ::^"K-:  ;>v 

V'lilr;  Soix)MowrW«f;.a8  I, say,  issued  the  annual  ri^^rt.  We  will  b)^;|    \  r.^-'^^^ 

:»  ;  f  TlilihcJudes^fi^^^^  and  liabilities  since  thfiJncep- 

■•■•--•^ionof'ETS.^'?.-      ■    V      '  v''^."'  ,v  ■/A^-^^.^i.<^^i^^^4^t^ 

^  "\^'^;;Qib^^h..>hak^^  ' 

"^^iM^in  liquid  assets,  and  aboHtV$24  million  in  ^i£)iit  antt,%[uip-  * 
ment  ancUand.-  .  ^      '  "  i  ».  '"^^ 

■  EV0  staited  with'  a  very  smiall  plaqt.  I  don't  know  the  eJiact 
t    amount.  Mr.  Naini  protJably  does 

To  start  ]ETS  off,  thare  was  no  endowment.  We  managed  on  the 
basis  of  the  income  from  test  programs. 

ERJC  ■ 
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Most  of  that  net  that  Mr.  Nairn  refers  to  has  gone  into  buildings, 
as  i  say,  $24y2  million.    .  n/  ■ 

Our  total  annual  operating  expense  is  over  $yO  million,  of.  which 
we  have  a  $4V2  million  liquid  reserve  whidi,.  by  any  business 
standard,  that  is  extremely  law.  7  v 

Furthermore,  in  this  same  annual  report/you  will  see  a  5rye^r 
summary  of  revenue  which  shows  the  inccmie  from  College  Board, 
from  other  graduate  programs,  which  shows,  research  and  develop- 
ment services  and,  in  other  words,i  gives  us  the  very  breakdown 
that  we  are  talking  about.  /  y 

Mr.  Nairn  financially  speaks  of  the  estimates  we  gave  with  re- 
gard to  the  SAT^development,  and  he  quotes  the  figure  correctly. 

The  point  I  have  tried  to  make  is  that  that  is  one  test,  and  in 
fact  for  some  other  testing  programs  thfat  ETS  administers,  the  cost 
of  limitations  of  your  proposed  legislation,  sir,  are  even  more  hor- 
rendous  than  they  are  for  the  college  boards.  , 

I  cited  the  problem  with  the  GRE  program  with  all  its  special 
administrations  more  than  those  for  the  College  Board,  so  it  isn't 
just  $1.2  million.  It's  $1.2  million  for  SAT. 

It's  the  aehivement  test  for  thd  College  Board  which  is  a  much 
more  serious  problem.  The  GRE  advanced  test,  the  aptitude  tests, 
the  Miller  analogies  test,  medical  college  admissions  teste,  dental 
exam  and  each  of  those  has  a  price  tag  next  to  it  which  is  substan- 
tial, and  your  legislation,  sir,  would  inevitably,  even  if  everyone 
^ould  find  a  way.  to  do  it  and  I  am  not  sure  they  could,  would, 
either,  in  terms  of  trade-offs,  either  increase  costs  to  students  or 
reduce  service  to  students  or  affect  the  quality  of  the  program. 

I  would  submit' to  you,  sir,  although  I  think  your  motives  are  of/ 
the  highest,  I  would  submit  to  you  that  some  of  the  people  support-, 
ing  this  legislation  indeed  do  want  to  bankrupt  the  tests  and  get 
rid  of  the  tests.  * 

Mr.  Weiss.  Let  rrte  just  suggest  or  invite  you,  whatever  inforrna- 
tion  you  have,  whatever  projections  you  can  make  as  to  financial 
or  expense  costs,  increases  in  the  cost^  of  preparation,  the'cbst  of 
giving,  whatever  on  any  angle  of  the  tests,  I  would  welcome  that 
and  the  committee  would  welcome  it.  .    '  ^  } 

I  urge  you  to  -please  submit  that  to  us.  '  ♦ 

I  wduld  also  urge  you  to  submit  to  us  the  kind  of  informatioa* 
|.hat  Mr.  Nairn  w^s  t^lkirig  about  which  is  the  project  defvelopment 
mformation  to  indicate  what  in  fact  goes  into  coming  up  with  the 
conclusions  as  to  what  the  increased  costs  would  be,Tbeeause  per- 
haps that  way  we  can  look  objectively  at  least  .to  see  where  the 
dollars  and  cents  lie  both  as  far  as  income  and  outgo  are  con- 
cerned. '  •  . 

[See  materials  at  the  end  of  this  day's  proceedings.]  ^ 

Mr.  SoLoyON.  I  understand  what  you  are  saying,  but  I  think 
.  there  is  one  other  point  that  needs  to , be  made.  ^ 

Mr.  Nairn  argued  that  what  agencies  sudi*  ^s  the  Collie  Board 
ought  to  do  is  just  develop  tests  and  administer  them^and  qollect 
(ees  and  do  nothing  more.  *      '  . 

Lsubmit  to^you  that  if  the  College  Board  did  that,  we  would  now 
be  having  hearings  held  by  you  to  know  why  tlie  College  Boiard  is 
Apt  giving  advice  to  colleges  on  the^,  appropriate  use  of  teste/, iind 
conducting  validity  studies  on  tejsts,' why  the^'College  Board  isn't  ' 


providing  publications  to  students  and  better  ujiderstand  the  test, 
such  as  the  free  SAT  booklet  published  for,  taking  SAT's. 
'  In  other  words,  you,  among  others,  would  probably  be  among  the 
very  first  who  ^oiild  be  genuinely  concerned  with  the  fact  that 
students  do  have  to  have  infonriation  which  is,  of  course,  the 
principle  behind  your  proposed  l^slation. 

'    Now,  we  h«ve  a  situation  where  m  fact  that  is  what  the  College 
Board  is  doing,  and  Mr.  Nairn  is  saying  that  is  a  bad  thing  to  do. 
In  fact,  they  shouldn't  do  ^y  of  those  things.  They  should^  just 
■  'administer  tests  and  scpre  t)iem  and  nothing  else. 

Mr.  Weiss..  I  ^eally  donyt  want  this  to  bb  a,  focus  on  yrhtA  Mr. 
Nairn  Mjants.^  -  /  '  \ 

It  is  what  I  want  and  what  the  committee  wants,  and  what  we 
are  trying  to  do  and  the  purpose  of  the  hearing  is  to  try  to  estab- 
lish a  factual  base  for/ coming  to  some  conclusions  as  to  what  we 
ought  to  do.  /■■  ■■'  -  ^ 

one' of  the  arguments  that  we  have  heard  rjeppatedly,  both  at 
this  hearing  and.preViously,  is  that  if  my  legislation  is  adopted  the 
costs  ar6  going  to  b^  just  astronomical,  andat  will  be  impossible  to 
dp  it. 

Well,  OK;  jnaybe  they  will  and  maybe  they  won't,  but  at  the  very 
least,  never  mm^i  Mr.  Nairn,  what  I  would  like  is  for  you  to 
substantiate  those  stateme^nts. 

3how  me  where*in  fact  the  costs  are  going  to  be  and  show  me 
what  it  costs  you  how  to  develop  the  test  on  an  individual  test 
basis,  and  what  the  differenfce  will  be  when  this  legislation  goes 
into  effect,  and  then  •maybe  we  can  inr^  toct  come  to  some  under- 
standing as  to  whv^in  fact  my  rtiggestipns  are  so  outrageous  or  why 
they  are  going  to  be  so  expensive. 

That  is  the  basis.for  doing  it. 

One  specific  question-^ — -  - 

Dr.  Cooper.  May  I  say,  I  also  am  afraid  I  have  to  go. 

I  h4ve  to  travel  and  I  apologize.  We  have  been  here  a  long  time, 

I  appreciate  the  fact  trait  you  have  been  here  for  the  bulk  of  the 
day,  and  I  thank  you  for  your  patience  and  your  cooperation,  and  I 
urge  you  not  to  put  pur  students  in  New- York  into  tl^e  position 
where  they  will  have  to  go  out  of.  State  to^  take  exammations 
because  I  tell  you  as  a  word  of  advice,  tlwtlc  that  probably  will 
create  more  of  an  impetus  for  more  legislaMon  than  anything  else 
that  you  could  think  of  doin^.  .  ^ 

Mr.  Solomon,  you  nad  said  in  the  last  round  of  responses  that 
most  of  ETS's  s(H;alled  profit  margin,  tlie  surplus,  went  into  re- 
search and  development. 

\  Is  that  research  and  development  for  test  purposes  or  followup 
vaiid8yhk>n  or  is  it  general  research  and  development? 

Mr.'lk)lx)MON.  It's  both.  Some  of  it  is  directly  connected  with 
tests,  test  development,  new  kinds  of 'test  development. 

1  said  m  my  testimony,  I  made  reference  to  the  fact  that  we  arei 
ido|ng  research  development  on  tests  which  measure  personal  ac- 
complishments, other  characteristics,  thq^t  are  not  measured  by  the 
current  ability  tests.       *  .  ^ 

Some  of  the  research  money  ,  goes  into  that,  but  in  addition  to 
♦that,  if  one  looks  at  ETS's  chartea^,  part  of  our  charter  obligation  is 
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to  conduct  resear^X to  ^improve  measurement  generally,  .not  just 
the  programs  that. ™^  to  administer,  and  sq  indeed  some  of 

our  research  is  not>  reife^ted  to  the  testing  programs,  but  is  related 
more  broadly  to  questka^  of  educational  development  and  growth)  ^ 
and  better  understandirra  that  process  and  applying  that  knowl-  ' 
edge  to  solutions  of  otheriMUcational  problems^nd,  indeecl,  part  of 
Our  research^and  develop^lftt  goes  to  that  and  it's  well  known  that 
itjdoes.  ■  \        y  .v  v 

Mr.  Weiss.  Do  you  have  a^makdownas  to  wh^vpercentage  of  it  ^ 
go^s  for  general  research,  edji^^^ional^s^fihr 6  and' 
for  testing?  ^ 

Mr»  Solomon.  L  don't  think  w^'^ve^y^  t^|J|d  to  break  it  down 
that  way,  iand  I  >yould  not  be  sui*e^^  cOUld,vb'^^se.t  suggests 
that  -there  is  some  sort  of  sharp  ^ision  Kfetw^eh  one  kind  of. 
research.,  and  de^lopment  and  ahot|ie%ahd  h  isVhat  one  ;learns 
in  basic  research,  one  then  applids  irr^  more  applied  situations. 

Mr.  Weiss.  You ^ee  the  problem  that  it'Wesents  to  somf«of  us  in 
getting  into  the  responses  to  the  questions  %  to  . how  muqhSftore  it 
would  cost  the  individual  student  to  take  th^  exa^ninationr^'r  how 
fewer  oportunities  a  student  will  have  to  t^ke\he  examinations^  Is 
that  we  don't  know  how  much  of  the  money  re^gdv  is  being  utilized  • 
for  nonprioritA^  purposes,  if  in  fact  your  prime  p^rpdse  is  for  it  to 
provide  for  telfcs.  '  • 

Mr.  Solomon.  Again,  M^Weiss,  our  charter  is  not\|hat  narrowly 
\vritten  and,  tlierefore,  the  question  yoii  raise  is:  ^yh^^is  to  decide 
what  t^e  priorities  are?  v  /     ■ . 

Now,  we  make  no  secret  ofrour  work.  It's  well  known  nationally 
in  the  research  community  and  even  in  the  educational  communi- 
ty; our  research  reports  are  contrary  to  some  things  that  have  b^en 
alleged  are  published. 

We  distributed  over  10,000  research  reports  this  last  yearj  but 
come  back  to  the. central  point  that  our  charter  obligiation  was  to 
provide  testing  programs  and  services,  conduct  research  in  the^area 
of  measurement  and  provide  advisory  services  and  field  services  in 
the  broad  area  of  educational  research.  .  ^ 

We  were  not  created  originally  to  be  narrowly  a  test  building 
and  test  selling  organi^tion,  but  Vather  were  created,  and  I  had 
nothing  to  do  with  the  creation,  but  the  inspiration  of  those  that 
did  was  to  create  an  agency  that  would  serve  the  educational 
community  in  ttiat  broad  a  way. 

Mr.  Weiss.  You  are  saying  that  there  is  no  way  that  you  pan 
break  down  and  give  us  a  figure  ps  out  of  those  three  specific 
responsibilties,  how  much  of  your  money  goes  to  testing?  > 

Mr.  Solomon.  That  breakdown  would Jbe  artificial  and  mislead- 
ing but  exists.         '  ^  * 

Mr.  Weiss.  But  exists? 

•Mr.  Solomon.  No;  no,  sir.  I  didn't  mean  to  imply  that  it  did. 

Mr.  Sims.  I  want  to  correct  as  statement  that  had  been  made 
about  the  charter  o£the  College  Board.  » 

We  ara  chartered  by  the  Board  of  Regents  of  the  State  of  New 
York  to  act  as  a  forum  for  the  discussion  and  exchange  among 
educational  institutions  and  secondary  schools,  of  educational 
standards,  an  important  associational  jFunction,  and  to  provide  cer^ 
tain  kinds  of  educational  services.      .  * 


.-.  ..135  •'■  ,  —  •  ^  v  •■ 

'  '  ■    •  ■  •  "     ■  .       ' '  ■  ■    ■'    ' .  ■  •*  ■  . 

the  people  who  wrote  that  charter,  in  their  wisdom,  never  in 
.  any  way  restricted  our  role,  even  primarily,  to  testing.       '  ^ 
.  Let  me  say- something  else  that  is  more  on  my  mind  than  that 
iniBcellaneous  piece  of  information;.  ,    ,   »  ,  I 

I  have  testified  now  twice  in  Albany,  once  m  Maryland,  and  no\<f 
here  with  respect  to  this  kind  of  legislation.  ,      3  , 

:  The  point  jiist  made' by  Mr.  Nairn  is  rjgpeatedly  made  with 
respect  to  the  Educational  Testing  Service.  ,  , 

In  fact,  in  Maryland  the  bill  was  labeled  a  bill  to  regulate  the 
Educational  Testing  Service.  •  .  '  . 

I  suggest,  sir,  tj^at  that  is  a  misconstruction  of  what  the  problem 
.  is,  if  the^e  is  any.  '  ■  ,  j 

"  The  epUege  Board,  insofar  as  its  programs  are  concerned^and 
we  have  a  wide  variety  of  tests  that  we  sponsor  and  a  lot  of  that 
activity  we  conduct  outside  of  ETS.  ,   .,  . 

El^  is  in  full  control  of  its  programs,  but  not  ours.  It  decides, 
what  programs  there  will  be,  and  appoints  the  committees  of  teach- 
ers and  pi  ^feasors  who  will  formulate  the  tests,  who  incidentally 
see  that  those  tests  are  relevant  to  what  is  being  tfested. 

yfe,  the  C!ollege  Board,  set  the  fees.  We  are  the  ones  who  monitor 
the  quality  of  servitee  for  6Ur  programs  at  the  Educational  Testing 
Service. 

We  are  the  ones  concerned,  throigh  our  trustees  and  our  finance 
'committee,  with  the  reasonableness  of  costs  for  the  services  per- 
formed  for  us  at  the  Educational  Testing  Service.    .  , 

We  are  the  one?  who  will  decide  whether  the  SAT  will  be  Offered 
five  times  or  seven  times  or  two'  times  and  in  what  circumstances 
and  where,  because  that  is  a  policy  affecting  one  of  our  programs. 
Unfortunately;  few  understand  that  the  Educational  Testing  Serv- 
ice is  a  sepwate  corporation  aiid  they  can  take  care  of  themselves; 
as  Bob  Solomon  has  given  some  indication  here  today,  they  are 

able  to  do  just  that.  ,    ,  ,  ,       i  ^    x-  « 

•  The  issue  is  whether  testing  policy  should  be  substantially 
changed  in  ways  that  your  bill  suggests  and  that  is  a  policy  consid- 
eration and  the  final  answers  as  to  whether  it  can  "be  done  and  how 
it  Will  be  done  will  be  rendered  by  the  C!ollege  Board's  Trustees  of 
the  College  Board  Association. 

Of  course,  we,  the  College  Board,  will  be  affected  by  the  testmg. 
legislation,  but  it  seems  to  me  that  what  has  been  happening  here 
is  that  a  strawman  has  been  set  up  to  attack,  namely,  the  Educa- 
tional Testing  Service  when  that  is  not  really  the  issue  of  proposals 
before  you,  as  I  understand  them,  at  least. 

Mr.  Weiss.  I  am  curious  about  one  of  tl\p  comments  you  just 
made  and,  again,  misapprehension,  on  my  part,  and  you  correct  it 

for  me.  '  .      -     %    j.  j.  ^ 

Are  you  saying  the  development  of  questions  for  the  tests  and^ 
the  hiring  of  professionals  field  to  do  that,  is  done  hot  by  the 

Educational  Testing  Service  but  done  by  you?  .  » 

Mr.  Sims.  No^  I  am  saying  that  the  appointment  of  committees: 
and  the  payment  of  committees— and  w6  have,  test  develomnent 
committees  in  for  every  Cbllege  Board  test  including  the  SAT  and 
the  achievement  test— is  made  by  the  College  Board.  We  select  the 
•  faculty  members  or  school  teaching  faculty  that  are  on  those  com- 
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mittees,  because  we  want  to  get  tests  that  are  relevant  and  fair  for 
the  students  in  the  country. 

Those  test  committees  work  with  the  ETS  test  development  staff 
Bob  Solomon  reported  in  his  earlier  'career  he  was>diie  of  those  test 
developers.  We  work  with  them,  and  o^r  staff  also  sits  in  on  those 
meetings  from  time  to  time  to  monitor  the  kind  of  activitv  that  is* 
going  on,  so  in  a  real  sense  we  take  a  policy  and  substantial 
responsibility  for  the  nature  of  the  tests.  ,    '         ^      *  ^'^ 

Mr.  Weiss.  To  answer  my  question .  specifically,  fhe  tests  are' 
developed  by  the  Educational  Testing  Set^vtee,  are  they- 'not?  - 

Mr.  Sims.  That  is  right.  I'he  standards*  With  respect  id  tliem  are 
set  by  our  committees,  and  our  committees  pass  oh  the  standards 
for  developing  the  questions.' 

Mr.  Weiss.  Again,  so  I 'understand  tliis  relationship,  for  back- 
ground I  read.sopiewhere  along  the  line  that  the  Educational  Test- 
ing Service  was  in  fact  created  under  the^auspices  of  the  College 
Entrance  Examination  Board.  ; 

True  or  not  true? 

Mr.  Sims.  Not  quite  true.  .  , 

Mr.  Weiss.  Tell  me  what  is  true. 

"Mr.  Sims.  The  College  Board  was  one  of  three  sponsoring' organi- 
zations in  1947y  1948. 
Mr.  Weiss.  That  matters? 
Who  were  the  others?      "  ^ 

•Mr.  Sims.  The  American  C!ouncil  of  Education  anid  the  Carnegie 
Foundation  fpr  the  Advancement  of  Teaching. 

Mr.  Weiss.  What  percentage  of  the'  work  of  ihe  Educational 
Testing  Service  was  done  for  the  College  Entrance  Examination 
Board? 

Mr.  Solomon.  About  45  percent.  ' 

Mr.  Weiss.  From  the  beginning  or  over  a  period  of  time? 

Mr.  Solomon.  It  has  varied,  gone  up  or  down.  ^ 

The  estimate  I  gave  you  is  about  what  it  is  now.  '  ^ 

Mr.  Weiss.  Because,  again,  Dr,  Sims,  it  seems  to  me  that  you* 
would  understdnd  that,  I  would  hope  that  you, would,  it's  not  a 
matter,  of  attacking  a  mar!,  that  regardless  of  how  you  set  ultimate 
policy,  if  in  fact  we  are  told  because  we  want  insurance  that  the 
secrecy  or  security  aspects  oC  the  tests  are .  removed  to  the  extent 
that  people  can  know  what/  examinations  they  take,  and  so  op. 
.  If  that  is  done,  it  will  cost  a  great  deal  of  additional  money,i 
becai^  ETS  says  that  they  are  going  to  have  to  charge  more  for  it. 

Then  it  seems  to  me  thht  that  is  a  matter  of  scapegoating:  That 
is  a  matter  really  of  finjiing  out  what  the  facts  are,  the  relevant 
facts.  Is  that  not  so? 

Mr.  Sims.  Yes;  it  is  so,  but  the  point  I  was  making  Was  that  the 
decision  as  to  how  you  would  comply  with  such  legislation  which 
.  will  undoubtedly  be  some  combination  of  increased  costs  and  re- 
duced test  availability  is  a  decision  of  the  kind  that  ^ould  be  made 
l^y  the  College  Board  itself. 

Dr.  Haney.  I  would  in  a  way  like  to  take  Mr.  Sims'  point-  even  a 
bit  further  than  he  took  it  iii  that  it^eems  to  me  the  issues  and 
concerns  behind,  the  proposed  legislation  we  started  out  discussing  . 
•  here  todayj^ci  far  beyond  ETS  and  certainly  far  beyond  College 
t  Board.      r  ♦  ^  , 


In  addition,  they  mise  impor|ant  educational  questions  about  ttie 
relationships  betweeil  those  commonly  used  tests,  secure  tests,  or 
secret,  whatever  word  you  phoose,  and  what  goefe  on  in  our  schools 
an<J  colleges. 

I  hope  that  the  committee,  if  it  wants  to  pursue  these  issues 
further,  AvUl  call  on  not  just  the  people  who  are  primarily  responsi- 
ble for  these  test^  but- educators  much  more  broadly,  because  my 
ultimate' coficern  really  is  at  root,  it»is  clearly  concerned  with 
College  Boards  and  the  others,  is  what  this  h^^s  to  do  with  learning 
and  teaching  in  our  educational  institutions.  % 

If  I  may  make  that  suggestion,  and  in  closing  perhaps  a  little 
historical  perspective  in  that  the  debate  today,  much  of  this  got 
caught  up  in  the  costs  of  what  ETS  entails  and  what  they  pass  on 
to  College  Boards,  et  cetera,  and  I  could  envision  this  hearing 
concerning  regulations,  of  general  Motors. 

We  are  getting  into  cost  issues,  accounting  issues,  when  in  fact 
the  real  substance  concerned  is  education. 

There  is  a  real  tension  between  current  pr9cedures  and  the 
current  means  b>^which  test  validity  is  determined  and  on  security 
as  it  is  now  construed,  and  there  seems  to  be  ^  real  tension  there. 

The  historical  antidote  I  would  like  to  bring  to  your  attention  is 
that  the  times  change.  What  we  can  do  in  education  does  change. 
I  hope  we  can  have  a  broader  view,  I  would  aote  simply  prior  to 
*  1958  it  was  deemed  inappropriate  evem  tp  tell  the  indj^viduai  stu-  .. 
dents  their  scores  on  the  SAT.  There  was  much  controversy  about 
whether  it  vvould  be  possible  or  desirable  tP  give  students  even 
knowledge  of  their  own  scores  on  the  SAT's. 
*  There  was  much  doubt  about  that  at  the  time.  Procedures  were 
wc^ed  out  so  that  that  was  accomplished,  apparently  not  without 
too  mtiny  unforeseen  or  detrimental  consequences  on  individual 
students,  even  thougji  that  openness  in  testing  provisions  was  hotly 
debated  at  the  time.  ' ^^ 

.  Mr.  Weiss.  Ms.  Rice? 
Ms.  Rice.  I  would  like  to  make  a  couple  of  comments, 
I  am  delighted  that  we  have  gotten  back  on  the  issue  of  educa- 
tion and  away  from  some  of  the  other  issues.  \  / 
I  would  very  much  like  to  call  your  attention  to  the  top  of  pagp 
12  of  Mr.  Hargadon's  testimony,  and  ask  you  to  compare  the  costs 
of  ourlftervices  ove5>-a  20-year  period.  Those  costs  have  gone  down 
'in  real^  terms  over  that  time.  We  now  charge  in  1978-79,  $1  more 
than  we  charged  for  our  tests  20  years  ago. 
Mr.  Weiss.  How  many  students  took  the  test  in  1958? 
'Ms.  Rice.  I'm  not  sure.  Admittedly,  costs  are  related  to  volume; 
for  example,  the  volume  went  up  in  1968. 

%  The  midpoint  between  1958  and  1978,^and  our  costs.went  down  to 
$4.50.    ^  ■ 

My  main  point,  Mr.  Weiss,  is  that  I  have  spent  my  entire  career 
trying  to  improve  ^ucation  in  this  country,  and  particularly  the 
lot  of  those  people  who  have  beea  and  continue^  to  be  the  'have 
nots"  in  this  society.  ,  ^ 

I  would  not  be  working  for  this,  organization  if  I  didn't  feel  and 
*  know  that  some  of  that  so-called  profit  that  has  been^discus?ed  was 

not  being  devoted  and  dedicated  to  help  the  helpless. 
■.  '■  .  i      •  .  ■ .  •  ' 


I  am  not  sure  that  you  would  like  us  to  find  no  difference 
between  the  income  and  costs  of  our  te^ts.  If  that  were  the  ca^^^ 
then  we  could  not  give  away  nearly  $300,000  in  fee;  waivers  annu- 
ally to  poor  kids.  •  . 

We  could  not  contribute  nearly  $100,000  a  year  to  an  educational 
opportunity  center  here  in  the  Anacostia  part  of  Washington. 
;  We  could  hot  train  the  people  in  tUe  qolleges  £id  universities  to 
be  sensitive  to  the  needs  of  the  disadvantaged  and  to  change  their 
old  admissions  policies  to  move^way  froni  objective  criteria,  and  to 
consider  what  other  strengths  the  poor  and  the  forgotten  and  the 
racial  minorities  have  been  ab^  to  bring  to  higher  education.  ' 

Ms.  Rice.  I  guess  I  am  a  litle  suspect— I  am  extremely  su^^t  of 
the  legislation  for  the  policy  reasons  we  have  outlined  m  our 
formal  testimony.  But  also  I  am  also  concerned^  that  the  consumer 
groups  supporting  this  ^legislation  have  not  been  that  interested  in 
the  poor,  because  if  you  are  poor,  you  seldom^are  a  consumer,  Mt. 
Weiss,  I  think  a  lot  of  the  consumer  legislation  that  We  Jlave  has 
been  directed  to  middle-class  Americans. 

I  simply  want  t6  say  this  organization  has  been  deVoted  to  some 
of  the  great  ideals  of  this  committee  and  ideals  of  yours. 

Moreover,  we  tried  to  focus  our  testimony  on  dqucation^l  issues 
not  testimony  on  the  fiscal  costs.  The  real  costs  are  those  >we  would 
have  to  pay  in  ternis  of  this  legislation  in  ad  it  redirects  the 
i^edet*al  role-in  education. 

There  are  some  constitutional  questions  and  protections  that  this 
legislation  seems  to  defy.  And  there  are 'Estill  other  problen^s  that 
we  tried  to  stress  in  -our  testimony. 

Mr.  Weiss.  I  am  aware  of  the  good  works  the  CJollege  Board  is 
en^ageld  in,  bfit  just  yesterday  I  sat  a6  a  member  ,  on  the  Subcom- 
Ynittee  on  Emplojrment  Opportunities,  and  we  had  before  us  the 
Chair  of  the  Equal.  Opportunities  Commission,  Mrs.  Norton. 

In  response  to  a  question  I  raised  about  sex  discrimination,  af- 
Hrmative  action  witnm  the  universities,  she  told  me  that  the  col- 
leges and  universrties  were  the  great  scandal  of  this  Nation;  that 
private  corporations  and  presidents  of  private  corporations  would 
not  dare  to  rcfact  as  cavalierly  and  ccdlously  to  questions  about 
affirmative  action  and  failure  to  meet  affirmative^  action  require^ 
ments.  • 

So  I  inust  t^U  you  that  basically  it  is  the  same  people  in  both 
instances.  I  am  not  overwhelmed  with  the  commitment  the  colleges 
and  universij^ied  have  as  to  equal  opportunities— maybe  sometimes 
yes,  but  not  evenrbpdy  everywhere. 

Mm  Rice.  As  fsit  here  at  this  table  as  an  officer  of  The  College 
Board  with  all' these  gentlemen,  it  should  be  clear  that  I  am  me 
only  person  who  is  both  a  woman  and  a  black.  We  are  the  only 
micgor  educational  association  in  Washington  which  has  taken  such 
a  step— I  cannot  speak  for  all  colleges  and  universities^but  I  can 
speak  for  the  Board  and^our  recora  has  been  admir^le  compared 
to  most.  *  . 

Mr.  Weiss.  Nor  do  I  understand  the  kind  of  conspiracy jsugges- 
tiona  implicit  in  a  memo  jfou  gave  to  Ms.  Chisholm  in  wmch  you 

close  it  out:   ■  .     -  ■  ^      ^  f  v  , 

■'      "  .  ■  •  » 

Ultimately  the  Weiss  bill  is  a  mysterious  piece  of  proposed  legislation.  There  are 
DO  self-evident  reasons  for  its  introduction,  no  known  scandals  to  cdrrect,  and  no 
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apparent  basis  for  the  Federal  intervention  proposed.  All  of  which  suggests  there 
may  be  a  hidden  agenda  that  will  in  time  be  revealed. 

I  do  not  know  what  the  hell  that  means;  and  I  wish  you  would 
tell. me.  - 

Ms.  Rice.  Much  of  that  memorandum  was  addressed  to  a  provi- 
sion which  you  have  deleted  from  you*  legislation.  You  had  a 
section  in  the  draft  legislation  which,  in  my  view,  would  have  set 
back  efforts,' and  I  think  in  Mrs.  Chisholm's  view  also,  to  diversify 
institutions  of^higher  education. 

You  ^ked  for  the  equatiion  or  formula  used  by  colleges  and 
universities  to  admit  students.  I  was  not  impugning  your  inten- 
tions. I  have  great  respect  for  you,  but  that  provision  touched  a 
deep  chord  in  me  when  it  was  in  the  legislation.  We  have  just  gone 
through  a  long  effort  oh  the  Bakke  case  and  I  was  ^  little  bit 
concerned  ,  that  this  specific  provision,  intended  or  nohintended— 
and  I  assume  it  was  unintended  because  you  dropped  it— would 
have  placed  far  too  much  reliance  on  objective  criteria.  That  con- 
cerned me.  The  Supreme  Court  I  think  reafftrmed  in  the  Bakke 
case  the  understanding  that  we  "have  ha$i  in  many  other  cases,  that 
institutioi).s  can  choose  who  to  teach,  how  to  teach,  and  who  shall 
teach.  I  justlbeliev^  sir,  that  memorandum  was  written  because  of 
those  concerns.  I  am  delighted  that  you  removed  the  provision. 
.  '  Mr.  Weiss.  The  memo  goes  t«  the  whole  legislation.  What  vou^ 
are  speaking  of,  we  dropp^  because  it  was  secdndary.  I  appreciate 
your  sugigestions  along  those  lines,  but  I  just  t^nk  that  it  is  not 
necessary  or  should  not  be  necessary  in  the  course  of  this  kind  of 
discussion  to  look  for  hidden  agendas.  I  h^oive  none;  I  do  not  think 
jjpu  have  or  they  haVe.  We  are  dealing  with  a  very  serious  and 
l^ofound  question  and  we  are  trjdhg  <o  deal  with  it  as  to  what  we 
think  is  best  for  this  Nation.  1  . 

At  this  point  perhaps  the  thing  to  do,  because  it  is  getting  late,  is 
to  ask  if  anyone  has  Bn^  ilnal  brief  comments  to  make  so  we  do  not 
leave  anyone  not  being  able  to  respond. 

Mr.  Nairn. 

'  Mr.  Nairn.  First  you  asked  about  the  tfollege  Board-ETS  rela- 
tionship. The  presidmt  of  ETS  is  ex  officio  president  of  the  College 
Board;  the  president  of  the  College  Board  is  an  ex  officio  member 
of  ETS. 

Second,  there  has  been  some  discussion  of  the  services  the  ^Col- 
lege  Board  provides  to  its  jnember  colleges  as  being  a  worthwhile 
activity,  and  I  tam  sure  it  is.  The  College  Board  has  two  sources  of 
incotne:  One  from  membership  fees  from  colleges;  the  other  test 
fees'.  If  they  want  to  provide  more  extensive  services  to  colleges, 
that  is  commendable.  ^ 

\  Mr,  Solomon  briefly  stated^  all  ETS  research  studies  are  pub- 
lished. There  are  also  certain  categories  of  ETS  reports  hot  re- 
vealed, such  BB  the  series  of  reports  khown  as  test  analysis. 

Finally,  there  hjas  been  some  reference  to  the  way  that  the  profit 
margin  is  spent  to  provide  free  waivers  and  so  on.  It  would  be 
helpful  if  ETS  and  the  Colleg^Board  provide  specific  breakdowns 
to  show  revenues.  Also,  how  mutb.>of  it  went  to  lobbying  the  ti^uth- 
in-testing  bill  in  New  York;  how  much  goes  to  support  the  Henry 
Chfimncey  Conference  Center,  which  recently  ibp€$!nea  it?  new  swim" 
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ming  pool;  and  how  much  goes  to  other  expenses  to  support  the 
high  lifestyle  of  ETS. 

I  am  proposing  the  profits  aSkbe  laid  out  in  the  open  for  inspec- 
tion by  any  interested  member  of  thei  public.  I  am  sure  ETS  will 
q<>operate  by  providing  the  project  operating  statement  and  other 
relevant  documents.  r\ 

Dr.  Hai^y,  I  am  hot  neany  interested  in  ETS,  the  College 
Board,  and  their  interrelationship  or  what  have  you,  as  the  larger 
Question,  which  I  redlly  hope  this  ,  committee  will  address  more 
tnoroughly,  namely  the  relationship  between  testing  and  assess- 
ment, particularly  with  respect  to  soured  tests  and  thfe  education- 
al process  in  this  country.  It  seems  to  me' there  are  two  fundamen- 
tal concepts  involved,  educational  and  matters  of  fairness  and  jus- 
tice^ It^  seems  to  me  those  two  perspectives  have  been  notably 
absent  today,  and  I  would  urge  the  committee  in  its  future  delib- 
erations try  to  involve  others  to  talk  and  examine  more  thoroughly 
the  consequences  of  secret  testing,  and  I  would  hope  since  I  truly 
do  believe  there  is  an  issue  of  fairness  of  justice  involved  iri  requir- 
ing as  matters  of  public  policy,  students  to  take  tests,  the  results  6f 
which  they  do  not  see  m  any  detailed  way,  I  think  there  is  an 
es&ential  fainiess  issue  involved  there.  That  this  committee  will  try 
at  least  to  some  extent  to  draw  on  at  least  som^  representation  of 
the  studente  and  children  who  might  be  affected  or  at  least  their 
representatives. 

Mr.  Weiss,  Mr.  Solomon.' 

Mr.  Solomon.  I  want  to  thank  you  for  your  patience  in  listening 
to  us. 

^  Mr.  Weiss.  Mr.  Sims. 

Mr.  Sims,  i  think  I  want  to  agree  with  Dr.  Haney.  The  essential 
issue  IS  a  policy  and  social  issue.  It  involves  a  question  of  whl^ther 
in  the  broad  sense  why  is  it  necessary  for  government  to  intervene 
in  regulations  in  this  neld,  and  it  also  seems  to  jne  it  is  a  question 
*of  social  and  educational  values.  There  is  implicit  in  the  agenda  for 
action  certain  values  that  need  to  be  ipade  explicit  and  cQscussed, 
and  they  need  >to  be  deemed  important  in  terms  of  serving  the 
public  at  large.  It  seems  that  is  as  yet  a  very  controversial  issue. 

Finally  let  me  say  the  College  Board  has  faculty  who  oversee  our 
pr%sram  and  discuss  the  relevance  of  testing  to  eaucation.  We  have 
studente  sitting  on  those  committees,  we  have^  an  apparatus  for . 
action  which  is  proved  a|id  can  accommodate  itself  to  cnange  very 
fluently. 

'  Mi\  WEISS.  Ms.  Rice,  i 

'Ms.  Rice.  Thank  you  and  other  members  or  the  committee  for; 
giving  us  tJhdsojppQrtunity. 

Mn  Weiss.  Thonk  you  tor  your  participation. 

I  jtiave  one  request,  Mr.  Goodling  had  indicated  he  would  like  to 
submit  written  questions,  and  I  am  sure  other  members  of  the 
committee  would  like  to  do  that.  If  you  will  respond  to  those.* 
TliaiU^  you  very  much. 

*  Committee  stan(}s  recessed  until  tomorrow  morning. 

tWhereupon,  at  |3:10  p.m.,  the  subcommittee  was  adijpurned,  to 
reconvene  Wedn^ay,  August  1, 1979.1  I 

[Additional  materisd  submitted  for  the  record  foU^ 
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JOHN  k  D.  C0Of»CII.  M.O..  PH  Q 
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August  10,  i979 


Hoaorable  Carjl  P. 'Perkins. 
-  Chainoan 

Conofttee  OD  Education  an^  Labor 
U.  S.  House  of  Representatives 
Washington,  D.  C.  20515 

Dear  Chairman' Perkins: 


On  Tuesday,  July  31  ,  1979,  I  testified  before  tlie  Subconmittee  on 
Elementary,  Secondary,  and  Vocational  Education  about  two  bills  on 
standardized  gating,  H.R.  3564  intraduce^  by  Mr.  Gibbons,,  and  H.R.  4949 
introduced  by/lr.  Wftisfi  et  al.    Enclosed  is  9  copy  of  my  testimony. 


Jlettff  tot 


While  H.R.  3564  poses  some  serious  probleaw  <ot  medical  education, 
H.R.  4949  threatens  the  very  viability  of  the  New  Medical  College  Admission 
Test  (New  MCAT).    This  examination  provide?i  information  critical- to  the 
fair  and  impartial  Selection  of- students  to  study  medicine. 

The  medical  schools  of  this  country^  the.  sponsats  of  the  New  MCAT,  are 
concerned  that  these  bills,  and  especially  H.R.  494^,  will  not  receive  proper 
scrutiny  and  that  their  destructive  cortsequences  for  medical  education  will 
not  be  recognized.    The  danger  4s  particularly  acute  siiice  they  are  being 
' promo ti^Sr  under  the  deceptive  banner,  "Truth  in  Testing." 

^'  I,  therefore,-  earnestly  ire 
considerations: 


^est  your  careful  attention  to  these 


No  documentation  of  the  alleged  problems  has  been  presented.  . 

Contrary  evidence  exists.  ,  *i 

\ 

MCAT  test  scores  are  not  the  sole  criterion  of  acceptance. 
Formal  studies  show  them  to  sharp  about  equal  weight  with  grades, 
interview  ratin8:8,  and  letter*  of  recoBunendation. 

"The  provisions  of  the  bill  will  not  achieve  the  so-called  reforms. 
In  fact,  they  are*llkely  to  be  counter-productive. 

The  provisions  are  highly  intrusive  into  education  and  th^  admissionaM 
process  at  a  time  when  the  Congress  is  particularly  sensitive  to  ' 
*siich  legislation.  . \ 
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•   Actioa  at  the  federal  level  prior  to  to  eveluitlbn  of  the  / 

coniequencet  of  «|  tiailar  New  York  lai^it  preMture.  ,  .  4^ 

>   The  AAMC  Juit  spent  $1.5'Billion  in  revising  iti  •dviiiioni  testing  ^  j 

progrM  to  increase  itg  relevance  and  utility.    The  New  HCAT  / 

incorporates  all  the  objectives  of  these  bills  regarding  public  ^  (' 

•  awareness  snd  protection.                                  '  / 

'       -.  •      •  ■ 

•  The  highly  specialized  nature  of  the  New  MCAT  and  the  restriction  7^ 
oD^questioni  to  assure  relevance  to  aedicine  is  not  coapatible  ^  ,/ 
with  continuous  disclosure  of  test  aaterial.                                         ^'  /■ 

-V.  >  .  i    '         .  -  • 

^   The  Hew  MCAT  Prograa  is  coapletely  accountable  to  the  educational  /  . 

coHwaity  it  serves  snd  its  policies  and  procedures  are  regularly 
reviewed. 

/ 

The  aesbers  snd  sUff  of  the  As'socistion  of  Aaerican  Medical  Colleges 
will  be  very  pleased  to  discuss  sny  of  these  Matters  in  grester  detail  with 
you  or  your  stsff.    Thank"*  you  far  your  seifiouii  sttention  to  these  concerns. 


^Sincerely, 

A.'  D.  Cooper,  hAd. 


I'y.  ^ 


.  .  ■  « 
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CONGRESS  OF  THE  UNITED  STATES 
H0U9E  OF,  REPRESENTATIVES 

eOMMirm  ON  BOytATiON  AND  LABOR  ' 
SUBCOMMlTTft  ON  EtmCNTARY,  SECONDARY, 
AND  VOCATIONAL  EDUCATION  . 
>  Vmip  raysurn  ^ioum  orricK  miiloino  /' 
wA»HiNarro»i(  torn 

November  9,  1979 


Dr.*  Robert  J;  Solomon  « 
Executive  Vice  Preaident .  . 
Educational  Testing  Service 
Princeton,  New  Jersey  08541 


Dear  Dr .  So lomon : 


On  July  3l8t  you  testiifled  beffore  the  Subcom- 
Dilttee  on  Elementary »  Secondary,  and  Vocational  Ed- 
ucatlon  on  H.R.  3564  and  H.R.  4949.    During  the  course 
of  that  hearing  you  were  asked  to  submit  for.  the  re- 
cord Several  pieces  of.  Information.    After  reviewing 
the  transcript  and  the  materials  submitted  by  ETS.  we 
feel  that  you  did  not  respond  In  full  or,  In  some 
eases,  at  all  to  some  of  these  request^. 

# 

We  would  therefore  appreQlate  your  responding 
again  to  the  following  requests  for  information: 


ment ; 


1.*  A  copy  of  the  ETS  Project  Operating  State- 


2.  A. complete  statement  of  the  costs,  revenues,, 
and  surplus  for  each  Eft  test  covered  by  H.R.*  4949*,  In- 
cluding an  account  of  test  development  cost  and  how  the 
surplus  Is  allocated;  ^  ,^ 

3.  The  additional  cost,  If  any, ♦on  a  test-by- 
test  basis  that  would  be  incurred  If  H.R.  4949  vere  en- 
acted Including  a  specific  bVeakdown  of  How  and  why  such 
additional  costs  would  occdr;  bnd        ^  '  . 

4.  A  full  description  of  ETS'  research  and  de- 
velopment budget  IncludlntA  statement  by  percentage  of 
the  amount  of  research  andSrfevelopment  costs  which 
have  direct  application  to  current  testing  programs. 

"  .  •  '  . 

We  would  appreciate  receiving  a  response^ t6 
these  points.  In  writing  by  November  22nd  for  lnJelu- 


■*• 


vision 


its.1 

In  th^^earlng  record. 
Thank  you.  || 


•^Inceref 


Carl[fif.  Perkins 
Chalrmaty/'  . 


BDUOATIONAJL  TBSTINO  SBBVIpB  "       .    PRINCETON.  N.  J. 


Robert  J.  Soipmin  .        ^/  ^nm 

i^viiK  Vuf  PresidiHi  '  November  14,  .1979 


The  HoDorable  Carl  D.  Perkins  >Y 
Chairman      -  '  %  * 
House  «f  Representatives 
Connittee  oir Education  and  Labor 
Subcoonitte^^on  Elementary »  Secondary » 

«nd  Vocational  Education 
B-346C  RaybUm  House  Office  Building 
Washington,  b.C.  20515 


Dear  Chairman  Perkinsi 


of  November  9  in  whi^h  ydu  feque^ 
ETS  on  behalf  of  your  Subcommittee. 


Thank  you  fox  your  letter 

cett^itr  information  from  ETS  on^^ behalf  of  your 

During /he  past  few  weeks »  Mrs.  Alice  J.  Irby,  our  Vice 
PresidenJ:  In  Washington,  has  been  in  conversation  with 
members  of  the  Subcommittee  staff  on  several  occasions. 
It  ift*my  understanding  that  they  agreed  upon  a  range  of 
materials  to  be  submitted  as  a  follow-up^  to  my  testimony. 
Mr&.  Irby  has  informied  me  today,  that  the  materials  agreed 

.nipon  in  these  conversations  have  been  delivered  to  the 
Subcommittee  (attention  of  Mr.  Jennings  and  Ma.  Kober)  " 
under  a  cover  letter  dated  November  13,  1979.    t  trust  . 

«^ these  materials,  although  tkey  are  not  precisely,  the  same 
as  requested  in  your  letter,  will  indeed  serve  the  purposes 
of  the  Subcommittee. 

.Hay. I  take  this^rfpportunity  to  thank  you  again  for  your 

careful  and  thoughtful  consideration  of  our  expressed 
*  concerns  about  thti  proposed  legislation. 


B.DUOATIONAX  TBSTlWCf  BBRVIOB     (BS)     wAsHlNOTON,  D.C.  OFFICE 


9 

202.639-0616  ■  v .  ;  V 

'    -  \       .       .    ~      November  13,  1^79- 

House  .Sub coip^^tee  -qn,  El eiafe'h^ai^t.  Sf^^  *  .^v  o 

and  Vocational  Eduoatlorf  •/.  v  .  !^ '       . '  ./■         •  .     •  • 

f&om/&3(ke  c  ^  ' '    "  .         •     •  ..^ 

lUybuni  HoUBc'.CrfCice^/Bi^ijidiiig;*  .^^ 
Waehlngtpn,  OiQ^  ;,^pJi$.;i^:^;;^-^^  * 


a 

Gentlemen:.  .    .,  *'^t" 


M  tent  Ion:    Mr*  J«c^'''rflMmii(>^^^^ 


er 


In  respoktae  to  y6^c!^fqUf^t:fDYjinfon^  ijtc:  Robert 

''Soloinon*B  te8tliwiny^tj6^^Vi^4  Subcon^^  July  31,  1979,  I^am  f., 

enclosing  atatengjitB]  previously  submitted;;  v^.:\^[ 

•  document  entitled'  "idufliltiiinai  TMiti^  .Sitft^s^  i  .Wh^j^-thit  f-'f^i 

''Money  (Somea'  From-^aiiid  Where  It  Goes'*'' [Hr^Vl^d  da t^  qjfi  aource^  tjt  E^$-?f'  '  V. 
'  Income  and  on  t'«at  doveloppent  aoats  ^  _  -  *  "  .' . 

The  first  table ''glvea  a  plctpte' of  ETS  revenuea.  at.  teil-year 
Intervala  from  1959.  to.  1979',  ^  From*lt,  one  c^^aacertaln  the, growth'    :  \ 
*±n  categories  of  ETS  programs  and  the  chfhigea  over  time  In  t|ie -^bitH '  ■.  '  ' 
"jpofllclori  of  total  r^venuek  by  progr.am  a^rea,.  Two  points  ^ie  of 
•interest:  .  .  ^  llf^;.  . "  ■ 

Ik  College  Bjoard  programs-^,  while  the  largeat.  single  component, 
have  declined  proportionately  since'  1959.    The  $45.5  ml 
In  1979  includes  Sl^  College. Board  programs  of  wh^ch  the 
f     Preliminary  Schol4i|tlc  AptTltude.  Teat  and  the  Admissions*  / 
.    V  Testing  Prbg«;»m?i;SAT  and  AdihljS;^taene  Tests)  are  only  two* 

«  Z*  Professional  and  Occupatlonal\j^rbJtramo  have  doubled  as  a       •  •/ 

,  proportion  of  the  totals  and  Gra^at^  and 'Professional 
Programs  ^rew  from  12%  to  17Z  of  the  toj:al.  ^  . 

It  has  been  suggested  that  ETS  should  provide  revenue  minus  expense  ^  * 
'   and  fee  on  each  of  the  programa.lt  aerves  which  tre  affected  by  the    '  •  > 
leglalatlon,    Do^ng  ao  would  not  only'  provide  an  Incomplete  financial  ''c/^^h 
picture  of .  ecU^"  program  but  would  alao  be  misleading aas  to  full  progi^i^t<^^4  " 

■COStBt'  i':^  ...  ■.        '  /■  • 
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Host  of  the  programa  affected*  1>y  the  (Legislation  are'  conducted  under 
contract  with  independent  sponsoring  groups.    These  sponsors  have 
expenses  which  must  be  met  Ip  addition  to  ETS*s  charges.    Data  ' 
reflecting  total  revenues  and  costs  are  the  property  of  these  Independent 
clients.    Often,  ETS  does  not  have  access  to  these  complete  data. 
Even  when  It^does,  It.  does  hot  have  tiie  authority  to  decide  to  whoA  ' 
l*t  Hill  be  reported.    The  spdnsors  make  regnlar  financial  reports  to  . 
,  their  memberships  and  to  various  governmental  agencies. 

■     ■     '    -       /     '  '    '  i  .    '    -  .      ■  - 

BTS  ipuMlshes  and  distributes,  routinely  financial  reports  concerning 
^Its  own  flttanclaX  affairs  which  ai^  prepared  In  accordance  with  genejcally 
Accepted  accounting  standarda  and  certified  by  Independent  public 
accountants.    A  c^py  of  tKe  1978  Annual  Report  Is  attached. 

*      ■*    ■  '  ■    '.      •  ^  ..  . 

ETS*  reluctance  to.  release  more  detailed  cbst  Information  stems 
also  from  the  fact  that  It  submits  proposals  In  competition  with 
i9any  other  organizations,  both. non-prof It  and  profit,  to  offer  testing, 
research  ahd  related  services.    Contractual  arrangements  with  each 
/client  ate  determined  through  negotiation  and  depend  Aipon  the  specific 
clrcums^nces  of  each  situation.  •  'Factors  yhlch  must  be  considered 

'  .iRclud^^the  Dfttare  of  the  service  to  be  provl^jed,  the  transferability 
oiE  the  methods  used  In  designing  services  tot  the  same  or  other  clients, 
the  ppportunltie^fJor  research  or  exploratlon^of  new  lArChodology,  the 
length  of  the  contract  and  the  financial  stability  of  the  client.  ^ 
^om^tlmes,         enters  Into  cioatractS  wl'th  a  very  low  fee  or  none  at 
•all  to  e^co4ftge.  development  of  a  service  which  meets  a  pressing*  ^ 
social  flDf  jSducatlonal  need.    Making  public  the  financial  details  of 
each  indwdual  activity  would  give  competitors  coijslderable  and  un- 

. /|alr  advantisige  in  bidding  .fot»  contracts  and  substatitlally  restrict 

/JBtS'  ability  to  negotiate,  contracts  apffroprlate  to  partlcular-clrcum- . ^  . 

!  .stances,    to  our  kno^edge,^  the  Congress  does  not  generally  ^qulre 
corporations,  nonxpi^F^lt  bt  profit,  to  release  specific  data  from 
which  cost  rates  and  confidential  client  data  can  be  derived,    To  do  ^ 
80  In  this,  case  would  be  contrary  td  customary  pxacJtlce.       '  .  ' 

B.    The  second  table  Is  repirij^uced  from  Attachment  6  of  Mrl  Solomon's 
testimony.    It  gives  exampIesofV^o  J  ected  Increases  In  test  develop- 
ment costs,,  given  certain  assumptions  about  disclosure  pf  t^sts. 
•From  the -lablei'.pjM^iCan  estimate  Increases  In  costs  and  consequent 
llke]ig'^J^^aSM*4^  fees,  given'  different  assumptions  about 

the -^P^pbf ')^mj^'^or^  atid  the  number  of -test  . 

■   takeVSI^^.  . 

■  *'/>^;;-  ' 

-  "  1.  The  xurrent;  average  coBt  per  teist  form  In  GMAT  Is 

'apprOTtlmatcly  $92,000.    Actual  costs  vary  a  bit  depend-  ' 
:  ' ing  upon  the  scheduling  of  work.    GMAT  Introducls  two 
'  •  *.   *  forms  per  year,    Thus^  the  production  of  alx  new  forms 


(assuming  eight  natlonsl  sdmlhlst rations  are  continued) 
would  add  $552»000  annually  to  a  cui^ftent  baae  of  .  $1.84,000 
or  an  Increase  of  300X«    If  the  nuA^^r  of  test  tskera 
remains  constant »  the  Increase  In  faes  would  be  about 
$2,00  from  test  development  cost  Increases  slone,  Thls» 
of  course,  does  not  Include  other  s^ministrstlve  costs, 
such  ss  printing  more  tests  in  amaller  quantities  p^r 
test,  oailing  of  forma  to  students,' popying  of  answer  . 
sheets,  all  of  which  might  lead  to  increases  iii  fees* 

12.  "Thu  same  calculstions  csn  be  made  for  the  six  GRE  advanced 
t^sts  affected  by  H,R«  4949.    Currently  test  development 
costs  for  these  exams  approximate  $300,000  per  year. 
Assuming  they  are  administered  ten' times  in  national  admin- 
istrstioxis,  the  test  development  cost  increase  would 
approximate  $2,700,000  or  900X.    If  the  number  of  test 
.  takers  rei&ains  70,0Q0,  fee  increases  of  $38-'$39  could 
result*  ... 

These  data  assume  continued  nstional  administrations  but  ^do  not 
speak  to  problems  of  more  frequent  special  administrations  for^ahdi- 
cap'ped,  military  personnel,  institutional  use,  which  would  result  in 
very  substsntial  additional,  costs  were  present  services  to  be  maintained 
The  likely  result,  then,  is  a  combination  of  reductions  in  services  and 
increases  in  the. fees  changed  to  students* 

-   ■  •        ■  .  \ 

C.    The  third  t|^Ie  is  derived  from  the  srlnual  report  of  1978  and 
provides  a  brpRu^ovn  of  research,  development  ^nd  advisory  services 
income  and  exp^ditures*    The  table  reveals  that  £TS  funds  account  in 
total  for  somewhat  more  than"  one-third  of  these  expenditures  snd  that 
ita  corltribution  is  about  evenly  divided  between  researcif  on  the  one 
hand  and  development,  s^yiaory,  sQd  instructional  services  on  the  other* 
This  is  very  much  in  kee^tegMwlth  ETS  chapter  obligations  to  contribute 
to  the  fund  of  kfiowledge  in  educatiooal  methodology  $nd  psychometric  ^ 
theory,  to  develop  services  and  programs  needed  by  students  and  educa- 
tional institutions,  and  to  work  to  improve  the  understsnding  snd  use 
of  tests  and  .other  assessment  measures* 

Although  ETS  can  and  does  distinguish  between  research  directly 
supixorled  by  test  sponsors,  ETS  does  not  clsssify  research  into  that 
related  to  tea ting  programs  and  other  categories*    To  do  ao  would  mis- 
represent the  nature  of  ita  reaearch  activities  sin&e  mUch  research 
^related  to  teating  is  supported  by  others,  including  EtS,  beyond  '  . 
that  Vhich  program  sponsors  aloi|e  support*    It  is  in  the  very  nature 
of  research  that  applicability  to^  apeclfic  purposea  of  findings, 
conclusions  and  knowledge  gained  cannot  be  aasuifed  at  the  outset  or^ 
sometimes,  even  when  the  ^search  ia  in  progreaa.    A  project  which"- 
is  quite  speculative  and/or  quite  theoretical  mdy  yield  results  that 
have  immediate  benefit  to  teating  programa*  ' 
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Conversely,  projecte  believed  li^tlally  to  be  directly  related  to 
testing  prograas  nay  turn- out  tdHiivolve  broad  behavioral  concepts 
or  psychometric  Issues  which  have  no  applicability  to  operating 
programs  at  all.    Research  projects  funded  by  speelflc  testing  programB 
can  be  Identified,  as  shown  In  the  latest  Program  Research  Progress. 
Report  which  Is  enclosed.    However,  attempting  to  classify  projects  ^ 
as  testing  research  as  opposed  to  educational  research  wjould  result 
In  arbitrary  categorizations  of  doubtful  utility. 

^«    Decisions  concetnlnjg  the  allocation  of  ETS  funds  to  research 
activities  are  made  in  the  following  manner.    An  overall  research  plan 
Is  reviewed  and  approved  by  the  Standing  Committee  on  Research  and 
Development  and  the  fiTS  Board  of  Trustees.    The  membership  of  this 
standing  connlttee  Includes  both  ETS  Trustees  and  other  eminent 
educators  and  psychometrlclans.    The  research  plan  of  the  Coidmlttee  on 
Research  and  Developdient  Is  presented  to  the  Finance  Cotomlttee  of  the 
Board  of  T-mstees  which  reconmends  the  level  of  resources  to  be 
allocated  In  support  of  Research  .and  Development,  for  approval  by  the 
full  Bo^d,  >  * 

Once  the  overall  plan  and  total' resource  allocation,  has  been 
established  by  the' Board  of  Trustees,  responsibility  for  administration 
In  accordance  with  research  and  development  objectives  rests  with  ETS 
management.    Operating  under  the  purview  of  the  Standing  Committee  on 
Research  and  Development  the  Senior  Vice  President  for  Research  and 
Development  approves  an  annual  plan  for  allocating  ETS  support  funds 
to  various  programs  of  research  and,  working  with  officers  and  staff, 
determines  which  specific  projects  will  be  supported.    This  plan  for 
allocating  support,  and  progress  of  the  specific  activities  that  have 
been  conducted  Is  monitored  agaltist  the  research  plan,  and  reports 
are  provided  regularly  to  the  President,  othar  senior  BIS  officers, 
and.  to  the  Standing  Codmlttee^on  Research  andS)evelo^ent . 

In  addition;  ETS  annually  submits  over  100  proposals  to  federal 
goverment  agencies^  foundations  and  other  fundltig  organlzatlona.  The 
•vast  majority  of  these  are  competitive  proposals,  submitted  In  response 
to  published  requests  for  proposals  or  competitions  announced  by  these 
agencies.    As  Indicated  In  tables  accompanying  this  letter  about  two-  ' 
thirds  of  ETS  research  Is  supported  by  external  agencies,  and  about 
one  third  from  ETS  fuiids  as  outlined  ab6ve.  *  ^ 


.  We^  appreciate  this  opportunity  ^to,  respond  to  questions  raided  during 
the  hearing.  '  Let  me  also  comment  on  the  court etftldlrf^  professional 
manner  of  the  mimbers.  of  the  subcommittee  staff.  ^  Hy  stiaff  and  I  have 
been. treated  molt  cordially  during  the  several  months  of  activity  on 
the  proposed' biiuft^  .^R,  A949  and  H.R,  3564-.  y  . 


Sincerely, 


Alice  J.  Irby 
Vice  Pxesideni 


AJI/pm 
attachments 


Editor'fl  notet    The  tables  referred  tp  in  this  letter 
are  identical  to  tables  TJ,  ITT,  and  IV  attached  to 
^         irby's  letter  dated  November  28/  which  follows. 
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TABLE  I 


A  _ 


.COLLEGE  EKTRANCE  EXAHINATION  «0/tflO 


SfBtcMnt  of  (tevtnues,  Exptnst%  ind  Fund  8«1ance 
Yeir  Ended  Junt  30,  1979. 
UKth  CONVMritlvi  Flgurti  for  1977-78 
and  for  1979-80  Current  Projections 


Revertu€$ 

• .  Frts  for  ProgrMK  and  Services       .  . 

-  AdiUslons  Testing  ProarMi  * 
^-  Cont9«  Scholarship  Strvlce 

-  Advanced  Placenent  Prograa 

-  PSAT/NNSQT 

-  Co11e9t-Leve1  EmmI nation  Program 
r  Student  Search  Service  - 

-  Puerto  Rico  Prograas 

-  Descriptive  Tests 

-  Comparative  Goldante' and  Placenent  Progr 

-  ath«- 

'Grantlynd  Cintracts  for  SpKlal  Services 
HeeibersMt)  dues  and  Meetings 
InvestMnt  Incone 
Other  .  ' 


Expenses 

Prooraas  and  services: 
Olrect: 

-  AdHlsslons  Testing  Prograa 

-  College  Scholarship  Service 
Advanced  Placeaent  Program 

-  PSAT/NMS(}T 

-  Collegt-Level  EMslrtatlon  Prograa 

-  Student  Search  Service 
*  ►  Puerto  Rico  Prograas 

*  Descriptive  Tests 

-  CoMparatlve  Guidance  and  P1ace«^nt  Progr« 

•  Research  end  Developpent   .  / 

-  Educational  PuBlIc  Service 

-  Other 
Unellocfted 

-  Regional  Office- Operations  . 

-  Publications 

-  Other 
MeabersMp  Services 
General  Adiilnl  strati  on 


Excess  of  Revenues  over  Expenses 


Balences 

BegiAning  of  Year 


End  of  Ye«r 


Actual 
1977..  78* 


$19,205,988 
15,267,308 
3.719,224 
'  3.423,228 
3,S82f,263 
2,134,264 
791,753 
35,570 
^0,103 
'  1,714,551  ^ 

1,559.774 
'  425,697 
218,702 
34.896 


Actual 
1978*79 


$21,478,560 
18,819,291 
4,228,966 
3,719,620 
1^677,820 
2,574,882 
1,017,589  - 
704,109 
304,573 
1,612,631 
2,248,870 
456,909 
187,903 
53.575 


<52,453.321        $61.085,398  .w. 


Current  Projections 
1979-80 


$22,443,000 
20,332.000 
5,008,000 
4,008,000 
,  4,020,000 
2,767,000 
889,000 
"  478,000 
377,000 
1,818,000 
1,713,000 
'507,000 
225,000 

 12fiiOgg 

$6^.693.000 


$14,9^.4^1 
14,11>i^86 
3,055,702 
'    1,595.835  . 
2,724,071 
L007,077 
^881,140 
.  489,107 
Mr 304, 682 
V^*339 
1,019,846 
996,282 

$1^553.540 
17,248,229 
-  3^630,054 
1,838,045 
3,198,548 
1,141,438 
885,981 
812,270 
264,651 
2,314,852  = 
*  878,879 
558,430 

$17,790,000 
19,578;000 
4,215,000 
1,904,000 
3,074,000 
1,412.000 
1,053,000 
752,000 
303,000 
2,675,000 
798,000 
575,000 

3,189,223 
^,111,136 
850,145 
546,399 
2.511J00 

3,524,511 
2,317,179 
1,091,362 
818,753  ^ 
•  2.920.181 

3,943,000. 
2,636,POO 
1,192,000 
705,000 
2.986.000 

.$51,846,261 

$6q;796.903 

$65.591 .000 

S  605,060 

$  288.495 

(  (898,000) 

$  9,787,500 
$10,392^560 

$10,392,560 
$10,681,055 

$10.6qi,05S 
$  9,783,05S 

♦Certain  1te«' In  1977-?e  have  b#en>rec1atl1f led  to  confone  to'tht- 1978-79  presenUtion. 
(  )  denotes  red  figure  •,  .'   '    '    ^  .     ^  ■ 


October  1,  ^91^^ 
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TABtE  III 

TEST  DmWPMENT  COSTSt    SELECTED  TEStS 


CHI 


,  .  ?dt&l        ITuBbtr  of 
A2ninls«*   Hdv  Crtat.td 

8    •  •  2 


Nuxabtr  of 
Addition^ 
!Vtv  f  brst  to 
Ke<p  Currtnt 
?tttem 


ApproxisAt*  • 

Coft  per 

Hev  Tt»t  Fora 

$92*000 


.Tot&l         Nudbttr  Currtnt 

Adil^tionii  of       .  1979-60 
Te«t      Ttit  • 

185,000.  $12.50  • 


10    ,    ^1  for  tach 
Adaialf «• '  or  6  total 
trtticai 
•rTor  tteh 
of  S^tttts 
-  6o' 


9  for  tach 
of  6  ttttt^ 

-  : 


$50,000 


$2,700*001 


70,000  $1U.C0 
for  6 
^Teit* 


Note;    c6*tLt  for  crtatlng  a  otw  GK£  AVivaottd^.TtsC  In  any  dlaclpll^t  art 
Spproxloacaly  $50,000  for  tach  o^^rtralon,  and  Che  coaca  of  tach 
>tralon  of  tha  GHAT  4*  app'roxlqatijLy  $92,000.    Aa  ca^  bt  aatn  froa 
'  '      cht  fii/la  abovtt  tht  coata  of  crtaClog  tnough  additional  foraa  of 

thaat  two  ttata  to  ptralt  tha  currtnt  national  ttatlng  patttm  ualog 
"aacurt"  forms  would  approach  $2,700,000  annually  f ot^ tha  Hlx  GRE 
Advtncad  Ttata  only  and  ovtr  $500,000  for  tht  GMAT. 


Sotttcti  Attachstnt  #6,  Mr«  Solonon^a  taatlabny,  July  31,  1979'' 


TABU  IV 


RESmCH.  DmLOFMEMT.  ADVISOMr  (  I^ISTRUCTIOMAL  ACTXVIllZIS 


1978 


tMum^fh  only 

1"  ■ 


•  Ravaaut 

$  6.860,671' 

4»167,000 


ETS  Contribution 
$4,178,247 


$11,038,918 

'  /  ' 

6,19^,000*  2,028,000 
(Stt'Ttblt  III  •  btlov) 


4,843,918 


2,150,248 


TABLB  III  • 

.  SourcM  of  ETS  RMurch  Exptndlcuref  -  $6,195,000 


TidAal  CovftrnaiQC 

ETS    ■  . 

Foundation  i  ^ 

Statt  &  Local 
Govtrnmtnca 

Ochtr  Sourcta 


Aaount 

$2,636,000 
2^028,000 
477,000 

238,000 
816,000 

$6,155,000 


42.6 
32.7 
7.7 

3.8 
13.2 

100.0 


Source:    ETS  Annual  Rt)>orc  1978 


■ «  ■ 


EDUCATIONAL  TESTING  SERVICE     yg||§j  .WASHINGTON,  D.C.  OI^FICE 

S 
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'Sutte  JOO,  1909  Uatmkuitttf  4h.,  'S. 
W4iHmst(m.  O.C  X0J6 


November  28,  1979 


T]ie  Honorable  Carl  D.  Perkins  « 
:  Chairman 

Coi^lttee  on  Education  and  Labor 
"Subcommittee  on  Elementary,  Secondary,  ' 

aifU  Vocational  Education 
3-I346C  Raybuni  House  Office  Building 
WajBhlngton,  D.C.    20515  ^ 

Chairman  Perkins:  ^ 

A»\a  reault  of  conversations  with  your  staff ■ concerning- your  letter  of 
November  9,  1979  to  Mr.  Salomon,  his  response  of  November  14,  and  my 
let;ier  to  the^SubcollmlttOT  of  November  13,  1979,  It  seems  wise  to  try  ta 
arrange  the  Information  submitted  previously  frdm  time  to  time  In  a  form 
that  Is  directly  responsive  to  the  four  points  enumerated  In  yoiir  November 
9  letter.  -  . 

Since  the  four  points  desl  with  mattery  of  cost  and  finances,  let  me  state 
at  the  outset  that  BTS  publishes  and  distributes  routinely  financial  reports 
concerning  Its  flnsnclal  sffslrs  which  d^c  prepared  In  accordance  with 
gen^erally  accept e4|  accounting  standards  apd  certified  by  Independent  public 
accountants.    A  copy  Of  the  1978  Annual  Report  Is  at'tachsd.    Also  enclosed 
Is  a  document  prepared  expressly  for  the  Subcommittee  entitled  Educational  ^ 
Testing  Service;    Finances        Where  the  Money  Comes  From  and  Where  It  Goes, 
which  Is  an  attempt  to  ey^ldin  some  of  the  dsta  In  the  Annual  Report  and  to 
offer  additional  data  concerning  questions  raised  durlog  the  hearings  on 
H,R.  4949  and  H.R.  3564.    It  contains  the  most  recent  date  for  1978-79. 

1.    Your  letter  makes  reference  to  the  ETS  Projejt  Operating- Statement. 
The  statement  Is^ an  Internal  document  used  to  monitor  Income  and  expenfea 
during  the  course  of  a  fiscal' ypar.    Data  are  organised  by.  managafeeot  areas 
.(*»8<  by  reaponslbil^ity  of  Vice  Prealdents)  ; .  they  are  Unaudited  and  require 
adjustments  by  cost  centers  and  for  ove^rhead  charges.    Data  change  monthly 
^d  thus,  unlike  an  audited  balance  sheet  and. Income  statement,  do  not  give 
a  full. and  ;rell«ble  tnapahot  pf  the  financial  conditions  of  programs  Aid 
Qpoiisors.    The  document  also  contains! Information  on  balances  maintained^ 
for  clients,  such  balances  shoving  wide  cyclical  variations  during  the 
year  reflecting  patterns  of  program  activity.    We  believe  that- It  la  In- 
appropriate to  clrdilate  documents  auch  as  the  Projecit  Operating  Statement 
for  two. reasons:    a)  Data  reflecting  revenues,  costs  and  balances  for  ETS' 
clients  are  the. property  of  these  Independent  clients,  who  have  the  authorlty- 
to  release  such  ^'^formatlon,  alkd  b)  Making  public  flpahclal  details  of  KTS^ 
pricing  aiid  coat  recovery  policies  would  give  competitors  considerable  and 
unfair  advantage  In  bidding  for  contracts*  .  . 
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2.    The  tecpni}  point  It  relate  to  the. first  in  that  it  requests  cost 
:   and  ravenuc  data  by  progm  or  individual -activity.    Providing  such  Inf oma- . 

tion  would  not  only  provide  an  inoOaplete  financial  picture  of  each  program 
.  but  would  ^so  be  misleading  as  to>  full  program  costs.    The  programs  affected 
by  H.R.  4949  are  conducted  under  contract  with  independent  aponsoring  groups. 
Thes6  sponsors  have  expenses  vhich  must  be  net  in  addition  td  BTS*6  charges. 
As  indicated  above »  data  reflecting  total  revenues  and  costs  are  the  property' 
.    of  these  independent  clients.    Often,  ETS  does  not  have  access  to  these 
complete  ^ata.    Even  vhiin  it  does,  it  does  not  have  the  authority  to  decide 
.to  whom  it  will  be  reported.    The  sponsors  make  regular  financial  reports 
to  their  memberships  and  to  various  governmental  agencies.    A  sample  of  such 
a  Btatcment  is  enclosed,  labeled  Table  I.    It  is  a  statement  of  Revenues,. 
Expenses  and  Aind  Balance  piibliished  by  the  Corllege  Entrance  Examination 
'       Board  on  October  1^  1979. 

The  aecond  table  gives  a  picture  of  ETS  revenues  at  ten-year  intervals  from 
1^59  to  1979.    Prom  it,  one  can  ascertain  the  growth  in  cateaories  of  ETS 
programa  and  the  changes  over  time  in  the^composition  of  totffl  revenues  by 
program  area.    Two  points  are  of  interest:  '^^ 

a.    College  Board  programs!  while  the  largest  single  component,  have 
declined  proportionat^y  since  1959.    The  $45.5  million  in  1979 
■  '  Includes  all  Col^lege  ^oard  programs  of  which  the  Preliminary 
Scholastic  Aptitude  Ttst  and  the  Admissions  Testing  Program  (SAT 
.  ,  and  Achievet^nt  Tests) .  are  only  tw6.  v  \^ 

;b^.    Professional  ^nd  Occupational  Programs  have  doubled  as  a  proportion 
of  the  total,  and  Graduate  and  professional  Programs  grew  from  12 X 
to  17X  of  the  total.  . 

9t         Your  second  point  makes  reference  to  the  allocation  of  ^'surplus".    As  stated 
#         on  page  3  of  the  enclosure  on  ETS*  ?inan9e8,'  fees  charged  beyond  costs  to^ 

program  clients  (and  on  some  contract  Research  as  well)  average  9-^lOX.    Last . 

year  (1978-79),  this  amounted  to  $7.5  lillion.    0^  this  total  $6.3  million 
.went  to  support  research^  development, jadvisory  and  instructional  services. 

The  remaining  $1.1  million  (ETS*  net  ri^enues)  was  used  for  additions  to 

operating  buildings,  capital  equipment  hd  working  capital.  Research 

activities  are  diacuased  under  item  4  bcp,ow. 

'  \During  the  debate  on  H.R.  4949,  there  were  sometimee  references  to  a  ,^^profit 
margin  pf  22-27X.'\  Such  atatements,  we  believe,  stemsked* from  a  misunderstanding 

.  of  financial  income  and  expense  reports  of  the  College  Board  and  of  ETS.  The 
"22-27X**  figure  may  have  come  from  taking  the  excess  of  revenue  over  direct 
.  '      expenses  for  the  Admissions  Testing  Program  tn  1977-78  (sae  attached  nationally 
distributed  .College  Board  Statement  of  Revenues,  Expenses,  and  Pund  Balance,  ^ 
Year  Ended  June  30,  1979),  and^  using  the  result  ss  a  percentage  of  revenue: 

$19.2  million  (revenue)  ^ 
-14.9  million  (expenses) 


4.3  isiUion,* which  iB^2.3X  of  $19.2  million. 
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Such  luterpretatloo,  however,  ignores  I  total  of  $11,1  million  in  College 
Board,  expense  for  such  support  8srviceeL|a  regional  office  operations, 
publications,  research  and  development  ,Wadmini8trative  costs^  pupport  for  • 
specisl  conferences »  subsidy  for  test  administrations  lot  speclsl  populstions 
(such  as  religious  minorities  snd  the  handicspped). .  -i 

Since  the  Admissions  Testing  Progrsm  sccounts  for  36.6%  of  College  Bosrd 
revenues,  sllocsting  thst  percentsge  of  support  service  expense  ($4,085  mil 
to  Admissions  Testing  Progrsm  expense,  would  bring  that  program* s  tojsl  expi 
to  $1^,050,380  -  s  0.8Z  "surplus". of  $155,608  of  revfenue  ov^  totsl  expenses. 

*  .  ■ 

In  sd^^oa  to  concerns  'sbout  tht  pcoprietsry  interests  of  clients,  BIS 
reluc^^|Hp  relesse  more  detsiled  cost  information  then  contained  herein 
stemV^BI^Rie  fsct  that  it  su^its  propossls  in  competitipn  with  many  other 
brganitfl^ons,  both  non-profit  snj  profit,  to  offer  testing,  research  and 
■  re?at;ed  services.    Contrsctusl  srrangements  with,  each  client  are  determined 
through  negotiation  and  depend  upon  the  specific  circumstances  of  each  situation. 
Factors  which  must  be  considered  .include  the  nsture  of  the  service  to  be 
provided,  the  trsiisfersbif ity  of  the  methods  used  in  design^  services  for 
the  same  or  other  clients,  the  opportunities  for  research  oAxploration  of 
new  methodology,  the  length. of  the  contract  and  the  flnanci^  stability  of 
the  client.    Sometimes,  feTS  enters  into  c^ntrscts  with  s  ve^  low  fee  or 
none  at  all  to  encourage  development v>f  a' service  which  meets  a  ptessing  socisl 
or  educational  need.    As  stated  above,  making  public  the  financial  details  of 
esch  individual  acti\?ity  would  give  competitors  considerable  and  unfair 
advantage  in  bidding  for  contracts  and  substantially  restrict  BTS*  ability  to 
negotiate  contracts  appropriate  to  particular  circumst^ces.    To  our  knowledge, 
the  Congress  does  not  gcinerally  require  corporations,  non-profit  or  profit, 
to  release  specific  data-  from  which,  cost  rates  and  confidential  client 
can  be  derived.    To  do  so  in  this  case  would  be  contrary  to  customary  practice, 
.      .       ✓  ^ 
'    .3.    The.  third  item  asks  for  additional  costs,  test  by  test,  that  would  be 
incurred  if  H.R.  4949  were  enacted.    Such  projections  are  not  easily  derived, 
•for  they  would  depend  on  s  host  of  decisions  to  be  made  by  the  vsribus  sponsors 
concerning  sll  .aspects  of  complisnce  with  provisions  of  the  legislstion.  ^S 
xestimates  costs  of  progfsms ^rom  specifications  supplied  by  its  clients.  For 
example,  the  sponsor  mt^st  specify  the  niltaber  of  admlnistrstions  by  type  (e.g. 
nstionsl,  ssbbath,  handicapped),  t)ie  number  of  new  test  forms  to  be  crested 
during  a  giv^n  time  period,  test  candidate  volume  estimates  by.  test  snd  test^ 
sdmlnistirstlon,  the  number  and  kinds  pf  publlcationa  tq  accompany  the  test 
materials,  score  reporting  services,  the  kinds  of  score  interpretation 
materials  to  be -reported  as  well  as  information  on  numerous  additional  variables. 
Thus,  without  such  specifications  from  sponsors  as  to  the  kinds  and  availability 
of  services.,^ BTS  cSnnot  project  the  financial  impaci  of  any  specific,  legislstion. 
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We  c«n  provide  iOflM  rough  aat^Cta  of  |U8t  development  cosCb,  given  certain 
aasuaptloKiB.    The  third  ta^e  le  reprodu^d  from.ActachnenC  6  of  Mr,  Soloaon'a 
teatiaony.  ,  It  givea  i0(p^)].ea  of  projected.  Increeaea  in  leat  developnent  coefti, 
given  certain  M'uaptlicme  ^bout  dleeloaure  of  teata*    Prooi  the  teble,  one  can 
eatlaata  increeaea  in  coeta  «ad  c(m*^quent  likely  Increeaea  in  atudant  feea.  , 
given  different  aaeuaptlona  about  the  nunber  of  new  fomd  produced  ennually  . . 
and  the^uaber  ot  teat  tekers.  < 

e*    The  curreilt  everege  coat  per  teet  fofa  in  GMAT  la  approxioately 
-$92,000.    Actual  coat  a  very  e  bit  fro«  yeer  to  y«ar  .depending 
upon  the  scheduling  of  vork*    GMAT  introduces,  tvo  foma  per  year* 
Thua,  the  production  of  a^ic  new'  for«a  (a|aumlng  eight  netlonal 
adBinlatratiM>n8  are  eonttDued)  would  add  $552,000  annually  to  a 
/  current  beeeW  $184,000  Or  en  Increeae  of  300X,    If  the  nunber;^ 
of  test  tekerVsma|na  constant ,  the  indreaati  in  feea  vould  be  - 
about  $2»00  froATeat  deveaopsent  coet  increeaea  alone.    Thle,  of. 
ctnirae,  does  n0)t  incliide  othef 'adalnlatrative'coate,  auch  aa  < 
printing  Bore  teata  ^  aoalliir  quSntitiea  per  teat,  Bailing  of 
fona  to  atudente,  copying  of  aiisyer  ah^ets,  all  of  which  al)$ht 
lead  to  increeaea  In  f^ea*  ^  I 

b.   The  ease  calouletione  can  be  aide  for  the  eix  GRE  edvfnceeh  teats 
affected  by  H.R.  4949.    Currently  teat" development  coetafor  these 
exaaa  anproxiatte  $300,000  per  yeer*    Aaauning  they  are  adainietered  ' 
»ten  timpB  in  nationnX  edalniatrationa,  the  teat  developnent  coat 
Incveaee  would  epproxisate  $2,700,000  or  900X*.    If  the  nuid>er  of 
teet  tek«ra  reaaine  80,000,  fee  increeaea  of  $38-$39  could  reault* 

Theae  data-  aaauae  continued  netionel  adalnicftrationa  but  do  not  apeak  to 
probleaa  of  wott  frequent  special  adBiniaftrationa  for  hahdicapped,  military 
peraonnel,  institutional  use,  vbich  vhuldnresult  in  very  aubatantial  additional 
coata  were  preaent^aervices  to  be  aaintalned*    The  likely  reault,  then  is  e  . 
combination  jof  reductlona  in;aervlcea.and  Ijficreaaea  in  tjbs  fefea  charged  to 
students*  ^  '       .       '     *  ■ 

Another  way  of  examining  Jbeet  development  costa  la  to  aelect  a  sttftat  auch  aa 
NewVYprk^  in  which  elth^  the  SAT  end/or  one  or  more  Achievement  teata  of 
the  Cjpllege  fi^rd  ere  adminiatered  a  total  of  147  timea./  Uat  year  the  SAT 
waa  given  21  time  a;  the  IS  Achievement  teats  were  administered  aeveral  times, 
soi^  as  many  as  10,  some  ss  .few  ^  4*    Presently,  ETS  preperea  24  new  telitf 
forma  per  year.    However,  o(  the  gr^and  total  6^  147  occaaiona  for  which  teat 
orma  are  adminiatered,  123  depend  on  the  etorehoude  of  aecut'e  tests  produced 
in  previoua  years*    Beceuse  they  ere  secure— beceuse  their  contents  heve  not 
been  made  public-^ they  can  be  reueed^  'Vhe  coat  of  producing  each  of  the  24 
new  tests  varies,  but  e  very . cooservetive  estimate  of  the  co^  of  developing 
theae  24  would  be  about  $1  million  dollara.    Now,  suppose  thai  beceuee.of  ^ 
the  raquiregtenta  of  legteletion,  there  are  no  previqusly-ua^^  eecure  teata 
wh^^M  \e  reueed,    Inatead  of  24  new  forms,  the  College  Roard  would  have 
tJiProvSa  147  new  forma  to  a^ke  the  teata. as  readily  avalleble  as  at  present. 
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That  la  six  times  the  ofltscnt  rate  of  new  test  developsent ,  for  sn  addltlonsl 
coat  per  year  of  $4  nlHlon  dollars,  an  Increas^  In  tes't  development,  cost 
of  AOOX.    It  Is  unlikely  that;  the  neabership  of  the  College  Board  would 
want-  to  pass  all.  of  this  cost  J^ti- to  the  candidates.    So  the  dote  .likely  reault 
would  be  a  seduction  In  the  nnber  of  tests  and  the  tines  each  test  Is         ^  ' 
offered — especially  for  special  administrations  to  accomodate  varlods  Special 
student  needs,  such  as  Sunday  administrations  for  religious  reasons.    Even-  If- 
(legisla^tlon  would  require  disclosure  of  half  the  test  forms,  the  teault  vrauld 
add  an  addlti^i^nal  cost  of  about  $2  million  dollars'  or  200Z. 

As  a  general  rule  of  thumb,  It  Is  accurate  to  estimate  the  co^t  of  test 
development  of  a  single  form  of  a  test  tK>  fange.  from  $30,000  to  $100,000, 
dijpendlng  upon  the  nature  of  the  particular  test.    In  four  ma^r , program^  ^ 
(College,  ATP,  GRB,  GHAT,  LSAT) ,  test  dev^opment  costs  currently  average^ 
6%  of  "test-taker"  fees.    Assuming  maintenance  of  most  services^ 
percentage  would  Increase  .substantially  wsre  H.R.  4949  enacted. 
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,  4.    Your  letter  asks  for  Information  concerning  BTS'.  research  snd  develop-  \ 
^ment  expenditures.    The  fourth  table  Is  derived  from  >:he' annual  report  of 
1978  and  provides  a  breakdown  of  research,  development  and  advisory  services 
income  and  axpendltures.    The  table  reveals,  that  ETS  funds  account  In  lot%l 
for  somewhat  more  than  one-third  of  these  expendlrures  and  that  Its  contribu- 
tion la  about  evenly  divided  between  research  on  the  one  hand  and  development, 
advisory,  and^ Instructional  NaeTvlces  on  the  other.    This  \s  very  ouch  in  keeping 
with  ETS  charter  obligations^to  Contribute  to  the  fund  of  knowledge  in  educational 
methodology  and  psychometric  theory,'  to  develop  services  and  programs  needed 
by  students  .and  educational  institutions^  and  to  work  to  improve  the  understand'^ 
ing  and  use' of  tests' and  other  assessment  measures. 

Although  ETS  can  and  doas  distinguish  between  research  directly  supported  by 
test  sponsors,  ETS  does  not  classify  research  into  that  related  to  testing 
programs  and  other  categories.    To  do  so  would  id^srepresent  the  nature  pf 
its  research  activitiea  sinee  m^h  t«search  related  to  teatiag  is  supportied  ■ 
by  others,  incliui ing  ETS',  beyon^^  that  which  ar'ogr^m  aponsoys  alone  support.  ^ 
It  is  in  the  very  nature  of  .Research  that  apgjllcablllty  t^  specific  purposes 
of -findings,  conclusioila  and  knowledge  gained  cannot  be  aisured  at. the  outset 
or,  sometimes,  even  when  the  research  is  -in  progress.    A  project  whichMs 
quite  apeculfit lye* and/or  o^ite  theoretical  may  yield  results. that  have 
iimnedlate  benefit  to  tea^^ng'  program 


bnyex^ely,  projects  believed  Initially  to  be- directly  related  to  testing 
rograms  may  turn  out  to  involve  bjoad  behavioral  concepts  of  psychometric 
ssues  which  have  no' applicability  to  bperating  programs  at  all.  Research 
rojects    funded  by  si^ecific testing  i^rogifams  can  be  identified,  aa  shown 
in  the  latf^t  Program  Research  Progress  Aeport  which  , la,  i|nclosed.  However, 
attempting  to  c^^as^ify  pro.le^jts  as  testing  research  .as  opposed  to  educational 
research  would  result  in  arbitrary- Qategori^at ions  of  doubtful  utility.'' 
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p«ci«lont  conctrning  tlM  allocation" of  8TS  fundi  to  research  activities 
are  aade  In  the  following  Manner.    An  overell  reeearch  plan  Is  Reviewed,  and  '  * 
ap|)rov*^  by  the  Stendlng  Condttee  on  Reeearch  end  Developaent  iad  the  BT£f 
ipoiMrd  of  Inistees.    The  Meahershfft  of  this  etandlng  conalttee  li&ludAS  both 
VTS  Trustees  end  other,  eminent  educators  snd  peychonecriclAiis,    iti  research  ' 
.  t>lati  of  the  Cowl t tee  on  Ressarch  and  Developaent  Is  pteseoted  touhe  Finance  > 
Cowlttee  of  t^e  Board  of  Trustaes  vhlch'rscdiHieoda  the  laval  of  x^scTurces  to/ 
^  '  b«  allocated  in.  auppiprt  of  Research  and..  Dev'elopMtit ,  for  approval  by  the  fUU 
Board.   '  *  '  ■    '  ■  ^ 

Once  the  overall  plan  and  total  allocation  bee  been  an^abllebed  by  the  Board 
.  of  Trustaaa,  resiAtaSlbllUy  for  sdvlnlstratlon.ln  accordance  with  research 
and  diivelopnent  objectives  tasts  with  Et&  asnageaent.    Operetlng  under  the 
purview  of  the  Standing  Coailttee  on  ^eefrch  and  Development  the  Senior  Vice 
Presldant  for  Research  end  Dcvelopnant^kpprovee  ah  annu^  plan  for  allocating 
BT8  iNippott  fund  a  to  various  progress  6t  reeearch  an^  %rklng  with  officers 
and  s^sff,  detenUnae  which  epeciflc  proiecte  sdlLb^ supported.'  Thls.pjlan 
for  sUocst'lng  support,  and  prograae  ot  the  epec^c  actlvltlee  that  have 
been  conducted  le  monitored  egelhat  the  research  plan,  and  reports  are 
provided  regularly  to  the  President,  other  senior  BTS  officers,  and. to  the  . 
Stendlnr CoMilttee ton  Ressarch  and  Development.  ^ 
.  '  '  *     '       •    ■  ■. 

''^  In  addition,  RTS  annually  aubmite  oyer' 100  proposala  to  federal  ^government 
ageoclee,  fcKuidetlone  end  other  funding  organisations.    The  veet  majority  of 
these  ere  competitive  propoeala,  eubmltted  in  response  to  publlehed  requests 
for  proposala  or  competltloiiir  announced  by  theee  egencles.   As  Indicated  In 
I  tables  accompanying. thla  letter  ebout  two-thlrde  of  BTS  reeearch  le  supported 
by  eiftemal  agenclae,  and  about  one*thlrd  from  CIS  funds  as  outlined  above. 

.  He  eppreclat J  thie  opportunity  to  elaborete  the  information  aupplled  previously 
and  to  explaim  our  prectlces-  regarding  qur  resaerch  and  development  efforta. 
Va  appraclatai  too,  your  thoughtful- conalderetlon  of  the  Issues  surrounding 
•  the  proposed  legleletlon  and  the  profeeelonal  and  courtaoue  laanner  with  which 
your  ataff  have .dealt  with  those  of  us  who  have  been  associated  with  them. 
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.  Educational  Testing  Service  |et$|    a  private,  nonprofit 
organization  devoted  to  ineasur^ment  and  research,  primarily  in 
the  field  of  education.  It  wa^founded  ip  1947  by  the  American 
CoimQil  on  Education,  the  Carnegie  Foundation  for  the^' 
A.  '  Advancement  of  Teachings  and  the  College  Entraiice  Eyamination 
Board.  The  presidents  of  the  Anierican  Council  on  Education  and 
the  College  Board  setve  ex  officio  on  the  bts  Board  of  lYustees,  as 
does  the  president  of  ets.  Thirteen  other  members  arc  selected 

'  from  the  education  and  business  commimiities  to  serve  four*  year 
terms,  the  main  office  of  ets  is  in  Princetpn,  New  Jersey/ and 
[  :  there  are  nine  regional  offices. 


ETS/a  t^PROriT  ORGANIZATION,  IS  AN  EQUAL  OPPORTUNITY  EMPLOYER. 

Cova:  AcroM  the  pond«  a  illmpu  of  ibe  Henry  Chauncey  Conference  Center  at  aTS  In 
Princeton.  Photographed  by  Del  Merrill,  Viauat  Concepii  Unlimited,  iVenton,  N|. 

COPYRIGHT  ©  1978  SY  EDUCATIONAL  TESTING  SERVta.  .  jjf 
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The  PieMdent's  Report: 


Achievement  Tbst  Scores  ill  Perspective 


.'  The  need  to  amii  bow  much 
atudcoti  have  IcAraed  hai  been 
fundatnental  la  educttloa  (ot  at 
loog  M  there  have  been  itudeota 
and  teacheri.  Long  before 
ataodaidlud  teiti  of  achievement 
came  on  tl^e  icene^  teacheri  were 
makins'liich  hidgmenta.  They  baicd' 
them  Ob  Information  gleaned  from 
familiar  aourcei:  direct  obaervation 
of  itudents'  work/  claia  reoitatiMia, 

■  converMtloni  with  t^e  itudept  or 
other  teacheri,  daily  quizzes,  and 
final  examinationi.  All  theae-bitt  Of 
information  entered  into  the  (radea 
the  teacher  awarded.  They  itill  do— 
and  they  ihould. 
S1dc<  we  had  all  theae  techniques 

,  at  pur  diiposal  in  Horace  Mann's 
diy  and  long  before,  why  were 
Itandaidized  achievement.teati 
Welcopied  when  they  came*  along? 
Thert  aie  several  reasons. 


An  Inexact  Business 

TUchat  knew  what  an  inexact 
bulineas  grading  really  is,  and 
welcomed  a  new  development  that 
h^ld  promise  of  Improving  their 
information.  Among  the  virtuea  of 
Standardized  tests,  three  were^ 
particularly  appealing.  The  first 
virtue  was  accuracy.  Studies  were  ' 
made  to  compare  the  amount  of 
random  enor  In  the  traditional 
kinds  of  Information  with  the 
amount  of  error  In  the  newer, 
standardized  tests  In  the  same 
subilcts,  and  the  flndlnga  were 
consistent:  the  test  Kores  v^ere 
consistently  more  accurate. 
Furthermore,  they. had  a  second, 
related  virtue— ob^ectiWty^tha t 
helped  overcome  some  nther 
problems.  Some  teachers  marked 

■'.  hard  and  some  marked  e$8y,  some 
hased  their  grades  heavily  oh  . 
deportment,  some  on  how<hard' 
students  tried  rather  than  how 

'  much  they  achieved.  The 


BtandardlMd  teats  knw  nothing  of 
these  thlnfs,  nor  of  sex,  race,  , 
hobesty.  Amiability,  of  love  of  pne'a 
fdlow  man:  only  bow  much  the  / 
student  had  learned.  Third,  scores! 
on  standardized  tests  of 
achievement  had  the  virtue  of 
comparabiUty;  They  showed  not  ' 
only  how  well  partlculw  students 
■  performed  tn  comparison  with  their 
classmates  but  also -how  Well  they, 
did  in  comparison  with  pupils  in 
other  classes,  other  achools,  and 
other  Btatea. 

We  had,  tbert,  the  basis  for  a  fine 
combihatjon  of  techniques: 
standardized  tests,  wbich  could 
measure  sheer  accomplishment  in  . 
several  areas  very  well,  and.tescher 
iudgibent,  which  could  add 
dimensions  Inaccessible  to 
standardized  testing  but  pertinent  to 
the  interpretation  of  pupil  scores. 

We  have  learned  a  hard  lesson  In 
the  ensuing  years:  how  difficult  it  is 
to  keep  achievement  scores  In  that, 
perspective,  to  see  them  as  a 
valuable  Ingredient  in  the  mix  of 
Information  that  lndlc«fa  how 
much  an  individual  studefit  or  a 
group  of  students  has  leamed  ln  a 
particular  area!' Scores  are  not,  by 
themselves,  sufficient;  That  fact 
needs  to  be  reiterated.  But  they  do 
remain  a  key  com^netit  in  any 
adequate  learning  information 
system. 

Three  faUacies 

Undoubtedly,  testing  has  suffered  ' 
more  from  the  excessive 
expectations  of  Its  R\Ost  devoted 
advocatea  than  from  the  attacks  of 
its  critics.  1  have  mentioned  three 
virtuea  of  tests  that  have  enhanced 
their  usefulness.  Let  me  balance  the 
account  by  mentioning  three 
fallacies,  ^11  born  of 
overenthusiasm,  that  have 
encouraged  the  misuse  of  test 
scores. • 


the  first  I  shall  call  the 
MlCTomtUr  Fallacy.  Some  people 
have  Invested  test  scores  with  a 
precision— an  infallibility— that  they 
never,  l^fessed.  The  ensuing 
discovery 'tbst  they  are  not  perfectly 
accurate  has  obMured  the  fact  that . 
they  are  more  accurate  than  most  of 
the  ahematlvea.    -  ^ 

The  second  enor  I  shall  call  the 
Whole  Persoa  Fallacy:  the  tendency 


'  to  rcfid  into  «cluj|^e'ment  test  scored  • 
Diucb  mote  {htfSi^y  really  tell, 
J     which  is  amply  iht  amount  a 
student  haslo^irngl  in  a  given  • 
subject  Some  pcoOTe  are  let  down 
upon  discovering  mat  achievement  ' 
tests  U»l  to  measjire  ■  variety  of  1 
traits  like  honeiity  or  leadership  or  ^ 
social  consciousness,  and  in  their 
disappointment  Over  thejpct  that 
the  tests  do  n^t  describ^he  whole 
person,  lor^et  Obat  they  do  a  rather 

-  Kood  iob  of  measuring  the  academic 
accomplishments  they  purport' to 
measure. 
Third,  there  is  the  Equal 

.  Ptepatation  Pallacy.  Some  people 
expect  the  test  to  compensate 
somehow  fof  the  differences  in 
academic  development  of  children 
whose  learning.  qpj>ort unities  have 
differed  (dramatically.  The  test  scOrc 
^    tells  you  notbing  about  the  . 
difficulties  a  student  has  had  to 
overcome  tn  acquire  a  given  level  Of 
proficiency,  but  it  tells  you  a  great- 
deal  about  what  that  level  is—a  fact  ^ 
that  IS  central  to  decldlng.what  the 
student^ready  to  tackle  next. 

•  ■-        ■  ■  . 

Comparoble  Results 

The  »aiiie  three  virtue*  of  test 
scored— accuracy,  obiectivity,  and 
comparability— that  had  appealed  to 
'   teachers  interested  in  the 
accomplishments  Of  individual  . 
students  also  commended 
themselves  to  administrators        g  ' 
concerned  with  the  leaning  of 
groups  of  students  For  the 
administrators  the  greatest  of  the 
^  virtues  was  (and  is)  comparability 

They  saw  at  once  the  power  .of 
siandardi:yd  tests  to  permit 
comparisons  of  the  learning 
achieved  by  pupils  of  different 
teachers,  or  in  different  schools,  or  ■ 
.  in  different  districts  Since  it  was 
well  known  that  some  schools  were 
ntuch  rhore  demanding  jhan  others 
in  their  curriculum  aiid  in  their 
.  grades,  here  at  last  was  a  chance  to 
put  all  students  on  the  same  footing 
in  an  obiective  cqmparison  of 


|f  The  test  sc(*rc  iclls 
^  vou  noihitiK  about 
rhc  ilifliciiliies  a 
siuiU-iu  has  had  to 


results  atross  schools— to  fnake  sure 
the  children  were  learning  as  much 
as  they  should,  as  determined  by 
how  well  the  children  elsewhere 
were  doiQg. 

.Id- the  main,  these  aspirations 
were  sound  And  when  the  three 
fallacies  have  bcch  resisted— whc^ 
people  have  not  expected  the 
precision  of  (he  micrometer,  have 
not  looked  to  achievement  tests  to 
measure  the  whole  person,  and  have 
not  assumed  that  by  standardizing 
the  test  you  have  standardized 
preparation— then,  indeed,  the 
scores  have  given  a  new  dimension, 
through  their  comparability  across 
geographic  areas  and  spans  of  time, 
to' the  information  available  to 
educators  It  is  hard  to  imagine  any 
other  basis  we  might  bave  had  for 
learning,  for  cx^ample,  that  the 
verbal  and  mathematical  skills  of 
students  applying  to  college  have 
declined  in  the  last  15  years.  It  may 
not  have  been  a  comforting 
message;  but  lO^as  one  worth 
getting:  " 

Let's  look  at  a  third  maior  use  of 
standardized  achievement  test 
scores  — in  the  selection  of  students, 
especially  for  college  This  use  got 
an  important  boost  during  World 
War  II,  when  teacher  p*>wer  was 
unavailable  to  grade  the  College 
Board  essay  tests  The  Board 
substituted  obiectivc'tests  as  a  war 
measure  because  they  could  be 
graded  so  efficiently,  fully  cxpcctUig 


to  return  to  the  assays  after  the  war. 
But  to  the  surprise  of  many,  nOt 
only  were  the  obwctivc  tests  easier 
to  f(radc,  the  scores  on  them  were  ai 
l£ast  as  effective  is  the  essay  test 
scores  ha4  bccnjn  measuring  the 
attainments  of  the  students  who 
took  them  This  conclusion  was 
arrived  at  first  through  the  general 
observation  of  the  school  and 
College  people  involved  and  then 
confirmed  through  careful  rvnearch 
The  scores  were  by  and  large 
accuratc-^morc  so  than  scores  on 
the  essay  tests  b*d  been 

Students  who  were  admitted 
praved  to  have  the  accomplishments 
th^tcst  scores  hfil  promised  The 
scores  provided  a  common  QUtt^^y, 
unlike  the  Krade  point  averages  that 
.  reflected  differences  in  grading 
between  schools  and  between  parts 
of  the  country  Moreover,  they  were 
much  less  subject  to  special 
coaching  or  "prepping"  than  the 
essay  tests  had  \k<n,  they  reflected  • 
more  fairly  tfip  accomplishments  of  . 
students  from  differeni  parts  ol  the 
country,  different  schools,  different 
curricula 


Unparalleled  Growth 

As  a  result,  the  selective 
institutions  that  itsed  the  test  scores 
as  one  basis  lor  admissions, 
decisions  were  able  to  seek  out  a 
talented  students  from  every  corner  " 
of  the  nation  and  every  social  ^ 
stratum  They  began  to  ^c^  on 
campus  a  more  heterogeneous  group 
of  students  both  socially  and 
geographically  Moreover,  wi^m^^ 
objective  tests  of  aptitude  and^^^ 
achievement  in  place  and  efficient, 
it  was  possible  to*test  the  enormous 
postwar  wave  of  college  applicants 
under  the  new  system,  and  an 
unparalleled  expansion  of  higher 
education  took  place  in  this 
aountry 

The  system  worked  because  of  the 
same  virtues  of  standardized  tests: 
accuracy,  objectivity,  and 
comparability  Again,  however. 
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some  people  were  tempted  into 
entertiimn^  great  expectations  that  ' 
could  not  be  and  have  not  been 
lulhlled.  The  scores  were  accurate 
in  the  niaio  but  not  tnicrometers  in . 
their  precision,  even  though  their 
errors  were  smaller  than  those  of 
other  known  technique*.  They 
measured  aohievemetit  and 
readiness,  but  not  traits  ol  character 
and  temperament— not  the  whole 
person  They  made  no  allowance  for 
the  inadequacies  oi  preparation  or 
special  circMmstances  o\ 
environment  that  the  student  had  . 
overcome  in  school  In  short;  the 
assumption  oi  equal  preparation 
.  remamed— and  remains— a  /allacy. 


Guidance  for  Students 

We  have  discussed  three  legitimate 
■and*imporiant  uses  of  standardized 
tests  (heir  use  by  teachers  to 
determme  how  much  the  individual 
student  has  learned,  by 
administrators  to  determme  how 
much  classes  and  larger  groups  hrave 
learned,  and, by  university 
admissions  people  to  discover  how 
well  prepared  a  prospective  student 
may  be  Each  use  has  made  great 
contributions  to  education  and 
society  when  kept  in  perspective 
and  used  with  other  pertinent 
information. 

Another  important  use  of  test 
scores  is  by  studen^— to.help  them 
as  <hey^  examine  their  educational 
and  career  goals  and  estimate  their 
readiness  to  undertake  a  more  or 
less  demanding  program  of  study  as 
their  next  step  This  use  has 
received  less  emphasis  historically 
than  it  should  have,  but  the 
evidence  from  a  set  of. tests  can  add 
materially  to  the  iriformation 
available  for  a  student's  guidance 

People  who  now  discover  that  test 
scores  can  vafy  from  day  to  day  and 
^est  to  test  are  on  the  right  track 
Every  examination,  every  judgment 
about  people,  is  fallible  and  has  a  . 
typical  error  rate  Jhe  standaH«fyor 
of  measurement  associated  With 


^        there  arc 
inanv  ^iftt'd 

make  iiu'diocrt' 
rt'tords  ill  ^.t  lwuil 
but  siirl.Ki.' 
ihrnii^li  tlu'ir  test  , 


^tandfrdlzed  test,  scores  is  well 
knoWn  because^it  is  readily 
determined  and  regularly  annpunced 
by  the  publishers.  That  does  not 
mean  that  otljer  forms  of 
measurement,  such  as  essays  or 
interviews  or  letters  of  reference  or 
teachers'  grades,  have  no  error  or  a' 
smaller  aror.  In  fact,  although  such 
errors  are  rarely  reported  or  even 
determined,  research  indicates  that, 
^n  (he  typical  case,  they  are  much 
greater  th^athe  standard  error  of 
measurement  of  a  test  score 

Those  who  call  for  a  high  degvc 
of  teacher  involvement  in  assessing 
students  in  their-classes  are  right,  as 
are  those,  who  decry  the  use  of  test 
scores  alone  as  a  basis  for  evaluating 
the  effectiveness  of  an  entire 
educational  {irogram.  There  is  much 
more  to  be  considered  than  is 
reflected  in  the  score,  including  the 
conditions  under  which  tltc.  Results  . 
were  achieved  But  to  say  what 
some  recent  critics  have  said— that 
cVcn  if  one  -wants  to  know  how 
pupils  arc  doing  in  arithmetic  one 
should  be  forbidden  to  give  a 
standardized  test  in  Aithroctic— is 
.  tf  swmg  the  pendulum  r\ght  out  of 
inc  clock 

Colleges  and  universities  that  use 
test  scores  in  selective  admisMohs 
should  indeed  use  other  information 
vas  well  Achievement  tests  simply 
cannnt  measure  the  whole  person  - 
Obviously,  a  college  shouM  consider 
the  record  of  previous  school 
performance  and  the  iudgmcnts  of 
teachers  fnd  counselors.  Yet  there 


are  many  gifted  youngsters  who 
make  mediocre  record!  in  school 
but  surface  through  theli  test 
scores,  as  Julian  Stanley's  work  at 
Johns  Hopl^ins  University  has  amply 
demonstrate^. 


forget  the  Magic 

Finally,  those  who  would  ascribe  to 
tests  given  at  scbooHge  some 
^agic  that  enables  pem  to  divine 
genetic  intelligence  or  ability  to 
leani  should  forg^it.  Achievement 
tests  measure  deffopcd  ability— 
.developed  in  relation  to  a  particular 
subject  or  .discipline.  To  a  large 
extent,  so  do  scholastic  aptitude 
tests,  although  the -areas  of 
experience  through  which  a  student 
is  prepared  for  them  are  much  more 
long  term  and  more  pervasive  iri  our 
sociejy  But  equal  opportunity  In 
education  simply  has  not  been 
realized  To  think  that,  at  18  ye^rs 
of  age,  people  whose  experiences 
have  beeii  vastly  different  c.an  show 
their  inborn  potential  through  ^test  ■ 
of  verbal  and  mathematical 
reaspning  is  naive,  regardless  of 
their  cultural  advantages  or 
disad\«intages. 

Standardized  tests  of  achievem^t 
have  amply  demonstratciLtheir 
utility  over  the  past  two  or  three 
generations.  Because  of  their 
accuracy,  their  objectivity,  and  their 
comparability,  they  deserve 
recognition  as  a  powerful  tool  in  ■ 
education  They  have  suffered  in 
esteem  first  at  the  hands  of  those 
who  claimed  for  them  a  set  of  ^ 
qualities  they  could  never  attain,  • 
and  latterly  from  the  protests  ol 
those  who  have  proposed  that  since 
they  are  imperfect  they  be  done 
away  with  I  suggest  we  put  them 
in  a  reasonable  perspective  as  we 
strive  lo  jmprove  both  the  tests  and 
their  use 
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Piograms  &  Services 


When  Ediicitionil  Testing  Service  . 
WW  e»t4ib)i$hed  in  1946,  its  explieit 

■  purposes  were  to  develop 
responiibit  t^^sting  programs  and 
related  services,  to  eonduct  • 
edueationa)  research,  and  to  provide 
advisory  and  tnsUuctional  services 

'  in  measurement  Implicitly,  the 
new  organization  wa»  expected  to 
fetch  out  to- the  ediieatibna)  ' 
community,  to  help  analyze  and 
meet  its  needs. 

In  1977.78,  the  year  6i  its 
thirtieth  thniversary,  ets  could 
perhaps  be  characterized  best  as 
"rcachHig  out  "  * 


In  the  Field 

Through  a  network  of  regional 
offices,  the  organization  provides  a  « 
variety  of  services  for  educators  and 
test-takers  in  the  field  Launclyd  in 
1948  with-a  modest  office  in  Los 
Angeles.  rcKmnal  operations 
expanded  Ktadually  and  now  include 
eight  ollice^  spanning  the  continent, 
plus  cme  in  Puerto  Rico  This 
netwxjrk  enables  the  OrKanization  (o 
respond  swiftly  to  requests,    .  • 
A^hcrever  they  originate,  and 
generates  a  Steady  flow  of 
information  to  the  main  office  in 
Princeton  about  education  ^nd 
measurement  needs  in  all  parts  of 
the  nation 

Regional  staff  members  regularly 
i^iteract.with  educators,  students, 
[    parents,  and  others  witH  ah  active 
interest  in  education  and 
measurement  For  instajiee^  the. 
"  Southern,  Midwestern,  and 

Northeastern  offices  aie  Technical 
.  Assistance  Centers  |tacs)  designated 
by/the  U  S  Offie^  of  Education  to 
bclp  state  and  local  school  officials 
m  their  regiops  evaluate  programs 
for  the  disadvaritaged  under  Title  1 
of  the  Elementary  and  Secondary 
Education  Act  (esea)  In  this  role, 
they  provide  consultation  to  state 


Cammurnty  ieiahons  specialist 
Kaxheiint  Moote  leads  vtsitOis  on  a  tout 
of  ITS  In  Pnnceton 

departments  of  cdu£:atum.  conduct 
workshops  for  Title  I  evalM^tors  and 
classroom  teachers,  meet  with 
advisory.comniittecs  composed  of 
parents,  and  undertake  various* 
other  tasks 

At  the  largest  regional  office;  in 
Berkeley,  there  is  an  extensive  array  ■ 
of  activities,  including  testing 
program  services,  consultation,  and* 
research  Among  the  pioiects  under 
way  in  1977  78  a  national 
asscssmerit.of  the  n(ed  for 
educational  media  and  materials  to 
teach  tbe  handicapped)  and  a  survey 
of  the  >yays  universities  and  colleges 
have  adapted  to  the  changing 
conditions  of  the  1970s  ■ 

In  Wcilesley  Hills  (Boston),  staff 
studied  t})c  riieasurement  a^pccts  of 
performance  based  high  sthool  ■ 
graduation  tcquircm^nts  In 
.  Evanston,  a  process  was  developed 
for  identifying  and  placing 
academically  gifted  children  Los' 
Angeles  stiff  continued  to  work 
with  various  school  districts  in  the 


evaluation  of  bilingual  programs 
Meanwhile,  plans  were  drawn  lo  . 
xpand  the  Austin  office  so  it  could 
provide  a  broader  array  of  services  to 
he  Southwestern  slates 
Ope  pioneering  development  was  . 
he  crei^tion  of  a  Regional  Test  ^ 
Development  Center  at  the 
Southern  office  to  serve  the 
employment  tcstjrig  needs  of  a 
consortium  of  eight  Southeastern 
statQ^^^.e  center  grew  out  of  a 
I977  yiudy  by^fTS  staff  in  Atlanta 
and  at  the  Center  for  Occupational 
and  Professional  Assessment  (copa) 
in  Princctorf  They  explored  the 
feasibility  of  a.multistate  approach 
to  developing  and  validating  lests 
for  the  selection,  of  state  employees. 
The  study  was  funded  by  the  U  S 
Civil  Service  Commission  and 
conducted  under  a  contract  with  the 
State  of  Georgia. 


International  Activities 

For  many  years,,  its  has  engaged  in 
meauireniem  related  activities 
around  the  World  Its  /nf^rndriond/ 
NfwsUttei  IS  a  vehicle  for  the 
exchange  ol  infwrmation  by  sonie 
2,^(K1  psychologists  and  educators  in 
110  nations,  and  its  annual  summer 
workshops  in  measurement  for 
foreign  scholar«(  have  attracted  more 
than  4(K)4>ariieipa[1ts  in  \  f  years 
Several  tTs  developed  tests  are 
administered  in  faraway  places  each 
year,  including  the  College  Board  s 
Schojastit  Aptitude  Test  (sat|,  the 
Graduate  Record  Examinations 
((.re),  the  Graduate  Management 
Admission  Test  (cmat|.  the  Law 
School  Admission  Test  and 
the  Test  of  English  as  a  Foreign 
Language  (Totn)^  Sponsored  lointly. 
by  the  C  ollege  Board  and  the  cki 
Board.  loiH  is  designed  especially 
to  mea>ure  the  English  language 
skjlU  of  the  thousands  of  foreign 
students  who  annually  seek 
admission  to  U  S  universities  and 
colleges  In  1977-78,  Tom  was 
administered  to  a  recorit^  )91,000  at 
home  and  abroad. 


Durios  the  year,      continued  • 
working  with  the  I^-oatioo 
C«iibbean  EMmiiUtiooi  Council  to 
develop  the  councll't  cip«bUUy  for 
educatiooal- testing  and  related  data 
pfoceMing-  Started  In  1973,  thii 
cooperative  e0ort  haa  produced  teats 
appropriate  to  the  region  that  wUl 
beg^n,  in  1979,  to  supplant  the 
traditional  school -leaving 
examinations  from  ^he  United 
Kingdom.  As  the  council  gains 
.experience  and  expertise,  the  roU  of 
BTS  will  be  reduced  gradually,  then 
phased  out. 

Active  participation  in  the 
International  Asioclatlon  lor 
.  Educational  Assessment  (iaia),  . 
which  ITS  was  instrumental  in 
establishing  in  1976,  continuedjn 
1977-78.  For  iXiA,  rrs  began  to  sjudy . 
the  feasibility  of  developing  s 
multinational  aptitud<  test  to 
facilitate  college  admissions  across 
national  boundaries.  The  test  woujd 
be  administered  in  a  student's  . 
native  language,  with  a  separate- 
examination  determining  skill  in 
the  language  of  the  country  where 
be  of  she  plans  to  study  Thus, 
language  problems  would  not 
influence  sptltude  test  scores, 


Members  of  the  m  stsff  visited 
several  nations  during  the  year  to 
consult  with  education  officials  «nd 
conduct  research.  One  consultant 
advised  an  arm  of  thfc  Iranian 
MInistry'of  Education  regarding 
methods  of  administering  and 
processing  that  nation's  college 
entrance  examinations.  Others 
Visited  Indonesia  and  countries  in 
Africa  and  Latin  America  In  a 
continuing  study  of  nonforipal 
education-rout-of-schod  learning 
related  to  iob  skills  and  living 
Btandarda— in  developing  countries, 
ihil  study  Is  fund^  by  the  U.S. 
Agency  for  International 
Development. 

Continuing  Education 

.  W)rkshops  conducted  by  its  durlpg. 
the  year  covered  a  lot  of  ground,  . 
both  geographically  and  topically. 
Developed  by  the  Programs  of 
Continuing  Education  itilf  Ui 
Princeton,  the  workshops  were 
offered  both  af  that  site  and  around 
the  nation,  often  conducted  by 
regional  office  stalf.  Ibpics  ranged 
from,  assessing  minimum 
competence  In  thehasic  skills  to 


evaluatliig  programs  forgifted 
atudents.  add  also  encompsssed  the 
legal  issues  involved  In  tescher'  . 
evslustlon,  methods  of  Improving  ' 
InatrucMon,  program  evaluatioii, 
nesting  minority  groups,  vilues 
education,  and  aspects  of 
measureiAent. 

ThroU|hout  the  year,  ert  ^ 
cp'ntlnued>to  conduct  Evaluation;. 
Improvement  Program  iup) 
worksljbps 'scross  the'  nst ion .  BssCd 
■  on  msteriils  developed  by  the  ' 
California  Dcpartmet^t  of.^ucation 
and  published  by  rrs,  |ip  is  Intended 
to  help  ichool  pei^nnel  become 
seH'Sufncient  In'eyatpattng 
educational  programt  and  to 
Increase  their  awareness  of  available 
technical  assistance. 

With  the  National  Coubcil  on 
Measurement  ia  Education  Incmb), 
ITS  presented  a  nationwide  series  of 
seminsrs.on  issues  in-testing  for 
school  bbsrd  members  and  . 
administrators  Each  seminar  wss 
tailored*  ta  the  needs  of  local 
participants  as  they  dealt  with 
students,  parents,  and  their 
communities  at  large.  An^ong  the 
topics:  the  assessment  of  writing 
skills,  how  to  communicate  test 
reSMlts  to  parents  and  other  citizens, 
and  what  teachers  can  learn  from 
results  of  criterion-referenced  tet{s. 


Attuto  Madtid.  Morar,  UtUvMitlty  of 
Af  teaaioM.  coo/en  ¥dth  Jot*  Batovtto 
and  Carmea  Codlatt  Windhottt  at  tTS 
taBttkeUy- 
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Student  Services 

In  its  first  full  ycir  of  operation,  the 
.   ITS  OHice  for  Minority  Education 
published  several  monuKraphs  and  a 
compendium  of  cunent  ETS  services 
and  projects  relating  to  the 
^  Iniprovement  of  educational 
opportunity  for  minority  groups. 
College  Achievement  thiough  Self- 
Help,  a  manual  for  minority 
students  erirdlled  or  intending  to 
enroll  in  college,  provided  analyses 
of  the  common  problems  they  face 
i  in  adjusting  ^o  campus  and 

classroom  life  and  offered  guidance 
in  the  handling  of  each  problem. 

In  lanxiary  19784  the  new 
Pinanclal  Aid  Form  {rf^  became  the 
sole  documeni  for  students  to  file 
with  ihe  College  Board's  College 
.  Scholarship  Service  (ess)  in  order  to 
apply  for  assistance  in  meeting  j 
college  costs.  Phased  in  over  a  two*s 
and-a-haif-year  period,  the  rAf  is  a  ■ 
standard  application  fonn  used  by  % 
universltias  and  colleges  across  the 
*  nation,  aid  and  scholarship  agencies 
'in  30  states,  and  the  federal  Basic 
'    Educational  Opportunity  Grants 
program,  ^ 


Each  fAf  is^  processed  by  c^s  and  - 
forwarded  to  the  mstitutions  and 
agencies  designated  by  the 
applicant  Use  of  the  standard  form 
resulted  m  a  substantial  increase  in 
the  number  of  applica^uns  filed 
With  CSS  . 

During  ^he  year^  ess  also  initiated 
the  Early  Financial  Aid  Planning 
Service  to  help  high  school  juniors 
(and  younger  studenis|  and  their 
families  Calculate  m  advance  what 
they  can  a/ford  to  spend  on  college, 
how  much  aid  they  will  need  to 
attend  the  institutions  of  their 
choice,' and  what  aid  programs  are 
available  to  them. 


Testing  Programs 

Continued  nationwide  concern  with 
educational  standards  was  reflected 
in  numertfus  rrs  activities  during 
1977-78  It  was  the  first  year  that 
the  Basic  Skills  Assessment  program 
was  us<d  aaoss  the  country  to  help 
local  sckool  districts  determine 
wheth^  secondary  school  students 
could  read,  write,  and  comput^well 
enough  lo  meet  the  demands  of 


adult  life-or  the  levels  of 
competence  required  for  high  school 
graduation,  as  measured  against 
locally  established  standards. 

Developed  by  m  in  Cooperation 
wiih  a  consortium  o(  public  school 
dlstriciVtheBasic^kills  . 
Assessment  tests  Were  administered 
to  more  than  70,000  students  in  200 
school  diit^icts.  ets  provided  the 
tests  and  related  materials  and 
scoring  and  reporting  services^ 
tailoring  its  reports  to  the  specified 
nteds  of  the  various  districts.  Staff 
also  provided  guidance  to  district 
personnel  regarding  methods  of 
setting  appropriate  Standards  . 

^  College  Freshmen 

Meanwhile,  many  universities  and 
colleges  intensified  their  efforts  lo 
assess  the  skills  of  enicring 
freshmen,  primarily  for  purposes  of 
placement  In;1977'7B,  tho 
California  Stale  UnivcrMiy  and 
College  Systeip  administered  its . 
new  English  Placement  Test, 
developed  with  m,  to  all  first -year 
students— abuut  25.000  of  them~ai 
its  19  institutions.  Resultsrwere 
used  for  student  placement  and  the 
improvement  of  curriculum  and 
instruction' 

In  New  jersey,  starting  this  fall, 
all  ireshnlen  at  the  state  university 
and  colleges  will  take  College  B<iard 
tests  developed  by  m  lo  ascertain 
whether  they  arc  adequately 
prepared  in  the  basic  skills  to 
proceed  with  higher  education  or 
need  remedial  courses  first  Private 
institutions  in  the  state  were 
invited  to  participate  in  the  program 
voluntarily  As  in  California,  test 
results  will  be  used  for  both 
placement  and  curriculum  planning.  • 

The  Third 'R' 

During  1977-78,  ihere  was  a  marked 
increase  in  attempts  to  improve  the 
writing  skills  of  students  at  all 
levels  of  education  At  ets.  this 
irend  led  to  the  creation  of 
Pifograms  for  the  Assessment  of  . 
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Writing.  The  center  w*s  designed  to 
respond  .to  requests  fdr  consultstioo, 
trslning,  snd  rcUtcd  services  from 
ststc  snd  Iocs]  educstion  Agencies 
seeking  to  improve  writing 
instruction  snd  messure  the  writing 
sbilities  of  their  students. 
In  its  ftrtt  months,  the  center 
numerous  requests  to 
|irovl^  inservioe  trsining  of  fscuhy 
in  the  holistic  method  of  scoring 
esssys.  Becsusc  It  drimsticsUy  ; 
redqces  the  time  required  to  resd 
snd  grsde  compositions,  holistic 
scoring  ensbies  English  teachers  to 
Incresse  the  number  of  writing. 
Assignments  they  give  to  their 
dssses  without  burying  themlelvei 
in  psper  work. 

EsKntis%,  holistic.storing.ii 
based  on  the  sssumption  thst  the 
totsi  impression  msde  by  s>  piece,  of 
%vriting  serves  ss  s  relUhle  messure 
of  the  suthor's  skills.  Thst  is,  if  s 
piece  conirountcstes  effectively,  it 
reflects  skill  in  grsmmsr,  syntsx, 
snd  the  other  components  of 
writing-  So  esssys  are  resd  rapidly 
for  clarity  and  impact  rather  thsn 
juinstaklngly  for  enors.  TWp  or 
more  resdery  rate  each  essay  on  a 
I'S  Kslc,  and  the  total  is  the 
student's  score  Aside  from  its 
usefulness  in  the  classroom,  holistic 
Korlng  hss  been  instrumental  in  s 
resurgence  of  esssy  sections  in 
ers-developed  English  composition 
tests. 
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Bvani  Athway.  director  of  Pto$tanu  lor 
the  Atmument  of.WrtUng,  refiecti  on 
bis  busy  eobedule. 


Sequential  Thsting 

Norming  of  the  completely  revised 
School  and  College  Ability  l^sts  •. 
(scat!  and  Sequential  Tests  pf 
Educational  Progress  (srcrj  wss 
completed  in  1977-78  with  inbre 
than  ypfi(^  students  in  grades  4wo 
through  U  psrticipating 
nationwide.  With  scat*step  hi  and 
Iheaacus  measures  for  children  in 
preschool  and  the  early  grades,  ets 
now  has  tests  avallable^for  the  Utit 
time.-that  permit  monitoring  s 
student's  progress  iri  major  areas  of 
instruction  from  preschool  through 
the  twelfth  grade^ 


Director  Andre  Diaz,  titht,  diectiuei  the 
/oji'growifli  OMAT  prof  ram  with 
Oitociote  director  fohn  Hiih^ 


During  stsp  lu's-devetopment,  . 
me&uremeat  specislists  devised  a 
new  technique  for  reliiting  test 
results  to  grade  level,  e^s  does  not    . . 
report  nide^quivslent  scores  on 
groundKhat  they  are  misleading 
and  are  MKd  on  estimates  rather  - 
than  actual  performance  dsta.  For 
example,  tossy  that,  on  the.bssis  of  ' 
his  or  her  score  on  a  third-grade 
arithmetic  test,  a  student  hss 
performed  st  the  level  cixpected  In  ' 
Ihe  third  month  of  the  ^Ixth  grade  is  ' 
Inaccurate  because  the  performance 
was  not  on  a  sixth 'grsde  test  but  a 
third'grade  one  thst  may  never  have 
been  given  to  any  sixth  grader. 
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Under  the  its  Qrtde  Uvel 

•  lodicJtor  (cuhiywem,  a  brief 
'locator  teat"  may  be  admlnlatered 

'  •  to  a  ituikdl  to  determine  which 
^  level  teat  he  or  the  should  take.  If  a 
fourth  giradex'a  locator  teat  acore  ii 
high,  he'or  she  will  be  inoat 
appropriatety  teated  00  ftfth-gradc 
.  material,  mf  reaulta  Will  glYt  an' 
accurate  Indlcatloo^pf  achievement 
reUtlve  to  the  average  pafc 
'of  all  students  in' a  particul^ 
and  month,  aa  measured  i 
norniing  proceas.  Used  \n4 
V  With  the  ataodard  score  T 
peiceotiie  rank  reports.  1 
a  dimeniion  to  the  performance, 
profile  iketched  b^  STU.  -  :   >  ' 

Other  Devehpmeats 

In  its  second  year,  the 
Undergraduate 'Aaacaiment  Program 
|UAP)  offered  revised  Ares  l^eats  in  . 
social  Kience,  the  humanitlea,  fod 
natural  science,  and  Field  Ibata  in 
busineas  and  physical  education. 
About  37S  univviitiea  and  colleges 
participated  in  uap,  using  its  broad 
range  of  tef ts  and  related  Mrvites  to 
aims  student  performance  iM  . 

$  evaluate  cunlculuma.  ' 
Bflorts  to  Improve  tifkrating 
systems  resulted  in  ajpeedier 
processing  of  score  reports  following 
administrations  of  the  Graduate 
Management  Admisaloo  llMt  . 
(cmat).  Tliat  program  *a4ponsoring 

"  organization,  the  Gradate 
Management  Admission  Council 

.  -  (CMAcI,  estabViihed  a  committee  to 
plan  and  facilitate  research  into 
graduate  management  education. 
-  9MAC  also  formulated  a  policy 
statement  on  the  appropriate  uae  of 
CMAT  9<?orcs  in  making  admissions 
deciiioQi.. 

Some  developments  in  other 
programs' during  1977-78:  A  new 

•  Graduate  Record  Examinationa  (caa) 
section  mealuring  aoalytic  akills 

-   was  Introduced,  maf king  an  effort 
10  aaaeas  aptitude  in  p^tt  than 
verbal  and  quaotltatli^^pasi  the  * 
ToifL  Oounell  embarkcRo  an 
extensive  prograpi  of  research  Into 


Uft:  Auto  maebanic  WlllUun  t  fohntoa  ttpdt  to  btutMu  at  Oitbun  Poatiac, 
mmon.  5luv$  patchu  indicait  be  t$  atUftid  under  a  ptognm  eooducud  by  «n. 
Right .  Uo  MbinNf.  Uft,  dinctor  of  tbg  auto  ftiecbatiia  ptogram,-  examtna  data  with 
tett  specialist  Edvrin  Hay. 


various  aspects  of  i^  test's  Validity^ 
for  the  Law  School  Admission 
Council.  ITS  continued  development 
of  the  hiw  School  Interactive  • 
System,  a  pilot  program  linking  law. 
Khool  admissions  offices  directly- 
with  the  us  computer  records  of 
candidates  who  authorize  release  of ' 
thedsta.  .  .■ 

For  the  College  Board;  vn 
completed  norming  of  the  revised' 
General  ExamlnatUma  in  the 
College-Level  Examination  I^ogriAn 
(cur)]  an  easay  section  was  added  to 
jthe  CUT  English  Cotnpositlpn  t^^t 

\ArtAurKroii,  dimtot  of  piidaaca 
ptotramt.  taviewi  tb$  Carur  ShUt ' 
AsMMmadt  Program  with  ttt  auistant 
Hmtor:f^Bnwar. 


for  admiiftatratton  twice  a  year]  the 
Descriptive  l^ti  of  Laoguaa^  Skilli 
were  being  field  teated,  and^n 
began  developing  similar 
DcKriptive  Duts  of  Mathematics 
Skills  to  help  inititutioits  place 
studenti  and  plan  programs. 


Looking  at  C«reerg 

As  the'iob'  market  changei  In  this  ' 
poitinduitrial  society,  there  i) 
increasing  interest  in  careera. 
Students  are  intereated  in  chooiing 
caree^i  and  preparing  for  them. 
Employers  are  interested  in  how  to 
screen  applicants,  select  employees, 
and  asKss  their  competence.  The 
agencies  and  boards  that  govern 
professional  certification  and 
occupational  licensing  are  interested 
in  determining  th.e  adequacy  of 
cducatlbn  and  preparation. 

In  a  variety  of  ways,  its  attempts 
to  respond  tp  all  of  these  intetesta. 


CareeT  Skil 

For  the  CoUegi 
consortium  of  fi' 
Maryland,  Mlnnei 
and  Ohio^rrs 
instruments  to 
that  are  easiential 


laifd  and  a 
itatea —Georgia.' 
I,  New  lersey.' 


ire  six  skills 
Vreer 


i 
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dinetot  Raymond  a  Waadyk»p$JuUi  o 

pcepAitdncfs:  i«H-«vtlu4tton  and 
deyetopmeot,  t:areer  awiieneu, 
decliUm  makins,  employment 
seeking,  work  effectiveness,  tod' 
persons)  economics. 

More  tliftn  three  yeti s  In  the 
mskioj,  the  result  is  the  Csreer  . 
Skills  Assessment  Progrsffl/  . 
.'SvsUsble  in  ex^rimentsl  form 
durlni  1978-79.  A  key  feature  of  the 
progrsm  is  tiie  underlying 
conviction  thsi  ihese  csieer 
development  skills  csji  be  not  only 
Identified  snd  jncssurcd  but  tsught. 
Id  fscti  one  ms)or  use  of  the 
messmes  is  expected  to  be  the 
identificstion  of  skills  tbst  need  * 
«ddi(ioosl  sttemion  tn  the  *  . 
ciuticulum.  ' 

Guidance 

During  the  yor/STS  Progrsms  of 


Vocstionil  educitiott  completed ' 
development  of  s  bstter^^of. 
meuures  for  use  in  providing  bAreer. 
guidsnce  snd  counseling  to  . 
dissdvsntsged  adolescents  and 
young'adults  in  Comprehensive 
fimployment  and  Training  Act  (citaI 
pr(^«ins,  skills  trsinlng  centers,  . 
vQGallofiAl  bigb'sc)K)ola,  sod 
correctional  institutions.  Called 
PMgraiiii  fbi  Assessing  Youth 
Employment  SkilhTVAYis),  the 
(neasuies  help  identify  sttitudes, 
cognitive  sklUs,  and  social 
competencies  related  to 

; -employment,  they  rely  heavily  on 
pictorial  materials  and  are 
■dmln^steied  orally  to  minltoize  the 
Impact'of  limited  verbal  skill. 

MeHnwbile,  the  ni  eompOterized 
career  guidance  program  for  college 
atudenta  waa  Introduced  to  seversl 
r)ew  campuses.  Cslled  sigi  (for 
System  of  Interactlve'Cuidance  and  • 
Informiitloa).  the  program  Is  now 
helping  students  Identify  their 
career  tntertfits  and  valoesi  relate 
them  to  various  occupationa;  and 
progress  mwaid  inform^ 
rstionsl  csteet  decisions  at  14  two- 
year  and  14  four-year  colleges. 

In  the  Workplace 

In  197778,  the  m  Center  for 
OccupaiipmU  and  Professional 
Assesitment  fcoTA)  continued  to 

^ow,  reflA:ting  the  trend  toward 
ore  pr'eciK.ltandards  of  job 


preparation  and  qualification . 
During  Its  first  five  yeara,  oofa  has 
undertaken  numerous  measurement 
and  research  projects  in  a  wide 
variety  of  occupstiona.  Each  was 
designed  to  assist  in  ijhe  ; 
certification,  licenain^,  selection,  or 
self-fssessinent  of  peoplij  entering  or 
working  in  s  particular  Held. 

coM's  three  largcat  programa 
Illustrate  the  center'a  dlveralty.  The 
Reel  Bsute  Licensing  Bxaminatlon 
l^ogrsm  tested  175«0b0  aspiring 
brokers  and  agenta  in  26  stiftea 
during  the  year-  The  Certified  Auto 
Mechanics  Program,  aponsored  by 
the  National  Institute  ftf 
Automotive  Service  Excellence, 
issued  certificates  to  more  thsn 
56,000  suto  and  truck  repairmen  In 
a  number  of  mechanical  specialties. 
Some  42,000  would-be  insurance 
agents  were  tested  In  seven  ststes 
under  the  Multistste  Insurance 
Licensing  Prpgrsm. 

fity*  endesvors  hy  cota's  100- 
member  staff  Ipclude'the  evslustfon 
of  stste  trsining  programa  for 
persons  who  s^tkjfctlficatlon  as 
sppltcstors  ofdj^rous  pesticides. 
Such  certiflcApls  required  by 
federsl  Isw  befwe  s  person'  can 
purchase  the  deadly  chemicals. 
Involviiig  interviews  and  onalte 
observatlobs  before  snd  after 
training,  as  well  ss  tests,  the  project 
is  sponsored  by  the  U.S. 
Envlronmentsl  Protection  Agency 
snd  the  Council  on  Envlronmentsl 
Quality. 


.Left:  cofA  tut  iptoialiit  SuidiM  MmUl  l$ft.  and  btitlth  ' 
pfognmt  dh4ctot  fbby  Frttdmaa  diteuu  rtMpiatoiy 
tJMMpiu  c4tHik4tkM  pngtm  mth  iu  dinctof,  kufu^ 
Smtth.  lUgbt :  C$tUfkd  thttfiUt  /toAfl  It.  Lhyd        With  a 
patiitt  tf  Piim9too  ^§dk»t  Ctalu. 


IttuRadlotoglc  tichootogiit  fudith  Whttt.  ctttifttd  throuih 
a  cofA  piofMai,  wotk*  at  the  Pttac4ton  Mtdkai  dattt  '  . 
Right;  WtUiam  D.  Ho^ta.  dirtctor  ol  Utat  pmgmdi,  ' 
ditettsui  opatttUottal  dMtaUi  with  thi  ouiMtiut  dinetot, 
B$tty  (itoaiko¥f»kl.  - 
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Researcli  &  Development 


Thioush  lu  rctearch  efforts,  no  less 
than  its  pf ogrsms  and  services;  m 
attemjpts  to  teach  out  to  the  world 
around  it.  With  approximately  300 
projects  under  way  in  1977-78,  the 

'  reseaxcb  effort  enga|^  the  time  tni 
talents  of  iomc  200  staff,  about  half 
of  them  wiih4idvinced  degrees  in 
the  social  sciencei. 
In  broad  terms,  they  were  seeking 

•  dew  knowledge  about  human 
learning  and  development, 
Evaluating  educational  programs, 
analyzing  educational  policies  and 
practices,  developing  and  testing 
measurement  methodologies,  and 
defining  and  refhiing  statistical  data 
analysis  theories  and  techniques. 
Their  work  was  supported  by  grants 
from  an^  coi) tracts  with 
government  agencies,  priv4te 
foundations,  organizations  that 
sponsor  various  testins  programs^ 
and  by  allocations  of  bts  funds. 

Each  year  since  its  inception,  ets 
has  channeled  a  share  of  its  own' 
resources  into  educational  and 
Osychological  research.  In  recent 
fears  that  ^hare  has  grown,  and  in 
1977-78,  BTS  funds  accounted  for  . 
32.7  percent. of  the  total  expended 
for  research  (see  chart). 

I 

Development  Goals 

In  order  to  coordinate  research 
\efforts  for  maximum  benefit  to 
'<!ducation  and  s^iety,  and  to  . 

Sltocate  resources  wisely,  its 
evoted  considerable  effort  during 
the  year  to  formulating  a  statement 
of  research  and  development  gpals 
and  objectives.  In  the  process,  five 
fundamental  goals  were  defined. 
They  are: 

•  lb  improve  access  to  educational 
opportunity.  ; 

•  lb  ihaprove  the  quality  of 
education. 

.•  lb  increase  the  effectiveness  of 
education. 


•  lb  enhance  understanding  of 
human  development  and 
educational  processes. 

•  lb  enrich  understanding  of  the 
educational  needs  and  attributes 
of  selected  populations. 
Research  in  the  areas  suggested  by 

these  goats.ls  not  new  to  ets. 
.Numerousfp.rojectsover  llic-past  30 
years  havejrelated  to  each  of  thc^ 
five  areas.  The  slgilificancc  of  the 
goals  is  not  that  they  point  in  ' 
wholly  new  directions  but  that  they 
signal  areis  of  continued  emphasis 
for  the  future.  In  1977-78,  several  . 
projects  were  under  way  in  each  of 
the  five  areas.  Some  of  them  arc 
described  briefly  here. 

Access  to  Opportunity 

Recent  events  have  given  new 
Impetus  to  BTS  effofts  to  identify 
characteristics,  in  addition  to  ttie 
traditional  grade -point  averages  and' 
test  scores,  that  may  be  useful  in 
the  admissions  procesa~-and  to 
develop  ways  of  assessing  such 
criteria.  '  *. 

For  years,  bts  and  spoi^sors  of  . 
nationill  testing  programs  have 
advised  institutions  not  to  place 
undue  reliance  on  test  ticbres  or, . 


indeed,  on  any  single  admissions 
criterion,  but  to  take  into  account 
all  of  an  applicant's  relevant 
characteristics.  A  current  project 
called  New  Dimensioils  in 
Admissioi^is  expected  to  result  in  ' 
a  broada  /iew  of  such 
supplcmcntary.characteristicft  and 
the  ways  they  might  be  more 
systematically  and  reliably  assessed. 

No  prior  assumptions  have  been 
made  about  the  nature  of  tlie 
supplementary  characteristics  that 
may  be  most  useful. in  admissions, 
or  about  how.  to  assess  them.  It  is 
quite  possible  that  a  primary  need  is 
to  encourage  more. effective  use  of 
information  already  available  by 
strengthening  procedures  for  the 
subiective  appraisal  of  applicants' 
persotkal  gualities  and  <f 
accomplishments.  * 

During  the  past  few  months, 
riesearch  scientists  have  made 
progress  in  organizing  cooperative 
studies  of  personal  qualities  as 
factors  in  adiiiiss.ions,  working  with 
faculty  and  administrator^  in 
secondary  schools,  colleges,  And 
gri^duate  and  professional  schools, 
throughout  the  countrj^. 

Inhibiting  Factors 

Vbis  examination  Of  the  admission 
process  is  but  one  of  several  its 
efforts  to  help  make  educational 
opppliunities  accessiblf  to  all  who 


"iRUMich  ptycholdgiiSUi^^^itticIa  Ctott  and  Richard  E.  Pet£iMn 
review liie\pn$  teattilngtuivey,  df Vn lo  Berkeley. 


can  beDcHt  from  them.  Another  Is 
the  «nay  ot  pro|ects  limed  at 
.  overcoming  the  factora—tuch  at 
unmet  needs  fpr  financial  aid  and  • 
inadequate  educational  and  career 
guidance-^^at  Inhibit  access.  ^ 
Among  these  projects  are  the 
System  of  Interactive  Guidance  and. 
Information,  or  sici  (see  page  10), 
and  the  College  Boards  sponsored 
Career  Skilla  Asses smant  Program 
(seepage  9). 

*  Similarly,  atudiej  of  student 
financial  aid  problems  are  ' 
continually  Undertalcen  by  m  staff. 
In  1977-78,  a  study  sponsored  by  the 
Gfaduate  and  Professional  {financial 
Aid  Council  (gapmc)  examined  the 
burden  faced  by  graduate  students 
when  tbey  start  their  csreers  at 
modest  salaries  and  niust  repay 
education  loans  at  fairly  high  • 
monthly  rates.  The  study  resulted 
in  the  proposal  of  a  new  system,  the 
GradMSted  Repayment. Option  (cao), 
that  would  extend  the  repayment 
period  from  the  usual  10  years  to  16 
and  feature  more  reasonable  • 
mdtthty  installments  that^cre^^e* ' 
as  ift'come  does.  * . 

Educational  Quality 

Improving  the  quality  of  education 
is  the  prime  purpose  of  many  ets 
research  projects,  from  helping 
schools  establish  pettormance 
standards  and  evaluate  programs  to 
identifying  and  developing 
.techniques  for  assessing  outcomes 
of  higher  education. 

For  example,  as  part  of  the  Basic 
Skills  Assessment  program  (^ee  page 
7),  m  devised  techniques  for  } 
schools  to  use  in  setting  local 
standards  of  student  performance  ■ 
th^t  are  compatible  with  . 
community  attitudes  and 
expectations.  The  testing  program 
itself  does  more  than  measure  each 
student  againat  those^ndards.  It 
also  provides  eaq|i  school  or  school 
system  with  an. aggregate  indication  . 
of  instructional  strengths  and    .  ' 
weaknesses,  thus  pointing  out 


Luia  Lo^.  dirt^tor  of  a  longitudinal 
study  of  Mexican'  Amehcaa  children, 
discuttet  the  pmhct  with  nseareh 
assistant  fuditb  Morgan. 


needed  improvements. 

In  New  York  City,'m4esearch 
scientists  continued  to  work  with 
the  school  system- to  develop  an 
accountability  plan  to  hold  the 
schools  responsible  for  student 
learning  and  to  correct  instructional, 
djficiencies'by  identifying  strong 
programs  and  disseminating 
mformatiott  abut  them.  Fof  this 
purpose,  student  performance  is 
assessed  against  a  grade-level  -  ■ 
standard  rather  thkn  compared  with 
what  peers  liave  actually  learned. 
The  goal  is  to  set  proficiency  levels 
for  the  entire  school  system.  ^ 

Academic  Competence 

In  1977-78,  a  project  conducted  by 
ETS  Staff  in  Bcrkelay  tested  1,150 
College  students  io  four  areas  of 
academic  coinpetence  that  are 
usually  associated' with  general- 
education.  They  are  the  analytic, 
communicatidn^  and  synthesijsing 
skills,  and  cuhural  awareness. 

The  48-item  test,  developed  with 
the  help  of  faculty  members  at  15 
California  universities  and  colleges, 
called  far  bri^f,  free-response 
answers.  All  questions  Were  related 


.to  one  of  four  content  areas: 
mathematl^  and  natural  science, 
the  humanities  and  fine  artsj  the 
social  and  behavioral  sciences,  and 
political  science  ind  history.  Each 
of  tbe  cooperating  institutions 
employs  one  of  three  major 
approaches  to  structuring  the 
general  education  curriculum,  and 
the  study  is  expected  to  yield  data 
that  will  be  useful  in  evaluating  the 
relative  effectiveness  of  these 
approaches. 

More  Effective  Education 

Ouallty  and  effectiveness,  while 
clearly  Intertwined,  are  not 
syrionymous.  As  ers'uses  the  term, 
effectiveness  applies  to  such  aspects 
of  the  educational  enteri^ise  as 
productivity,  the.efficient  use  of 
resources,  and  the  equitable 
distribution  of  them  to  both  school 
systerns  and  students.  , 

One  example  is  the  application  of 
technological  advancements  to 
administrative  and  instructional 
needs.  What  computers  can  and 
cannot  do  in  the  classroom  is  a 
major  concern  of  a  number  of  its 
research  scientists. 

CAI  in  Los  Angeles 

ETS  researchers  completed,  during 
1977-78,  the  second  year  of  a  four* 
year  longitudinal  study  of  computer- 
assisted  instruction  (cAtj  in  Los 
Angeles  City  Schools,  with  support 
from  the  National  Institute  of 
Education.  Computer  terminals  are 
used  by  second,  fourth,  and  sixth- 
grade  students  in  four  schools,  to 
.  study  reading  and  mathematics. 
■  Participating-  students  are  being 
tested  tiefore  and  after  each  year's 
cAi  experience,  and  its  staff  observe 
each  fourth-grade  classroom— there 
are  about  25  of  them^five  times 
each  year.  Nonparticipating  classes 
are  monitored  for  purposes  of 
comparison. 

One  of  the  mos;  systematic  and 
long-tdb  studies  of  cm  ever 


uoderttkeitJHfhe  pi o{«ct  U  intended 
to  dctejrmine  how  valuible  in 
inttniclloDil  toQl  the  computer  c«a 
bc^and  why— «nd.  whether  Ut  use 
is  ccoooioiiully  feMible.  Hie  study 
will  contmue  through  1980.  , 

.  Pxogram  Evaluation 

One  wny  of  ifsessinif  the 
elfectiveness  of  education  is 
systematic  program  evaluation,  tod 
ITS  has  been  among  the  pioneers  in 
this  Held,  hs  evaluations  of  SeMme 
Stteet  and  The  Electric  dompaAy. 
as  well  as  several  progrjms  of  *^ 
computer>assisted  instruction,  have 
been  milestones  in  the  development 
of  these  forms  of  educational 
technology. 

£TS  research  scientists  also  design 
arid  ponduct  evaluations  of  programs 
in  bilingual  education,  reading 
instruction,  ct^reer  education,  and 
spccill  educiition.  ' 
.  In  1977-78,  for  the  Danforth 
Foundation,  staff  initiated  a  study 
that  will  synthesize  information, 
about  effective  techniques  fqr 
evaluating  progtams  in  moral 
education  Id  the  schools. 

School  Financing 

With  grants  from  the  Ford 
Foundation,  among  others,  the  ets 
Education  Policy  Research  institute. 
(EPiuj  cpnttnued  to  build  a  program 
of  research  into  state  methods  of 
financing  public  school  systems,  in 
1977-78,  a  major  study  was 
conducted  in  New  jersey,  where  a 
court  found 4o€al  school  financing 
practices  unconstitutional  and 
ordered  redistribution  of  funds  tp  . 
provide  a  "thorough  and  efficient" 
education  for  all  citizens. 

ETiu  also  examined  the  politics  of 
school  finance  reform  movements  in 
various  states,  including  Florida,  | 
.  Kansas,  Maine,  Michigan,  and* 
.  Minnesota.  At  the  end  of  1977-78, 
tpai  staff  Were  analyzing  the 
campaign  for  California  Proposition 
13  and  the  voting  patterns  that 
.produced  its  resounding  vfctory. 


ij|uinaii  Development 

A  primary  tbnist  oi  jrn  research 
over  the  years  baa  tteen  the  study  of 
cogniUve  styles,"tbe  differing  ways 
individuals  organbKjMid  process 
informaUon.  VVhillb[iuchx)f  this 
work  is  basic  reseanb,  practical 
applicadohs  to  the  teacbing*and-  ' 
learning  process  are  constantly 
sought.  For  e](#mple,  a  community 
college  s|udyindicat^^#t  teachers 
are  viewed  more  favoraRy^y 
students  whose  cognitive  styles  are 
similar  to  their  own. 

Many  other  aspects  of  human 
learning  and  developinent  are  also, 
being  studied*.  They  include  close 
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observation  of  infants  and  young 
children  to  discover  what  they  learn 
and  when,  how  family  structure 
affects  their  development,  the  ways 
they  acquire  language  skills,  and  the 
factors  that  influence  personality 
and  social  bchavibr.  . 

Learning  Sex  Roles 

In  1977-78,  a  research  team 
continued  to  examine  sex*role  '. 
stereotyping  among  youngsters  in 
the  New  York  City  public  schools 
under  a  grant  from  the  National . 
Institute  of  Mental  Health.  Their  ' 
-purpose  is  to  determine  whether^  in 
light  of  the  women's  movement, 
traditional  stereotypes  are 
disappearing. 

Results  of  another  study  seem  to 
show  that  they  are  not.  Based  on 
results  of  a  questionnaire  . 
administered  to  some  1,000  fourth 
and  fifth-grade  students  in  40 
centra^  New  |ersey  classrooms,  rt 
was  learned  that  a  majority  of  the 
boys— and  many  of  the  girls- 
believed  that,  while  intelligence  is 
not  sex  related,  leadership  is 
essenijially  the  prpvince  of  the  male. 
The  research  scientist  conducting 
the  study  is  now  working  with 
teachers  on  instructional  materials 
that  will  reduce  the  influence  of 
stereotypes. 

^Special  Populations 

Identifying  the  educational  needs  of 
various  population  grgups~racial 
minorities,  adults,  women,  the 
economically  disadvantaged,  the 
cuhurally.  different,  the  gifted,  the 
handicapi!^— claims  the  attention 
of  many  Etft  research 
scieni ists. Sever al  rnajor  projects  of 
this  sort  were  under  way  In 
1977-78.  Among  them: 
•  A  longitudinal  study  of  the 
cognitive  and  social  development . 
of  youBg  Mexican*  Americans. 
Focusing  on  the  effects  of  cultural 
and  linguistic  factors,  the 
research  team  is  studying  . 
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pretchoorcbltdren  in  their  homes 
and  will  t»ck  them  through  the 

^•rly  grades.  A  primary  purpose  is 
learn  whetber-^tnd  if  so, 

.   howthe  development  of  . 
bUingual  children  differs 
si^ificantl^  from  that  of  the 
monolingual  miiority. 

•  A  nationwide  survey  of  the 
continuing  education  needs  an^ 
interests  of  adults  and  the 
program  si  resources,  and  acr  vibes 
available  to  them  .  Directed  hi 
research  staff  at  the  Berkeley/ 
office,  the  pfoiect  will  result/in 
1979  publication  of  the  L//eZ()ng 
Learning  Souicebook  by  jossty- 
Bass,  inc.,  of  Sin  Franciscof 

A  study  to  determine  wbatJ factors 
encourage  and  discourage  firls 
from  studying  advanced  hilh 
school  mathemAtica  and  s^ence 
courses  that  are  estential  Stepping 
<  stones  to  careers  in  the  plysicaK 
i   sciences  and  engineertng-jThe 
'  critical  factors  were  found  to  be 
the  attitudes  and  bebaviol  of 
parents,  teachers,  attd  gu  dance 
counselors.  About  200  gl  Is 
.    participated  in  the  study  which 
Was  supported  by  the  Co  lege 


Board  and  the  National  Science 
Foundation. 

Exceptional  Children  - 

Under  «  five^year^ant  from  usoe's 
Bureau  of  Education  for  the 
Handicapped,  ets  established  the 
Institute  for  the  Study  of 
Exceptional  Childrcfrafsic),  one  of 
four  institutes  comprfl||^he 
national  Barly  Childho|B^earch 
Center.  The  others  ardloeited  at 
the  Universities  of  North  Carolina, 
Kansas,  and  California  at  Los 
Angeles.      '<  ^ 

The  new  institute  joins  the 
research  capabilities  of  the  m 
Infant  Laboratory  with  the  medical  ' 
expertise  of  the  pediatrics 
department  of  RQ68?velt  Hospital  in 
New  York  City/isEC  also  Works 
closely  with  tjh  Coalition  of 
Administrators  of  New  Jersey  Infant 
Programs,  an  umbrella  organization 
for  primary  care  programs  that  serve 
handicapped  |nd  at-risk  children 
around  the  state.  Thus,  the. institute 
crosses  thb  usual  boundaries  <^  ^ 
between  B]pecial  education,  ped*latric. 
medicine,  and  developmental  - 
pisychojogy. 

.  With  four  units^Dctectionj 


Research;  Intervention  and 
Bvaluitionj  and  Products,  pelivery^ 
and  TVainIng— isEc  focuses  on  early 
assessment  and  intervention  for  « 
handicapped  and  at-risk  children 
ranging  in  age  from  newborn  to 
three  years.  Workshops  and  training 
sessions  for  professionals  who  work  • 
with  thp  handicapped  will  be  offered 
.by  ISEC  at  ets.  ' 

Methodological  Research 

Underlying  all  ets  research,  testing, 
and  evalualion. activities  there  Is  a 
solid  foundation  of  methodological 
research.  Over  the  past  ^  years,  fqr 
example,  ETS  research  scientists 
have  been  at  the  forefront  In  thi 
development  and  application  of  . 
psychometric  theory.  Repeatedly, 
their  work  bas  contributed 
.significantly  to  the  refinement  of 
educational  measurements 

Currently,  a  team  of  research 
scientists  and  outside  consultants  is 
conducting  a  thorough  examination 
of  all  the  statistical  practices  bts  . 
uses  in  developing  and  validating 
tests.  The  purpose  is  to  assure  that 
the  organization's  sutisticat . 
methods  are  as^advanced  as  the 
state  of  the  art  allows.  ^  ■ 


Michael  Uwii.  dittttot,  Inttiiutk  fpithe 
Study  of  Bxctpiional  Children,  Uamines 
data  with  auistoftt  Mary  Katherfnt 
Hawryluk,  center,  apd  predociorai  feihw 
Laurie  Wafte,  \ 


Prtychologitt  lonathan  Warren  explains  a4:unent  prefect  to  BekheJey  colleagues 
(seated,  from  left)  Michael  Waish,  Ken  fobnsoa,  fuditb  Bdnneti  HIrabayashi. 
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Sta|[  &  Administration 


Snowstorms  closed  bts  Id  E^inceton 
twice  daring  th^  winter  o(  1977*78, 
forcing  staff  to  work  overtime  to  . 
meei  critical  deadlines  for  test 
registration,  scoring,  and  reporting.. 
The  unprecedented  closings  came 
during  a  year  marked  by  contini^ed 
j^b^Pth  in  many  programs,  increased 


'  Pat  MocCtabie.  ccmpeaaatioa  dinctor,' 
■  (U$cuf»$t  pmctduns  vfitb  ouUtant 
director  DoaaJd  Blckel. 


workload  and  productivity,  and 
extensive  review  and  evaluation  of 
activities  across  the  organization. 

In  the  contmuing  effort  to  be 
accountable  to  its  varioui 
constituencies,  ets  gave 
considerable  attention  to  controlling 
the  quality  of  iii  products  ond  the 
efficiency  of  its  prtKedures.  The 
major  thrust  of  these  endeavors  was 
a  systematic  audit  of  all  programs 
and  activities,  using  the  standards 
set  forth  in  the  Principles.  Pblicies, 
and  Procedural  Guidelines 
Regarding  ETS  Products  and 
Services,  adopted  the  previous  year. 

=  When  statistical  errors  were 
discovered  in  the  score  reports  for  a 
few  test  administrations,  £T$  moved 
swiftly  to  notify  the  affected 
students  and  institutions  and  to  ; 
issue  corrected  scores.  Procedures  ■ 
were  tightened  to  reduce  the  chance 
of  similar  occurrences  in  the  future^ 
The  organization  also  took  stebs  to  ' 
sharpen  its  test  security  measyres  ^ 
following  revelations  that  some  test* 
*  M<^s  bad  been  coached  with 
mater/tfts  including  actual  test 
items* 

Operations  e>  Pinanc^ 

Construction  of  an  extensive 
addition  to  Wood  Hall  on  the  main 
Princeton  site  was  r)earing 
completiop  at  the  close  of  1977-78. 
•It  was  designed  to  provide  office 
space  for  about  350  staff,  primarily 
engaged  in  student  financial  aid 
services,  who  previously  occupied 
leaded  offices  at  nearby  Research 

"thiring  the  year,  plans  were 
drawn  jfoc  tbe  continued  reftnem'ent 
and  expansion  of  ets'  technological 
capabilities.  New  computer^  were  to 
be  installed  later  in  1978,  and  / 
minicomtutets  were  adapted  to  a' 
variety  oflplerical  and  operational 
functions, including  the  prodtssing 
of  publicaqon  orders  and 


Dr.  Aane  Anatta$f.  a  pioaeer  in  the  field 
of  differential  psychology,  received  the  , 
eight^i  annual  its  Award  for 
Distinguithed  Service  to  Measurement  at 
the  J 977  Invitaiioaal  Conference  iii  New 
York.  Now  retired,  sfie  was  on  the 
Pordham  University  faculty. 


inventories,  and  of  general  office 
work. 

Financially,  1977-75  was  a 
satisfactory  year,  as  indicated  by  the 
report  of  (ftopers  di  Lybrand, 
certified  pmtlic  accountants,  and 
documented  in  the  supporting  ' 
financial  statements  (see  pogeis 
lM4j.  Given  the  continuing 
inflation  in  the  national  economy, 
and  the  growth  of  several  testing 
programs,  total  expensM  were  13.3 
percent  above  the  197677  level. 
Total  revenue  kept  piTce,  rising  13.7 
percent.  Tlie  excess  of  revenue  over 
expenditures  increased  from 
$901,022  in  1976-77  tp  $1,315,649 
in  1977-78 

In  its  fifth  year,  the  Hemy 
Chauncoy  Con^rence  Center 
continued  to  attract  educational 
meetings  and  seminars  from  across 
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the  ottioD  and  from  pther  countries. 
The  anoiul  Bilderber^  Meeting  drew 
more  tbtn  100  interDttional  figiuea 
to  the  center  for  informal 
discussions  of  global  trends  and 
issues  in  April  1978. 

R^miting  and  Promoting 

Equality  remai<led  a  primary  goal  of 
staff  recruitment  and  promotion 
practices  in  1977-78.  Under  its 
Affirmative  Action  com{^Uance 
progfams,  ETs  continued. to 
em^asi^  fairness  in  the  hiring  and 
advancement  of  employees, 
particularly  women,  minority  fioup 
-members,  the  handicapped,  and 
Vietnam-era  veterans.  The  \ 
organization  exceeded  national  Ubor 
force  participation  rates  for  womln 
and  minorities  in  the  official s-an*^  ^ 
managers  category,  and  for  women 
in  the  professionals  category. . 

During  the  year,  supervisors 
participated  in  a  series  of  wt^rksbops 
aimed  at  familiarlz^  them*  with 
the  BTS  Equal  Employment 
Opportunity  policy  and  Affirmative 
Action  programs.  Specif  attention 
was  devoted  to  the  legal 
backgrounds  of  the  programs  and' 
^idelipes  for  compliance: 

Staff  Development 

Education  and  training  programs  for 
ITS  grew  more  numerous  and 
diversified  in  1977-78.  A  great 
variety  of  seminars  were  offered, 
featurifig  guest  speakers  on  Issues 
and  trends  in  education, 
measurement,  and  human 
development.  Data  processing  staff 
in  Princeton' presented  a  wide  range 
of  courses,  some  developed  inhouse 
and  some  purchased  in  ^ckage 
form,  to  employees  acrou  the 
orpnization. 

At  the.same  time,  three 
postsecondary  institutions— Mercer 
County  Community  College, 
IVen  ton  State  College,  and  Rutgers 
University— offered  aedit  courses  to 
staff  at  the  Rosedale  Road  site  in 
Princeton. 
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Some  Current  ETS  Publications 


fft-  • 

^Periodicals 

.  CATC  Digeit,  a  qutitaly  newsletter 
for  persons 'ii|terested  in  coroputer- 
MSisted  teat  instruction. 

BTS  Developments,  a  quarterly  ' 
newsletter  about  Bts  meaaurement, 
research,  and  related  activities  o| 
general  interest. 

Pindmgi,  a  semiannual  report  of  its 
research  In  posisecondary 
education. 

Iniematlonal  Newsktter,  a  vehicle  . 
for  the  exchange  of  measurement 
information  from  varlov^  couotriei, 
published  semiannually. 

Selected  Reports 

A  Guide  to  ETS  AcUvitlef  Related 
to  Minority  and  Dtsadvamaged 
Groups,  1970-77,  a  compendium 
prepared  by  Audre  Griffiths  and 
John  A.  Wintetbottom  and  . 
published  by  tbe^vrr^lnce  lor 
.Minority  EdM^Stion. 

Children  of  Poverty:  Overcoming 
.the  Barriers,  an  eigbt>page  summary 
'o(  a  report  by  Virginia  C.  Shipman 
od  the  socjal  and  educational  factors 
diat  are  characteristic  of  low-  and 
high-achieving  disadvantaged  ' 
chiloreo,  part  of  the  rr&^liead  Start 
Longitudinal  Study. 


*CoUege  Achievement  Thtough  Self' 
Help  by  Luis  Nievea,  a  manual' 
designed  to  help  minority  students 
cope  with  the  special  problems  they, 
face  in  adapting  to  campus  life. 

Coping  o^Campus:  The  Problems 
of  Minoriq^ollege  Students,  an 
eightrpage  skimary  of  the  reaults  of 
a  study  conducted  by  the  tn  Office 
for  Minority  Education  for  the 
Graduate  Record  Bxaminations 
Bfoard. 

'Educational  Measurement  and  the 
Law,  proceedings  of  the  1977  m. 
Invitational  Conference. 


Focus:  Learning  to  Read,  fourth  in  a 
series  of  occasional  papers  about, 
current  issues  and  problems  in 
.education  and  measurement  and 
related  Work  at  bts. 

Pocus:  The  Concern  for  Writing, 
fifth  in'the  series. 

•How  7b  Get  College  Credit  for 
.  What  You  Have  Learned  as  a 
Homemaker  and  Volunteer  by  Ruth 
B.  Ekstrom,  Abigail  M.  Harris,  an< 
Marlaine  E.  Lockheed,  a  guide  for 
women  who  plan  to  enter  or  return 
to  college  and  seek  credit  for  prior 
learning. 

Money  and  Education:  Where  Did 
the  400  Million  Dollars  Got  by 
Margaret  Goertz,  report  of  a  study 
of  school  finance  reform  in  New 
lersey^  conducted,  by  the  ets 
Education  Policy  Re^arch  Institute. 


Public  InfOvmatlQii 
Brochures 

About  ETS.  a  brief  overview  of  eti 
activities  in  testing,  meaiiuremept, 
related  services,  and  educational 
research. 

Assessing  Occupational 
Competence,  a  description  of  the 
programs  and  procedures  of  the  ers 
Center  for  Occupational  and 
Professional  Assessment  |copa|. 

£75  in  Pact..  1979,  a  collection  oj 
facts  and  figures  about  ets  testing 
programs,  services,  research, 
finances,  and  regional  offices. 

firs  International  Activities,  a  brief 
survey  of  &ts  programs  and  proiects 
involving  agencies,  institutions,  and  N 
individuals  of  other  nations. 

Etshubllcations,.l979,  a  catalog  of 
current  publications  including, 
research  reports  and  testing  program 
materials,  with  form  and 
instructions  for  ordering. 
Keeping  Up,  a  folder  containing  a 
catalog  of  ITS  Plograms  of  ^ 
Continuing  Education  and  a  booklet  ' 
detailing  available  instructional 
services. 


'There  ki  «  Chvgt  ^ot  e«ch  publication  riuikcd 
with  «o  titeflllb  To  order  publiiitiotit  or 
obtiln  «ddUtOQ«l  tntorraukm  «bout  them, 
ple«K  eooiftct  ib«  lofoimirtoo  OlvlAoo.  in, 
Princeton,  ni  01541}  609-911  •9O0p. 
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A  Flrtial  List  of  ETS  Clients^  1977-78 


alAaC 


alTIIA  Center  lor  Hcilth  Pltnqing 
Albright  College,  PeiuiiylvtnU 
.  Amerluo  Attembly  iOV  Collegiate 
Schooli  ol  Buslnetf  ' 
AmerfcM  Atsoclttton  of  Colleges  of 

Pharmacy 
J&nericin  AMOclttion  of  Colleges  of 

PodUttk  Medicine 
AMericA  Atloclttlon  of  'Drtcberi  of 
French 

Americsn  Atfoclatlon  of  'n;acbers  of 

German 
American  Bankers  Association 
.  American  Board  of  Obstetrics  and 

•Gynecology  , 
American  Council  on  Bducatioo 
American  Federation  of  'Drachers 
American  Foundation  for  Negro  . 

Affalri 

American  Institute  of  Planners 
American  Institutes  for  Research 
American  foumal  ol  Nursing 

Company 
American  Nutks'  Association 
American  Pharmaceutical 

Association 
■    American  Production  and  Inventory 

Control  Society 
American  Psychiatric  Association 
American  Registry  of  Radiologic 

Technologists 
■  American  Speech  and  Hearing 

Foundation 
ApptleA  Data  Research,  Incorporated 
Arabian-American  Oil  Company 

Education  [Apartment 
Asia  Foundation  i 
'  Asioclatlon  of  American  radical* 

CoHegea  1 
Association  of  Collegiate  ScOools  of 

Architect uit  <  ■ 
Atlanta  Area  Association  of 

Independent  Schools,  Georgia 

Bank  of  Canada 

' .  Bermuda  Pepartment  of  Education 
Bermuda  Finance  Departme&t 
Bilingual  Education  Services  Center 
Blomedla,  Incorporated 
Borough  of  Manhattan  Community 
College,  New  York 


Boston  Public  Schools, 

MassachiiMtts:. 
Bropkline  Public  ScboolSj 

Massachusetts  . 

CAU,  Incorporated 

California  State  Universities  and 

CoHeges 
Caribbean  Examinations  Council 
Carnegie  Corj>dration  of  New  Vprk 
Carnegie  Council  on  Policy  Studies 

In  Higher  Education 
\  Cariiegle-Melloo  Uhlverilty 
Charles  County  Community . 

College,  Maryland 
Chicago  Educational  'Dilevlslon 

Association  (WTTW) 
City  of  Atlanta 
City  of  Chicago 
Cit](^f  New  York 
City  of  Philadelphia 
College  Entrance  Examination 

Board , 

College  of  Charleston,  South 
.  Carolina 

.  College  of  Medicine  and  Dentistry 

of  New  Jersey 
Commlision  on  Graduates  of 

Foreign  Nursing  Schools 
Committee  of  Bar  Examiners,  State  ■ 

of  California 
Consumers  Union 
Council  of  Graduate  Schools  lii^the. 

United  States 
Cpunciloa Legal  Education  for 

Profeiiional  Responsibility, 

Incono/ated  '. 
Crergbwn  University.  Nebraska 

Danforth  Foundation 
Departmeats  or  agcnctea  ol  the 
followUg  sutca  or  commoowealtbsi 
Alatiu  Kansas 

Cslifomis  Kentucky 
Colotido  Louisiini 
Connecticut  Maine 
Dclawsre  Marylaod 
DiJtti^t  of  Columbis  Massacbusctis 
Florida  Mtchtgjn 
wU  Missouri 
Wtii  '  ■  Montani 

boil  \  Nebraska 

diaos.  Nevjdj 
towa  New  Haqipshlfc 


New  lerwy 
New  Ypik 
North  Carolina 
North  Dakota 
OrcKon 
PenniyWanla 
South  CaioUna 


De  Pauw  University,  Indiana  ^  / 
Development  and  Resources  *  /  . 
Corporation  / 

Eastman  Kodak  Company  / 
Educational  Commission  fdrTorelgn 

Medical  Graduates 
Questional  Records  Bureau 
fcXXON  Foundation 

Fairfax  School  DU^rlct,  California 
Fayetieville  State  Qntverslty, 

North  Carolina  /  ' 
Flint  Comi;nunlty/Schools,  Michigan 
Florld^funlor  Cdllegejst 

fackiionvllle  /  < 
Ford  Foundation 

Freehold  Regilonal  High  School  . 
District,  New  lersey 

Garvey  School  District,  Callfbrnla 
Gbvernifient  of  IVlnldad  and  Ibbago 
Graduate  Management  Admission  -  ^ 

Council 
Graduate  Record  Examinations 

Bosrd 

Grant  Foundation  .  ^ 

High/Scope  EdUcatipnal  Research 

Foundation 
Hospital  Financial  Management 

Assoclatipn 

Institute  Tecnol6gico  y  de  Estudlos 

^uperlores  de  Monterrey 
International  Business  Machines 

Corporation 
International  tVansactlonsl  Analysis 
.  Association' 

lapari-Unlted  States  Friendship 

Commission 
|ers<y  City  Public  Schools,  New 

iJrsey 

fohiu  Hopkins  University 
lAlaH  Macy  Foundation  j 

Kern  Union  High  School  District,  / 
Kern  County,  California 
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Law  Scbodt  Admlulon  Council 
Lilly  Endow  meat  . 
Ltnfleld  CoHese.  Oreson 
LlvUigttone  .Collese,  North  Caroliiia 
Lompoc  Unified  School  District,  ^ 

Cillffl^ia 
Lof  Ah^e(s  County,  California 
Los  Anselea  Uniiied  School  District. 

Mercer  County  Community 
College,  New  jersey 


National- Aatociation  of  Boards  of 

Phtrmacy 
Natloiiil  Association  qf  Housing  and 

Redevelopment  OfiiciaU 
National  Association  of  Independent 

Schools 

National  Association  of  Secondary 

School  Principals 
National  Association  of  Social 

Workers  . 
National  Board  for  Respiratory 

Therapy  ' 
National^  Board  of  PtiUiatry 

^uminera 
National  Business  Forms* 

Aasociation 
•National  Catholic  Education 

Association. 
National  Conference  of  Bar 

EzMnera 
National  Council  of  Architectural  . 

Registratiop  Boards 
National  Council  of  Engineering 

Exam^ets^ 
National  Furniture  Warehouseman's 

Association 
.  Natiood  Inshtute  for  Automotive 

Servile  ^c^llence 
National  Metit  Scholarship 

Coflporation 
Newark  School  District,  DelawarcT 
Newark  Bo«rd  of  Education,  New 

New  Jersey  .School  Boarda 

AWociation 
New  York  Stock  Exchange 
Northeastern.  University « 

Massachusetts. 
Nocwalk  Board  Ji  Education, 
'  Connecticut 

^  Opticians  Association  of  America 


Oxnard  Union  High  School  District, 
California 

■  • 

fAa- Institute,  Incorporated 
Pasadena'Unified'Scliool  District, 

California 
Pompton  Lakes  Board  of  Education, 

New  jersey 
Princeton  University,  kew  jersey 
Professional  Golfers'  Asociation  of 

America  m 
Province  of  New  Brunsn^k,  Canada 
Province  of  Nova  $cotia,  Canada  *  • 

Radio  Corporation  of  America 
Robert  Woodjohnson  Foundation 
Rockefeller  Family  Fund 
Rutgers,  The  State  University, 
New  Jersey 

Santa  Monica  Unified  School 

District,  CalUomia 
School  District  of  Philadelphia, 
,  Pennsylvania  , 
Scientific  Ameriq|j|i^  . 
Secondary  School  Admission  JtM 

Board 

Secondary  School  Research  Program 
Society  of  Actuaries 
Southeastern  Tidewater  Area 
Manpdwer  Authority 

Texas  Education  Agency 
TVenton  State  College,  New  jersey 

Union  College,  New  jersey 
United  States  departments  and 
■gCBcicat 

.ACTION 

Peace  Corps 
Civil  Service  Commission 
Council  on  Environmental 

Quality 
Depariment  of  Defense 
Department  of  the  Army 
Army  Research  Institute  for 
the  Behavioral  and  Social 
-  Sciences 
Army  aorc 

DelenM  Advance  Research 
Proiects  Agency 
Department  of  the  Air  Force 

Air  Force  aoTC  ^ 
Department  of  the  Navy 


Defense  Activity  for 
Non traditional  Education 
Support 
*  Marine  Corps 
Office  of  General  Counsel , 
National  Security  Agency 
Department  of  Health,  Education 
and  Welfare 
Office  of  the  Assistant 
Secrcury  for  Education 
Fund  for  the  Improvement  of 

PostMcondlary  Education 
Office  of  Education  . 
National  Institute  of 
Education 
Office  of  Human  Development 
Public  Health  Service 
Health  Resources 
Administration 
National  Institutes  pf  Health  . 
Department  of  Labor 
I    Employment  and  IVaining 
Administration 
Department  of  State 
Ageiicy  for  International 

Development 
Board  of  Examiners  of  the 
Foreign  Service  | 
•  Department  of  1Vansportati(jf 
Coast  Guard  J  A 
Environmental  Protect KmMgency 
.International  Communlcauon 

Agency  ^ 
National  Endowment  for  the 

Humanities  ' 
National  Science  Foundation 
.  National  Security  Council 
Central  Intelligence  AgenCy- 

Uplted  States  District  Court  for  the 

Northern  District  of 'n;xas,  Dallas 

Division  « 
University  ^  Cnifornla  Center  for 
.   Research  (9  Developi^nt  in 

Higher  Education 
University  of  London 
University  of  Maryland 
University  of  Southern  California, 

School  of  Medicine 
Uniworld  Croup,  Incorporated 

Whitman  College,  Washington 
World  University^erto  Kico 
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Boaid  o(1]rili8teei 


Alkcit  K  WkHhi,  Cluitwkm 
\ChuiceUor,  North  C«roIioa  Central 
\univ«fiUy 

Deaa/^riduatt  School  of 
|ouraaH|m,  Columbia  Uoivcrilty 

.  M.  Am  Ca^i^U 

ComrolMloQerV  Education,  State 
ol  Nehraika 

HwUm  T,  Dakjr 
Career  Education  SpeclaHit,  Board 
of  Education  o(  Baltlmoo^County 

J«ka  W/HcaMfMf,  ft. 
Profeasor  ol  Maoafcment,  The 
•  Amot  Ibck  School  of  Buaineai 

AdminlitratloD,  Dartmouth 

CbUege 

WajTM  H.  Holunaa 

-  Prealdent,  Hogs  Foundation  for 
Mental  Health,  and  Profeaior  ol 
PaychoIo|y  and  Education,  The 
Unlveriity  of  l^iaa  at  Auatln 

'ClatfclUrr 

Chairman  and  Staff  Director; 
Gamesle  Council  on  Policy 
Studiea  In  lllther  Education 

C.  reter  Macraih 

Prealdeot,  Unlyerilty  of  Minnesota 

Preai(%it,  The  College  Board 

Peitff  Maitko,  |f .     '  . 
Prealdent,  Miaml*Dade  Community 
College 

Gcfftrvde  G.  MIclwUaiB 

Senior  Vice  Prealdent.  Macy's  New^ 
York 

ClMrica  D.  O'CowilU.  |c. 
Vice  Preaideot  and  DeaA  of 

Students,  The  Unlverti^y  of 

Chicago 

lack  W.  Pfltaa4M 

Prea^Sent,  American  Council  on 
;  Education 


VlitlBto  K  Smith 
Presldeot,  Vaaaar  College 

SieplMK  H.  Sfurt 

Profeaaor,  Lyndon  B.  Johnson  School 
of  Publlo  Affalra,  The  University 
of  Ibxu  at  Austin 

wmiaa  W.  IWiakvll 

President,  Educational  lasting 
Service 


Executive  Committee. 

SiefhcK  H.  Spun,  Chairman 
Elk  Abel 

loha  W.  HewMtacf ,  |r. 
Wayac  H.  Holtsnaa. 

^Charlea  D*  O'Coonell;  fr. 

W.  T^nM 
Albc>t^.  WUtiag 

Fintncc  CIpmmittee 

Mm  W.  Hcuca^,  |r.,  Cbainnan 

Kvtt  M.  HcrtifcM 
IVeasurer,  Amherst  Cdl^t 

Nter  Maalko,  |r. 

Gcttnidc  G.  Mkkclsoo 

SteflKB  H.  Sfiin 

^WlUiam  W.  tWmhoU 


Audit  Committee 

folui  W.  Hi nacaacy,  ft..  Chairman 
Gcttnide  G.  Mkbelsoo 
Stephen  H.  Sparr 

Committee  on  Research 
and  Development 

Wayne  H.  Holtxman,  Chairman 
Thclrna  T.  Oaky 
Bobett  GUacr 

Co-dixector,  Learning ^Jlesearch  and 
Dcvelopttient  Center,  University 
of  Pittsburgh 

PUUp  W.  lackaoo 

Chairman,  Department  of 
Education,  The  University  of 
Chicago 

Chrialine  McGnkc 

Associate  Director  for  Research  and 

Development,  Center  for 
'  ^ucational  Development, 

College  of  Medicine,  University 

0^  Illinois 

WUbcttl.  McKcachk 
Profeasor  of  Psychology,  University  - 
of  Michigan 

SUterloel  Read 
Preaiclent,  Alvemo  College 

I  Rkhard  E.  Scli«li 

Executive  Director,  Southwest 
Regional  Laboratory  for 
Educational  Reaearch  and 

iment 

B.  Smith 
^  Ibraball 
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Ptcsident 

Wnriim  W.  TbrnbuU 

Executive  Vice  Piresident 

Robert  J.  .  Solomon 

Senior  Vice  Presidents 

"ScirvU  B.  Anderson  • 
David  I .  Brodsky 
Winton  H  Manning 
^.  Belvin  Williams 


Vice  Presidents 

Ki<;hird  L.  Bums 
labk  R  Childress 
Marion  C.  Epstein, 
lohn  Helmick 
Samuel  |.  Messick' 
Robeu  E.  Smith 
Bernaid  L.  Tbhorni 

'Treasurer  / 

Donald  S,  Gtant 

General  Counsel 

lohn^S.  Kramer 


Secretary 

lane  D.  Wirsig 

Assistant  Vice  Presidents 

L.  Lynnwood  Arts 

Anio'inelte  M.  Orsi  * 

Assistant  General  Counsels 

Russell  W.  Martin,  Ir. 
Stanford  H.  von-Mayrhauser 

Assistant  llreasurer  and 
Controller 

Frank  R.  Henderson. 


Regional  Offices 

Midwestern  Efcgion 

.  f 

1  Americafi  Plaza  .  : 

Evanston.  ti  60201  - 

Northeastern  Region 

md'Mhntic  Office 
Rosedale  Road 
Princeton,  Ni  08541 

New  Bttgtand  Office 
1  Sun  Life  Executive  Park 
ItX)  Worcester  Road  • 
Wellesley  Hills,  ma  02181 

Southern  Region 

Suite  1040 
.  3445  P'eachiree  Road,  m 
.  Atlanta,  CA  30326  * 


Southwestern  Region  . . 

Suiic  100,  Southwtst  tower 
211  East  Seventh  Street 
Austin,  tx  78701 

Western  Region 

Beikeley  Office 
1947  Center  Street 
Berkeley,  ca  94704 

Los  Angelis  Office 

Room  216,  2700  Merton  Avenue 

Los  Angeles,  CA  90041 

Puerto  Rico 

Suite  1 1 15,  .Banco  Popular 
209.MuAoz  Rivera  Avenue 
Hato  Rey,  pk  00918 


Washington  Office 

Suite  300 

1800  Massachusetts  Avenue,  nw 
Wasbin«ton>  DC  20036 


......  ■       ■■    237.  ■„ 

,    .  EDUCATIONAL     TSSJINC  SgRV^icS 

Finances. .  .Vhere  che  Money  Gaines  rran  and.Vthere  Ic  Coe» 

''  '  f 

Educational  Testtr.g  S«rvic*  Is  a  nonprofi:  organization  chat  providei  tll^^llng^ 
•financial  aid  and'  transcript  services  to  «.tudent3  and  institutions;  -conducts 
research  and  dev«lcpnenc  in  adu"ca:ionii  aeasureoent;  and  provides  advisory  and 
-♦^*^^<^cicnal  ser.'ices  in  the  proper  uses  of  aeasureeent.    In  :he  fiscal  vear 
endinj  June  30,  i97.9,  ETS  earned  income  of  $9^  million  on  e:cpenses  of  $93* million, 
result*ngVin  net  revenues  of  - just  over  $1  million— or  1.23;  of  expenses... 

Incjope  *_,  •■.  '  «     *  . 

.    ^  ■  ■  sj 

Most  of  ETS'  income— cldTTTO.  S'85  million,,  or  90!:— cW  from  the  ser^/ices' th^  J 
it  provides  in  conducting  program  ^ervices  for  various  test  sponsqrs,  e.g.  the 
Co-l«g«  3oard,    These  servlcerf"  include,  developing  cesci,  printing  and 
distributing  rhe  cesta^edministerihg  chem  to  aver  "  million  individuals 
annually  chroughou^^^g^vorld^  scoring  the  tests  and  reporting  those  scores 
to  test* takers  and  institutions.    To  ensure  test- quality,  ETS  4I50  conducts 
■stftistical  analyses  and  .rese4rch  on  test  results  and  publishes  extensive  . 
ini^rsation  about  the  pxoper  uses  of  tests  and  test  Scores.  ' 

Mcs:  casrir.g  prqgrans  are  car.duc.red  .by  ETS  -n<i*r  contract  vith  client  groups 
who  2ak2  policy  decisions:    vhat  si:ills  and  kncwlfclge  vlll  be  measured,  how 
•often  tests  vill  be  offered  and  how  much  they  will\cost  the  test  taker.  l'8UAl^.y, 
.  the- client  r«i3(burses  ETS  for  its  costs  *nd  pays  a 'ser/ice  charge  out  of  teft 
fees,  keeping  th?  ^:;i?;ainder  for  .its  own  activities. 

*  ■   v  . .  .  ■ 

In  1973^7$,  about  53*  of  program  income  cac<S  from  Collfege  3oerd  programs: 
approxiiiately  19tl  cane  f row;. graduate  and  prof essionai  .schcol  programs,  e.g. 
the  Graduate  Record  Ixaminat ion  and  the  Law  School  .Admissions  Test;'ianother  ■ 
13*  came. from  the  testing  p:  teachers  and  other  professionals  and' th«  resiaining 
15^  from  other  testing  activities  at  various  educational  levels  (Attachaetit  A}.  ^ 
•0.  this  last  amount,  approxljiately  $500,000  or  well  under  IX  of  total  program  * 
.•income  vai  received  for  the  sa>a  of  published  tests,'  e.g.  Cooperative  Tmc». 

under  its  Charter  and  By-Laws,  in  additi.pn  to  providing  services  for  tesCing 
programs;  ETS  is  mandated  -to  conduct  research  in  measurement,  develop  new 
seir\'icei. . ,  .'.'in  the  field  of  tests        measurement'-',  "promote  the  understanding 
3^. . .edycational  measurement",  "counsel  .test  users  on  thj^  technicues  of 
measurer]«nt",  "undertake ...  advisory  services"  and  "serve... as  a /clearinghouse 
o:  infcrr^tion  jibcut  resear;h".    .Thus,  in  addition       specific  f^search  ^ 
tsr.ducted  for  testing  ;Jrograns,  ^ET?  conducts  1  broad  program  of  research  and 
development  ^n  measurement  and  provides  advisory,  consnltlng  mn^  'Inttructional 
services..    .       >  ^  .  .'  J 

In  irS.79  nearly  S9  million,  or  just  over  S:  of  ITS'  total  income,  was  lece^ved  ' ■■ 
rroc  otitside  sources  in  support  'of  these  acti'rities.  Appro^tlaately  three-quirters  ■ 
az  amount  ?:ame  from  projects  conducted  .for  |ovemcenty-scate,  federal  and  . 
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local  agtnclti,  tbo(ic  16%.  from  conduccl;ig  sptclfic  prograa  rcstar'ch  and 
providing  adviet  Co  tchoolf  and  eolltgtt  and  cht  rtaainder  from  sci^ts 
and  aeclvldts  fundtd  by  foundmclona*    Mora  than  10,000  resaarch  raporcs 
wara  diatribucad  laic  yaar.  , 

•Maarly  SlH  Qllllon  In  Inaootr.  lUghdy  ovar  IH^  ot  ch#  cocal,  cana  from'ochar 
•lourcaa^prlaarlly  froo  faas  chargad  co  usars  of  cha  Sanry  Chauhcay  Confartnea 
Cancar  and  frOn  racurni  on  Invaicaanc  in  aarktcabla  sacuricilis.    CSaa  Audlcad 
Sta.ctoanc  of  Ravanua- and  Zxpandituras ,  Actachaanc  3.) 


&xpan»aa       .  ■"  .  - 

In  cha  fiscal  yaar  andad  lasc  Juna^  K?S'  cocal  expanses  amounted  co  $93  million. 
Not  surprisingly,  che  great  majority  of  these  expenses,  83%,  were  devoted  co' 
providing  prograoa  and  services  f or '^ra  than  300  separate  cliencs.    Over  1*5% 
was  spent  ifor  programs  of  research,  developmenc  and  ^dvisory  acd  instnictional 
activities.    Less  than  2%  of  axpenae^vare  devoced  to  operating  the  Conference 
Cen^r..  .         .  .  '  ^ 

.     ■  # 

On  a  fucc clonal  b^sis,  clgsa  to  $^9  million  or  53%  of  £TS'  expenses  were 
devoted  to  salaries,- vagas  and  fringe  benefits.    Of  this  amount  S*0  □llllon 
vas  for  •Che  salaries  and  wages  of  the  2300^  pananent  staff  members  and  f cr 
the  payroll  of  the  temporary  sta(|  which  exceeded  llOO  people  at  peak  tiqe; — 
X equivalent  in  hours^worked  to  about  630  full-time  asployaes.    Average  salary 
for  the  total  staff. was  approxizataly  313,600  compared  to  about  313,600 
ierivad  from  the  Bureau  of  the  Census'  .Statistical  Abstract  vhith  reports 
incbae'  of  all  wage  earners  nationwide.  ■> 

XZS  salMles  are  comparable  co  salaries  established  for  jobs  requiring  skills  ■ 
.'oand  talents  jlmilar  to  those  needed  in  ITS'  work.  For  exampl4,  the  salaries 
'"<Sf  ETS  professlcnal  research  staff  are  compared  vlth  .those  of  people  ccnductlr.g. 
slmilax^  work  in  universities  and  research  Institutions;  salaries  of  da^ 
processing  staff,  prograq  managers,  administrators,  secretaries  and  q^^ical 
staff  ar.e  compared  with  those  of  their  counterpart^  in  other  institutions  and 
•organizations.    (See  Attachment  C.)    The  £TS  President '^i  .salary  of  S88,C00 
is  ccmparable-.to  the  sajLsr^s  of  chief;  executive  officers  of  majots|ducatlonal 
fit^t^itutions,-  nonprofit  organizations  (includini  researc?(sLlnstitutes' and 
foundations)  and  other  service  organizations  of  siallar  size. 

Th#  rest  of  ETS'  major  expenses,  in  order  of  size  are;    about  $10  million  to 
pay  #ooe  58,000  test  adainistritors,  essay  eacamination  readers,  question 
writers  and  other  professional  consultants. wio  help  In  ETS*  work;  ETS' 
printing  bill— nearly  39  million— for  test  booklets,  answer  sheets  and 
pub.lisaed  interpretative  ^terials  and  reports  sent  out  lasc  veer;  about 
^7  aillion  s;>est  on^the  freight  and  pos case  for  sendini  and  rie.-rv^no  r-u 
aacerials;  $U 


printing  bill— nearly  39  million— for  tesc  booklets,  answer  sheets  and 
pub.lisaed  interpretative  ^terials  and  reports  sent  out  lasc  veer;  abou- 
^7  aillion  s;>est  on^^the  freight  and  postage  for  sending  and  receiving  Chcse 
aacerials;       million  paid  for  computer  retvcal  and  ser/ice*;  i2  million  for 
dep^eciac^on^^on  buildings  and  owned  equipment;  $1W  zillion  fcr  the  expenses 
Of  utilities  and  property  taxes  and  e  celephone  bili;;Tf-*bouc  $14  oiiilon 
touch  of  which  arises  from. informing  and  responding  tc' inquiries  from  students 
and  inssiCutions.    These  represent,  90?2  of  ZtS'  tests.    Thalenainlng  opera-ng 
end  adr^nistrati^^e  ccpensas-t^ie  cosJts  of  bocks,  supplies^  professional  trivel ' 
and  tne  like,  are  enuafrated  in  hundreds  cf  irdividuai  accounts  too  extensive 
co.'lisr  here.  .  * 
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■ETS  n«c  r*v«au4ii,  i.e.  che  cxctss  d£  IncodL  ever' expenses «  anouncW  co  U.l 
alUtdn.tn  1978-7^9—1.21;  of  tx?tt>sef..       /  ,      "    \  . 

la  order  ctf  help  lupporc  Ics  ocber  charter-aandAced  acclvltl<s?«nd  co  provide 
•funds,  for-  Che  plaac.and  equlpoenc  needed  to  carr>*  on  lt«  vork,  ETS  charjes  a 

■  fee  be^oad  ci^zt  co  Its  prograa  cllencs  as  well  es  for  iome  of  ic<  coacracc 
^*''#raseatca.    Fees  are  aegotiated  Indepeadeady  vich  eich  pf  Its  dleacs  aad.  la 

"each  9f  its  coattaccs,  biic  chey  have  cpaslsceacly  averaged  be cveen  9  aad  105 
of  "orogrea  ex^eases  la  che  last  tea  years.    Of  chose  program  fees,  which 
eaciiated  ia  cocal  co  S7h  ijiillioa  id  1978-79,  aearlv  35X,  .or  about  $6.3  aillioa 
(ia  >*ddicion  :c  over  $7 .8' aiillioa  in  oucside.  fuads)  was  used  co  support  research, 
'  developceat  aad  advisor/,  ead  iastrucdonal  services  lasc  year.    The  ochet  15Z 
;  ■  of  program  fees-r-i-s.  che. $1.1  oillloa  ia  aec  reveftu^s— was  used  for  additloas 
CO  operating  b.u^ldi^igs,  capital'  aquipmeat  aad  workiag 'capital:    .  • 

Met  .Assets  ■ 

.    At  the  end  of  flscil  year  1973-79  ETS  had  aet  assets,  or  a  ?uad  Balaace,  of  ■ 

•aearlv  S28  aillion.    This  represents  the  total  anouat  of  capical  contributed  Co 
•    -  HTS  a:  its  rour.ding  Cabouc  51^  million)  plus  the  accuaulacec  .nee  revenues  from 
^^31  vears  of  opcrat;ioa.  .  (Sce»  Audited  Balaace  S'r.eec Accachmeat  D.) 
Cf  :hia  aaou.-.:,  about  $2SH  siillioa,  or  95^  was  put  back  Into  property,  plant, 
furniture  ar.d  equipoenc.    Mos:  of  :his  "reinvescaenc"  occurred  after  the  mid-50s 
vhen  :he  surge  of  post-war  students  sought  adsilsslcn  to  iasxl  tut  ions  of  higher 
education  ar.c  £75  vas  pressed  to  sftr/e  rhe=  wlch  ao*  anzlcuattd  plant  scattered 
Ir.  =ore  tr.aa  a  half-dozen  locations  ia  :he  .downtouT.  ?riace;sn  area. 

■     In  1955  ETS  bought  365  acres  of  fanalar^  (at  approxinataly.  S700.  an  acre)  just  ^ 
outside  Priacetoa  aad  in  1958  completed  ccostruetioa  of  the  first  cf  a  set  of 
builclngs  thac  vere  the  base  of  ics  present  aoderr,  and  efficieni  plant.  The 
iTS  plant  r.ow  canprifies  soae  ten  buildings,  used  for  offices,  research,  clerical 
aad  ccn:pu:er  operations  and  shipping  and  warehousing .    All  buildings  were 
constructed  after  being  competitively  bid  and  itS*  anrioal  cctupaacy  rate  at 
$7  fer  square  foct— including  depreciation utilities ,  maintenance  aad  the  real 
estate  taxes  that  it  .pays-f-coopiiTes  very  favorably  with  office  and  operating 

■  facilities  costs  in  the  region.  .  • 

The  Hear:/  Chauncey  Conference  Center,  first  opened  in  August  of  1973,  was 

■  bull:  10  house  the  hundreds  cf  .  people  'jho  come  tc  Priacetoa  to  work  with  TTS  • 
ann-^lly  on  t^st  developaent  tconiittees  and  prograc  council^  ,*»as  . well  as  . 
educators  and  consultants  who  advise  ZTTS  on  its  progra:^  of  aeasurement  acd 
res-^rcn.    Tr.e  Center  vas  also  created  to  serve  as  a  base  fcr  ITS'  prograxs 

o:  instruction  ar.d  bo  hous*.  the  sar.y  foreign  visitors  and  students  whc  cose 
'  to  rrs  to  learn  about  =eas-^retient  thaor/.  and  practite.'    It  is  a  popu;ar  sice 
."for  ether  educational  groups  and  provides  a  place  for  the  exchange  of  probless  .- 

and  ideas  for  the  iaprov«aent  of  the  educatioaal  procesa-. 

Trom.  the  begirxiag  of  the  project  it  was  recognized  that  ia  qrder  to  operate 
such.a  facility  without  iaposiag  a  fiaanc/ial.  burden  oa  the  rest  cf  STS^    '  ■ 
accivities,  ic* would  be  aedessary  co  accomnodata  outside  groups  uatil  ETS' 
ovn  growiag  needs  reachjpi  »  level  to  sustaia  l^e  .  Center  economically ...  Thus , 
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iz        concluded  chac  .i  nulci-purpose  educacipnal.  ccnc'er  wich  facillcies 
adequate  to  aCCracc  .=any  groups,  Including  actraptlve  rccrcaclDnal  facillslcs 

•  cypically  found  at  »con:f rence  cencer*,  wolild  aaed  co  be  copscrucred.    The  100- 
roon" Center,  buiic  ac  a  cose  of  three  .million  dollars,  has  cpcra:«d  at  an  annual 
deficit  since  its  opening.    The  deficit  in  1978-79  vas  abcuc  $150 ,000— well 
under  2/10  of  i;;  of  total  income.    Th^s  deficit  riat  b«cn  reduced  arjiuaily  to 
the  point  where  the  Center  U  projecte^d,  to  be  totally  self-supporting  within 
Che  next,  2^  nonths.    It  should  be  noted  that  the  priaary  purpose  of  the  Center 

.  is  anfl^lways  has  l>ecn  to  facilitate  tlS  activities  in.  testing,  research  and 
insertion,  that  it  w^s  built  out  of  aamcd  resources  froa  tTS  prograns  and 
services,,  aad  that  tjia  operating  deficit  '.reflects  a  full  allocation  of  costs, 
including  taxes  and  depreciation^ 

Apart  free  its  plant  and  equipment  and  the  working  capital  (amounts  owed  to 
vendors  and  others,  less  amounts"  coming  i a  from  fees  and  contracts  or  amounts 
held  for  prodding  future  ser-/icei)  required  by  ever/  organisation,  ITS  has  no 
financial  assess  other  than  its  portfolio  o:  marketable  securities,  valued  at 
cost  on  June  30,  1979  at  about  $4.S  aillion.    "Shis  azount,  which  is  held  for 
equipnen:  red'lacenent  and  operating  or  financial  contingencies,  represents 
less  th^n  three  weeks  of  operating  expense  at.ETS'  current  Ipvel  of  ;^ctivi»y. 
.  As  noted  above,  the. return  on  those  investments'' helps  to  support  all  of  ITS* 
acti*/ities.    In  1973-79  the  return  was  about  S300 ,000— or- apprsxiziat^y  double 
tl)e  anount  required  to  support  die  Conference  Center. 


Costs  and  Efficiency 

ITS  i^nage.'Ler.:  is  ccrttinually  challenged  by- the  probletis  of  keying  costs 
(ulcinately  reflected  in  student  fees)  £S  lo#  as  possible  vhila  prcvicir.g 
extensive  a::d  comple:t  services  for  ailliony  of  students  arx  thousands  of 
institution^ ,  a  challenge  compounded  by  the  critical  r^^^j^reciegt  that  the 
processed  inforsaticc  be  as  accurate  and  tl-se^y  as  is  huaar.I?'^?^ s ib  1  e .  ■ 
Since  all  of  ^^TS'  servicels  ar^^  labor-intensive,  requiring  the  close  attention  . 
c:  people  for  their  effective  accooplishmenc ,  Che  ca-ority  of  ETS *  expenses  I 
«re  payroll  and  benefits  coHf*  as  was  nenticned.^earlier .    Constant  attention- 
to  aaincair.V.g  efficient  work^i^cil^tie^  end  to  oppcrcunicles  for  automating 
those  activities  that  can  be  3ofe-  accurately  and  swiftly  acccnclished  by 
computers  and  oth^r  ^abor-saving  devices- has  paid  off.    As.^  nieasure  of  that 
success,  in  four  of  the  largest  prograas  chat  ITS  conducts  for  its  clients — 
the  Acaissi^ns  Testing  ?rcgraa  of  the  College  3card,  the  Qraduaae  Kecord  ExaQi 
:he  Law  School  *Admission  Test  and  the  Graduate  >iar.ageafint  Acssission  Te^t  — 
student  test  fees,  which  reflect  costs,  have  risen  on  the  average  less  than 
5CS  in  the  lasg  Z5  years  while  the  Cost  of  Living  Index  has  Just  about  tripled 
-during  that  tisie  (see  Attachnen^  E). .    la  the  last  cecade,  whila  the  cost  of 
living  nearly  doubled  and  th.e  nunber  of  student^  taking  the  College  board's 
Scholastic  Aptitude  Test  (&  bellwether  program)  dropped  by  accut'6^i-,  the  fee 
;or^akir»g  the  SAT  rtse  by  only  ^5^ . 

As  has  been  pointed  out  earlier,  acme  90%  of  ZTS'  'inccce  comes  froa  progratss'*^ 
and  ser"/ices  and  the  tiajority  of  that  inqcce  cices  indirectly  frca  student  fees. 
Attachnent  ■  is  an  Illustration  of  where  the., ITS  incone  dollar  tcnea  from  and 
where  that  dollar  -is  spent.    Attachnent  G  shews  where  ITS  spends  its  portion  of 
"test-taker"  fees,  ba^ad  oh  the  expenses  of  four  iajcr  nac^or^l. testing  prcgrar.s 
"Most  of  the  fee  is  spent  on  supervisors*  honoraria,  processing  cf  tests  and  on 
the  production,  shipping  and  availing  cf  test  booklets,  answer  sheets,  test 
infor^aticn  and  reports.    At  present  about  6  cents  on.  the  dollar  go. to  devel3p 
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And  analyst  Cttct.  D« 
or  achitvtotnc,  broad 
davaXopnaat  pf  a  alngl 

J^Char  ^aaura  of  ETS ' 

ui(;h  cha  work  rac^uira 
ha«  grown  19 1  vhljla  .1 
major  ?rog.raaa,  ha<  Ipc 


ndlng 
jll^ghly 


ily«%acla: 
of  i  tatc 


oacura^of  cha  partieuXir  case— aptlcuda 
iclalltad  aJ^J'^ct  oa'ctar— cha  coac  of  taac; 
can  tailga  from  530,000  $100»000. 


oparacional  afficiancy  la  lea  groyth  In  acaff  cotaparad 
CQ  ba  aeco^liahad.    In  Cha  laac  flva  yaata,  ETS  acaff 
workload,  aa  naaaurad  by  procaaaing  voli^iaa  In  lea. 
rtaaad  ac.\alaoac.  doubla.  chtc  raca, 

2TS  "dvarhaad"  or  IndlracC  coaca  Jiava  rantinad  in; a  band  batuaan  15X  and  20% 
of  cocal  coaca  fo?  tha.laac  ten  yaars  and  hava  dr3p{>ad  ata«dUy/in  ]ha  laac 
fiya  yaars  frcjio  .19::  tojl6l5t.  •        •    /  f 

Finally,  in  cha  Caac  of  ch«  aarkacplaqa,  ETS  haa  wen  a  aubatan4a^  porcion  of 
cha' concracta  for  wHicl\  ic  h4»  bid  on  a  coiapacitlvtly  pricad  baaia. 


Accouncability 


Sinca  l:a  incapcion  ETS*  financaa  hava.baan  audlcad  annual&r  by  an  indapandanc 
axjcamal  fin  of  accouncanca  and  audicork  (praaandy  Coopatl  &  lybrao4)  vho 
raport  dlraccly  co  cha  Audlc  Coomiccaa  of  cha  ETS  Beard  of  Truacaea.  ETS 
publiahaa  an  annual  raport  which  includaA  i^a  audicad  financial  iicacaaiinca. 
ETS 'financial  parfornanca  ia  ravlawad  at  laasc  aaaliynnually  l&r  tha  Financa  . 
Consiicsaa— oae^ara  of  cha  Board  wich  parc^icular  iknoWladga  of  cha  finimcaa  and 
aanagamenc  of  aajor  Inagicuciona..   Xn  addl\:lon,  lavaral  of  ETS* jfcajor  clianta , 
a.g.  cha  Collaga  3oard,  conduce  indapandanl  annual  audits,  of  Etr  financial 
aanat^infnc  of  thei#  prograsa ,  af  doaa  cha  iaderal  gcvarriient..  ^ 

.aacocsBandaciooa  cojcicaming  cha  allocacion  of;rasourcas  to  tha  aupporc  of 
raaaarch  and  davalopaanc  ara'qada  by  cha  Financa. Cecal :c<a  co  cha  fall  Board, 
baaad  cn  (^asaarch  plapa  raVliwad  indapandaTltly  by.  cha  Rasaarch  and  Upvalopaanc 
Coomiccaa*    Tha  Financa  Cqoniiccaa  alao  raviiva  aad  approvaa  all  allTcaci.ons 'of 
raaourcas  for  cha  acquiaicion  of  plane  and  aquipmcnc , and  aakaa  all  final 
Invascstnc  daciaiona  which  a ra  ravlavad  and  .conf Irsad  by  cha  full  Board. 
Suonatiaa  of  ETS*  concracca  with  its  major  clianCs  hava  baan  avalj^abla  for  * 
inapactlon  for  cha  paac  fiya  yaars..  . 
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CihiImjic  jimI  l*M>f c»iitHiat 
Sclitml  VitiKiami  

.  |*M>ICStHHI«tl.  

Viiimik  At44lemk  Levrls  ..... 

'hHi^TvsiiiiC  Atiiviiki  . ...  . .... 

Hrscjiclii  1  )4:vvlh|iiiiciii«  jiikI 

lllSllllillliiMl  $«:iv)us  

Oihvr  liictMitc  

TtMAl  Htfvvniie  


Par  (J4ifciiiiMl6n  t>ur|K>iittfi  i^nly 
Still  J  vc  t. .  t  o  Rttvi  M  ton 


!  IVE  YKAU  SUMMAliY  01  KKVtNUI: 


1979 


1(^.11.1,443 


I3;652.3j7 


$jo,6«y,ii.u 

i2,S6S;IS7 
5,807,  i'jy 
.6,A88,)VI 


_  19^5  

$17.$77;I61  . 

11.731,692 

5,087,719 

r.ll.lJ8S 
50.5iu,5SV 


7,8j7,5i3.         6.B«I.67I         7,1I«,M«    '  ^  5,819.161         jmMt  / 
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ATTACJm-TB 
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•for  the  years  ended  Cur.c  •2C;vii''9  and  1973" 


Tes^ins  ac-ivi-slei  " 
;  Hesearci;,  developoenv,  advisory. 
I  And/.ir.3':r;ictioofi^  services i  ' 

.  (Xote  6.^  •  '  ■  f 

•  Othe^  revenue 

Tot  Ax  wv^ue 

v^'-  ixper.lltures: 

Salaries^  v&ges  and  employee 

btnerizfi 
Test,  adatr.iscrators,  readers^ 
tteB  wrl-ers  and  ozher 

•  J    prcfesslcr.al  services  ,"' 
^  in  ting  and'  aarariaifi 
tecreciatlpr. 

IlecrrcnlS'f ;ulpaer-t  rental 

and-  services 
V- 111  ties  ar.i  property  taxes' 
'  rr eight  ar.d  posza^e  • 

.elephcr.e  and  te-egrtph 
c-rher  'opera-lr.g  and  aiilr.li- 
..tratlve  expenses  (?;czes  6 
and  H^' 

rcstl.  expenditures 

^xcess  of  revenue  ever 
expenilt'^res 

.  rjLr.i  'r'al&r.ce,  segir-ilr^  of  year 

Fund  balance,  end  of  2jear 


\ 


1  i7i,5ca;39c 


c,5£o,57r 


1,932.555  1.622,371 


See  notss  to  financiil  t'tateser.'is. 

■    -  3'  •. 
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EDtfCATXOWAL    TESTING*  StRVICS  .: 


.SIS  SaX^ty  R*ni«« 


ProfMtlotutl  and- AdainUtr^tlv  SMtf  ■ 

^iolor  R«««Arch  SclancUc*  Sr.  Program 
A^Blnia tracer,  Sr.  DiVlaioo  01;raccor 

$23/220  Y^38,010  •  • 

•  Rtatai:c!v  ScliineUC|  Rtad  Scatlatiul 
Syaeaaa,  Olvlalon  Diraetora/  Sanlor 
.Taac  Exaalnan 

"9201,520  *  333,540 

$anior  Raaaarch  AaaoeUea.,  Tasc  ExMlnar, 
Prograa  ^^Inlacraioiy 

Data  ?rocaialr|^  Staff 

520,620  533.540 
Sinior  Syataoa  Analyst,  Sr.  Pragrao  Analyst 
$18,490.  -  S«,880 
.  Staff  Systaoa  Analyst,  Staff  Prograa  Aaalyac 


Outalda  Salary  Ranita  aad  Avaragi 


a  Salar^M 


(  Ptofaaaor 

Profaaaor 
-pTofasaor 


<  Aaaoc. 

(^it .  P 


$34, 45a  avaraga 
$25,950  iy«rag« 
$20,890  avaraga 


U.S.  civil  Sarvlca     '  $27,.453-$35,668 

(GS  13)  .        /  ■ 
$elafitisca,Profaiai9^a, 
Sa;^or  Admialstrajtora 

Cuoivatsity'Dii^  '$31,935  avariga 

VUaivtrai^  Oiractora     $22,206  avaraga 


latiotial  Sur/ay  $26,260  avaraga 

US  Ci*^l  Sarvici(GS/U)$19, 263-525, 04A 
National  Sur/ay  '  $25,688  avaraga 
as  Civil  SafviceCGS  10)$17,532-:$22,y88 


Clerical  Staff 

$8,920  -  513,360 
Senior  Clarlcal  Aaaistant  y 


i 


Z  ^(agiocal  Clerical  Salary  $10,226  avaraga- 
F  National  Clarical  Salary  $10,816  avaraga.. 
B       QS  Civil  Sarvlca  (GS  4)  $9,391-512,208 


Total  Staff 


■i 


$?J,60 
Ayaiagt. Sali^v 


$13,300 

National  Avaraga  -all  full-tlaa  vagi 
aamara 


A  Aaarican  Aia'a.  Cniveraisy  'Profaaaora  1978*79     D   la^o  ayataiu  Hagaxina  -  Juna  1979 

Adjusted  to  11  aooths  ■  • 

B   OS  Civil  Sarvica  Siiar?  Gra<laa  thru  Aug^,i979    .2  Local  Araa  Parsooaal  Sur/ay  1979 

C   Cdllaga'  and  Coivarsif^  ^a'r^onAl  Asaociatto^ 
•  March  1979'  '  .     •  - 


t  9uraaa  of.  Labor  Statistics 
G'  US  . aursau  of  Cansua-  Scatiatical  Abstract 
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KIH(I!ATI(HIAI.  ThiCtim  iJKHVICK 
jMiiu        I*)'/)  ami  U'/O' 
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i.*iiriuii*C  HHttutiit 
Ctttlli 

:]iH»ri  itfiiM  tnvttuiMviiit}  <(tt|»i»vi>jii7 
ii»  lO'/O)  1  # 


lAvviiiHjjttt  in  iMiiitutiiUlv  \ 

.    Ui  |73B*OUO  ati  ^«|iil|iiaei)t 

i'ui»Ucu«MsnV^v»*0     ^  I 


fri»|iitriy,  ,  , 


f  u rill  til i*u  fijiil 
(Note  I 


mi 

MAIII MTJEU 

Current  lUblUtlnKt 
.  AccoUitlOi^y")'^*' 

>  j.L'ObJlZI 

•  i 

Aecrtio'tl  oKiieiitiofl  «it(l  oiHor 

3.Yi^J.Yt)) 

Under  oiKilravia  . 

7.0-jO,33'» 

!)}912.91Y 

Uidtir  ^ruDtu  liicluJltii'' 
litlviititio  pnyiitfiitH 

tuUl  current  JlsbllUlon 

'  m 

>  .fkrerraJ  incoMu  (Notu  3) 

673i86l 

*i-»i'>:'*o|ii. 

*Ui0Kptiiiiltttl  reuotpU  (Hote  'l) . , 

i»»«»,s^iii,iHj' 

\ 

hmtl  buluncu  (Hutu  '>) 
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CA^SDOATS  FEES      FOCK^ttLJOR  PROGRAMS  vs.  INTUXIOlf 


...  £/ 


1954-55 


25  Ytart' 


X979-ao 


Adoissions  Ttscing  ?i;ograa 
CrfduACfl  ManagezcnC  Adaissioa 

f 

Craduatc  Rtcordf  ZxAciaicio^ 
Law  SchoQl  AdaissioQ  Ttst 


S  6>00 

10.00 
8.00 

10  .bo 


50 


29,15 
23.33 
29.15 


S  8.25 

12,50 
U.OO 
15. PO 


■/ 


Whbhe  the  sts 
income  dollar 

COMES  FROM... 


mVESTMCNT  INCOME   >|       v^AOVISOHY  d  INSTRUCTIONAL 


WHERE  IT  OOES... 


PROGRAMS  5  SERVICES 
FOfi 

STUDENTS  O  lflSTITllTIONS 


^  RESEARCH.  DEVELOPMENT 

AOVI^iRV  ft  mSTRUCtlONAt 
SERVICES 


H.ANT«f  EQUIPMENT 
■     ■    •  ft 

W0RKI|>I9  CAPITAL 


WHERE  THE  #8T  TAKER  DOLLAR  fS  SPENT 
IN  FOUR  MAJOR  PROGRAMS 


SERVICES  a  CURICAL 


DATA 

PflOCCSSlHa/SYSTCMS 


"^PHOOIIAM  MATCniAU 

a  nUBLICATIOHS 


TEST  DEVEUOPMEHr^ 

PMXNIAM  ADMINISTRATION 


DISTRIBUTION  a  MAlLI 


LOO 


COLUQE  BOARD  ADMISSIONS  TESTING  PROOJ 

,  ORAOUATE  Management  ADMISSIONS  TEs; 

ORADUATE  RECORD  EXAMINATIONS 
LAW  SCHOOL  ADMISSION  teST 

> 


SUPERVISORS  a  PROCTORS 
H0N0RAR1\  . 


L 
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PROGRAM  RESEARCH^ 
PROGRESS  REPORT  > 


AUGUST  1979 


THE  COLLEGE  BOARD 
GRADUATE  MANAGEMENT  ADMISSION'COUNCjL 
GRADUATE  RECORD  EXAMINATIONS  BOARD 

LAW  SCHOOL  ADMItSSION  COUNCIL 
TEST  OF  ENGLISH  AS  A  FOREIGN  LANGUAGE 
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'  /  PROGRAM  RESEARCH  PROGRESS  REPORT 

i  ■     *  ■  '    '        .        •  " 

The  Program  Research. Progress  Report  serves  as  a  summary 

program  research  projects  of  five  majo^  pcograms  at  Educational 

Testing  Service:    The  College  Board,  Graduate  Management  Admission 

Council,  Graduate  Record  Examinations  Board,  Law  School  Admission 

Council,  and  Test  of  En'Sllsh  as  a  Foreign  Language*    This  report 

recognizes  that  E^S  research  program  sponsors  often  are  lnterest<^d 

In  the  research  activities,  of  other  ETS  progra^T^'^^Che^^ep^  \ 

Includes  ojie~page  sumparles  of  projects  In  progress  or  pro}ects. 

recently  completed  and  a  listing  of  projects  completed  during  the 

p^st  five  years*    The  summaries  describe  the  purpose,  progress  to 

4-  \  '  -  -. 

date,  plitnaed  completion  sche4ule,.  an^f  Indlngs  In  the  case  of 
coli^leted  projects*^ 

For  completed  projects^  citations  are  Included  so  that 

those  Interested  may  obtain  copies  of  Reports  where  available* 

*/  ■  ^ 

Requests  for  reports  should  be  addressed  to  the  lndlvldual\; 
'program  offices  at  ETS. 


.  ^  •»     This  report  was-  prepared  by  the 

•  Office  of  Program  Research 
Educational  Testing  Service 
Princeton,        Jersey  .  "08541 

Questions  concerning  specific  projects  should  be  directed  to.  the 

project  directors  or  the  respective  program  research  cpordlnator 

*.     ■  ■ 
, a t  ETS  t  •  i    ■     ■    "        •  ■  •  " 

Hunter  Breland  --The  College  ^S^rd^ 

Thomas  Barrows '-^^raduate  Man^gemen^  Admission  Council 

Mary  Jo.  Clark    -Graduate  Record  Examinations  Board 

Franklin  Eva na  -t-Law  School  Admiaslon  Council 

Donald  Aldeman— Test  of  English  as  a  Foreign  Language 

Linda  Johnlqn  Warren  V*  Wllllngham 

Stkff  Associate  Assistant  Vice  President 

'  ■   '  '  for  Program  Research 
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A*    PROGRESS  REPORTS  FOR  RESEARCH  PROJECTS  OF 


tH£  COLLEGE  BOARD 


A 


erJc* 
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Title:    SAT  Speededness  aij^udv  '  .■    ^  ■ 

Project/Job  Number : ^  142/15       Project  Director:    Franklin  R«  Evans 


Purpose 

The  study  will  seek  to  dietermine  (1)  if  the  SAT  is  more 
speeded  for  minority  group  (Mexican-American  and  black)  than  ^jfrhj[.te 
candidates,  (2)  if  the  SAT  is  more  speeded  for  rural  than  urban  ■ 
cartdidatesy  and  (3)  if  removing  speededne^s  from  the  SAT  results  in 
more  valid  or  less  yali^  scores  for  minority  group  candidates* 
. '        *  ■  ' 

Progress  (as  of  July ^  1979) 

Special'  tests  were  administered  in  12  schools  in  January  and 
February y . 1972*    Scores  are  on  tape  and  data  analysis  is  complete. 
Preliminary  results  indicate  that  removing  speededness  does  not 
provide  any  differential  benefit  for  any  of  the  vctrious  ^oups. 
Vai^ious  single  administration  indices  of  test  speededness^haye 
been  studied*  /  . 

Schedule  for  Completion  .'^ 

A  draft  report  has  been  prepared  and  submitted  for  review* 


■  ■■  ■  '   '  '  ■    ■'■  ■  .■ .  ■ '  ■  ■  •    : . 

■  253- 

Title:    Teat  of  the  Adequacy  of  Score  Equating  Models  . 

Project/Job  Nuiaber:    142/25      Project  Directors:  ,  Gary  Marco 

B;  Elizabeth  Stewart 


Purpose 

To  test  the  adequacy  of  standard  ETS  equating  models  and  a 
variety  of  new  models  when  sample  and  test  characteristics  are  ^ 
systematically  varied.   *  M  ' 

'  .    ■  ■  ■      ■  ■ 

Progress  (as  of  Augusts  1979.)  .  } 

Scoring  was  tSompleted  in  April  1977,  and  all  equatings  have 
been  performed  for  each  of  the*  466  equating  situatioris.    A  total 
of  .40  linear »  tiwo  equipercentile  (direct  arid  frequency  estimation), 
and  two  item  characteristic,  curve  (1-  and  3-parameter  logistic) 
equating  models  were  ud.ed.    Summary  tables  of  equating  results  have 
been  prepared.    Comparative  analysis  of  the  curvilinear  models  have 
been  completed  and  a  report  on  this  part  of  the  study  has  been 
prepared.    Comparative  analysis  of  the  llnoar  models  are  in  progress. 

Schedule  j^r  Completion 

The  final  reports  are  scheduled  to  be  completed  by  October  1979. 
Final  summary .  tables  and  graphs  are  in  the  pi^ocess  of  being  completed. 
A  draft  of  the  final  report  is  in  process  except  for  the  section  on 
the  interpretation  of  the  comparative  anal^iS' of  the  linear  models. 

Findings     .     » . 

When  total  tests  differ  in  difficulty,  a  curvilinear  equating 
model  Is  superior  to  a  linear  model.    Because  of  the  criterion 
problem,  a  choice  cannot  easily  be  made  among  the  curvilinear 
models,  except  that  the  1-parameter  model  tends  to  be  superior 
when  a  test  is  equated  to  itself  and  it  tends  to  be  inferior  when 
a  test  is  equated  to  a  different  test.    All  models  are  satisfactory 
when  conditions  are  optimum;  . 
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Title;.   Llteratu)j:e  Review  of  Relationships  Among  Teata,  GriadQa>  and 
Life  Succeag        '.  ^  ~ 

Project /Job  Number:    142/27  Project  Director:    Leonard  .Balrd 


PurDoae  .  •  ^ 

^hla  review  la  dealgned  tp  critically  aaqeaa  and  aynthealze  the 
available  reaearch  which  beara  on  the  queatlon,  "Do  academic  ability 
teat  acoreaand  grades  piCdlct  anything  but  gradea;  I.e.,  are  they 
related  to  real  life  accompllahment?"  . 

Prokreaa  (aa  ot  July,  1979)       ^  *  . 

Reaearch  from  many  aourcea  ha^  been  examined  for  their  relevance 
to  the  question  above.    Flf tjeen  joutnala  were  ayatematlcally  aurveyea 
by  examining  the  art Idea  publlahed  In  them  during  the  laat  ten  yeara. 
These  artlclea  often  referred  to  other  articles  In  journala  outalde 
the  fifteen.     In  addition,  relevant  categor.lea  In  Paychologlca.l 
Abatracta  for  the  laat  five  yeara  were  ayatematlcally  reviewed. 
Finally,  aeveral  leading  figures  In  creativity  reaearch  ^i^j^^  asked 
to  send  any  publlahed  or  nnpubllahed  work  that  could  help  anawer 
the  queatlon.    The^e  sourcea  led  to  many  repOrta  which' had  to  be 
examined  carefully,  becauae  the  relevant  analyaea  were  often  hidden 
In  appendlcea,  and  the  queatlon  of  concern  In  thla  re^^lew  waa 
not  the  major  queatlon  ot  thoae  projecta.    Theae  atudlea  have  been 
reviewed. and  analyzed. 

Schedule  for  Completion 

A  draft  report  haa  been  prepared.  ^ 


I 
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title:  .  Hew  Meaamfes  for  ColXeae  AdmlaBloga  •  * 

Project/job  Humber:    142/34      Project  Director:    Hunter  Breland 


Purpose   .  '  I    .   .  . 

*       ■       ■        "     i  ^  '■ 

The  purpoBie  o£  this  project  Is  to  review  the  possibilities 
for  ube  and  to  evaluate  new  klilds  o£  neaBures  £or  college 
adalSBlons' that  night  aUppi|.'enent  traditional  Indicators* 
•nUiiber  o£  suppl^ppntal  neacjures.  Including  structured  In 
and  biographical  data»  are  to  be . considered  with  respect 
reliabilities y  validities,  [probable  liqpact)  costy  and  otl 
practical  probiens'. 

Progress  (as  of  August,  1979)  • 

This  project  has  been  subsumed  .under  m  larger  project, 
Personsl  ttialltles  in  Ailmlsslons  (Jointly  sponsored  by  CB  and  ETS)^ 


"Schedule  for  4?omplyio 


Project  wlll/be  coop let ed  as  part  of  the  Personal  Qualities 
Project. 


Title t    An  lovfeBtlgatlon  ofl  Peraistence  In  Higher  Education.  Phase.  I 
Project/Job  Humbert    142/35        /  Proj}ect  Director:    Thomas  L.  Hilton 


Purpoge  (Phase  I) 


ftjor  types  o^^^ 


1)  To  ^identify  the  najor  types  oiJ[>ersl6tera  according  to  the 


pa 


r 

em  and  duration  of,  attendance  In  various  Inatltutlons  o£^hlgher 
education*  - 

■  V   •  r". 

2)  ^  conpare  "hlgh-pbtentlal"  dropQuta  Who  peralated  Alth 
thoae  vho^dld  not* 


.3)  To  conceptualise  a  conprehenalve  modeX  o£  the  peraistence 
proceas  and  teft  by  means  o£  NLS  data  £lle»  Including  2nd  £ollov-up 

.  data*  '  . .    ■■    '-^    ■  ..    .    .  1   ■  a ' 


Proj^reas  (as  o£  August/  1979) 


1 


All  the  necessary  analyses  have  been  conpleted^  and  a  dra£t 


report   has  been  compieted.       Thla  draft  la  nbw  being  revised* 


Schedule  for  Completion^ 
December,  1979* 


.  \ 
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^   •  Title:  .  Career  Skills  Assessment  Froyram  Validity  Study 


I 


Project/Job  Number:  142/41 


Purpose 


Project  Directors:    Jerllee  Grandy 
^  Charles  Werts 


'This  study  was  designed  to  Investigate  the  construct  validity 
of  thtee  €oJ.lege  Ifoard  Career  Skills  Instruments:    Career  Awsreness, 
Career  Decision  Itaklngt  and  Eni^loyment  Seeking  Skills*    A  sample  o£\ 
1500  high  school  scudentli  took  twp  o^  the  three  Csreer  Skills- 
messures  (the  three  were  spiralled  In  pairs);  the  PSAT^  a  Csreer 
Development  Questlphnalre  (CDQ),  , and  li  Test  of  General  Information 
(TGI)*    A  coof Imatory  factor  analysis  was  used  to  estimate  the  . 
extent  to  which  each  of  the  Career  Skills  Instruments  Is  measuring  * 
something  uniquely- different  from  verbal  and  mathematical  aptitude  . 
(discriminate  validity)  and  the  extent  to  which  it  is  measuring  the 
same  kinds  of  skills  ^s  the  CDQ  (conyergent  validity)*  'Results 
suggest  that  about  ont«-thlrd  of  the  varlanqe  in  the  CSAP  scores  can 
be  predicted  from  measures  of  academic  ability*    Convergent  validity' 
With  the  CDQ  was  not  established*    As  a  by-product,  the  CDQ  may 
become  a  marketable  product  in  its  own  right* 


Progress  (as  of  August,  1979) 

A  final  draft  report  revision  has  been  coippleted. 


Schedule  for  Coaipletion 

The  final  draft  report  is  to  be  submitted  for  approval  in 
September  197d. 


.\- 
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Title:    Discriminant  Validity  Study  of^CSAP 


Project/Job  Numb^i::    142/A8     Frojj^ct  Dine^ctpr:    Donald  A..  Rock 

Nancy  Petersen 


■ ; 


Purpose 


The  purpose  of  the  study  is 
in  an  effort  to  verify  the  cpnatr 


More  specif icaliy,  project  directors  ^re  investigating:     (1)  the 


construct  validity  of  each  of  the 


:o  perform  a  confirmatory  analysis 
i<^t  validity  of  the  C^AP  materials. 


skill  areas,  (2)  the  reliability 


of  measurement  of  each  of  the  skill  areas,  (3)  the  interrelationship 
among  the  ^ill  area  constructs,  ^iid  (4)  relationships  between  the 
skill  area  constructs  and  outside  constructs  as  measured  by  ^ 
sfcandaVdJ^zed  achievement  tests. 


T 

Progress  (as  of  August,  1979) 

Data  collection  Is  nearlng  completion;  data  analysis  will  follow 
in  the  fal^» 

Schedule  for  Completion 
January.,  1980. 


ERIC 
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'  ■  ■  .  ■  ■ "    '    '  f 

■    *  • 

Title:    Developneot  of  CSAP  Uqer  Validity  Models 
Project/Job  Number:    142/49     Project*  Director:^    Jerilee  Grandy 


Purpose  .  ^  . 

This  study  is  being  executed  in  two  phases:    (1)  Designs 
were  developed  ^according  to  which  users  can  conduct  their  own 
content  valid^t^^on  studies.    A  discussion  of  th^aie  deaigna  appeara 
in  the  CSAP  HanVl^ook.    (2)  Several  institutions  are  being  contacted 
to.  encourage  thei^t  utodertakicfg  a  va3.idation  study Reaulta  of  their 
studies  will  be| included  as  exao|>les  In  a  manual  dealgned  to  guide 
schools  in  condAcping  their  own  content  validation  studies.    .  .  ' 


Progress  (as  of 


July,  1979) 


thase  I  is 
"studifp  is  being 


complete;  a. manual  with  examples  of  user  validation 
written. 


Schedu^te  for  Com>letibn 


Phaae  I  was 
'In  August,  1979. 


coa|>leteld  in  Julj/V  ^pB;  phaae  II  will  en^ 


Title:    Validation  of  the  Descjrlptlye  Tgata 'of  MathematlcB  Skilla 


Project/Job  Number:    142/50  Projeot^;^rectorV  ^Brtetit  Brldgeman 


/ 

hirp.ose  I 

The  purpose  of  this  attjidy  la  ^to  deteriAine  the  validity  of 
the  Descriptive  Tests  of  Hathematics  Skills  (DTNS)  for  placeme 
purposes^    Various  aspects  6f  the  project  Include  a  content 
analysis  of  the  DTNS,  assessment  of  student  attitudes  toward 
the  quality. of  placement  decisions^  concurrent  and  predictive 
correlations  of  the  DTNS  wlt^  indicators  of  success  iti  diath 
courses  (e*g»»  grades,  class 'rank,  final  exam  scores)/,  a  study 
of  gains  on  the  DTNS  f  rom  the  beginning  of  a  math  course  to  the 
end,  and*a  trait-treatment* Interaction  study*  ,  '  .  . 


ProRress  (as  of  July,  1979) 


DTMS  tests  were;  administered  to  about  11,000  students  in 
3A  institutions  during  the  Fall  of  1978.    Posttests  were  admlniatfired 
at  the  end  of  the  Fall  term  in  10  of  these  lnstltutloi(is,  and  two' 
institutions  participated  as  a  post  tea  t-K)nly  school.    \Rosters  with 
the.  math,  courae^succeas  indicators  haye  been  recelvedf^  Content 
analysis  forms  frdm  128  faculty  members  were  received  l^nd  are  now 
being  processed.    Some,  data  from  the  field  was*  late  in  arriving. 
Analyses  of  these. data  are  just  beginning*  > 

A  school  that  couLd  meet  the  requirements  for  a  high  quality 
trait-treatment  interaction  study  could  not  be  located.    A  crude 
approximation,  may  still  be  possible^  in- one  institution. 


\ 


Schedule  for  Completion 


October^  19J9« 


•  .  »  ■ 
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Tltlet    Pire-^quatilng  the  Test  of  Standard  Written  English 


Project/Job  Nui)iber:    142/51    ♦    '?rolecfc  Director:  jlsaac  1.  Be  Jar  ^, 


/ 


\Putp08e 


I 


^  To  study  the  feaelblUty  of  pre-equati,ng  Test  of  Standard  Wrltteri 
fnglish  foijU  using  Item  Characteristic  Curve  Theory. 

V  ■     ■     •  ■)• 

■     '     .    ■      ^         .  I 

Pjrogreas  iaa  of  July,  1979)^  | 

^     ^boi/t  half  of  the  required  LOGIST  (item  calibration)  runs 
needed  h^ve' been  coa|ileted«    Programming  required  to  do  analysis  of  I  | 
cpvariance' structure  analysis  of  .item  type  e|ffect  has  also  been 
completed.    Analysis  ^s* now  under  wa^«  ^ 

Findings 

/   f      ■ .  ■     ^  ■ 

Preliminaty  analysis  suggests  that  the  thi^ee  parameter  logistic 
model  fits  TSVE  data  adequately.  Mo  results  ar^  available  yet  ofi  to 
how  well  pre-eqiiatitig  iff  likely  to  work. 


^tb  work.     .       \  ^ 


Schedule  for  Completion 
DecembLr,  1979. 


f 
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Titlei 


i  •  Eacplorhtory  Apalyslfl  of  Sex  Differ etices  In  Response 
Date  for  the  ATP  Physics  AAlj.evemeni^  Test  ~~ 


Project/ Job  .Number:    142/52      Project  Directors :    Patricia  Whefllbr 
:  Abigail  M.  Harris 


Purpose  •  '  ^ 

Sizeable  performa^nce  differences  have  existed  between  men  a^d 
women  on  the  AtP>Physlcs  Achievement  Test  for  matiy  years.  The 
purpose  of  this  exploratory  study  Is  to  Investigate  two  maj^r 
questions,  tine  focusing  on  the  test  Itself  and  the  second  on  th 
candidates: 

1)  Are  there  any  systematic  differences  In  ojale/female 
perfbmiance  on  Individual  Items  or  subgroups  of  Items 
which  can  account  for  or  help  us  Interpret  the  differ-^* 
ences  between  males  and  females  In  overa^^^erformanc^ 
on  the  test?  \  f 

2)  Are  there  any  factors  such  as  number  of  semesters  of 
physics  or  math,  or  overall  level  performance  on  the 
ATP  Physics  Test  which,  when  tela ted  to  performance 
data' on  Itemis  can  help  us  to  interpret  the  overall 
performance  differences  and  perhaps  gain  Insights  Into  . 
t}\e  unique  characteristics  of  the  jEemal^  physics  student? 


Progress   (as  of  August,  1979) 

A  review  flraft  has  been,  completed. f   This  draft  Is  presently 
being  reviewed.  * 

Schedule  for  Completion 

Upon  receipt  of  comments  from  reviewers,  a  final  report  will 
be  prepared. 


A 
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Title*  ^  Older  Students  and  the  SAT    ^  | 
Project/Job  Nunbers      U2r53  Project  Director:     Gita  Wilder 


Purpose 


i 


.  The  purpoae  of  this  study  is  to'  assess  the  validity  of  the 
^AT  yith  respect  to  older  students*    A, sample  ot  about  1,000 
studeota  who  were  21.  or  older  at  the  tine  of  application  for 
admission  to  college  will  be  selected  for  study  in  %n  effort  to 
diadover  how  well  the  SAT  predicts  subsequent  academic  performance* 
A  subsample  of  the  students  will  be  intferviewed  to  learn  something 
about  the  admission  process  for^older  .student^s*^ 
■  ■    '        .  ■    ■  »  ■ 


"rtonress  (as  of  August^  1.979) 


The  majot  efforts  of  the  project  to  date  have  been  directed 
toward  identifying  schools  with  significant  numbers  of  older 

.students  irtio  have  taken  the  SAT*    (Because  ma  Ay  schools  exeii4>t 
older  students. from  the  testing  aspects  of  fSie  admissions  process* 
finding  an  adequate  sample  is  one  of  the 'most  difficult  tasks 
of  the  entire  endeavor*)    CEEB  regional  of fick' personnel  have 

. provided' contacts  with  admissions  officers  in  their  respective 

''areas « 


Schedule  for  Completion 


It  is  intended  that  the  sample  be  idefntif ied  by  early 
so  that  the  collection  of  data  liay  be  carried  out  during  the  early 
part  of  the  1979-80 ^academic  ye^r* 


fall  1979 


V 
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title;    Supplementary  Analyses  of  Data  Obtained  for  the  StudvOf 

V'^TaklnR  the  SAT"    '  ' 

Project / Job:  >f42-f 54  '     .    ■    '  -    Project  Director:    Donald  E.  Powers 


hirpose        .  c 

The  objectives  of  the  stody  are  to  conduct  further  analyses  pf 
the  survey  data  obtained  for  the  study  o^  Taking  the  SAT;    A  Te8»; 
Familiarization  Booklet  to  answer  the  following  questions: 

1*    In  what  Ways  do  students  prepare  for  the  SAT? 

2.  What  are  the  relative  effects  on^SAT  scores  associated  with 
various  ftypes  of  prepajratlon? 

3.  Were  there  any^  effects  of  using  Takltig  the  SAT  that  were 
not  reflected  In  test  scores  (e.g*,  rate  of  worK  a'nd 

.  guessing  behavior)?    »  / 


Progress  tis  of  August  1979) 

A. draft  report  has  been  prepared  describing  the  Incidence  and 
patterns  of  use  of  various  modes  olE  preparation  for  the  SAT  In  a 
national  random  sample  of  candidates*    PSAT  scores  are  now  being 
retrieved  from  score  files  for  matching  with  SAT  scores  and  othet 
demographic  variables*    These  data,  along  with  students'  reports  of 
preparation  activities^  will  be  used  to  assess  the  relative  effects 
of  various  methods  of  preparation* 


.Schedule,  for  Completion 

Two'  additional .  reports  are  scheduled  for  com^l^ion  by  December  31, 

.1979* 


f 


0 
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.^^     Titles    Peasitfillty  of  Studying  SAX  Vamditv  for  Mexican-American 
Students  .   


Project/Job  Ntimber.:      142/55.  '      Project  Director:    Gerilee  Grandy 


Purpose  *  '/ 

The  purpose  of  the  feasibility  study  is  to  establish  whether 
.a  sufficient. number  of  institutions  with  J^^cge  Mexican-American 
enrollments 'Can  be  foifnd  and  recruj^^ted  to  partici^pate  in  a  validity 
study.    If  SQ»  a  two-year  study 'of  the  relatiotis|ftip  between  SAT 
and  college  grades  will  be  conducted  to  uetermine  whether  the  lew 
correlations  between  SAT  and  college . grades  fbt  Mexican-Americans 
(as  found  in  earlier  studies)  can  be  attributed  to  (1)  l-esTser  .  ■ 

Itltrinsic  relationship  between  SAT  and  freshman  GPA^  (2)  lower 
reliability  of  the  SAT,  or  (J)  lower  reliability  of  the  GPA  for    '  - 
Mexican-Americans y  or  (4)  some  combination  of*  these  factors. 

*  *  •  * 

Progress  (as  of  August,.  1979)  . 

.     The  project  has  just  begun.      .  ' 

ScheAiie  for  Completions  •  , 

•    The  feasibility  study  will  be  completed  by  September  30,  1979.    .  ' 


Title;    Handicapped  Students  and  the  SAT 

*  .       *  '  o  *       ■  . 

J      ■  ^  '  ■  .        .  ■  ■ 

Project/Job "^Numbejr:     142/56  Project  DirectQt:    Marjorie  Ragosta 


Purpose 

The  purpose  of  this  study  is  ^  pteliminary  investigation  of 
(1)  the  perceptions  of  handicapped  students  about  . the  SAT  and  the 
conditions  under  which  it  is  adndnlstered  especially  as  they  relate^ 
to  the  individual's  j^ndicapping  condition*       '      ^  . 


PrferesB  (as  of  August » 


The  project  is  dlvi 
been,  completed*    Phase  X 
search  designed  to  iQok  for 
with  various  handicaps^ 


phases,  the  first  of  which  haa 
of  three  it^asks:     (1)  a  literature 
1  testing  conditions  forepersons 
lllisphone  survey  designed  to  locate 
colleges  and  universities  usljigi  the  SAT  and  having  large  pt)pulations 
of  handicapped  studonts,  and^.O)  development  and  field  testing  of  an 
interview  schedule  for  use  in  Phase  II  of  the  study. 

A  progress  reiSort  wa&  prepared  for  approval  before  Phase  id 
would  begin*    Phase  II  includes  interviews  with  handicapped  stu«tfits 
in  six  selected  universities  and  the  production  pf  a  final  reportX 


Schedule  for  Completion 

•  Phase  II  ^s  scheduled  for  completion  December  31,  1979. 
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Tltl(^  ^  Personal  Qualities  In  Admissions  -  Phase  I  .      '  ^ 

^Projei^/Job  Number:.  IaO/XX     Project  Director:    Warren  W.  Wllllngham 

I  »     i  .       ■  ^ 

Purpose  .      ,  ' 

i       The  primary  purpose  of  the  project  'is  to  evaluate  the  ijsefuiness 
of  personal  qualities  (beyond  the  usual  grades  and  test  scores)  in 
n^lecting  college  students  and  in  understand itig  student  decjl,61ons 
fo  attend  college.    Nine  private  colleges  are  collaborating  in  the  studyt 


Progress  (as  of  July.  1979)  ■■'  " 

■   ■  ■     •  u  ■  . 

Considerable  staff  time  has  been  devoted  in  the  early  stages 
J  of  the  work  tp  planning  dieetings,  organizational  activities,  visits 
to  campuses  of  participating  colleges,  and  other  activities  essential 
to  establishing  good  working,  relationships  and  getting  underway.  ^ 
Similarly,  institutional  participants  faced  major  tasks  early  in  * 
the  prpject — preparing  j^detailed  description  of  their  admission^ 
.policy;  and  procedures,  adjusting  their  operational  routines  t^  the 
demands  of  the  project,  and  training  staff  for  the  work  involved. 

Institutional  work  on  behalf  pf  the  project  has  been  substantial.  ^ 
Each  of  more  than  25,000  admission^  folders  has  been  given  a  careful  ^ 
reading  by  admissions  staff  and  faculty  in  order  to  produce  Some  20  $ 
special  ratings  of  personal  qualities.    At  each  institution  a  number 
of  records  have  been  rated  two  or  more  times  independently  to  provide 
Information  about  the  consistency  of  different  types  of  judgments..  | 
Finally,  those  ratings  and.  other  essential  parts,  of  the  application— 
some  300^000  sheets — are'^eing  copied,  assembled,  and  forwarded  to 
the  project  staff  in  Princeton.    All  of  this  work  has  proceeded  very  '  ^ 

nearly  on  schedule  with  no  serious  mishap. 


The  initial  stage  of  dat^  coding  and  entry  on  tape  has  J)c^en . 
completed  for  approximately  half  of  the  total  group.    A  second 
major  stage  of  data  preparation  involve*^  systediatic  rating  by  ETS 
staftf  o*f.  a  number  of  personal  qualities  of  students  (e.g..,  work 
experience,  leadershipf,  community  activities,  special  talents, 
references,  etc.).    Considerable  progress  t)as  been  made  In 
experimenting  with  subjective  rating  procedures  and  training 
project  staffs  to  make  reliable  research  ratings  of  various  aspects  ti 
of  the  applications  that  will  complement  the  judgments  oj^'insti-  . 
tutional  staff  and  faculty.-  That  experimental  work  has  proceeded 
quit^  satisfactorily  ai^d  it  is  now  dlear  that  praters  can*  be  trained 
to  distingui9h  reliably  among  a  number  of  Important  student 
qualities,    f  .   *  a 

Schedule  for  Completion  <t/ 


i 

olect  is  schedu 


Phase  I  of  the  project  is  scheduled  for  completion  ^n  January 
.1980.  V 
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B;    PROGRESS  REPORTS  FOR  JIeSEAR^  PROJECTS  OF  THE 


GRADUATE  MAN AGEMEriT  ADMISSION  COUNCliX* 


nODD 
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I 


/  ■ 

j 

i  • 


'     •  ^-  ■  •':     ■:•  ■:  ■■■  •  .■;  .  .....  .  '■  >.  •■  ■-.  ■I. 

S..>-;.i*-;H\.i  •     .  ...  ... 

fdtle:    AaaeBBment  of  Interpersonal  Competency  .        ^  * 

Proje<it/job  Number:    693/77       Project.  Director:  Lawrence  J*  Strieker 


Purpose 

"*    '       '■  i     '  ' . 

..  The  aim  of  this  study  Is  to  (fi^)  develop  a  prototype  measure  of 
Interpersonal  c6n|>etence  based  oh  the  videotape  presentation  of  a 
common  social  situation  la  a  business  setting  and  (b)  obtain 
preliminary  data  on  the  device's  Item  functioning  and  reliability » 
and»  to  the  extent  feasible^  validity*       ;  *•  — 

Progress  ^as  of  July »  1979)        «  ,  / 

.As  a  first  step  In  detailed  planning  of  the  Instrument^  /' 
author^les  on  Interpersonal  processes »  executive  assessment  and 
training)  and  simulation  measures  were  extensively  consulted*  Tbe 
pertinent  literature  was  also  reviewed*    Based  on  the  consultations 
and  review!  a  blueprint  for  the  measure  was  prepared*    A  large 
numbier  of  m:enes  portraying  a  vaVlety  oiE  situations  were  drafted  and 
edited*    The  scenes  and  accompanying  Injst Actions^  In  paper  and  « 
pencil  format »  wei^e  tried  out  and  successively  revised  after  a 
series  of  pilot  tests  with  individuals  and  small  groups  at  ETS  a|s 
well  as  with  two  classes  of  undergraduates  at  business  school*, 
A  videotape  containing  all  the  neqessary  instructions  together  with 
exercises  based  on  the  scenes  was  f ilmed^  narrated^  edited^  and 
copied*    The  videotape  and  accoiqpaayln^  material  were  pilot  tested 
iiifdivldu ally  with  ETS  employeed*  'A  small  scale  study^  in  conjunction 
with  9  sepaiBte  investigation  by  Wand/i  Rapacznski^  was  carried  out* 
The. Videotape  and  other  instruments^  including  experimental  measures. 
of'iu:curacy  in  social  perception^  a  vocabulary  test»  the  Embedded. 
Figures  Test^  and  a  background  quest ionpaire»  were  given  to  59 
collage-age  women*.    Procedures  t^f  rating  the  responsefs  to  the 
videotape'^measure  were  deve loped »  .  the  cooperation  of/  two  expert 
Judges  obtained)  and  the  ddta  analysis  is  underway  *  .  * 


Schedule  for  Completion 
September^  1979* 
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Title:  .  Technical  Report  on  Test  Development  and  Score  ' 
Interpretation  tot  GMAT  Users 

Pro1ect/Job  Number:    693/79    Project  Director:    William  B»  Schrader 


Purpose 

To  provide  GMAT  te^t  users  and  others  concerijed  with  the 
technical  quality  of  the  test  and  related  services  with  the  basic 
information  needed  for  understanding  the  processes  Involved  in  test 
development  and  score  Interpretation.    Reliability,  validity, 
speededness,  and  score  equating  will  be  discussed  In  terms  of  their 
contribution  to  program  objectives. 


Progress  (as  of  July,  1979) 

Basic  data  and  reference  sources  for  tYik  manual  have  been 
collected,  apd  a  draft  of  the  initial  section^bn  test  development 
has  been  written*  ^  '  •  . 

Anticipated  Completion  and  Diasemlnation 

Referenced  work  is  substantially  completed,  and  it  id 
anticipated  that  it  will  be  published  in. the  fall  of  1979» 


ERIC         ■   -        ■  ,  ^ 


Title:    Differences  In  Item  Pegfornance  Acroaa  Groups 

•  •'■       T      1  • 

V     Project /Job  Number  i    693-81        .  |  Pro joftt  Director  :  ,Laralne  Slnnott 
Purpose 

*^     The  study  will  examine  the  extent  of  Item  bias  within  the  GMAT 
relative  to  groups  characterized  by  their  sex,  race,  age,  or  language 
fluency* 

■  ..-  .      ■     ■  i 

Pyogress    (as  of  July,  1979) 

The  January  197i3  test  administration  will  provide  the  study's 
data.    The  aa^iple  has  been  drawn  and  data  analysis  Is  undeijway. 


Schedule  for  tompj,etlon  ■/ 

It  Is  .  anticipated  that  data  analysis  will  be  completed  . by 
August  30*    A  draft  of  the  final  report  will  be  available  fot  the 
Selection  Committee's . fall  meeting. 


TltJ^e*    Construct  Validity  of  the  GMAT;    A  Factor  Analytic  Study 


Project/Job  Number;     6.93/92         Project  Directors;     Spencer  S.  Swlnton 


^^Dbnsld  A»  Rock 
Donsld  E»  Powers 


Purpose  . 

A  factor  analytic  study  of  the|^MAT  will  be  undertsken  to 
determine  relevant  dimensions  of  test  variation  in  several  forms  of 
the  GMAT  and  for  several  subgrpups.    The  r^ationshlp  of  each  of 
several  experimental  item  types  to  the  dimensions  underlying 
performance  on  current  operational  ftDnns  will  also  be  determined* 


Progress  (as  of  August^  1979) 

Specif icstions  for  drawiiig  several  samples  from  two  GMAT 
administrations  (from  three  test  forms)  have  been  develoiSed; 
Ssmples  are  being  drawn  of . 1, 000  cases  of  item-level  responses  of 
examinees  frpm  £prmB  ZBSl  (November  1977  and  March  1978),  ZBS^  and 
K-YBSl  (November  1977). 


Schedule  for  Completioh    .  .         "  • 

All  analyses  sre  scheduled  for  completion  by  Spring  1980  so 
that  a  final  report  can.  be^prepared  by  June,  1980»    A  detailed 
progress  report  dealing  wtih  structure  snd  psrallelism  of  the  forms 
is  to  be  submitted  on  November  30,  1979. 


\ 


\ 
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GRE  Number;  73-3 
Project/Job  Number:  822/01 


Project  Director:    Michael  V*  Levlne 


Purpose 

.  ■        ■  ♦  ■  ■ 

Current  aptitude  test  models  and  scoring  procedures  my  4e 
Inappropriate  for  dome  exceptionally  creative  examinees,  examineea 
with  atypical  cultural  or.  educational  backgrounds,  arid  copiers. 
Some  of  these  aberrant  examinees  are  expected  to  produce  unusual 
patterns  of  item  responses*    The  main  purpose  of  this  project  is  to 
develop  an  objective  way  to  use  the  exatoinee's  pattern  ot  right  and 
Srrqng  answers  to  decide  whether  a  test;  is  an  appropriate  measure  of 
his  or  her  ability* 


Findings  .  » 

Several  appropriateness  indices  (statistics  for  identifying 
aberrant  candidates)  have  been  defined  and  evap.uated.    The  basic 
idea  of  appropriateness  oeasuriement  has  been  supported  by  Monte 
Carlo  studies  and  studies  with  GRE  data;  moderately  and  extremely 
aberrant  candidates  can  be  Identified  by  their  pattern  of  item 
scores* 

A  Research  Bulletin  (RB- 76-31)  has  been  completed  and  submitted 
to  the  Journal  of  the  American  Statistical  Society*    Two  additional 
articles  are  being  prepared*  .  Work  on  the  project  is  continuing  at 
the  University  of  Illinois,  where. a  dissertation  on  the  topic  has 
been  completed* 


Schedule  for  Completion 

A  final  project  report  will  be  submitted  to  the  GREB  Research 
Committed  in  September*  1979*  ^ 


.*Thlfl  project  is  sponsored  jointly  by  CEEB,  GREB,  and  ETS* 


234 


Titl^:    Normlng  and  Validation  of  a  Machine-Scorable  Test  of  Field 
Dependence-Independence  -  *       "  * 


GRE  Number:    75-7  Project  Directors;    *el  Ganq)bell 

Project/Job  Number:    5.A6/2^  \       .     Thomas  Donlon 

Purpose  ■•• 


This  project  undertook  an  experimental  administration  .of  a 
machlne-scorable  te^t  of  field  dependence-Independence  In  the  v 
October  1976  ORE  Aptitude'  Test  administration  to  a  sample  of  about  > 
20^000  students*    Using  data  ffoi^  the  background  questionnaire  in 
tt^e  registration  form  and  follow-up  questionnaires  Immediately  after  ' 
the  test  and  approximately  20  inonths  later,  test  resultts  wllX  be 
related  to  undergraduate  major,  graduate  major,  persistence  in  major 
chosen^  and  academic  performance*  ■      "  '    *  ^ 

Progress  (as  of  July,  1979)'* 

Follow-up  questionnaires  were  mailed  in  November  1976  %o  all  • 
students  registered  at  those  centers  where  the  Figure  Location  Test 
had' been  administered  in  October*    A  second  nailing  was  made  in 
April  1977  to  non-respondents*    An  initial  analysis  oiE  approximately 
9,500  cases  was  reported  to  the  research  committee  in  January* 
1978.    .  . 

A  second  questionnaire,  designed' to  elicit  graduate  school 
experience  as  well  as  :,8ome  attitudes  and  values  was  jna lied  in  early'  ,  «^ 

July  1978*    The  follow-up,  however,  was  delayed  until  October  by  . 
processing  delays,  such  as  the  necessity  of  fiand-darkenlng  the 
machine-printed  registration  numbers  which  were  rejected  in  substantial 
number  by  the  scanner*    A' total  of  3,378  usable  questionnaires 
were  returned*  ,  , 

Data  analysis  fpr  the  validation  part  of  the  study  has  been 
started*     Initial  findings  show  limited  evidence  for  any  general  . 
.contribution  by  FLT.to  graduate  performance  beyond  what  is  already 
4vallable  through  GRE  V  and  Q*    More  Metalled  analysis. by  major 
field  is  continuing*  ^  \ 

Schedule  for  Complefclon  ^  ^    ^  ' 

■  '      \  . 

Results  of  the  first  phase  ;of  the  project  were  reported  to  the 
Research  Committee  in  January,  1978*    A  final  report  will  be 
sujbmitted  to  the  GRE  Board  in  January,  19B0* 


\ 
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Title)    Career  Achievement  and  GRE  Scoree      .  . 

GRE.  Number i    7.6-1  .  Project  Director :  ' William  B.  Schrader 

Project/jpb  Number:   .546/25    .  ... 

'  ' ' PurpgsiB   ■       .'v "  '     ■  ■  •' ^  ^  ^^'^  ■     '     y  '         f  '    '  '"'  '^  ^'      -     '  ^ 

.   ''to  examine,  the  r^^iatloniBhip  between 
>.':  sclent l£lc  priKfuctlVlty^bf  psychologlpts  anil  his totlans^  and  .t;<K^^^^ 

iexplore  the  ueefulness  .p£  bloicaphlcal  dlyectorici  and  cltatlbi  v 
Indices^as  souTcea  of  iiiifiimatlott  on  attalnmei^ts*',^.  .  \ 

■ '•  •       *  :  /  '  ..' V. ■ -"''^    !  ''-v-' ■' "'"^ ''^ "-^ 

bindings  ■  ■    '  ■  .  '-  J^^''^^  ' „ 

.  Alaio ng  the  va rl bu 9  tnees u r«8  *  of  *  pt oduc tl vl  ty  and  p t; pf  e ^ s lonal  ,  ^ 

^  contribution  included  In  th^  studleB,  th^  total  number  of' .cltatidna,  J 
•  "  as  obtained'  from  the  Social,  Sclencfes  .Citation  Ii^iex,.  was  Wrtdl'deJfeA  :  \, 
y  to  b(^  oJE"  special  interest*  ^  Coi^relatlpna  of  the  tiKre^  Gjl£  8corvi.;^.  ,^  ii^  j^^^^^^ 
with  tot^,  citations  for  150  psychoiq|iafes  and:B 
follows!'  .   V"  V  ■    '.      .  ^      • .  ■      '  ■  ■■      .J;  — ^     ^.  %     '    • ' 


■*  .        :.     ;     Psychologi*s)Ds  ?     ^    Hl^ori'arts ;/ ^  .  "J  V„r-^^^^ 

-GRE-Verbal'-   '  ..-27  '.•  vvf  \>/     1^5  ^  "  •:.  .. 

GRB-Quantltatlve-     ^  .  .    -31 ,  .  .    :*(IQ       o  %  --^*  ; 

GRE  Advanced      ;\     /  ,Ai     .  „       -^1^14  -     ^  £         .  / 

Although  all  three  coefflfclents  for  psychologlstf  were  slgnlfltant    :    .  C 
at  the^ii  .  levels,  atid  none  of  otKe  three  cbef  ficlentd  for  historians      .  V"  ■  • 


'  ■  -y^-'-i' .  v^r^  statlsti<j4lXy  aignlflcaat,  |^e>  spples  were  too  stwll  to  „ 

■     i -mtrmt  deealiiBd  .pomparlsona  or  strong '^conciailofis*  xKeA^sulis-*. 

.  are  "sSifMclfently«  prmislngt  iiov^^^^  fuftjiet^ 

-  \^  s'tujiles  ^ased  «on  larger,  provide. 4ia|^l^ul  J^^nf  armatlon 

^  a^out  th^  extetit '  to  'w^ilch  car^er^  aphievemen^^^^^^  El-^Xds  can 

^  ^  -^be^  pr€dlijCJ:ea  •f^oqii;GiaE,/sfbxf^ .  \v  ■ V'.-"  '^'T'    - « '  \  "'^  '  f  «     . \ 

'•^•"i  '  » y-Dissemlniajtio^"        - -    '  '^7*      ^ '^^-^"'^ '     '  ■  ^  ■         v  -*  J 


•.  :     Thr  repdW.iar  'psyjpholcJglstm/w^^^  fte#Ba[f  jph  / 

.  .  jr6p©rt^  GI|jE&  UTo/  7*'8lft;  ^Sepi^tobVrr i9:73»CA;!|ii4^^^^^^         of  th^      .  ;    -      .  ;^ 

and  will i)e^pubI;ished  iV't^^  :  -  -V ;\     .Cv^^" "-^ 


id 
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Title:    The  Effect  of  Increased  Test'-Taklng  Time  on  Test  Scores  by 
Ethnic  Gyoup,  Sex,  and  Age " | ^ 


GRE  Number:  76-6 
Project/Job' Number?^  546/30 


'Project  Director;     Cheryl  Wild 


Purpose     ^  ^  . 

»      -/       *  *  *.•'*. 

*    \  The  project  Is  deslgaed.tio  determine  whether  the  4Xlotinent  of. 
/toore^lwe.  par  feat  item  wlll  "Result.  In  &.dif  fer  -score 
**  ii^^^  aeiitj^i^d  subgroups  of  test  t^k^rsV  •  Experlinental 

•  •  pr Aefl.ts  wiA^tl^^^  daci' 'setTs  of .  Yer|41  artd  ^u^ntliaUve  Items  were 

admtoltt^ref  wlt^^  ael^ct^d  test' 


-    -T.     J?hlB  ttud5^*'ihv4^^  ^fftfcfes  ctf  -ijtcteaslng-the  test  ■ . 

,^tiiBo  to"  fediucie  the  stseedednc^s  -bf^  the; Verbal  Sh^rquaati^Utlve 
e)c|>toclBen|aV«^tltOtii  of  the^  (GRE)  '. 

-:;Vij5tiJtjide/'I^B^>  i9'76v*„at  appro3(lfta^tely  5^^,domB8tlc  v 

'[J^  a  Verbal  experimental 

'  -';tjHat:;;ajvd,^^  were  adminlBtered 

•V^tblt^^^  time  on  acbrea:. 

£o5  Mho irltyrgroup  vers u  on  male  vera ua 

^^fejiale  exartlhe€sa;\iaild  on  ^ejtai^  el^paed. since  they  ' 

-.*y*eccive.d  tfie  baccalatireate  .de3|;&e  .atfe"liMrestlgat;ed.  •  iUt^hough  the* . 
!<:'2(Hiiinute".ej^penw  W  gen'^riliy^rapre 'epeedeil '  than  tbp,  " 

'  30^nute  .  teatr/  the;,.ten*dddJLtional  mlnuteft  resulted  In  ja  small- 
^    s^ore  gain  tar  all  groups /-and  dlf|ei?entialec(afe  gains  were  Hot., 
^*.j.  jPounC''betW^en  the  Su^gro  On  the  baals  of  .  t|G  reauite  of  this 

V-r;%tud:^t  vthfe'^extefiBlo^  of.  testing  fidW  for  the  .GRK  Aptttudfe'  Test  forj 
^  *  the.  purpose;  of  ^ttLducinfo-tntetgroup  differences  4.^-  iJbt,  Indicated. 


rt  j^chedvle  for  Completion 


^  ^  Submitted  to  the. pE  Bo^rd  In  AprUt  1979. and  pwbUsherf  ln'  - 

r  "jw&;197JfiS  ,a8  dREB  llesfearch  l^eport  No.'  7,6-6R4 ;  4  .  /  f 


J 
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Title:    Older^tudehts  and  the  Graduate  Record  Examinations;     ,  . 
A  Preliminary  Investigation 

GflE  Number:    76-13  Project  Directors:    ^oan  Baratz 

Project/Job  Number:    546/64  Terry  Hartle 


Purpose  ^ 

The  purpose  of  .the  i^tudy  Is  a  prellmlnary^nvestigatlon  of  the^ 
characteristics  and  graduate  student  plans  of  older  persons  who  ^ 
took  the  'ORE  In  a  ro^nt  year,  the  problem^  encountered  by  sample 
of  graduate  programs  In  the  admission  of  older  students,  and 
recommendations  of  w^ys  in  which  the  Board  apd  program  staff  might 
assist  universities  In  dealing  with  the  admissions  problems  presente 
by  .older  Btudents.  ^ 


Findings       "       .  ^ 

The  records  of  more  than  230,000  men  and  women  who  took  tHe 
ORE  Aptitude  Test  during  1975-76  were  examined  for  differences 
between  those  who  were  completing  college  at  the  usual  age  of  22 
or  younger  (about  48Z  of  the  test-takei^s) ,  and  thode  who  had  com- 
pleted their  undergraduate  degrees  more  than  8  y^rs  earlier  (about 
8%  of  the  test-takers*)    Though  on  the  average  the  older  groups 
scored  lower  on  the  verbal  and  quantitative  GRE'  tests,  more  of  the 
differences  In  verbal  scopes  were  consistent  with  'differences  In 
an^clpated  fields  of  graduate  study.    The  average  verbal  scores 
of  older  men  and  women  usually  were  about  the  same  as  those  ol^ 
22-:8eai'  olds  when  comparisons  were  made  within  a  given  field. 
In  fotct,  women  more  than  8  years  beydnd  the  bachelor's  degree  often 
averaged  higher  verbal  test  scores  than  did  younger  test-tj^kers 
who  were  planning  graduate  study  In  the  sai^  field. 

Older  test-takers. Consistently /averaged  lower  scores. on  the 
quantitative  test.    Differences  In  performance  oh  the  verbal  and 
quantitative  tests  may  reflect  differences  i&  opportunities  for 
adults  to  maintain  verbal  and  quantitative  skills,  with  much  more 
verbal  stimulation  in  everyday  living  for  most  persons.  Also, 
proportionately  fewer. dlder  candldatea  planned  graduaO^  study  In 
scientific  or  technical  fields. 

'  ^.    '  ' .  • 

Dissemination  ^ 

A  final  report  on  the  backgrounds  of  older  ORE  test-takqrfi 
was  completed  in  April,  1979,  and  Is  being  published  as  GRE  Board 
Research  ttepo^rt  No. 76-13R. 

Interviews  also  were  conducted  qn  about  a  dozen-  campuses 
xonceirning  departmental  experienced  with  older  applicants  for 
graduate  admission.     A  report  of  these  Interviews,  with  reccjmraen?^' 
datlons  t"p  the  GRE  Boai;d  about  the  usee  of  *GRE  scores,  was  sub-^^ 
mittfed  to  the  GREB  Researcfi  Committee  in  Septembe^;  1J078.  ^ 


m 


T^tle:    Further  Research  on  DAta  Collected  for  the  Dimen^ioris  of 
Quality  Project 


GRE  Number:  77-2 
Project/Job  Number:  .  546/57 


Project  Dlrecfors    Mary  Jo  Clark' 


Purpose  * 

■        •  ■   ■  .      /  ' 

The  purpose  of  this  work  is  to  increase  our  understanding  of 
the  processes  and  outcomes  of  doctoral  education  through  the 
intensive  study  of  selected  graduate  pn^graros*    Data  A^ere  collected 
from  advanced  graduate  students,  faculty  members,  and  recent  alumni 
in  departnenti^  of  chemistry,  histor^r,' and  psychology  at  25 
representative  universities  for  the 'recently  completed  CG§/EtS 
project  on  the  Dioensionb  of  Quality  in  Doctoral  Education. 
Qugstiona  such  as  the  effect  of  sulpr^isciplines  on  program  evaluation,, 
the  employment  patterns  of  graduates,  and  personal  vs.  gituertiohal 
influences  on  faculty  productivity  will  be  investigated  by  using. 
individual  questionnaire  respondents  as  the  unit  of  analysis. 


/ 


Progress  (as  of  July,  1979) 


/ 


The  analysis  of  the  extejlit  to  wt^cb  questionnaire  responses  of 
faculty  members  and  titudents  can  be  attributed  to  consistent 
individual,  university,  und  department  effects. is  being  completed 
in  a  way  that  will  be  most  useful  in  the  revision  of  questionnaires 
for  operational  use  in  program  reviews  (currently  sponsored  by  GRE 
and  CGS),  as  well  as  for  d  report  to  the  GRE  Board.    Analyses  have 
also  been  carried  out  to  Investigate  sex  difl^rences  in  faculty 
opinions  and  behaviors,  faculty  publication  records  in  relation  (o 
the  prestige  of  their  employing  departments, ^and  variations  in 
questionnaire  responses  by  faculty  ipembers  in  the  subdisciplines  Of 
psychology.    Draft  articles  for  publication  are  underway. 


Schedule. for  Completion  *  ^ 

Pindlngs  w&^Pbe.  disseminated  as  ^ticle^  in  appropriate 
professional  journals,  with  a  final  report  to  thq  Board  as  soon 
as  the  articles  are  completed* 


ERLC 
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Title:    Information  Needs  o£ 


bectlve  Graduate  Students 


GRE  Number:,  77-8 
Project /Job  Number: 


Purpose  * 


5A6/32 


Rodney  t.  Hartnett 


The  purpose  of  this  research  Is  to 
separate  but  related  aspects  of  the  achool^^ 
Information  at  the  graduate  school  level: 
Important  Inf lu^ncers  to  applicants''  choices'  c 
programs?;  (2)  Whiat  specific  Information  about 
would  probably  be  most  iieXpful  to  prospective 
how!  likely  Is.  It  that  such  Infotmatlon  can  be 
What  would  seem  to  ^e  the  mo^t  useful  and  efficient 
collecting,  summarizing,  and  reporting  such 
students? 


Findings 


andM^A'''^ 
ce'dur^  for  V 
\  prospective 


The  great  majority  of  graduate  studentd  lnteryiewed  reporti^d 
general  satisfaction  with  the  Information  available  to  them  abou 
graduate  programs*    In  this  sense,  then»  ttiere  does  not' appear  td<^ 
an  information  need. among  prospective  gx^diiate  students.    On  the 
other  hand,  there  is  some^  indication  that  prospective  dtudents 
could  have  benefitted  from  more  and  better  information  If  tl)ey  had 
known  more  about  yarious  aspects  of  graduate  ed^ication  prior  to  the 
.time  they  enrolled.    It  is  concluded  that  more  information  could 
Improve  the  graduate  school  choices  of  some  students,  but  that  It 
1^  not  lively  to  do  so  without  some  formal  effort  to  assist  pro- 
spective students  clarify  their  own  Interests  and* goals  and  identify 
the  types  of  information  that  they  need  to  -have  to  enable  an 
accurate  estimate  of  the  appropriateness  of  a  given  department  for 
them* 


Schedule  for  Completion  and  Dissemination 


A  draft  final- report  for  the  fall,  1979,  Board  meeting* 


Tltief    Conatrugt  Validity  of  the  GRg  Aptitude  Tasts  AcrosB 
Populations:    An  Empirical  Confirmatory  Study 


GRE  Number:  78-1 
Project /Job  Kumber:  546/50 

Purpose  . 

'  The  sjtudy  will  examine  th^  GRE  Aptitude  Tests  for  psychometric 
bias  across  populations  by  st^lstlcally  (1)  verifying  the  a  priori 
factor  structure  of  .the  GRE-V,  GRE-Q,  and  GRE-A;^  (2)  testing  the  . 
•  goodaesa  of  fit  of  this  structure  across  black,  vhltei,  male  and 
female  populartons^  <3)  testing  If  the  metric  or  scale  units  the 
test  scores  are  the  same  oyer  these  populations;  and  ,(4)  testing 
whether  the  a  priori  test  reliabilities  are  equal  across  populations 
dubscales  of  item  types  will  be  Examined  in  the  same  vay» 

...     Progress  (as  of-  July,  1979) 

\        '  /  ■  The  analysis  of  th6  GRE-V,  GRE-Q,  and  GRE-A  indicated  support 
%  for  the  hypothesis,  that  each  o£  the  a  priori  factors  was  measuring 
' '  ..the  same  thing  for  white  and  black  men  and  women*    The  measures 

also  were  in  the  same  units  with  equivalent  accuracy  as  indicated  by 
\  both  reliajbilitles;  and  the  standard  errors  of  measurement*  Further 
study,  particularly  to  investigate  the  characteristica  of  groups 
through  the  use  o£  extension  variables  is  undc^rway. 

Schedule,  for  Completion- 

**  •     .■  ■  ■  '  ■  .  ■ 

A  preliminary  report  in  September,  1979,  with  a  final  draftt 
report  in  January,  1980.  .  •  ^  V 


Project  Director:    Donald  At  Rock 

■      •  ^ 


f 
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Title:    A  Study  of  the  Effects  of  Special  Preparation  on  GRB 
Analytical  Scores  .  . 

GRE  Number:    78-2  JProjfect  Directors:    Spencer  S.  Swlnton 

Project/Job  Number:    546/61  Donald  E.  Powers  f 

Purpose 

the  primary  purtJose  pf  the  project  Is  to  determine  the 
susctptlblllty  of  analytic  Item,  vypes  to  shoi^-term  Instruction 
by  developing  coaching  materials  and  pilot . testing  them  at  one  or 
two  local  universities*    If  warranted  by  the  results  of  this' 
feasibility  study,  a  full  scale  study  u^ing  th^.  coaching  materials 
will  be  proposed  as  a  separate  study*     ^     .  . 


Progress  (ais  of  July,  1979) 

Existing  test-taking  manuals  were  secured  and  examined*  ^ 
The  project  directors  have  also  gained  some  familiarity  with  .the' 
t^ype  of  preparation  for  the  pRE  analytical  section  that  is  cu^rr^ntly 
being  off.^red'by  proprietary  coaching  schools*  ■  A  number  of  practice 
items  have  been  written*  <  Data  to  test  the  similarity  of  these 
It&ms  to  those  included  in  the  GRE  sfimple  test  resulted  in  reliabili- 
ties of  •92  and  *87t  suggesting  that,  the  new  sample  items  measure 
sHllls  quite  comparable  to  those  measured  by  the  ifeins  from  the  ; 
sample  test*    The  test-taking  strajtegies  of  several  subjects  have 
.  been  reviewed  in  order  to  analyze  typical  errors  in  each  item  type* 
Familiarization  materials  have  been  developed  and  arrangements  fot 
pilot  use  of  tbese  materials  hasM)een  made  at  a  local  college*  .A 
proposal  f6.r  packaging,  these  materials!  in  a  manner  suitable  for, 
4nall  delivery  and  Valuation  (after  they  have  been' pilot  tested)  . 
has  been  submitted  to  tl^e  GRE  Research  Committee*  .  \ 


Schedule  for  Completion 


An  extended  progress  report  is  being  submlttefl  to  the  GRKB 
in  September, .1979,  with  a  draft  fina^  report  expected  in  January^ 

igao:  . 


\ 


Titles    Documented  AccoppliBhrnente^V  Phase  III 


GRS  Number:    78-3  y       Project  Directors!    Leonard  Baird 

Project /Job  Number;    546|/62  '  Joan  Knapp  ' 


Purpose  • 

Tha  project  Is  the  third  stage  of  a  four-stage  project  designed 
to  develop  an  inventory  pf  documented  acconplisKnents        graduate  , 
selection*    (See  GRE  project  No*  77-3  for  a  report  of  the  earlier 
votk*)    This  phase  of  the  study  is  designed  to  tryout.  the  materials 
developed  in  earlier  stages  in  graduate  departments*    The  major* 
purposes  o^  this  study  ace  to  examine  the  instpiment  developed  in 
Stage  Two  in  terns  of:    (1)  technical  soundness,  and  (2)  the  feasi-i- 
bility  of  1^8  use  in  the  admissions  process*    This  study  represents 
the  transition  of  the  use  of  documented  accomplishments  to  predict 
graduate  ^ichool  achievement  from  a  research  phase  to  a  more  opera- 
tioi^al  phase  during  which  the  ii^tTument  wd^ll'be  tested  in  a  real 
life  situation.  ;^  >  V 

Proi^ress  (as  of  July,  1979)  •  ^  . 

Entering  students  at  27  departments  in  10  diverse  universities 
were  administeiffd  the  inventory*    The  fields  of  biology,  English  and 
psychology  were  'Included*    The  same  students  were  sent  a  f ollowup 
questionnaire  about  thtfir  activities  during  their,  first  year  in 
graduate  school  at  the  end  of  their  academic  year*    Both  instruments 
are  on  tape  and  analyses  are  underway*    Substantive  analyses  of 
students'  free  responses  to  the  inventory  are  also  being  conducted* 

Schedule  for  Completion 

A  draft  final  report  to  the  GREB  is  e3q)ected'in  January, 

1980.*        :  ^ 


Title:    Content  Validity  of  Selected  GRE  Advanced  Testa 


GRE  Nunbeir:    78-4  Project  Director:    Miles  MpPeek 

Project/Job  Number:.  546/63 


Purpose  ■     V  , 

The  purp08e^o£  the  study  is  to  obtain  ln£ondation  about  the 
correspondence  between  GRE  Advanced  Tests:  (  Biology  /  Literatui^e 
'  in  English,  and  Political  Science.    The  study  will  derve  .a$  a  pilot 
test  £or  succeeding  content  validity  studies  of  the  remaining 
Advanced  Tests.  *  * 

•  '  • . 

Progress  (as  of  July,  1979) 

A  revised  study  design,' reflecting  the  major  changes  in  thd  . 
direction  of  the  study  requested  by  the  Research  Conlmlttee,  was 
approved  by  the  Research  Conunlttee  at  their  April  meeting*  ^Develop 
ment  of  the  final  form  of . the  questionnaires  to  be  used  for  e^ch 
discipline  is  underway*  .        «      .     .  . 

.    '    .   .  .    ■  ■ 

Schedule  for  Completion  ,  . 


A  draft  final  report  will  be  completed  by  June, .  1980. 


Title:    Analvaig  of  the  Data  Collected  from  ORE  Test-Takers. 
1975-1977  .  .  - 


GRE  Number:    78-5      .  .  Project  Director:    Paul  HoUand 

Project/Job  Numbar:    546/04  ^  .. 


Purpose 

This  project.  Will  examine  summaries  of  background  information 
supplied  by  GRE  test-takers  and  published  by  the  ORE  Baa»i  (Altman  . 
and  Hollamli  1976;  Altman,  1977)*    Modern  data  analytic  techniques 
will  be  applied  to  improve  the  quality  of  the  information,  simplffy        ,  \  ■ 
Its.  presentation,  and  make  It  more  useful  to  policy  makers  and 
researchers*    Th.e  results  will  be  tiSed  to  improve^ future  summary 
reports,  of  similar  data-  '  ■  ^  . 

'  ' '        •   ■ '      •  .  ■      .  > 

Findings  (as  of  July,  1979) 

This  study  Includes  five  sub-studies  and  separate  summary  reports 
are  being  prep^ared  for  each*    T^e  general  conclusions  of  these  studies 
are  aS  fallows;     (1)  Stindardiztn^  ethnic  group  mead  GRE  scores,  on 
background  variables  is  feaaible  ^nd  does  have^^  sma^l  but  clear  . 
effect*    l.t'^was  recommended  that  similar  standardizations  be  done,  using 
the  new  SES  data#aad  the  reaults'OiC  this  new  analysis  are  tiow  available 
in  a  preliminary  form*    (2)  The  patterns  of  missing  data  in  the  background 
data  are  very  numerous  but  are  almost  completely  explainable  by  ^he 
operation  of  two^  nearly  indep^endent  phenomena,  (a)  answering  all  but 
one  question,  or  (b)  quitting  after  answering  some  of  the  questions  in 
sequence.    (3)  The  effect  on  missing  data  of  the  currently  used  criterion 
for  inclusd^n  in. the  published  tables  is  of  medium  importance  and  it 
should  be  changed  to  reflect  the  Instructions  given  to  the  respondees* 
(4)  The  analysis  of  the.  published  tables  of  counts' and  |()ercenta((es 
using  log-linear  models  revealed  ai  number  of  ways  in  which  complex 
tables  could  be  simplified  without  losing  essential  information*  In 
addition,  the  stability  over  time  of  several  aspects  of  the  test-taking 
population  was  detected*    (3)    The  analyses  of  t)ie  published  tables  of 
GRE  means  revealed  that  many  can  be  described  more  simply  by  row  and 
column  effects.    Often,  the  interactions  are  nqt  large  and  do  not 
Justify  elaborate  disaggregated  tables*  . 

*    ^'  '  ^     ■      •  .  ' 

Schedule  for  Completion 


A  draft  final  report  to  the  GRE  Board  is  expected  in  January, 
1980.    :  '  •  , 
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Title:    A  Study  of  the  Correlational  Validity  of  the  Restructured 
GRE  Aptitude  Test 

^  .  ■    .   •■  ■ 

■  ♦  *  ■ 

GRE  Number:   "78-6  Project  Director:    Kenneth  Wilson 

Project/J^  Number:  5A6/65 


Purpose  ^  .  ' 

The  project  will  study  the  correlational  validit:f  of  the 
restructured  GRE  Aptitude  Test  (shortened  tests  of  verbal  and 
quantitative  ability  and  new  test  o{  analytical  ability)  by  evaluating 
scores  on  the  GRE. Aptitude  Tests  administered  during  1977-78  in 
relation  to  f iA4:  year  graduate  school,  grades  or  other  performance 
criteria  in  a  sample  of  graduate  departments  in  each  of  about  10 
di8cj.plines«  ,  ^Particularly ,  the  study  . asks:    does  the  GRE«-A  8core^ 
increase  the  ability  t^d^redict  typical  performance*  criteria  in  a 
variety  of  fields?    If^Sfb,  in  which  fields  does  the- informs tioii 
provided  by  GRE-A  appear  to  supplement  GRE-V  and/or  GRE-Q,  and  in 
what  ways? 

The  ^ese&rch  will:     (a)  evaluate  trends  in  patterns  of  zero- 
order  coefficients  of  predictors  with  criteria; . (b)  pool  within- 
group.data  across  departments  within  field?  to  explore  the  relative 
weighting  of  the  respective  Aptitude  Test  scores;  (c)  assess  the 
correlational  validity  of  a  residual  score  reflecting  variation 
in  GRErA  independent  of  V  and  Q;  and  (d)  for  selected  institutions^ 
regress  the  accept/reject ' decision  on  selected  admissions  variables. 

Progress  (as  of  July,  1979) 

.  As  of  July  1979,  39  graduate  schools  represented  by  a  total  of 
oyer  150  departments  (a)  haye  provided  names  of  students  eligible 
for  inclusion  in  a  study  sample  and  (b)  are  in  the  process  of 
providing  a  firs t-^'year  graduate  grade  point  average  for  these 
individuals.    Many  of  the  departmental  samples  are  extremely  small  • 
(i.e..,  less  than  10  cases)  l>ut  it. is  expected  that  pooling-pro- 
cedures will  y^eld  interpr/jtable  and  useful  results.    In  addition 
to  providing  inforination  about  enrolled  first-time  graduate  students, 
several  graduate  schools  also  have  identified  GRE  sc6r«  senders  (a) 
who  applied  but  were  not  accepted,  and  (b)  who  were  accepted  but  did 
not  enroll.    Using  these  data,  analyses  will  b^  made  of  differences  . 
between  various  admissions  stages  (e^g*,  accepted  vs*  rejected, 
accepted  enrolled  V8«  accepted  nondnroll^d)  with  respect  to.  GRE  • 
scores  and  other  data.    All  Work  oa  this  prpject  is  being  coordinated 
with  the  GRE  program's  development  and  implementation  of  a  Validity 
Study  Service  for  graduat^e  departmen(;S«  ^ 

Schedule  for  Completion  >^  . 

■    .  \  ■  ■ 

A  final  report  will  be  submitted  to  the  GRE  Board  in  September, 
.1980.  .  • 
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.  Title:  *  Item  Index^  of  Differential  Suburoup  Performance 

.  GRB  Number:     78-7  Project  Director:    Lawrence  J.  'Strieker 

Project/Job  Number;    5A6/66  .  .  - 

•p  "...  *  ■  *  "  . 

.  Purpose  .    "V  • 

One  promising  approach  to  minimizing  test  bias  is  to  identify^  . 
during/t4ie  course  of  the  test  construction,  items  that  perform 
differently  for* the  relevant  subgroups.    This  study  will  explore 
the  usefulness  of  a  new  Index  ill  identifying,  differential  performance 

'  of  GRE  Aptitude  Teet  items  wi th  |espect  to  race  (white  and  black) 
and  sex:    the  partial  correlation  between  the  item  and.  subgroup 
total  score  being. held  constant*    This  procedure  is  free  of  the. 
problems  associated  with  most  existing  methods  and  is  applicable'  to 
comparatively  small  samples.    The  investigation  will  (a)  determine 

-  whether  differentially  functioning  items  can  be  identified  by  this 
index;  (b)  assess  whether  these  items  are  the  same  as  those  earmarked 
liy  two  of  the  most  important  other  methods  of  studying  item  bias— item' 
difficulty  plots  and  item  characteristic  curves;  and  (c.)  attempt  to 
ascertain  content  characteristics  that  distinguish  the  items  uncovered 
by  the  various  prdcedures*    Subanalyses  will  also  evaluate  the  extent 
to  which  the  results  (a)  are  altered  when  the  race  and  sex  samples 
are  matcned'on  the  various  GRE  Aptitude  Test  scores,  and  (b)  can  be^ 
accounted^or  by  chance,  as  Judge(^  by  Monte  Carlo  analyses  of  the 
smallest  ;]r ace  and  sex  samples*  '. 

Progress;  (as  of  July,  197^;  •  ' 

r  ;Data  fox  tV^  GRE  Aptitude  Test  (ZG42)  used  in  the  October,  1977 

and,  January »  197B  administrations  were  analyzed*    Samples  were  drawn 
of  one-fpurth  of  the  white  and  all  the  black  examinees  with  these 
charac'teri sties:     nev^ril^ttended  graduate  school  full-time,  curreii^ly 
'  a  senior  or  unenrolled  college  graduate,  und^graduate  major  in 
social  sciences,  no  test  'irregulatlty »  never  Took  the  GRE  previously 
and  ntfCive  of  the  United  States*    fHe  four  basic  samplea  were  white 
males  (N  -  1122) »  White  females  (N  -  1471) »  black  males  (N  -  284), 
and  black  females.  ^;tl  -  626) •     Samples  with  matching  true  score 
distrlbul^iona  (e*g^^*,  matched  on  scores  for  odd  items  on  the  Verbal 

i^'  test  for  analyses  of  even  items  on  that  tesi)  were- also  obtained; 
the  matched  sai&ples  were  white  females/black  fejuales,  and  white 
fflalei(^jiite  females*    Monte  Carlo >amples  were  also  secured:  a 
randooi  sample  i^f  white  males»  the  -^ame  si^e  as  the  basic  sample  of 
black  males;  tfhid  another  random  sample  of  white  males,  identical  in 
size  to  th^  basic  sample  of  black  females*    The  analyses  of  the 
pattial  c4r;relation8  have  Just  been  completed  and  are  being  examined 
in  detail;  the  analyaes  of  thet^t>ther' indexes  are  underway* 

A  substantial  proportion  of  the  item  partislrcorrelatio^||[ere 
^  significant,  (p  <  -OS)  in  the  miin  analyses  for  race  and  sex*iBRwever , 
few  of-  the  correlations  exceeded  *l0  in  absolute  size  and  the  eignifi- 
''cant  correlation^  variedcJ:n  tln^ir  direction,  not  predominantly  favoring 
ohe  su^roup*    Aidetailed  appraisal  of  these  results  is  being  made,.  % 
focusing  particularly  on  their  consistency  actoss  samples  and  analyses* 

Schedule  for  Completion- 

A  final  report  is  scheduled  for  completion  by  January,  1980* 


Title;    ftesearch  on  a  Revlaed  Format  of  Aitalvgla  of .  Bxplanationfl 
Itema  '.     '.  [  '.  ^- 


GRE  Numbar:    79-^.  Project  Dlrtfctora;    Sydell  Carlton 

Projeet/Job  Number:    546/68  .  Mllea  McPeek 


Purpoae 

A  factor  analyals  of  the  xeatruetured  GRE  Aptitude  Teat 
suggeated  that  the  correlation  between  the  Verbal  and  Analytical 
acorea  might  be  reduced  by  eliminating  one  of  the.reaponae  options 
associated  with  Analyala  of  Explanatlona  Itema  and  replacing  Items 
keyed  to  this  response  with  Items  keyed  to  one  of  the  remalf^li>g  four 
reaponaea*    The  purpoae  oT  thla  project  la  to  determine  vhether  uae 
of  A'-optlon  rather  than  5-oDtlbn  Analylsla  of  Explanation^  Items  In 
the  Analytical  Section  of  the  GRE  Aptitude  Teat  would  reault  In 
Analytical  acorea  that  are  more  Independent  of  Verbal  scores  while 
belng^equally  reliable  and  valid. 

Progresa  (aa  of  July,  1979)  - 

Two  preteats,  each  containing,  the  same  four  aets  of  previously 
teated  Analyala  of  Explanatlona  Itema,  were  prepared*    In  one 
pretest,  the  f lve-chol<;e  control  format,  the  Items  remain-  aa  they 
were  In  final  form  admJJhlatratlon.    In  the*  other,  the  four-chdlce 
•  experimental  preteat,  Items  with  ah  A  key  have  been  removed  and 
replaced  ,  by  preteated  Itema  with  B,  C,  or  D  keys  but  with  almllar 
pretest  statlatlca*    Theae  two  preteata  will  be  spiralled  In  the 
October  1979  administration  of  the  GRE  Aptitude  Teat.  "  ^ 


Schedule  lot  Completion  » 


Adminlatratlon  of  four-choice  and. five -choice  formats  In 
October  1979;  draft  final  report  In  April  1980* 


,  ....  •  '■„■..«.«  ..■  V** 
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D.     PROGRESS  REPORTS  FOR  RfiSEARCH  PRCOpCTS  OF  THE 


LAW  SCHOOL  ADMISSION  COUNCI^ 


4J 


IQIQIQIQI 
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u 
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Title:.  RAearch  op  Proficiency  Ik  Legal  Practice  -  Phaee  II# 

Study  2;    "The *Activitie8  and  Taaks  of  lawyers. in  Ljti&ation 
•  *     Practice"     •  «  $  ' 


Proje'ct/Job.  Number:    688/12       Project.  Dii*ec;:ort.    Rdbert  F.  Boldt  ' 


Purpose 


this  study  Is  concerned  with' obtaining  a  detailed  and  systematic 
description  of  the  litigation-related  work  activities  of  the  ^ 
profession*    The  objective  of  the  study  if  to  gather  quantitative 
raCinjjB  on  the.  activities  of  lawyers  in  advocacy/trtal  practice,  on 
the  importance  of  these  aptivities,  as  judged  by  l.iti^atit}n  lawyers, 
to  th^  discharge  of  their  professional  reaponsibllitilBS,  .and  ^tp 
gather: questionnaire  information  on  demographic  factors  and  the 
lawyer's  characteriratibns  of ^ their  practices*    These  data  will 
.then  be  analyzed  to  (1)  identify  groups*  6£  lawyers  with  similar^^ 
perceptions  bf  the  Importance ^of  activities,  (2)  identify  groups  of 
lawyers  that  distribute  time  to  these  Activities  similarly,  (3)« 
examine  the  8 IaI la rity  of  \g roups  determined  by.  time  ^and^importanceV^ 
(4)  identify  those  aptlvVt^a  that,  fo^  the  groups,  ar^  most 
freqijent  and  most  l^brtant^\(5)  relate  group-membership  to  demographic 
data  and    descriptions  of  theHypes  of  practice,  and  JC6)  make 
recommendations  for  the  Content  Of  rating  forms  that  could  be  ^sed  o 
in  the  evaluation  of  la^yet;  performance*    The  results  will  provide    .  * 
a  d<^sCEipl;ion  qf  the  important  tasks,  of  lawyers  in  a  form  that  will 
be  usefu^  in  guiding  the  development  of  measures  of  the  proficiency 
of  lawyetl^S  in  this  segment  of  practice* 

■  ■  /  ^         '         '  ' 

ProgresI  (as  of  July*  1979) 

job  analysis  i<^volving  observation,  interviews,  and  collection 
of  ^iae-iog  data  for  a  small  sampled  of  attorneys  has  been  conducted* 
A  list  of  th6  activities  of  litigators  has  been  compiled  and  r    .  • 

reviewed*  A  background  questionnaire  -and  instructions  for  responding 
to  the  activities  list  has  been  developed,  pretesit^d^  and  revised*  ^ 

Data  collection  materials  were  sent  to  a  sample  of  6,272 
attorneys  drawn  from  the  >9li|6  Mattindale-Hubble  Law  Direttorv 
and  1^059  women  attorneys  from  the  1974  Membership  Directory 

of  tihe  National  Assoqlatioh  oi  Women  Lawyers*  '  Preliminary  analysis 
Indicates  that  after  three  followiips  1»  704  seta  of  ratiltigs  are  ^ 
.  'available  for  the  idantif ication  of  groups*  antf- group jfwmbfira;  and 
the,  analysis  has  . baan  planned  and  initlatad  for  the  about  1^ 200 
coinpleta  data  cases.  '  ^  *      •   *  *         V  * 


Schedule  for'^Completion  , 

This  atudf  is  scheduled  for  coii|>ietidn  durii^  1979* 

»  *  ■  • 


\ 


5> 


Title:    A  Study  of  the  Characteristics  of  Lav  School  ExaCmlnatlons 
Written  by  Minority  and  Non-Mlnorlty  liav  Students 

.  -         •  .r  ■  .    ■  ■  " 

Project/Job  Number:    890/21*     Project  Director;    Franklin  R.  Evans. 


Purpose  ' 

—  — ^  •   *  • '       *  •    ;  '  " 

The  study  will  attempt  to  Identify  ways  In  which  groups  of 

minority  and  non-mlnorlty  law  students  systematically  differ  In 

their  performance  on  a  law  school  essay  examination*  A  secandary 

purpose  Is  to  use  the  data  to  escamlne  possible  "bias"  In  law  school 

gradlng^and  the  differential  prediction  of  an  "unbiased"  criterion* 


Progress  (as  of  July,.  1979) 


.  Nine  law  professors  at.  eight  law  schools  l^ve  participated 
by  providing  data  from  their  TORTS  plasses-    A  common  essay 
question  was  included  Iti'the  tORT^  final  Examinations.^    A  twenty 
Item  multiple  choice  test  In  TORTS  was  also*  admlnlst-ered  by  8  of 

.  the  ^9  professors.    Supplementary  Information,  auch  as  undergraduate 
grades  and  flrstryear  law  school  grades  has  been- collected*  /the 

."essay  answers  have  been  scored  for  several  Indices  of  riadabll^i:y, 
leg^l^nalyal^',  and  overall  writing  quality*  ^ 

Schedgle  fbr  bompletlori    .  ^  ■ 

.    A  f*lnal  report  wlJLl'W  available  In  1979* 


4; 
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* 

.••••*  ■       ■  '  •  *  •  .        '  . 

41    Title:    Modela  of  Law  School  AdmipsiojnB  Pryedurea 

Projectyjob  Number:    890/22       Project  Director:    Franklin  R.  E.Vana 

Purpose 

.■  > 

The  purpose  of  tfiis  project  is  to  develop  several  toodels 
of  adndlisiQns  procedures*    Each  model  will  be  evaluated^y  comparing 
predicted  decisions  obtained  using  the  rooHels  with  actual  admLsaiona 
decisions*    Models  will  alao  be  uaed  to  investigate  factors  such 
aa  coBt»  the  values  attached  to  certain  .decisions,  and  efficiency 
of  the  .admi«^sions  process*  ' 


Progress  (ss  of  July,  1979)  . 

•  During  1976^^  aite^ visits  were  conducted  to  observe  the  admiaaions 
process  at  nine  law  schools.    Quantitative  4ata  obtained  from 
a  subs#t  of  the  schools  aye  being  analyzed*    At  the^ same  time,  brief 
narratives  describing  each  law  ischool's  admissiona  procedurea 
are  being  written  based  oh  information  obtained  during  the  site 

.visits*    A  prelimlndfl|r  analysis  of  the  data' from  one  school  is 

■  completed*  " 


Schedule  for  Completion  ■ 

A  descriptive  repi>rt  o^ admiaaions  procedures  at  the  law 
schools  is  now  in  preparation* 


1  ^ 
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Title:    A  CpppArlson  of  the  EffectlveneBS  of  Several  Methods  of 
UslnR  AdIUBted  Underftraduate  Grades  for  Predicting  First 
Y6ar  Lav  School  Performance 


Project/Job  Number:  890/41         •   ProJectDlrector:    Donald  A.  Rock 

Franklin  R.  EVans 


Purpose    ,  '    '  ' 

'  i 

This  itudy  Is  designed  to  determine  If  any  of  several  methods 
currently  used  to  adjust  undergraduate  grades' at  one  or  more 
law  schools  are  effective  across  a  representative  sample  of  law 
schools* 

Progress  (as  of  July,  1979) 

A  draft  report  was  submitted  to  the  T  D  &  R  committee  at  its 
October,  1978  meeting.    At  that  .time  the  committee  requested 
additional  analyses.    A  revised  draft  report  was  prepared  for 
the  spring  1979  meeting.    At  that  time  the  Committee  requested 
further  analyses.    These  are  in  progress.  .  * 


Schedule  for  completion  , 

Final  report  is  scheduled  for  coiH)letlon  during  winter,  J979» 
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Title:    Validity  iStudv  of  Three  ExpetHaentai  Item  Types  -  IssueB 
and  Facta.  Analytioal  Reaaonina Aand  Evaluation  of 
Evidence     Administered  in  1975^6   '■  ' 


Project/Job  Number:  -890/61         Project  Directors:    Miles  McPe^k 


of 


Purpose     y  • 

This  project  is  designed  to  study  the  validity  of  Issues  and 
Facts,  Analytical  Reasoning,  and  Evaluation  of  Evidence  for 
predicting  first-year  average  grades  in  law  school*    Of  major 
interest  Xs  the  validity  of  combinations  of  these  items  with  those 
currently  in  use  in  the  LSAT  (Logical  Reasoning,  Practical 
Judgment,  Data  Interpretation  and  Quantitative  Comparison,  Principals 
and  Cases,  Sentence  Correction  and  Error  Kecognition)«    The  effect 
on  validity  of  ^ut>stituting  the  new  item  types  for  certain  of  the 
current  ones  Will  also  be  evaluated* 


Progress  (as  of  July,  1979) 

'  The  three  experimental  item  types  were  included  In  test  forms 
administered  in  1975-76*    Criterion  data  were  Collected  in 
the  1977-78  Validity  Study  Service*  .  ' 

At  the  request  of.  the  LSAC  these  analyses  were  postponed  in 
order  to  collect  criterion  data  on  four  additional  new  item  types 
(analyses  of  explanations,  supporting'  conclusions.,  deductive 
reasoning,  and  evaluating  summaries)  admlnistexed  during  1976-77* 
These  additional  data  will  be  collected  in  the  1978-79  Validity 
Study  Service*  ■   ■    ^  • 


Schedule  for  Completion 

Data  procesalng  and  statistical  analysis  ars  schc^duled  .for  the 
summer  of  1.979*    Results  should  be  available  during  spring,  1980* 


:ERIC 


4 


Title:    LSAT  in  WlAnd. 
Project/Job  Mumbex:  890/%7 


^5 


Vroje^t  Director:    Barbara  Pitcher 


Purpose 

•-^Vf-  '      ■      .  ■ 

T:he  purpose  of^his  study  is  to  eiq)ldre  the  appropriateness 
of  using  th#Law  School  Adndssion  Test  tor  selection  of  law 
students  in  Great  Britain  and  to  study  the  effectiveness  of  the 
test  for  predicting  grades. in  the. first  and  subsequent  years  in 
British  law  schools.  '  ' 


Progress  ^ (as  of  July\  1979) 

Five  law  schools  In  Great  Britain  agreed  to  administer  the 
LSAT  to  their  entering  classes  in  early  October,  1975.    An  old 
form  of  the  L^AT,  of  which  there  was  a  sufficient  supply  available 
and  for  which  item  and  test  analysis  results  were  on  file,  waa 
selected  for  administration. 

Answer  sheets  Were  received  from  four  of  the  law  schools; 
the  fifth  founS  it  Impossible,  because  of  changes  in  persoimel 
and  illiiess,  to  cooperate  as  originally  planned.    Thus,  a  total 
of  A7 3  answer  sheets  have  been  scored,  from  four  British  law 
schools. 

Criterion  data,  including  grades  for  the  entire  three-year 
period  are  being /collected. 


Schedule  for  Completion 

The  final  project  report  is  scheduled  to  be  coiH)leted  in 
1979*  '  . 
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rr.^:  

296  * 


'Title I    Predicting  Law  School  Grades  for  Mlpority  and  Nonminorltv 
.   .         Students:    Beyond  First-Year. Averagea  '    :  ■  " . 

/ 

Project/Job  Num^er;^  Project  Director:    Donald  Powers 

■•  .  .■■  ■  ■  "X 

Purpose. 

•    .  ■  t    ■■    -  •  ■ 

This  study  Id  bf Ing  conducted  In  6rder\o  Investigate  (1)  the 
prediatlve  and  possible  differential  validity  or  standard  preadmission 
.H«asures  (UGPA  and  LSAT  scopes)  for  forecasting  the  academic 
performance  of  minority- and  nonmlnorlty  students  beyond  the  first 
year  of •  law  school  and  (2)  the  predictability  of  criteria  other 
than  global  averages  (e«g«,  composites  based  on  s^ts  of  courses)* 

Progress  (as  of  July,  1979]j  •      .   ^  ^ 

Procedures  are  now  being  devised  for  collecting  data  frrom 
law  schools  that  provided  Informe^tloa  for  a  previously  con^leted 
study  and  requests  for  data  have  been .made  to  30  of  them*  San^le 
-  transcripts  have  been  obtained  from  a6out  30  law  schools  to  assess 
the  ways  In  which  such  transcripts  may  differ  and  to  suggest- 
procedures,  for  their  analysis* 


Schedule  for  Completion 


iule  toi 

A  draft 
Ing  ofltl 


final  report  will  be  prepared  for  the  Spring  19.60 
meeting  of^th^^  Test  Development  and  Research  Committee* 


Title:  differential  Predictive  Valjxlity  of  Writing'  Ability 
ScOreg  for  Minority  Students  . 

•  %  • 

Project /Job  tlumber:    900/06  Project  Director:    Donald  Powers  . 

Purpoae 

The  purpose  is  to  investigate  the  possibility  tfiat  the 
Writing  Ability  section  of  the  LSAT  may  be  . a  better  predictor  of 
first^ear  lav  school  performance  for  minority  students  than  for 
nonmlnority  students*    The  Test  Developmenjt  and  Reaearch  Committee's 
interest  in  this  issue  was  stimulated  by  data  from  a  previous  study 
suggesting  this  possibility*    The  present  study  will  re-examine  the 
.  previously  collected  data  and  attempt  to  replicate  findings  based 
on  those  data. by  using  additional  data.  . 


Progress  (as  of  February,  1979) 

V  ■■ 

Reanalysis  of  previously  collected  da^a  is  partially  completed* 
Results  of  selected  schools  from  the  current  yeat's  Validity  Study 
S^vice  have  be^n  obtained  for.  comparison  purposes* 

Schedule,  for  Completion  . 

A  final  report  will  be  prepared  for  the  Spring  1980  meeting  of 
the  Test  Development  and  Research  Committee* 


307 


;  ■  "  ■  299 

'  ^     Title:    A  Comparison  of  Non-tiattvc  Speaker  Performance  on 
.  TOEFli  and  Verbal  Aptl^de  Teats  .  ■  . 

:  jProJect/jdb  Number:    575/31  *    Jroject  Director:    Paul  J,  Angelis 
Purpose 

The  purpose  of  this  study  was  ta  relate  the  perfo^nce  of 
non^ative  English  speaking  graduate  and  undergraduate  applicants 
on  TOEFL  to  their  performance  on  the  GRE  verbal  or  SAT  Verbal, 
including  TSW^*    A  secondary  purpO0e  wks  to  gather  assessments  of 
the  appropriateness  of  the  item  formats  and  test  content  from  a 
group  of  English  as  a  second  language  spec4.a lists* 


Progress  (as  of  *^^|h}-979) 

The  final  reporvis  nofW  .in  the  review  process. 


Schedule  for  Completion 

The  final  report  will  be  available  by. late  summer  19)9* 


0 


A 


Title:    An  Exploration  of  Speaking  Proficiency  Meaaurea  in  the 
'  TOEFL  Context 

 ^   .     •  ■ 

Project /Job  Numbers  .575/32     Pro jedV  Directors:    John  L.D.  Clark 

.f  Spei^cer  S,.  Swinton 


Purpose 


This  projjict  involves  the  dievelopment  and  experimental 
administration ^bf  a  variety  of  item  types  and. formats  f or Jcne 
dirfect  testing 'of  English  speaking  proficiency  vrLthin  theftOEFL 
can4idate  population.     In  addition  to  the  experimental  me«ures, 
examinees  will  also  be  adml0f£»tered  the  Foreign  Service  Inajjltute 
("FSI")  prttf  iciency.  interview  as  a  criterion  measure  of  sp^dv*" 
ability »  as  well       the  non-speaking  (listenltig  comjrtTfehension, 
structure,  reading)  sections  of  the  current  TOEFL.    Factont  analysis 
and  other  techniques  will  be  used  to  determine  the  interrelationship^ 
between. experimental,  criteripi>» Sand  TOEFL  measures.    The^f^  analyses, 
togetheYwith  a  consideration  pf.'  the  relative  ease  Of  administ'^ation, 
face  validity,  and  other  characteristics  p£  the  experimental  item 
types,  will  be  used  to  identify^  a  ju^jsjet  of  item  types  w|.j:h  . 
potential  for  operational  use  Within  t^e  TOEFL  program  ad  a  j 
direct  test  of  English  speaking  proficiency. 


VProgreqs  (as  of^^ugust,.  1979).  '  i      .  *  ; 

The  final  rej^rt  has  been  (^gjjpleted  1)^  Internal  review^' form  and 
being  circulated  for  review. r 


Schedule  for  Completion      ^  J . 

Final  printed  report  should  be  available  by  August  30,.  J:9t79. 


Titles   Unguage  Skills  in  Academic  Study  and  Performaace 

on  TOEFL  ^  v;:'  > 

.  Prdjftct/Job  Numberj  ^  575/60.^  Project  Direct*>r:    Paul  J.  AngeUs 


Purboae  v 

.  ^   ^  . 

The  purpose  of  this  etudy  is  to  collect  and  analyze  data 
indica.ting  the  English  skills  tf'equired  for  successful  academic 

.vork  i6>t^e  principal  graduates  and  undergraduate  fields  studied 
by  foreign  students  in  U«S«  institutions*    The  principal  components 
of  the  itudy  vlll  be  coli^ection  of  curricula,  information  fromj 
institutions,  and  intervfewe  with  students  at  thd  coiqpletion  / 
of  a  full  year  of  study* 

"'^     .  '  . 

Progress  (aa  of  Augusts  1979) 


.         A  faculty  questioiinaire  has  been  prepared  and  reviewed  by  a 
cogmittee  of  representatives  from  the  fields  chosen  (Business^ 
Chemistry  ^d  Clyil  Engineering).    Pilot  and  Full  administrations  of 
the  questionnaire  vill  be  conducted  in  fall  1979*    Graduate  student 
ifilervieva  are  being  conducted  in  summer  1979* 


Schedule  for  Comoletiton 


on  b^c 


The  study  is  planned  for  completion  byl early  4980« 

4'         \  1  ■ 
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.Title!    Developnent  of  a  Manual  for  Intftltuy.onal  Language 
Growth  Analvals 


Project/Job  Humbert    575/61       Project  Directors:^  Spencer  S.  Swlnton 
«   Paul  Ji  Angells 

ft^gppaft  ^^^^  ^ 

This  flel^i^M  development  project  will  yield  a  manual  to 
*  assist  Engllah«a8-a-Second-Lan8;uage  dej^rtmehts  In  analyzing 
predicting,  and  interpreting  cnanges  in  language  test  scores  over 
time* 


Progress  (as  of  August,  1979) 


A  worked  example,  involving  a  pretest,  a  reliability  test,  and 
a  poSttest  of  data  from  the  tfall  aemester  at  San  Francisca  State 
University  has  been  analyzed  using  the  SPSS  package  and  presented  to 
members  of  the  department.    Initial  reaction  suggested  tlyt  the 
original  presentation  was  too  technical,  aad  a  revision,  in  a  more 
step-by-8tep  fo^t,  is  being  prepared  to  guide  department  membecs 
in  performing  and  interpreting  the  analyses  on  their  own. 


■Schedule  for  Completion 

■  ■  ■•» 

The  revised  nanual  will  be  ttied  out  with< ^n  additional  department 
(using  sumnBr  data  in  October).    Final  revisions  will  be  made  in 
November  and  December,  1979.  .        *  - 


•/ 

\  ■ 
'  \ 
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TJ^tlej    Factor  An»lY>i»  of  the  Test  of  Bnglish  as  a  Foreign 
Language  for  Several  Language  Grojps 

Project/Job  Kuober::  i7V62      Project  Directors:.  Spencer  S*  Swin.ton 

Donald  E»  Power? 


Purpose 

This  study  has  three  purposes*    (1)    To  obtain  a  cleare 
understanding  of  the  psychological  constructs  underlying  TOBl 
(2)    To  determine  dinmnsions^iBiytfrtant  to  control  in  nAintain^qg 
parallelism  of  test  fonas,  (3i)  To  ascertain  the  coi^>aral)ility  of 
•test  dimensions  for  examinees  of  differecit  native  language  groups* 


Progress  (as  of  August*  1979) 


Item  responses  by  samples  of  approximately  ItOOO  subjects  in 
each  language  group  ho^e  been  dravn/  and  the  matrices  of  tetrachoric 
correlations  coo^ut^d*    An  assessment  of  the  impact  of  applying 
Carroll's  correction  for  guessing  yielded  the  conclusion  that  the  « 
procedure  would  increase  the  magnitude  of  the  common  factor  but 
would  not  eliminate  apparent  **difficulty  favors***    Eyen  and  odd 
items  were  factored  'separately  in  each  langgage  groupt  yith  two 
interesting  resultsi    1)  Because  of  differing  distributions  of 
verb'^fprm  and  modifier  (adjective. and  adverb)  items  apong  the- evens 
and  oddst  minor  factors  emerged  from  these  analyseSf  factors 'which 
we>re  not  clearly  Isomorphic  across  ^he  (wo  halves  of  the  test, 
and  2)  Within  'even  or  odd  item,  analyses,  the  factor  structures, 
are  majrkedly  different  across' language  groups.    This  latter  finding 
was  not  unexpected*    Although  listening  items  cohere  across  all 
language  groups,  structure,  written  expression,  and  reading  items 
show  different  patterns  of  coyariance  in  the  several  groups*  Some 
of  these  patterns  may  be  explained  by  differing  distributions  of 
cognates  (e*g*»  "global**  in  Spanish)  and  false  cognates  (^*g*, 
**relation**  in  Spanish),  but  two  factors  tentatively  identified  as  , 
**form^**  and  **collo<iuial**  vocabulary  seem  to  show  only  tDoderate 
overlap  in  specific  items  involved  across  groups* 

•  N^ecause  of  the  lack  of  agreement  of  the  even  and  odd  half 
analyses,  the  full  150  by.  150  tetrachoric  matrices  have  been 
analydsd»  and  final  interpretation  awaits  tHe  results  of  tluse 
analyses*  .  ^ 

jSchedule^  for  Completion 

^'A  draft  f itial  report  is  scheduled  for  completion  by  September 
1979-  . 
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Title:    TOEFL  Itett  Performance  Aflaroas  Language  Groups 


ProJeiCt/Job  Number:    575/63   Project  I^irector:    Donald  L.  A14ir^n 

Purpose    -  A.-  .  •  .    •  \  ..i  s  -. 

■    .  '      .  i'  V 
The  purpose  of  this  project  is  to  identify  TOEFL  iteipt^f  fHWt 
differ  signif icaifftly  in  difficulty  ot  discrioinatioj^i  acro9$'^^Ver4'  ' 
language  groups.    Estinates  of  item  difficulty  and  actual  dlbtrac|oi^  ; 
choices  vill  lead  to  the  identification  of  Iteito  ^hid^  ^^iblt-  ' 
differWt  respbnse  patterns  across  language' gtoui>s*  .  Th<0b  ijemtf  . 
will  then  be  reviewed  by  linguistic  experts  in  an  att^n^iit  to.  establish 
guidelines  for  subsequent  test  development.    TentatlVftf  t'etommen^^tiona 
would  be  tested  in  an  analysis  of  another  form  of 'tl](^e  test  as  ^; 
check  on  generalizations*  ^  /  ?         .  Jia  »!i 


Pro^r»SB  (as  of.  Augu8t,.^1979) 


1* 


.nguage,,  groijips » 
chara^peristie  ' 
!ed '^^tu^y^of  altetnative 


Item  analyses  have  been  conducjced/ f  or  sc 
with'  a  duplicate  sample  drawn  f  ot  0^  groupv 
curves  (three  paralineter  logistic  Ctfr^es)  ptt,  .       . , .  . 
apprbaches  to  identiiEying  particular  itetps  for  liiigUia.tic  analysis;  . 
add  of  methods  foit  presenting  result*  across  sevet^l  groups  io  the^  . 
absence  of  a  natural  reference  group.  'Cither  indtcea  of^item  ^iff^culty 
confiroed  variation  in  performance  depefcdtept  on  native  language". 
Preliminary  results  -have  been  share^wjlh  test;  dev||opofent  committees 
and  will  be  subject  to  further  study  this*  fall  in  Order  to  detect 
^possible  linguistic  patterns  in  item  diificul^/.  .  '  ;  * 


prfule  for  Completion  *  »  ' 

•^Another  form  of  the  test  will  be  examlne^4  .^^^^  summer  and  a 
/.report  submitted  in  the  winter.  ".■ -^^ 


{ 
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Title;  <An  ExoXoratory  Study,  of  a.  Ciollaboratlve  Research  Effort 
•  "    with  the  Institute  of  International  Education  (IIE> 

•  '  '  '     .  . 

Project/ Job  Numbers    575/64  .      ^  Project  Dlrectpr:    Glta  W^ldei 


fc  •  \     '  ...... 

*•  .       -  ■  •         ■     ■  * 

Purpoae 

-%       ■        '        '         4  ' 

The  purpoae  of  thie  effort  is  to  examine  in.  detail  the  data. 

housed  at  HE  representing  about  2,500  Venezuelan  students  who 

have  received  grants  to  ^tudy  in  the  United  9tates*    The  files 

contain  socioeconomic  data,  information  about  foreign  ^ 

language  study  and  examinations,  academic  study  in  thetUaited 

States,  and  secondary  school  backgrojund*  .  The  exploratory .ef fort 

was  initiated  in  order  to  assess  the  coopleten^s  of  the  records 

and  to  assess-  the  kinds  of  quest iQns  that  might  be  asked  of  the. 

data.  -  I 


Progress  (as  of  December,  1978)      .  . 

A  aystematic  review  of  the  files  has  been  carried  oyt  and 
a  draft  report  has' been  pr^ared  describing  their  contents*  Some* 
information  from  the| files  has  been  summarized  and  is  available  in 
^he  form  of  data  shetts  and  a  computer  printout.    Facsimiles  of 
student  transcripts  representing  a  subset  of  the  entire  popt^lation 
have  been  made  available  to  ETS* 


Schedule  for  Completion 

/  A  draft  report  hal^been  prepared  indicating  what  information 
is  available  and  for  what  subgroups  of  students.    Sojie  questions 
that  might  be  posed  of  the  data  have  been  presented '^long  with  some 
proprosed  approaches  to  answering  the  questions.    The  draft  is 
presently  under  review  by  ETS  and  I IE  staff. 


.St 
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Titl^:    TOBFL  Speakintt  Tcfft  Validation  Study 

-  '    .  •     •  •  >  '  * 

Project/Job  Number:    579/11       Project  Direct<?r8;  John  L.D<  Clark 

.  ...  .  Sp^ce'r  S»  Swinton 


Purpose 

■  — —  ■ 

The  purpose  of  this  study  is  to  provide  use-^alidlty  inforination 
for  one  najor  ^application  of  the  new  jTOEFL  Test  of  Spoken  English 
(TSE):    the  prediction  of  the  linguistic  effectiveness,  in  cl'as^toom 
or  other  instructional  situations,,  of  teaching  as^istaflts  or  graduate 

^astructors'whose  native  language  is  not  English  but  whose  ability 
to  comminicate  in  English  is  crucial  to  their  Job  perf ormance* .  The* 
validation  procedure  will  involve  conparing  foreign  teAHing  assistants' 

•  scores  on  TSE  to  their  Judged  "communicative  ef f ectivenesi"  in 
instructional  settings,  as  rated  by  native  U.S.  students  taking 
their  clashes.    The  study  will  also  provide  for  concurrent  validation 
of  th^  TSE  as  a  neasur^of  general  speaking  proficiency,  using  as  a 
criterion  the  foreign  sWrvice  Institute  (FSI)  interview  procedure. 

«  ■ 

ProftYess  (ftB  of  August,  1979) 

&ince  initiation  of  the  project  in  June,  initial  contacts  have 
been  made  with  participating  schools  and  arrangements  pade  to  train 
TSE  scorerA  and  FSI  interview  raters  for  the  project.  On-site 
testing  at  the  institutions  will  be  conducted  in  September  and  early 
October. 


Schedule  for  Completion^- 

■        '        .  • 
Authorised  project  period  is  June  1,  19>9  to  August  31,  1980. 
However I  project  planning  memorandum  and  schedule  have  been  based  on 
a  target  completi{^  date  of  June.  30,  X99Q. 
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;      Title:    A  Study  of  the  Relationshipa.  Between  Scores  on  the  Graduate 
^  Manageaent  AdttlSBion.  Test  (GMAT)  and  the  Test  of  Engliah  as  ^ 

a  go  reign . Lapguage  (TOEFL ) 

Project /Job  Number J    579/12.  Project  Director:    Donald  E.  Povers 

*  • 

Purpose 

The  objective  of  the  study  ia  to  prepare  data  illustrating  the 
relationships  aiaong  the  TOE.FL  and  GMAT.  scores  and  first-year  averages 
.  of  nonnative  applicants  to  American  graduate  schools  of  .mafiagement* 

^  Progresa  (as  of  August  1979) 

Requests  for  data  pertaining  to  nonnative  graduate  management 
students* and  applicants  have  been  made  to  admissions  staf.f  at  nearly 
30  graduate  achools  of  management.    Plana  are  also  being  developed 
to  match  the  GMAT^hd  TOEFL  test  scores  of  nonnative  applicants* 


Schedule  for  Completion 

First  stage  analyses  involving  only  GHAT  and  TOEFL  scores  are 
scheduled  for  completion  by  December -31/  1979*    The  second  sta|^ 
analyses  using  first'-year  averages  will  be  completed  by  June  30|' 
1980  at  which. time  a  final  report  will  be  prepared*' 
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Title).  A  Descriptive  Analyels  of  Forelgri  Test^gandldates: 

•.Characterl8tl<xa  and  Score  Profiles  on  TyEFL  and  Major  " 
Admissions  Tests    .  .  .  [     ^     \  ■ 

\  ■  ■      .  ' 

ProJ[e<lt/Job  Number:    579/13     *   Project  Director:    Kenneth  M.  Wilson 

'  .         « *  •  ■  * 

Purpose 

To  define,  describe,  and  delineate  the  foreign  candidate         •  ^ 
population    served  by  TOEFL;  and  assess  the  extent  and  nature  of  . 
overlap  between  TOEFL  population  and  those  served  by  GRE,  GMAT,  and 
ATP  to  .analyze. score  profiles  for  the  respective  populations* 

Progress  (as  of  August,  1979)  'y^^ 

Discussions  with  representatives  of  the  admissions  testing 
progra&s  Involved  in  the  study  have  resulted  In  preliminary  plans 
for  extracting  records  of  candidates  who  are  not  U«  S«  citizens 
(noncltlzefis)  and  U*  S*    citizens  who  indicate  that  they  communicate 
best  In  a  language  o^her  than  English  (nonfluent  citizens)  during 
the  testing  years  1977-78  and  1978-79,  respectively.    It  appears 
that  the  most  effective  method  for  Identifying  "foreign**  admlsslons- 
tes ting-program  candidates  Is  to  use  responses  to. a  citizenship 
(background)  qu^^stlon*    Work  required  to  establish  code-equi^lencles 
for  variables  such  as  country,  major  field,  etc*  across  tesj^B 
p'^rograms  has  bUen  initiated*    Inquiries  have  been  undertaken^F 
Internally  regarding  the  problem  of  assessing  linguistic  dlstance-- 
the  possibility  of  classifying  languages  according  to  'Mistanqe" 
from  English  would  facilitate  analysis  of  score  profiles* 


Schedule  for  Completion  \ 

The  prbject  is  scheduled  for  coi^pletion  as  of  February  1981* 
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XX*    USTXNGS  OF  PROGRAM  RESEAItCH  PROJECTS  COMPLETED 

DURING  THE  UST  FXVE  YEARS  .  ^  '. 

ColXeRC  Boatd  Research  jProjects  Completed  During  the  Laat  Five  Years 


Equating  th^  scales  of  the  Spanish-Language 
Prueba  de  Aptitud  Academics  and  the  English-^ 
Language  Scholastic  Aptitude  Test  of  the 
College  Entrance  Examination  Board 

Learning  style  preferences  among  college 
students 

College  £evel  Examination  Program:  Xts 
meaning,  to  participiants 

Validity  of  the  quantitative  comparison 
tjest 

Effect  of  moderate  departures  from 
parallelism  on  the  precision  of  SAT  equating 

Using  self -reports  to  p^redict  student 
perforniance 


Prediction  of  college  achievement  among 
Mexican-^Amefi'ican  students  in.  California 


Verbal  and  mathematical  ability  of  high  school 
Juniors  in  1974:    A  norms  study  of  PSAt/NMSQT 


.Measuring  the  appropriateness  of  multiple- 
choice  test  scores 


A  study  of  college  English  placement  and  the 
Tests  of  Standard  Written  English  . 


College  placement  and  exemption  workbook  . 

Xtem  characteristic  curve  solutions  to  three 
Intractable  teqting  problems 


Group  comparisons  for  the  Test  of  Standard 
Written  English 


W.  Angoff 
:  C*  Modo 
RB^73-4 


R*  Hattnett 
.  RB-73-14 

P*  Casserly 
PR-73-5 

W.  Schrader 
'  SR-73-60 

W*  Schrader 
PR-73-41 

L.  Baird 
CB  Research 
zraph  #7 

J)fl?arren 

-76-22 
CB  RDR  .76-77-1 

\*  Jackson 

Schrader 
1-76-27 
CbVdR  76-77-2 

M*.  Levine 

Rubin 
RB-76-31 
CB  RDR  Ih-ll-'^ 

H*  Ireland 
PR-77-1 

CB  RDR  76-7  7-4^ 

L*  Aleamonl  ^  '■. 
(in  press) 

Q*  Marco 
RB-77-11 
eft  RDR  76-*77-5 

.H*  Breland 
RB-77-15  , 
CB  RDR  77-78-1 


,  No-njeed/aerlt  awards  t    A  survey  of  their  use 
'  at  fdtir-ytar  public  and  private  colleges  and  ' 
universities  '*  '  . 

Short-^em  instruction^  testwiseness^  and  the 
Scholastic  Aptitude  Test)    A  literature  reyiew 
vlth  research  recommendations 

Predicting  long-^tarm  pe^Armance  in  colleges 
of  minority  and  nonminorlty  students:  A 
comparative  analysis  in  two  :collegiate  settings 

College  enrollment  in  the  19808:  •  Projections 
and  possibilities     .       .  i  . 


Population  validity  and  xollegip.  entrance 


measures^ 


■  i 


Multivariate  talent  flow  analysis s 
A  pilot  study  ■  .  ^ 


That's  a  very  good  question:  'The  economic 
Impact  of  credit  by  exanLlnation  policies  and 
practices  '    .  ■ 

The  effects  of  special  preparation  on  SAT- Verbal' 
scores  . 


A*  Sidar 
D*  Potter 
1978  . 

L.  Pike 
RB-78-2 
CB-  RDR  77-78-2 

'  K.  Vilson  ▲ 
RB-78-6  ^ 
CP  RDR  77-78-3 

J*  Centra 
RB-78-lp  , 
CB/RDR  ^8-79-1 

'  H*'  Breland 
RB-78-19 
CB  RDR  78-79-? 

K«  Wilson 
RB-78-20  , 
CB  RbR  78-79-a 

J.  Valley 
1978 


D.  Aldernjan 

D.  Powers 

CB  RDR  78-79-5 


Construct  validity  of  th^  SAT  across  populations: 
An  empirical  confirmatory  atudy  " 


D.'Rock 
Werts 
CB  RDR  78-79-5 


The  use,  acceptance,  and  impact  of  Taking  the  SAT- 
a  tei^t  familiarization  booklet 


D.  Powers. 
D.  Alderman 
CB  RDR  78-79-6 


RB  (Research  bulletin) 
/  PR  (Project  Report) 
.  #  SR  (Statistical  Report)' 

RDR  (Research  &  Development  Report) 
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*  •    GMAC  Research  Proljecta  Completed  Durinft  the  Last  Five  Years 


A  study  o£  the  Infhience  of  undergraduate  course  F«  Connelly 

content  on  the  Admission  Test  for  Graduate  W.  Nord 

Study  in  Business  as  a  predictor  of  success  in  .  GMAC  Brief  15 
graduate  schools  of  business  / 


Indicators  of  college  quality. as  predictors 
of  success  in  graduate  schools  of  business 


Predicting  first-year  average  grades  for 
'interrupted  and  uninterrupted  students  in  , 
graduate  business  schools 

A  survey  of  skills  aiid  abilities  needed  for 
graduate  study  in  business  • 


B.  I^itcher 
W*  Schrader 
GMAC  Brief  #6| 

B.  Pitcher 
GMAC  Brief  If 


J«  Campbell 
?•  Casserly 
GMAC  Brief  #9 


Criterion  0tudy»  Phase  IV:  Career  progress 
of  MBAs  six  years  after  graduation 


hm  Crooks 
J«  Campbell 
-PR-74-8  , 


Survey  of  women  interested  in  management 


Relationship  of  pieadmlssion  measures 
to  academic  success  in  graduate  -  * 
management  iduqation 

Predicting  career  progress  of  HBAs 
s#ven  years  after  graduations 
Eleven-school  sample 


A  prototype  report  for  the  GMAC 
Validity  Study'Service 

Designing  your  validity  study: 

.A  manual  tot  the  Graduate  Management 

Aclnission  Coiancil  Validity  Study  Service 

Final  report  of  the  results  of  the  GMAC 
Validity  Study  Service  pilot  study 

Relationships,  of  preadmission  measures, 
to  aai|demic  success  in  gradirate 
management  education .  ' 


6«  EcAternacht 
A«  Hussein 
GMAC  ]»rief.  #10. 

D«  Powers 
F«  Evans 
RB-78-11 

L«  trobks 
J«  Campbell 
D.  Rock 
(in  press) 

D/  Powers 
PR-77-13 


D«  Powers 
'F«  Evans 


D«  Powers 
P»r  Evans 

D«  Powers 
F«  Evans 
'aB-78-11 


PR  (Project  Report) 
RB. (Research  Bulletin) 


RaportB  Available  for  GREB  ReBearch  Prolectg  Completed  During  the 

Last. Five  Yeafs 


Conparlson  of  a  Bayeslan  and  a  least  squares' 
nrthod  of  educational  prediction  (1975) 

The  Graduates:    A  report  on  the  characteristics 
and  planf  of  college  seniors  (1973)  4^ 
^  careers  and  curricula:    A  report  on  the  activities 
and  views  of  graduates  a  year  after  leaving 
college  (1974) 

(Cooperatively  sponsored  by  GftEB,  AAHC,  and  LSAC) 
Factors  In  graduate  student  perfopnance  (1974) 


A  study  o£  the  relative  effectiveness  of  a 

program  of  coaching/instruction  far  the  GRB-Q 

for  blacky  Chlcano,  and  white  GRE  candidates  (1977) 

•  ■  *  ■  •  ■ 

Word  aasocletlons  of  students  It  predominantly 

white  and  t>redomlnantly  black  colleges  (1975) 


R.  Boldt 
RB-75-15  • 

L.  Balrd 
GR£B-70-4R 


R.  Rellly 

RB-74-2 

GRBB-71-2P 

F.  R. 'Evans 
GREB-71-5aP 


j/ Campbell 
L«  Belcher 
RB-75-29 
GREB-71-6P 


Woment         and  the  doctorate  (1974) 


Development  of  measures  Cor  the  study  of 
-creativity  (1975)  '  . 

I  ■    ^  ■  ■       :^  ■  ■ 

l^he  development  and  pilot  testing  of  criterion^ 
raUng.  scales  (1976)  . 

Summafy  of  data  from  the  graduate  programs  and 
admlsalons  manual,  2nd  Edition  (1975) 


'An  Investigation  of  the  feaslMllty  of  obtaining 
additional  subscores  on  the  GRE  advanced 
psychology  test  (1976) 

A  stud^^^Uhe  predictive  validity  pf  the  t^sts 
of  scientific  thltdclug  (1977)  ' 


\ 


J.  Centra 
GREB-71-10R 

N*  Frederlksen 
W.  6.  Ward 
.kB-75-18 
GRE^-72-2-P 

A1  Carlaon 
R.  Rellly  '  • 
GREB-73-1P 

K«  Altman 
M.  Wallmark 
GREB-74-1R 

M.  McPeek 
R*  Altman 
GRgB-74-4P 

W.  C.>ard 

M.  Frederlksen 

RB-77-6 

GREB-74-6? 
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Construct  validity  of  free^responae  and  mt^ne- 
acorabla  versions  b£  a  test  of  scientific  A 
'^^thlnklng(1978)  \ 


DevelopMnt  of  a  test  of  global  vs. 
articulated  ,  thinking:    The  Figure  Location 
Test  (1978)  ,,r 


The  progrvi  review  practices  of  university 
«  departaents  .(f^y?)  . 

.  How  universities'  evaluate  faculty  performance: 
A  survey  of  departottnt  chairpersons  (1977) 

the  validation  of  GEE  iBcores  as  predictors 
^of  first-year  perfbraance  In  graduate  study: 
report  of  the  GRE  eooperatlve  validity 

"  atvdlas  proJeci:<^1979)      .  ^ 

•  ^         ■  ■ 

lapllclt  guessing  strategies  of  GRE 
aptitude  exaalnees  classified  by  ethnic 
group  and  sex  (In  press) 

A  factor  analytjlc  study  of  the  GRE  Aptitude 
Test  (1977) 

\  Adals^lons  test  scores  as  predictors 
of  career  achleveaent  In  psychology  (1978) 

'  Factors  contributing  to  the  career 
periEoraance  o(  recent  Fh*D.'s  (1979) 


Tlv  implications  of  test  speededness 
(fe  press) 


A  longitudinal  study,  of  the  role  of  cognitive" 
atylea  In  acajiealc  igvolutlon  during  the 
college  years  ' 


W.  C.  Ward 
N;  Frederlkaen 
S*  B«  Carlson 
RB-78-15 
GftEB-7A-aP  ^ 

T.  F«  Donloh  , 
R.  R«  Rellly 
J.  T)i  McKee 
GREB-74-9P  , 

M.  J.~ciark 
.GREB-75-5aR 

J*  A*  Centra 
GREB-75-5bR  ' 

M.  Wilson 
GREB-75-8R 


U  W.  pike 
GREB-75-10P 


p.  Powers  • 
$•  Swlnton 
A*  Carlson 
GREB~75-11P 

V«  B.  Schrader 
GREB-76-1R 

M.  J.  Clark 
J.  A.  Centra. 
GREB-76--2R 

T.  F«  Donlon 
CREB-76-9aP 

(Report) 
GREB-76-9bR^ 

(Bibliography) 


Wltklh 
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GREB~76-l(m 
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A 
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The  •iimctibt  nonstAiMiarH^ndergraduate 
a^Bessnent  and  reporting  pracjtlcea  on  • 
graduate  adoi 80 Ion  piTQceaaeB  (1978) 

it  J^actor' analytic  Investigation  of  seven 
experimental  analytical  Item  types  (1978). 


J«.  £•  Knapp 
I.  B.  Eam:|.lton 
(^EB-76-lAR 

D.  £•  Powers 
GREB-77-1P 


Deveiopnent  of  an  Inventory  of  documented 
acconpllahmenta:    Phase  II  (1979) 

The  criterion  problem?    what  meaaute  of 
auccesa  In  graduate  educj^tlon?  (1979) 

A  factor  analytic  study  of  the 
restructured  GRE  Aptitude  Test  . 
(In  press) 

An  analysis  of  tline  related  decrementa 
and  recoveries  for  GRE  repeaters  acrosa 
ability  and  aex  groupa  (In  preaa) 


L.  Balrd 
GREB-77-3R 

R.  T.  Hartnett 
W.  W.  Wllllngham 
GREB-77-4R      .  . 

D.  E^Powera 
S.  Swlnton 
GREB-77-6P 

/D«  A«  Rock 
GRE-77-9R^ 


RB  (Reaearch  Bulletin) 
GREB  No.  (number  of  report) 
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■L8AC  feaarch  Project's  Cowpletcd  During  the  Laat  Flv€  Years 


Factor  analysis  of  law  school  grades 


A  study  ot  the  effects  of  Moderator  variables 
on  the.  predict  Ion  of  law  scihool  performance 
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,  ,  ^    House  OF  |lEPRESBNTATiy]E)s,      ^         ,   .     ^  .  / 

.       SuB^ON^Mrn^Er^QN  ELEMENT^jf  V,  SeQ^I^QARV,  y    •     *  . 
t^^:   '  V  :  AND  yO(^ATIQNAi;'El)UCATION^  '   ^'      •  - 

/.  /    CtoMMFTTiEis  ON  EdWC^tIoN  AC^P  l^ABOK,.  ,  .  ...  r 

■   .  -  ••  r  .  •  .  '^  ■  ■    . ■  \     .  Ji^^'^' '  '  ^^hingtorv,  D.C^  ' 
^  V     The  subpommitti^  tnet/  piursuant  vto  ■  nD|xse,  at  9:80  a.m.,  in  r2fbm  .  - ' 
;  .  2175,  Rayburn  House  Officfe  Buildihg,  H^!^r  Carl  D.  P^jkins,  (chair-  >  ■ . 

TOan  dftha 'subcommittee)  presiding.  .  .:v.    ^    '  ^    *  ^ '  s    •  . 

;    /   Members  preseiit:  jReprespnt^tivea  PerJu  ii^ildee,  Wil- 

liam)^,. KogQvsek,  ^d^i^^  .|^^  \ 

,    Staff  present:  John  F.  Jenniijgs,,  CQU  '  ; 

minority  legislative  associate;  Laurence  A.  tJzzell,  senior  re^rch 
specialist^  and  Ma^in  LaVor,  minority  S€gm)r..le|g^6lative  associate.      ^  i ' . 
Mr.  W^iss.  The  Stibcommitte^;  on,  El^tn^nt^o^,  Sieqondary,  and  ♦ 

•  yocational  Education  will  come  to  orde  ^^^v> 
;  \  .  Mr.  Perkins,y  who  chairs  both  tfie  jBubcommittee  :aftd;  th^^  / 

J^xomiiiae  oh  Blducation  and  Labor,  will  befMth  u$  shortly, ;  ^     v  ^.  „^  ; 
.  V"  In  the  meantime^;  Mr.  doodlihg  rfnd  I-'^'WHl  start  the  hearing,   j     -r.  . 

We  h^Ve  a  large  "number  of  witnesses  schedifled'for  this  niorning, 
.  r^and  1  think  that  we  will  try  to  do  the  same  thing  ^e  did  yesterday^  ^,  ^ ... 
which  I  think  jvqrkj^out.fairly.  we'll:,     ''.-''t-        •    ^  ,  ^ 
We  jvill  ask-  all  oiF  the  witnesses  to  joiri  us  at  the  witjaess  table  »  * 
.  and  thteh  whenever  one  is  finished  with  his  statement,  which  hope-  ^ 
ifully  will  be  limited  to  j5.  or  6  mintJtites  at  the  jfiosti  wa  will  ther)^  ^ 
j  addtressf  question^  to 'either  the"  entire  p^ndbfto.ah.Jpdividu^^  ' 
witDieSs.  \  ii^JL-  "  "  - 

I  thinkJIiirSat  way  w0  get  the  benefit  of  the  clash  of^ideas  as*^/^  - 

*  'Well  as  tjpWiacK*of^petitioji  of  questions  \v:hicli  would  otherwise  ■    #/-v.  > 
' :  obviously  take  iplaci^  .   V  .  -     ,    v  t  r "         "   ; ^yr" " 
^'    Some  of  the  witnesses  may  not.h^ve  arrived  yet  t^specially  thos$^f  . 

^    who  may  have  bieen/flyihg*  in,  but  we  will  c^k.^ilf  j;^  you  n<j#vwh6'  ' 
f ar^eJiere  to  nlease  join  us.  '   ,  \  /    -  *  v;^.v 

f  S^aitor.  I^iVaJl^,  I  undei^tandli  has  not  y^t  arrived,  has  he!^:^^  '  -' 
S^lator  Halperin,  if  you  will|^        ;  'i^'*^.    '      '.^  ^  ^  •  • 

i.      S^ator  Vann  has  np£  yet  atrlved.  ,  .    /   '  ^  ¥^ 

Mr.  ;M0]Keany  of-ihe  American  Federation  ^df^'fea^ 
_  '  Hferndon^pf  the  National  Educafion  Associ^tiOtt^;       -ii;        ■-^^'  '  ^'^  '"^'  '^^^^ 
%     Mr.  Kovaqp[  I  think  will  Ibe  actompaiiyi^  Mr.  Iferndonr       i  '      •  .>  ''^ 
Dr.  Grc^am  of  the  CQuncil  on  deiital  education,  ;American  .I)e)ital     •  . 
AatociaUoii;  M^^  H.  Iluftd  of  the  i^ietrican  ll^w^ 

Ajeusoci^tion;  Mr!  Jon  'Haberr  consultant  pri  st»a^ 
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U.S.  Student  Association,  accomflanied  by  Andrew  Burnett;  Dr. 
Roger  T.  Lennon,  assistant  to  the.  chairman  in  measurement,  Har- 
court  Brace  Jovanovich,  Inc.  ' 

If  any  of  you  haye  prepared  statenients  which  have  not  yet  been 
submitted  to  us  the  staff  will  accept  'them  fron\  you,  4nd  wp  will 
proceed. 

\  We  will  wait  ^until- the' entire  New  York  delegation  is  here  before 
we  commence  with  them,  ^nd  I  gather  Mr.  McKeany  is  substitut- 
ing a  statenient. 

Mr;  McKeany  is  not  going  to  be  testifying  directly  this  morning. 
He  is  goingito  be  submitting  a  statement.  1 
If  you'  will  begin,  Mr.  Herndon,  and  then  I  will  call  on  everyone 

else  m  order;  ^  •     '  . 

*.'"'»•■'  * 

STATEMENT  OF  SENATOR  KENNETH  LaVALLE,  NEW  YORK  STATE 
SENATE,  ACCOMPANIED  BY  SENATOR  DONALD  HALPEIRIN,  N^W 
YORK. STATE  SENATE;  TERRY  HERNDON,  EXECUTIVE  DllffiC- 
TOR,  NATIONAL  EDUCATION  ASSOCIATION,  ACCOMPANIED  BY 
FRANK  kOVACS,  DIRECTOR  OF  RESEARCH;  JAMES  W.  GRAHAM, « 
COUNCIL  ON  DENTAL  EDUCATION,  AMERICAN  DENTAL^ASSOCL 
ATION;  MILLARD  H.  RUUD;  EXECUTIVE  DIRECTOR,  ASSOCL 
ATION  OF  AMBIRICAN  LAW  SCHOOLS;  JON  HABER,  CONSULTANT 
ON  STANDARDIZED  TESTING,  U.S.  STUDENT  ASSOCIATION,  AC- 
COMPANIED BY  ANDRE  BUftNETT,  DIRECTOR,  NATIONAL  THIRQ 
WORLD  COALITION,  USSA;  ROGER  T.  LENNON,  ASSISTANT  TO 
THE  CHAIRMAN  IN  MEASUREI^NT,  HARCOURT  BRACE  JOVANO- 
VICH,INC.  ,^      '  X  ' 

STATEMENT  OF  TERRY  HERNDON,  EXECUTIVE  DIRECTOR,  NA- 

.  TiONAL  Education  association^  accompanied  by  frank 

KOVACS,  DIRECTOR  OF  RESEARCH 

Mr.  HerNdon.  Thank  you,  sir.  . 

NEA  is  pleased  to  have  the  invitation  to  appear  today  to  discuss 
the  matteiipf  truth  in  testing  and  particularly  the  Educational 
Testing  Actdf  1979.  .  . 

The  delegates  at  the  most  receht  NEA  convention  which  oc- 
curred this  past  month  strongly  urged  a  congressional  investigation 
of  the  standardized  testing  industry. 

They  ,  ask  that  you  also  look  at  the  tax  exempt  status  of  some 
aspfects  of  the  testing  business  and  most  particularly  that  the  Con- 
gress look  at  the  heed  for  Federal  truth  in  testing  legislation  to 
'guarantee  fiipCess  to  all  te^  ai\d  statistical  material  held  by  such 
agencies  wlitch  affect  stutfents,  parents,  and  teachers,  so  we  cer- 
tainly commend  you>  Mr.  Weiss  and  Ihe  Congress,  for  addressing 
this  issue.  V 

\  The  teacherib  have  questionted  the  impact  of  standardized  testing 
ror  a  long  time*  In  many  respjects  w^  look  at  tests  as  much^as  one 
might,  took  at  narcotics.  They  probably  have  legitimate  uses  but 
they  fire  so  widely  abused  today  that  we  have  great  concern  about 
them.  I  k  -  k  - 

That  is  ni3t  a  ©ecent  concern,  because  OscaivBuros,  who  has  been 
one  of  the  giants  of  that  business  for  a  long  time  and  the  editor  of 
the  Mental  Measurement  Yearbook,  has  over  the  past  years  statea 
many  of  oui^cofatemporary  concer^and  has  done  so  directly  for 
the  testin^industry.  Mr  .  * 

Shortly  before  his  death,  wjien  ne  addressed  the  Amewcan  col- 
lege testing  progratti  on  .,tjie»  personnel  inj/olved  vfrith  that  progr;am 


at  the  Univeraily  of  Iowa,  he  made  several  observations,  among 
which  are  publishers  of  secured  tests  not  commercially  availabler 
have  been  very  good  about  making  their  confidential  test  available 
to  persons  invited  to  review  the  test  for  the  Mental  Measurement 
Yearbook.  ■  .  ^  '/' 

He  goes  oji  to  point  out  the4nformation  available  to  permit  an 
adequate  assessment  by  th^  is  unsatisfactory,  even  for  their 
needs/ and  since  the  tests  could  only  be  examined  in  highly  restric- 
tive conditions,  if  at  all, /it  was  most  important  that  additional 
detailed  infqnnation  be  generally  available  to  researchers  and  ex- 
aminers and:  (educators  and  others  who  would  evaluate  the  teste  for 
the  purposes  for  which4hey  are  bein^  used. 

He  suggested  thatit  that  detailed  mformation  were  made  availa- 
ble simuttaneouslyMiia  the  publication  of  teste,  not  only  would 
educators  and  teming  specialiste  be  in  a  better  position  to  evaluate 
the  test  and  to  interpret  the  resulte  mor^^  intelligently  biit  the 
publishers  would  be  xomjpelled  to  cons^ct  better  tests  pointing 
out  both  their  strengths  and  their  weaknesses. 

There  have  4)een  roadblocks  to  that.  The  roadblocks  are  placed  in 
the  way  of  the  test  user,  the  educator,  and  the  researcher  in 
deciding  just  what  these  teste  mean  and  how  they  ought  to  be  used, 
so  we  encourage  the  Congress  to  proceed  "with  this  act,  to  make  the 
information  available  so  that  we  and  our  members,  researchers; 
and  evaluators  of  teste  across  the  country  can  examine  them  and 
can  draw"  rational  conclusions  as  to  how  the  use  of  standardized 
tcHste  is  in  fact  restricting  the  equality  of  educational  opportunity 
for  all  people.  . 

We  supported  the  enactment  of  the  stetute  that  was  recently 
passed  by  the  New  York  Stete  Legislature,  and  I  note  in  closing 
*nere  tod^y  that,  even  though  many  of  the  Institutions  who  make 
up  the  toting  industry  endfeavored  to  influence  the  legislature  to 
reject  that  law. 

Just  this  past  week  I  appeared  on  the  ''Today"  program  in  New 
York  City«  along  with  Dr.  E.  Belvin  Williams,  senior  vice  president 
of  the*  ^ucational  Testing  Service.  When  asked  why  they  had 
opposed  the  law,  he  indicated  i!hat  they  had  changed  their  minds 
and  that  it  was  a  good  law,  that  it  was  a  good  idea  for  studente  to 
receive  copies  of  the  teste  that  they  had  taken.  ■  _  \' 

I  observe  when  one  jof  ^e  strongest  proponente  of  standardized 
testing,  that  being  the  Educational  T^stmg  S^rvice,  and  one  of  the 
strongest  opponente,  and  the;  National  Education  Association,  agree 
fihe  law  embodies  sound  principlei^,  then  the  law  ^obably  embodies 
sound  principles,  and  we  urge,  you  to  proceed  with  ite  expeditious 
l>assage.  . 

{The  complete  stetemeAt  of  Mir.  Hemdon  follows:] 

PMPAUD  STATIUi^NT  Of  TbEEY  HlRNDON,  ExiDOUTIVB  DlRBCTOR,  NATIONAL 

Education  Association 

The  National  BS^ucfitioii  Association  is  pleased  to  have  been  invited  to  discuss  the 
matter  of  tmth  in  testing,  most  particularly  the  Educational  Testing  Act  of  197$. 
^e  dbleg0ites  at  the  1979  KEA  Annual  Meeting,  which  occurred  Just  this  past 
month,  strongly  urgd  a  congressional  investigation  of  the  standardized  testing  Indus* 
tfjr.  Thev  also  ask  that  Congress  examine  the  tax-exempt  status  of  some  aspects^of 
Vthejieting  businesSt  most  {iulicularly  the  need  for  .  federal  truth^in-testing  legisla- 
ttpsfto jniariuiteei  access  to  all.teits  and  statistical  material  hejid  by  U^ie  agencies 
th)|t  mkA  fltu4|iits,  parents,  and  teachers.  Tlierefore^  we  cer&bly  commend  lili*. 
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.Ted  Weiss  (N.Y.);  Mrs.  Shirley  Chisholm  (N.Y.),  Mr.  George  Miller  (Calit),  and  the 
Congress  for  addressing  this  issue. 

Teachers  have  questioned  the  impact  of  standardiaed  testing  for  many  years,  and 
in  many  respects  we  look'  at  tests  as  much  as  one  might  look  at  narcotics— tbey 
probably  have  legitimate  uses,  but  they  are  so  widely  abused  that  we  have  great 
concern  about  it.  That,  however,  is  not  a  recent  concern  of  teachers  and  profession- 
als in  the  field.  Oscar  K.  Buros,  who  was  one  of  the  giants  of  that  business  and  the 
editor  of  the  Mental  Mieasurement  Yearbook,,  had  for  over  47  years  stated  many  of 
our  contemporary  concerns  and  often  done  so  directly  to  the  testing  industry. 

Shortly  before  his  death  in  1978,  Buros  made  several  cogent  observations  during 
an  address  to  the  American  College  Testing  Program  personnel  at  the  University  of 
Iowa.'  Excerpts  from  that  address  are  pertinent  to  our  discussion  today: 

"Publishers  of  secure  tests  not  commercially  available  have  been  very  good  about 
making  their  confidential  tests  available  to  persons  invited  to  review  the  tests  for 
the  Mental  Measurements  Yearbook.  I  deeply  appreciate  the  wholehearted  coopera- 
tion which  we  have  received  from  the' American  College  Testing  Program,  College 
Entrance  Examination  Board,  Educational  Testing  Service,  and  other  organizations. 
Nevertheless,  I  would  like  to  point  out  that  the  information  available  to  permit  an 
adequate  assessment  to  be  made  of  these  secure  tests  is  quite  unsatisfactory.  Al- 
though our  reviewers  generally  receive  some  in*house  material,  which  is  not  availa- 
ble to  other  educators  and  psychologists,*even  this  material  id  inadequate. 

"I  would  like  to  recommend  that  every  secure  test  be  accompanied  by  a  manual 
describing  the  planning,  construction,  standardization,  reliability,  and  validity  of 
the  test;  Since  the  tests  themselves  can  be  examined  only  under  highly  restricted 
conditions,  if  at  all,  it  becomes  of  greatest  importance  that  detailed  information  be 
provided  for  secure  tests.  The  important  role  which  these  tests  play  in  influencing 
the  lives  of  the  examinees  is  much  gre^ater  than  the  role  of  the  Commercially 
available  tests.  Yet  far  less  information  is  available  on  these  secure  tests  and,  to 
make  matters  worse,  much  of  the  information  which  the  publisher  does  possess  is 
considered  to  be  confidential—for  in-house  .iise  only.  If  detailed  information  wece 
made  available  simultaneously  Vith  the  publication  of  tests,  not  only  would  educa- 
tors  and  testing  specialists  be  in  a  better  position  to  evaluate  the  tests  and  to 
interpret  the  results  more  intelligently,  but  the^  publishers  would  be  ihipelled  to 
construct  better  tests,  pointing  out  both  their  strengths  and  weaknesses." 

In  another  part  of  tne  same  pre^ntation,  Buros  identifies  another  probleni  that 
the  testing  industry  has  not  corrected: 

"Let  me  mention  two  important  programs  as  examples  of  test  whicVv  provide  far 
too  little  information.  These  programs  are  probably  no  worse  than  many  of  the 
other  programs  of  secure  tests.  I  refer  to  the  College-Level  Examination  Program 
and  the  ACT  Proficiency  Examination  Program,  both  of  which  provide  examinations 
to  permit  students  to  receive  college  credit  without  taking  the^  relevant  college 
courses.  The  CLEP  program,  initiated  thirteen  yeiars  ago,  js  on^  ot  the  most  signifi- 
cant developments  in  testing  in  recent  years.  It  has  received  extraordinarily  wide 
publicity— it  is  regularly  advertised  on  television,  yet  thiere  is  relatively  little  re- 
search data  on  the  validity  of  these  tests.  Roadblocks  have  been  placed  between  the 
test  user  and  what  the  scores  mean.  Only  confidential  house  papers  present  raw 
score  distributions.  Such  information  shoul*  be  routinely  presented  for  every 
achievement  test.  The  corresponding  ACT  PEP  program  is  especially  poor  in  the^ 
iifFormation  it  provides.  I  find  it  discouraging  that  two  outstanding  not-for-profit 
testing  organizations  have  not  provided  test  users  with  the  hard  data  to  permit 
ihem  to  assess  more  adequately  the  usefulness,  of  the  tests  for  the  assignment  of 
college  credit. 

"I  would  like  to  repeat  a  statement  which  I  made  forty-two  years  ago:  Today  iiM^ 
practically  impossible  for  a  competent  test  technician  or  test  consumer  to  make  d 
thorough  appraisal  of  the  construction,  validation,  ahd  lise  of  most  standardized 
tests  teing  published  because  of  the  limited  amount  6{  trustworthy  infprmatidn 
supplied  by  test  publishers  and  authors  .  .  .  If  testing  is  to  be  of  maximum  value  to 
schools,  test  authors  and  publishers  must  give  more  adequate  information  *  *  *  It 
would  be  advantageous  *  *  ^  if  test  publishers  vtbuld  construct  only  one-fourth  to 
one-half  as  manv  tests  *  *  *  and  use  the  time  s^ived  for  presenting  the  detailed 
information  needed  by  test  consumers. 

'^Unfortunately,  although  some  progress  has  been  made,  my  1935  complaint  is 
equally  applicable  today  to  the  majority  of  existing \tests^and  especially  so  for 
secure  tests.'*  .         ^  *  . 

it>   ,   .  "   ■      .  . 

•  Buroe,  08€ar  K.  "Fifty  Years  in  Testing:  Some  ReminiscerMJea.  CriticiBms,  fihd  Suggefltions  " 
JESftico^iona/ /?cscaTO/icr  6:  9-16;  July-August  .  ' 


i    The  NEA  believee  that  tHe  tlsetiiig  industry  will  not  move  to  correct  these  Inap* 

^  propriate  practices  without  federal  leffislation.  We  would  encourage  the  Congress  to 
proceed  with  H.R.  4949  and  make  the  information  available  so  that  we  and  our 
m^mbe^  researchers,  and  evaluators  of  tests  across  the  country  can  examine  them« 

• .  and  can  draW  rational  conclusions  on  how  the  use  of  standardized  tests  is  restricting 

.   theedu^Uity  of  educiitional  opportunity  for  all  pro 

NEA  supported  the  enactment  of  the  statute  passed  by  the  New  .Yojrk  State 
legislature;  and  even  though  many  of  the  ihstitutions  who  make  up  the  testing 
industry  endeavored  to  influence  the  legislature  to  reject  that  law,  just  this  past 
week  I  was  a  guest  on  NBCs  Today  program  in  New  York  City  along  with  Dr.  E. 
Belvin  Williams;  senior  vice-president  oT^he  Educational  Testing  Service.  Wheii 
askod  why  ETS  has  opposed  the  law»  Dr.  Williams  indicated  that  ETS  had  since 
changed  its  mind»  that  it  was  a  "good  law/'  and  th^t  ^students  should  see  their 
tests.  So»  when  one  of  the  strongest  proponents  of  Bt4ndardized^testing»  that  being 
the  Educational  Testing  9ervice»  Jihd  one  of  the  strongest  opponents,  that  being  the 
National  Education  Association,  agree  that  the  law  ei^fibodies  sound  principles,  then, 
the  law  probably  embodies  sound  principles.  i  \ 

JfiEA  urges  the  Congress  to  proceed  and  expedite  the  passage  of  this  leg^lation. 

Mr.  Weiss.  Thank  you  ver^  much. 

I  understand  Senator  LaVaUe  has  now  arrived.  \ 
(     Senator,  we  welcome  you  and  I  just  want  to  |:ive  a  word  of 
introduction  to  both  Senator  LaValle  and  Senator  mlperin. 

Senator  Halperin  is  a  p^rspnal  a?  well  as  a  political  friend  of 
many  years  standing. 

Senator  LaVWe  is  one  who  I  know  by  reputation,  which  is  a 
very  esteemable  one.  They  represent  both  the  minority  anfl  the 
mcuority  in  thd  New  York  State  l^n^te^d  have  been  successful 
after  a  couple  of  years,  I  guess,  of  efforts  in  having  8om$  mQjor 
legislation  adopted  by  the  State,  the  Senate  and  the  State  Assem: 
bly  and  signed  int^  law  by  Governor  Carey  just  a  few  weeks^o. 

We  will  ask  Senator  LaValle  to  proceed  first  with  his  statement 
and  ask  Senator  Halpenn  to  make  nis  statement,  but  the  questions 
wm  be  delayed  until  th|  entire  panel  has  com[ileted  its  testimony. 

STATteMENTdF  SENATOR  KENNETH  taVALLE,       /  ^ 
NEW  YORK  STi^  SENATE ' 

Mr.  LaValle.  Thank  you,  Congressiban  W 
My  name  is  Ken  LaValle  and  I  represent  the  First  State  Senato- 
ripl  l)istrict  iij^ew  York.  i  ' 

I  am  pleaseV  to  appear  before  you  ijbday  'as  you  probe  the  impor- 
tant issues  surrounding  testing,  issues  thai  n'eatly  affect  milliot|ns 
of  postsecondary  students  throughout  our.  Nal  ^ion  each  year. 
As  chairman  of  th^  New  York  Senate  Higher  Edi^cation  Commit- 
>  tee,  I  held  a  bint  hearing  with  the  ^bembly  Higher  Bklucation 
/  Committee  in  My  cm  New  YorH's  Trutjf  in-Testing  legislation. 
As  the  prime  senate  sponsor  t&  that  mll»  I  aiA  very  pleased  to  say 
thftt  our  ne^tring  was  onlv  the  first  successful  step  in  the  life  of 
diat  bill«  We  were  able,  with  the  help  of  several  testing  experts,  ai^ 
:well  as  the  support  oi  parenl;^,  teachers,  and  students,  t^  get  our 
mU  passed  in  both  houses  q^d  eventucdly  signed  by  the  Governor. 

Bilore  I«trace  the  histoid  of  what  proved  to  be  one  of  the  most 
toniroversial  issues  of  oiir  1979  sMj9ion,  llet  me  say  that  I  sincerely 
liope  thiit  tnith-in-testin^  at  the  Feder^  level  meets  with  similar' 
suco^ssk  •  •.  '  ■  • 

fhe  imiB  are  dear.  This  legislation  is  necessary  and  the  timing 
is  oritioid^Ea<!lh  studen^deniea  access  to  his  or  her  exam  is  unfair- 
ly and  irreparably  ii\jured.  9  ^  ' 
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Each  unscrutinized  test^  potentially  destroys  the  future  of  thou^ 
'sandb  of  students.  .These  are  the  lives  of  our  youth,  our  greal^sr 
natural  resource. 

I  urge  you  to  act  now  to  prevj^nt  farther  harm. 

I  bfNCame  interested  in  this  issue  really  as  -an  educator  before  I 
st&rted  my  c#eer  in  government;  and  one  of  the  things  that  I 
think,  having  sonjie  knowledge  and  some  experience  in  the  testing 
area,  that  I  found  that  there  was  a  great  importance  placed  on 
these  tests  and  that  many  of  ud  as  educators  were  taught  that 
often  these  tests  had  a  very  low  statistical  validity. 

My  interest ^ontipued  and  later,  when  I  was  executive  director  of  - 
the  State's  senate  education  coqimittee,  I*  was  able  to  view  the 
Impact  of  this  issue  from  a  statewide  perspective. 

Finally,  ad  State  senator,  I  intipduced  the  first  truth-in-testing 
legislation  in  1978.  Although  the  bill  remained  in.  committee  at  the 
close  of  the  1978  session,  it  served  to  raise  the  issue  and  enlighten 
many  legislators  regarding  the  problems  surrounding,  standardized  • 
admissions  tests. 

OfT  session  hours  were  then  spent  in  research  which  involved 
consultations  with  exjperts  in  the  field.  Hie  bill  I  introduced  this 
year  was  |;he  resi^lt  oMhis  research^  and  it  reflected  the  advice  we 
received.  * 
.  I  have  .to  conipliment.  the*  fll^ple  on  my  staff,  along  with  the 
people  such  as  Senator  Halperm  and  hie  staff,  for  the  research  and 
Ihe  field  work  that  thejKdid  on  this  legislation. 

The  hearing  we  held  lasted  6  hours  and  produced  testimony 
which  was  overwhelmingly  in  support  of  the  desire  and  need  for 
this  legislation. 

Most  of  the  opposition  offered  was  based  on  fear,  fear  instilled  by 
unsupportable  threats  of  dire  circumstances  made  by  the  mcgor 
testing  agencies.  /  i  * 

As  previously  stated,  the  support  was  overwhelming  and  the 
testimony  was  replete  with  questions  about: 

The  sidfflciency  of  publicly  availabjadata  for  independent  eyalua-  " 
tipns  of  construction,  validity,  or  use  of  the  tests; 

The  quality  of  |the  items  appearing  on  the  tests  and  t^e  possible  ' 
existence  of  built-in  bias;  \ 

The  many  reports  of  known  scoring  errors,  leaving  great  doubt 
as  to  the  number  of  scorinjg  errors  left  undiscovered,  and,  perhiaps 
most  compelling,  was  testimony  concerninp^^  the  issue  of  fc^ri^ess. 

Ought  not  t^he  burden  be  on  those  denying  access,  to  prove  the  / 
need  to  continue  in  secrecy? 

The  answer  miist  be  "les."  l  am  here  todav  to  testify  that  that  ^ 
burden  has  not  beeift  met,  nor  will  it  be.  I.  have  heard  all  their 
arguments.  I  assure  you  that  when  you  hajire  heard  them  you  will 
agree  with  me.  /  ^  -  ' 

Defeat  of  our       in  New  York  was  urged  for  the  following 
.  reasons:  / 

First,  the  tecJhiiique  of  equating  would  be  destroyed; 

Second,  the  cost  of  compliance  would  cause  student  fees  to  rise^as 
much  jGts  50  pi^rcent  and.  Anally,  rather  than  comply,  test  agencies 
would  boycott  New  York  and  as  a  result  New  York  students  would  * 
be  iinduly  ha|i?ied. 


L 


DeQiite  intensive  lobbying^  done  of  course  with  student  fees, 
these  arguments  convinced  neither  the  migority  of  the  senate  or 
assembly  nor  the^Sovemor,  and  I.niust  indicate  that  the  lobbying 
on  this  legislation  was  probably  some  of  th^e  toughest  that  I  have 
encountered,  and  some  olrYon  may  have  seeh  a  recent  piece  by  Jay 
Anderson  oh  the  lobbying  by  some  of  the  test-making  companies  qn  ■. 
this  l^nslation^  and  .1^  am  sure  that  you  yn^  encounter  the  same 
kind  of  intense  lobbying  here  on  the  Hill. 

'  Current  knowledge  among  testing  Experts  disposed  of  alt  equat- 
ing ai]guments.  Use  of  methods  already  empl^ed  by  mcgor  testing 
aj^encies  such  as  the  practice  of  simply  n^  sc^^g  equating  ques- 
tions or  use  of  proven  new.  techniques  would  permit  equating  to 
continue  undisturbed.  No  attempt  was  ever  Offered  to  refute*  these 
facts.  \^ 

I  might  just  emphasize  that  there  are — and  sbnie  of  the  experts 
have  indicated  that  there  are— equating  techniques  that  have  not 
befen  used,  and  it  would  seem  there  is  almost  a  laziness  on  the  part 
of  the  testing  people  not  to  go  inland  use  those  techniques. 

Similarly,  the  cost  issue  was 'unconvincing,  particularly  in  light 
of  undisputed  information  r^arding  the  small  percentage  of  stu- 
dent fees  uised  for  test  development  and  the  very  large  surplus 
earned  by  the  meyor  companies  on  these  testa^ 

Ai^  yQU  all  know,  the  testing  companies,  as  chartered  in  our 
State,  New  York,  are  nonprofit,  tax-exempt  corporations. 

For  e;Kample,  ETS  documents  indicateUhat  only  5  percent  of  the 
student  fe6  for  the  SAT  and  only  about  7  percent  of  the  student  fee 
for  the  GRE  is  used  for  test  development,  the  only  aspect  of  the 
testing  process  affected  by  our  bill.  In  addition,  their  documente 
show  earned  surplus  in  excess  of  22  on  the  SAT,  a  figure  estimated 
to  be  similar  for  other  testing  programs. 

Information  that  I  requested  and  received  from  ETS  following 
our  hearing  stated  that  the  bill  Would  increase  SAT  development 
by  $1,092,000.  Even  if  ETS's  figure  is  accepted,  despite  our  coilflict- 
ing  data,  it  still  amounts  to  less  than  one-third  of  tne  surplus  taken 
by  ETS  and  College  Board  on  the  SAT.  Between  1974--75  and  1976- 
77  the  efamed  sutplus  ranged  from  $3  million  to  $3^541,000. 

Upon  learning  of  the  extremely  profitable  nature  of  this  indus- 
try,  many  legislators  asked  both  me  and  our  stedf,  well,  if  we  have 
tms,  if  they  have  this  surplus,  why  don't  we  legislate  a  decrease  in 
the  cost  of  these  examples?  ^ 

The  third  argun^ent  in  opposition,  that  of  possible  isolation  of 
New  York,  was  viewed  as  merely  a  desperate  threat  since  such  a 
course  of  action  would  bi^  an  unsound  business  decision. 

However,  as  we  now  know,  the  American  Association  of  Medical 
CoU^^  and  the  Dental  Association  have  reacted  to  the  adoption  of 
this  I^fialatioii  by  stating  'they;  would  no  longer  sponsor  the 
pICATs  or  DATs  in  New  Y6rk.  This  attempt  to  avoid  the  disclo- 
^sure  legialation  of  one  State  points  out  the  need  |br  Federal  legisla- 
tion in  this  area.  * 

1  would  like  to  take  this  opportunity  to  say  that  neither  of  these 
professional  associations  participated  in  the  debate  generated  by 
this  bill.  I  t 

Although  the  spok^person  for  Associated  Medical  Collies  of 
New  Y^k  mentioned  i^iation  with  tne  American  Associatm  of 


Medical  CJoUeges  at  bur  hearing,  we  have,  to  this  date,  received  no 
communication  from  the  Dental  Association  and  we  did  not  hear 
from  the  AAGM  for  nearly /a  week  following  their  announcement. 

Reastns  for  their  noninyolvement  are  not  clear,  and  I  wOuld 
hope  an  explanation  will  oe  offered  at  this  hearing.  If  they  persist 
»4n  this  conduct,  however ,/l  intend  to  use  my  subpena  powers  as. 
chairman  of  the  Senate  ^Higher  Education  ^mmittee  to  compel 
tiiem  to  substantiate  their  claims.  1 

^or  example,  they  clawed  there  are  ]||utd  lumbers  of  quality 
questions  which  may  b0  used  on  these         "^'^  j:«->-«— i  4.u:« 


argument  when  it  was 


We  disposed  of  this 


held  known  to  man, 
each  year?  We  have 
read  some  of  the  exs 
that  is  produced  by 
and  I  ihink  the  coi 


 ^    /  ^  -  concerning  other  tests  covered  by  the 

legislation,  and  I  believe  we  can  similarly  prove  it  is  without  merit 
in  the  case  of  the  MCAr  s 
Can  we  be  expected/ to  believe  that  science,  the  most  d3mamic 
^annot  jdeld  enough  questions  for  two  tests 
m  through  the  manual,  and  I  am  going  to 
Ifcples,  but  the  staff  has  looked  at  the  manual 
yAT  and  we  looked  at  some  of  the  questions, 
KAxxsA  Ajwixtin.  ..At^  w^aitt|e  will  find  that  many  of  those  questions 
can  be  reproduced  without  any  problem. 

Mr.  Weiss.  Without  objiection,  Senator,  whatever  additional  ma- 
terial you  would  liU^  to  have  submitted  for  the  record  will  be 
entered. 

Mr.  LaValle*  Jf  thk  AAMC  and  Dental  Association  are  threaten- 
ing to  boycott  New  York  merely  out  of  arrogance,  then  I  believe 
they  must  state  it  a)  such.  l*he  fact  is,  they  can  comply  without 
compromising  their  (^xams.  Passage  of  Federal  l^islation  will,  of 
course,  insure^ompliance,  and  I  emploj^e  this  committee  and  Con- 
gress to  act  swiftly. 

At  this  point  I  would  like  to  comment  on  Congressman  Weiss' 
bill  which  has  been  grafted,  I  believe,  with  the  aid  of  some  of  the 
experts  in  our  bill,    j  . 

I  am  particularly  interested  in  section  7,  entitled  ^Testing  Costs 
and  Fee8toStudents.f  .  i 

The  infomiation  th^t  would  be  disclosed  pursuant  to  this  section 
would  answer  many  of  the  questions  raised  by  the  conflictmg 
memos  circulated  for  the  New  .York  version  of  trUth-in-tpsting. 

I  requested  many  6f  the  figures  which  would  be  required  for 
disclosure  but  was  unable  to  receive  them.  A  constant  accounting 
b^  the  testing  agencies  would  prohibit  retaliatory  actions  fo^'  osten- 
sibly meritorious  reasons,  v 

To  the  degrese  that  these  testing  agencies  haVe  such  a  tn^men- 
dous  impact  on  the  liveiSi  of  millions  each  year,  I  believe  this  kind  of 
monitormg  is  qj^irable  and,  ip  fact,  necessary.  A 
'  The  testmg  industry  has  shrouded  itself  for  years  in  what  I  Jiave 
called  a  ''mantle  of  secrecy,''  and  this  provisioifi^fts  well  as  others\ip 
the  bill  would  certainly  help  [)ierce  that  veil. '  \ 
I  am  9IS0  very  interei^ted  in  section  8  which  wotild  amend  the 
^Higher  Education  Act  of  1965  to  require  inst^tions  to  explainV 
their  use  of  test  scores  in  i^he  Admissions  proces 

Mr.  Wbiss.  That  is  the  ^provision  that  weJrave  deleted  from  the 
Rnel  half pf  the  bill,  and  we  no  longer  incljime  it.  . 
Air:  LAvJiLE.  All  right^We  Vill  skip  down  and  just  say  in  conclu- 


sion- 


'9r 
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:  Mr.  Wbiss.  ^ot  everybody  was  unanimous  in  his  appreciation  ias 
-you  are.  j 

Mr.  La Vallb.  |n  conclusion,  let  me  urge  you  *to  listen  with  a 
.  critical  ear  tontiie  claims  of  the  test  agencies  before  you.  Independ- 
ent einierts  Wt^e  seeh  the  need  ier  this  legislation  for  years;  stu- 
dents haVe  feli  the  need  and  are  calling  for  your  aid. 

J£.  they  are  to  be  judged  by  a  single  instrument,  if  their  futures 
are  to  t)e  determinea  by  a  few  hours  or  highly  pressurized  efn)rt,  let 
•    that  test  ]^  the  pest  it  can  be.  ' 
(      Passage  of  tMs  legislation  is  the  most  positive  step  you  can  take 
toward  that  goal; 

I  commenofyoiir  decision  to  hold  this  hearing  on  this  most  impor- 
tant matter,  arid  thank  you-for  inviting  me  to  testify. 

|Tlie  prepared  jBtatementof  Kenneth  ♦ 

.      Prbparbo  Statxmint  of  Senator  Kenneth  LaVaixe,  N^w  York  State  Senate 

•     My  name  is  Ken  L^Valle  and  I  represent  the  first  State  senatorial  district  in  New 

/York*  I  Am  pleased  to  appear  before  you  today  as  vou  probe  the  important  issues 
surrounding  teeting^-^ues  that  greatly  affect  millions  of  postsecondary  studeij^ts 
throughput  our  NatioiTeach  vear.  *       V  ^ 

As  chairman  of  the  ^ew  York  Senate  Higher  Education  Gommitteeif  I  held  a  joint 
hearing  with  the  assembly  Higher  Education  Committee  in  Ma^  on  New  York's 
truth-'in-teetiiig  legislation.  As  the  prime  senate  sponsor  of  that  Mil,  I  am  very 
'  pleaaed  to  say  thiEit  our  hearm£  was  oqjiy  the  first  successful  step  in  the  life  of  that 
bill.  We  were  able,  with.tiiettelp  of  several  testingiexperts,  as  well  as  the  support  of 
parents,  teachers,  and  studema,  to  get  our  bill  passed  in  both  houses  and  eventually 
signed  by  the  Governor.^  i 

Before  I  tracj^  the  history  of  what  proved  to  be  one  of  th^  most  controversial 
issues  of  our  1979  sessimi/let  me  say  mat  I  sinceiely  hope  that  truth-in-testing  at 
the  Federal  level  meets  Witii  similar  succesiB.  The  facts  are  clear— this  iegisiati(H  is 
and  iJie  timing  is  critical.  Each  student  denied  access  to  his  or  her  efam 


is  unfairly  and  irrepara^  injured.  Each  Unscrutinized  test  potentially  destroys  the 
iiiture  of  thousands  of  s^udentsv  These  are  the  lives  or  our  youth^ur  greatest 
natural  resource.  I  urge  y<iu  to  act  noyf  to  prevent  further  harm. 

I  became  interestcid  in  tnis  issUe  years  ago  as.  both  an  educator  and  a  parent.  The 
field  of  measurement  is  not  unftuniliar  to  me,  and  I  watched  with  great  concern  the 

rroliferation  of  test  adminijstrations  and  the  infreasing  importance  assigned  to  tests 
hflid  been  taught  were  often  of  low  statistical  validity. 

My  interest  continued  ahd  later,  when  I  was  executive  director  df  the  State's 
Senate  Education  pommittfte,  I  was  able  to  view  the  impact  of  thi/ issue  from-n 
statewide  perspective.  FiniEdqr,  as  State  senator  I  infroducea  the  firstiruth-in-testinff 
legidation  in  1978.  Although  the  bill  remained  in  committee  at  the  dose  of  the  1978 
session,  it  served  to  raise  the  issue  and  enlighten  ibany  legiBli|ors  regarding  the  . 
problems  surrounding  standardized  admissions  test^  On  session  hours  were  then 
sient  in  research  which  involved  consultations  with  ]^perts  in  the  field  such  as  Dr. 
Vito  Penrone,' president  of  the  nationA  consortium  6^  testing  and  Dr.  Lewis  Pike, 
senior  assocurte  at  the  Nationfd  Institute  of  Education  and  former  ETS  employee  for 
14  years.  The  bill  I  introduced  this  year  was  the  reoult  oT  this  re^arch  and  it 
reflected  the  fivice  .we  received.  f  # 

The  heariiuf  we  held  lasted  six  hours  and  produced  testimony  which  was  q|rer- 
helmingly  m  support  of  the  desire  and  need  for  tMs  legislatioh.  Most  of  the 
ipoeition  ofm^A  was  based  on  ffear^-fear  inilstilled  by  unsupportable  threats  of  dire 
rcumstances  made  by  the  miyor  testlnaagenicies.  As  pf^viously  stated,  the  support 
'pa  overwhelming.  The  testimony  was  replete  with  ouestiOns  about: 
'  The  sufficient  of  wblicly  available  ddta  for  independent  evaluations  of 
\  constniction,  vfididi^  OF  uto  of      tests;  0 

The  quality  of  the  items  appearing  on  the  tests  and.  the  possible  existence  of 
built-iiH)ias;  *  1 

The  man%  reports  of  known  scoring,  errors— leaving^great  doubt  as  to  the 
number  of  seorldg  errors  left  undiscovered;  and 

Perhaps  itioet  compelling>  wa$  testimoiiy  concerning  the  issue  of  fairne^p. 
Ought  not:  the  bujrdcm  be  ofl  those  denying  access  to  prove  the  need  to  continue 
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The  aniwer  must  be  yes.  I  ma  here  today  to  testify  ^at  that  burden  has  not  been 
met— nor  will  it  be.  I  have  heard  all  their  argumentis.  I  assure  you  that  when  you 
have  heard  them  you  wiU  Qfipreef  with  me. 

Defeat  of  our  bul  in  New  Yoml  was  urged  for  the  following  reasons:  The  technique 
of  (squating  would  be  deetfo^ma;  the  cost  of  compliance  woudd  cause  student  fees  to 
rise  as  much  as  60  perceI^t;^and  finally/ rather* than  copiply/'test  agencies  would 
boycott  New  York  and  as  a  result^  New  York  students  Would  be  unduly  harmed. 

D^pite  intensive  lobbying-^one  of  course  with  student  fees^these  ^guments 
convinced  neit^r  the  mi^oiity  of  the.  Senate  or  assembly  nor  the  Goveri]ior. 

Current  knowledge  among  testinjlexperts  disposed  of  all  equating  arguments.  Use 
.  of  methods  already  employed  by  meijor  testing  agencies  such  as  the  practice  of 
sunply  not  scoring  equatmg  questions  or  use  of  proven  new  techniques  would  permit 
equatmg  to  continue  undistured.  No  attempt  was  ever  offered  to  ^f ute  these  facta: 

Simillgrly,  the  cost  issue  was  unconvincmg,  particularly  in  lififht  of  imdisputed 
.  information  regarding  the  small  percentage  of  student  fees  used  for  test  develop- 
ment and  the  very  large  surplus  earned  oy  the  m^jor  companies  on' these  tests.  ' 

For  example,  ETS  documents  indicate  that  only  5  percent  of  the  student  fee  for. 
the  SAT  and  only  about  7  i)ercent  of  the  student  fee  for  the  GRE  is  used  for  test 
development^the  only  aspect  of  the  testihg  process  affected  by  our  bill.  In  addition, 
their  dodmients  show  earned  surplus  in  excess  of  22  percent  on  the  SAT— a  figure 
estimaUA  to  be  similar  for  otWr  testing  programs.  Information  that  I  requested  a^d 
received  from  ETS  following  our  hearmg  stated  that  the  bill  would  increase  SAT 
development  by .$1,092,000.  Even  if  ETS's  figure  is  accepted,  despite  our  conflicting 
•  data»  if  still  amounts  to  less  than  otie-ihird^fth^  surplus  taken  by  ETS  and  college 
board  on  the  SAT.  Between  1974-76  and  1976-77  the  earned  surplus  ranged  fhim 
$3,000,000  to  $8,641,000.  >  ^  ,i 

Upon  learning  of  the  extremely  profitable  nature  of  this  industry,  many  legisla- 
tors asked:  Why  don't  we  legislate  a  decrease  in  the  cost  of  these  exains? 

The  third  argument  in  opposition— that  of  possible  isolation  of  New  York— was 
viewed  as  merely  a  desperate  threat  since  such  A  course  of  action  would  be  an 
unsound  business  decision. 

However  as  we  now  kAow,  the  American  Association  of  Medical  Colleges  and  thei 
Dented  Amociotion  have  reacted  to  the  adoption  of  this  legislation  by  stating  they 
would  no  longer  sponsor  the  MCATs  or  DATs  in  New  York.  This  attempt  to  avoid 
the  disclosure  legislation  of  one  State  points  out  the  need  for  Federal  legislation  in 
this  area.  .  , 

I  would  like  to  takl^  this  opportunity  to  say  that  neither  of  these  professional 
^  associations  participated  in  the  debate  generated  bv  this  bill.  Although  the  spokes- 
person for  Associated  Medical  Collies  of  New  York  mentioned  affiliation  with  the 
American  Association  of  Medical  Colleges  at  our  hearing,  we  have,  to  this  date, 
received  no  communication  from  the  Dental  Association  and  we, did  not  hear  from 
the  AAMC  for  nearly  a  week  following  their  announcemnt.  Reasons  for  their 
nohinvolvemeni  are  not  clear  and  I  would  hoife  an  explanation  will  be  ofTered  at 
^  hearing.  If  they  persist  in  this  conduct,  however^  I  intend  to  use  my  subperib 
powers  as  chairman  of  the  Senate  Hijrher  Education  Committee  to  compel  them  to 
substantiate  their  claims.  For  example,  they  claimed  there  are  finite  numbers  of 
quality  questions  which  nSay  be  used  on  these  tests^We  disposed  of  this  argument 
when  it  was  raised  concerning  other  tests  covered  by  the  Ic^lation,  and  I  believe 
we  can  similarly  prove  it  is  without  merit  in  the  case  of  the  MCATs  and  DATs. 
Can  we  be  expected  to  believe  that  science— the  most  dynamic  field  known  to  man— 
cannot  yield  enough  questions  for  two  tests  each  year?  Let  me  cite  examples  of 
questions  appearing  in  "The  New  MCAT  Student  Manual": 

These  a^  examples  of  questions  so  unique  that  they  defy  reproduction?  Obviously 
not.  ^ 

If  the  AAMC  and  Dental  Association  are  threatening  to  boycott  New  York  merely 
out  of  arrogance,  then  I  believe  they  must  state  it  as  such.  The  faet  is,  they  can 
comply  without  compromising  their  exams.  Passage  of  Federal  l^islation  will  of 
course  insure  compliance  iutid  I  upaplore  you  to  act  swiftly.  .« 

^  At  this  point  I  would  like  to  comment  on  Congressman  Weiss's  bill  which  has 
been  drafted,  I  believe,  with  the  aid  of  some  of  the  experts  involved  in  our  bill.  I  am 
particularly  interested  in  section  7  entitled,  ''Testing  Costs  and  Fees  to  Students." 
The  information  that  would  be  disclosed  pursuant  to  this  section  would  answer 
many  of  th|  questions  raised  by  the  conflicting  memos  ctfculated  for  th^  New  York 
'  version  ofi^tH-in-testlng.  I  requited  many  of  the  figures  which  would  be  required 
for  disclosure  but  was  unable  to  receive  them.  A  constant  accounting  by  the  testing: 
agencies  would  prohibitgetaliatory  actions  for  ostensibly  meritorious  reasons.  To 
the  degree  that  these  testing  agencies  have  such  a  tremendous  impact  on  the  lives^ 
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.  of  millions  each  year,  I  believe  this  kiqd  of  monitoring  is  desirable  and  in  fact, 
necessary.  The  testing  industry  has  shrouded  itself  for  years  in  what  I  have  called  a 
''mantle  of  secrep/'  and  this  provision  as  well  bb  others  in  the  bill  would  certainly 
help  pierce  that;.veil. 

I  am  also  vepr  interested  in  section  8  which  would  aiiiend  the  Higher  Education 
Act  of  19$5  tojrequire  institutions  to  explain  their  use  of  test  scores  in  the  admi^- 
sions  process.  ]E7rS  was  duick  to  declar^ihat  they  do  not  advise  use  of  test  scores  as 
the  sole  criterion  for  admissionr-not  /surprising  caution  since  they  never  denied 
that  academic  grades  ale  by  them^ves  a  better  predictor  of  future  success  in 
school.  ,     I  '  • 

Despite  thSi  advice,  I  have  learned  that  admissions  officers  are  using  test  scores  to 
eetablii^h  arbitrary  cut-off  pbints  for  admissions  decisions.  While  the  reasons  for  this  / 
are  many,  itfis  significant  in  that  it  portrays  the  attitude  of  the  general  public.  The 
migor  tc«t  opmpanies  have  become  so  complex  that  their  product  is  often  granted 
unwarranted  value,  regardless  of  their  statistical  validity.  This  provision,  requiring 
disclosure  of  the  admissions  procedure  followed  bv  each  institution' will  further 
assist  studetots  in  their  decbion  process  and  wi^l  hopefully  encourage  the  higher 
education  community  to  re-evali^te  ^eir  current  practices. 

In  conclusion,  let  me  urge  you  to  listen  with  a  critical  ear  to  the  claims  of  the  test 
agencies  before  you.  Independent  experts  have  seen  the  need  for  this  legislation  for 
years:  students  nave  felt  the  need  and  are  calling  for  your  aid.  If  they  are  to  foe 
judged  by  a  single  instrumeiit-^if  their,  futures  are  to  be.  determined  by  a  few  hours 
of  highly  pressurized  effort,  let  that  test  be  the  best  it  can  be.  Passa^  of  this 
legislation  is  the  most  positive  step  you  can  take*  toward,  that  goal.  I  commend  your 
decision  to  hold  this  bearing  on  this  most  important  matter,  and  thank  you  for 
invitbg  n^o  to  testify. 

Mr.  Weiss.  Senatbr,  thank  3rou  \ery  much  for  your  testimony^ 
.  Before  I  ask  Senator  Halperin  to  give  us  his 'statement,  let  me 
explain  for  those  of  you  who  may  be  new  to  our  bells  and  buzzers 
jahd  Ii|^htBm;jt)he  clock  that  the  House  is  now  in  session. 

We  areSIso  subject  to  being  summoned  to  some  floor  action  for  a 
:  :yater  or  whatever.  '  v 

When  that  happens  the  bells,  the  buzzers  go  off,  and  we  have  15 
^minutes  from  the  time  that  the  first  bell  sounds  to  get  dowh  there 
and.'so  Wje  may  have^to  from  time  to  time  recess  the  proceedings, 
;  but 'we  will  complete  the  session  and  hopefully  the  disturbances  or 
dfelcr^d  will  be  minimal. 
With  that.  Senator  Halperin,  please  proceed.  -  . 

STATEMENT  OF  SENATOR  DONALD  HALPERIN,  NEW  tORK 

STATE  SENATE     ■  . 

Mr.^  HAij>EAiN.  Mr.  Chairman  and  honorable  members  of  the 
subconiihittee,  I  appreciate  the  opportunity  to  testif|r  here  today  in 
support  of  Federal  legislatiOl)^  which  would  establish  disclosure  re- 
quirements for  the  develoi^rs  of  standardized  admission  tests  for 
university  And  iK)6tgraduate^  schools,  similar  to  those  recently 
adopted  by  Ne^v  York  State.  »  '  ^  X    '  ' 

As  a  m^^benof  the  New  Vork  State  Senate  Standing  Committee 
?  on  JHigher  Education,  and  a  former  ranking  Democratic  member  of 
that  committee  and  a  cosponsor  of  the  New  York  legislation,  I  was 
d^ply  involved  in  its  passage, 

While  the  Neiy  York  law  and  the  proposals  pending  before  you 
differ  in  a  number  of  wtf^s,  hiy  purpi^  m  festiinring  is  to  convince 
you  of  the  advisability  of  this  approacn.  I  have  mil  confidence  that 
shoiild  you  decide  to  adopt  legislation  the  technicalities  can  be 
wor|ped^QUt.  . 

I  would  add  that  sint^  this  statement  was  prepared,  I  had  an 
Importunity  to  review  Cbngressnian  Weiss*  biU  an(|  I  do  believe 
that  it  effectively  iihplemei^ts  theA^  ^  \ 
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—  The  importance  of  these  te^ts  to^  millions  of  Americans  is  ines- 
capable. M^y  schools  rely  heavily  upon  them  in  making  admis^ 
sions  decigms,  and  a  poor  grade  can  mean  nonconsideration. 

The  pwposedSegislation  should  be  supported  for  three  basic 
reasons.  \ 
The  public  and  oit^aide  ejfcerts  should  have  the  opportunity  to 
,  evaluate  the  effectiveness  of  these  tests  in  predicting  scholastic 
success^d  accomplishment  potential; 

Test  takers  should  have  the  opportunity  to  identify  administr 
;tive  and  clencal  errors,  and  all  test  lakers  should  have  an  equ 
opportunity  to  evaluate  their  test-taking  ability  and  to  understand 
the  nature  of  the  test.  ,      .  ,  ~ 

Let  me  now  deal  with  the  issue  of  validity,  a  basic  question  since 
^  it  goes  to  the  very  purpose  of  the  test.  ~  / 

I  havie  very  strong  reason  to  be  a  proponent  of  standardized/testa 
since  they  always  have  indicated  a  great  aptitude  on^  my  behali| 
than  did  my  grades.  But  there  are!  manv  examples  to  the  contrary. 

•  One  such  example  is  a  young  man  who  worked  in  my  law  office 
as  a  clerk.  When  he  took  the  SAT  he  got  such  low  grades  that  he 
was  told  a  monkev  could  have  done  as  well.  Yet  he  was  valedictori: 
an  of  his  class  in  high  school.         i  ^ 

One  good  college  was  willing  to  take  a  chance  and  he  was  accept*, 
ed.  He  did  fantastically  well.  He  made  dean's  list  and  was  consid- 
ered for  a  number  of  very  fine  fellowships.      ^  , 

Then  it  came  time  to  go  to  law  school,  so  he  took  the  LSAT  and 
once  again  ranked  as  high  as  a  Rhesus  monkey! 

This  time  he  wasn't  as  lucky  and  no  law  school  was  .willing  to 
consider  him  even  with  his  grades!  He  then  took  the  job  at  my  law 
firm  and  took  the  test  again* 

This  time  his  ftverage  went  up  a  few  points,  according  to  him, 
merely  a  mattef  <S^f  luck.  After  a  renewed  search  he  found  a  school 
willing  to  accept  him^  '  . 

I  recently  ccJled  to  find  out  how  he  was  doing  in  law  school.  Not 
quite  as  well  as  college;  not  a  valedictorian,  but  he  successfully 
completed  his  first  semester  and  felt  he  was  doing  much  better  in 
'  'his'  second  semester  *  ^ 

It  is  absolutely  unfair  to  him*  and  othiprs  who  have  similar  prob- 
lems to  be  cut  off  from  any  knowledge  as  to  how  they  are^ing 
*      evaluated  and  why  they  are  unsuccessful.  But  that  is  happening  to 
thousands  of  studeniB.  * 

This  type  of  test-taking  problem'  is  but  one  ekample  of  poor 
predifctability.  What  about  geographic  and  ethnic  factors  which 
mighl  not  be  properly  accounted  for?  Are  we  tp  rely  solely,  on  tjiose 
whose  business  it  is  to  sell  the  valjj^  \ 

I  think  that  is  poor  public  P^B^ The  process  must  be  \opeh  to 
outside  evaluation.  '^m        *  j   .  • 

I  do  a6t  think  it  necessary  to  dwell  uport  the  next  issue;  admmis- 
trative  and  clerical  jerror.  Suffice  it  to  say  we  have  all  had  our  own 
unfortunate  experiences  with  human  and  computer  error;  At  least 
*    wa  are  usually  given  the  benefit  of  explanations  atid  the  opportuni- 
i   ty  to  f^ght  for  0ur  just  due.  y 
I     Examples  do  exist  of  error  in  scoring.  These  were  discovered  by 
I  forti^tous  happenstance.  Who  knows  how  many  lives  werefinfairly 
^  A  altered  by  undetected  and  unprpvaole  error? 
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.  Title  ihird  arid  finai  reason  I  offer  for  support  of  the  proposed 
l^ri8latio^  is  equalized  access  to  test  questions  and  techniques  by 
all  test  takers.  In  this  regard  I  was  a  beneficiary  of  the  e;xisting 
system.  I  was  one  of  thosie  whose  family  was  abl^Vto  afford  a  course 
which  helped  tojraise  my  grades  from  the  P3AT  to  the  SAT  hy  200 
points  in  Englisr|  and  by  over  100  points  in  math- 

A  well  known  iemd  highly  organized  tutoring  course  that  I  was 
able  to  p^icipate  in  had  pisople  taking  the  test  year  after  year, 
extracting  questions  whichj  ail  the  test  people  |hem8elves  say,  are 
used  year  after  year* 

A  whole  list  of  questions  were  accumulated  and  our  course  en- 
tailed ^in^over  those  questions  and  knowing  how  to  answer  them. 
So  wjheh  r^w  m^my  of  them  for  the  first  time  I  was  no  stranger  to 
themt 

To  accept  the  argument  raised  in  opposition  to  the  proposed 
l^^latioh  that  public  disclosure  of  the  questions  will  undermine 
the  validity  of  the  trat,  is  to  accept  a  myth«  These  questions  are 
already  to  a  large  degree  public,  but  theatre  available  only  to 
those  lucky  enough  to  know  about  tutoring  course,  able  to  atiord 
these  courses,  and  geographically  accessible  to  them. 
'  It  has  also  been  argued  that  certain  questions  are  necessary  to 
equate  the  results  of  groups  who  take  the  test  at  different  times. 
TUs  issue  is  easily  dealt  with  by  excluding  from  the  legislation's 
coverage  those^^'equating  questions  and  then  not  using  such  ques- 
tions for  the  purpose  of  scoring.  / 

I  am  not  quick  to  encourage  the  entry  of  the  Federal  Gbvem- 
meht  into  areas  I  feel  .should  be  left  to  State  regulations  but  I  feel 
the  time  Ijas  clearly  arrived  for  Congress  to  take  action  in  this 
area.       /      |  ' 

One  reason  is  that  New  York  is  now  being  blackmailed  b\ 
powerful  Association  of  American  Medical  Colleges  with  the  ti 
that  they  will  not  conduct  their  tests  in  our  State  because  of 
new  law.      ^  V 

This  threat'  woiild  dis^lve  with  the  adoption  of  FederaH  legisla- 
tion^ but  more  importantly  these^tests  are  used  to  evaluate  and 
consider  students  from  different  parts  of  the  country  and,  there- 
fore, should  have  national  standards.  \ 

Also,  aCctes  to  t€«its  must  become  a  national  policy  so  that  their 
intc^ty  is  maximized  and  so  that  those  using  these  instruments  of 
predictability  will  have  to  do  so  wit^  full  knowled^'  of  their 
strengths  and  their  weaknesses.     .   /  \ 

Thank  you,  Mr.  Chaittnaji.  ,  x  / 

Mr.  Weiss.  Thank  you  very  much,  Senate.  \ 

Dr.  Grahai^?  |  i  ^  ^  \ 

STATEMENT  OF  JAMES  W.  GIUl^AM,  ASSISTANT  SECRETARY 
COUNCa.  ON  DENTAL  EDVOimOK  AMERICAN  DENTAli  ASSO 
CIATION  /  1^ 

^  Dr.  GRAHiJk(^Thank  you^Congressman  Weiss. 

Mr.  Chairman,  and  members  of  the  subcommittee,  my  name  is 
Dr.  James  Graham*  \.\ 

the  American  Dental  AssociatioAxS 
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I,  am  affl  assistant 
Counj^il  ba  Dentai  " 
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the  American  Dental  Association  Conducts  two  national  testing 
programs.       «  , 
\  One,  the  dental  admission,  testing  program  which  is  an  entrance 
e^umaination  required  by  all  the  60  dental  schools  in  the  United 
States,  and  ttie  other,  the  coimcil  of  national  boards  examinations, 
a  proficiency  examination  rcKiuired  by  48  of  the  50  States  as  a 
pakiab^u^meM  for  State  licensure. 
I  W0UI4  like  to  talk  about  each  of  the  programs  separately. 
rThe  dent^  admission  testing  program  or  DAT  was  b^^  in  1946 
for'^the  expr^  purpose  of  reducing  attrition  taking  place  in  dental 
sqhodls.         \  ' 

^  During  the  193(^s  and  1940's,  before  the  test  was  instituted,  the 
national  attrition  nMe  in  dental  schools  averaged  between  20  and 
25  percent.  After  ttie  DAT  ^as  accepted  as  a  requirement  for 
entrance  for  cdl  dentanachools  in  1960,  and  additional  requireinento 
were  introduced,  thiis  rate. was  reduced  to  about  7  percent.^ 

if  one  were  to  convert  tlus  to  present-^ay  stetistics,  sintie  thei:e 
are  now  slightly  over  6,000  fintryear  d^tcd  studente,  this  attrition 
rate  reduction  would  be  from  lv200:  to  420.  With  the  average  cost  of 
educating  a  dented  student  novrbeing  about  ^19,000  pei^yiear,  the 
American  Dental  Associqitioh  believes  the  dental  admission  testing 
pr^»m  has  more  than  achieved  itrgoals. 

The  dental  admission  testing  pr^mn  is  in  many  ways  a  very 
uniquie  admisfion  testing  program.  FirstKthe  prc^a^is  conducted 
entirely  in-house  by  the  Amejdcan  DentaKAssociation  s  Council  on 
Dentai  Educatjpn.  \ 

It  mainttdnanjp  relations  or  subcontracto  with  any  of  the  lai]ge 
testing  cozporc^ns  or  test  consulting  firms  nbr  jjjias  it  ever  main- 
tained any  such  relations  or  Subcontracto.  \ 

llie  dental  admission  testing  program  is  the  only  postsecondaiy 
entrance  toting  program^  conducted  by  a  professionM  organization 
like  the  American  Dental  Ai^sOciation.  ^ 

It  do^  this  in  border  to  mcdntain  better  control  over  the  quality 
of  ite.  program  at  what  it  feels  is  a  more  reasonable  price*  Since  it 
began  in  1950  the  program  hfts  increa^  ite  fee  once  and  that  wais 
by  only  $5  to  ite  present  fee  of  $20.  The  committee  should  under- 
stand that  compliance  with  this  bill  would  subistantially  rietise  this 
cost  td  the  studento.  • 

A  second  unique /eature  of  the  dental  admission  testing  program 
ia  ito^manuaj  dexterity  teste.  As  you  know,  one  of  the  absolutely 
necessaiy  and  basic  skills  required  of  all  dental  studento  is  the 
ability  called  fine  manual  dexterity^        v  * 

la^rdlbr  tp  gmduate  from  dental  school,  the  dental  student  must 
ha\i0the  proHciencies  to  practice  What  is  commonly  called  general 
dentistry.  General  dentistry,  like  the  medical  specialty  of  surgery,  ^ 
as  opposed  tolthe  pmctice  of  most  other  professions,  requires  a  nigh 
d^ee  of  maniiai  t^h|^iaue  proficiency. 

Not  everyone  tHe  nne  manual  dexterity  td  master  the  techni- 
cal skills  to  practice  dentistry.  The  DAT  has  develojped  nonverbal^ 

Serceptual,  and  space  relation  teste  which  o^r  the  years  have 
emonstrated  .proven  ability  to  meaisure  and  iflvaluate  the  appli-> 
cant's  fine  manual  dexterity 

<  /  ThO/ formal  of  these  testiris  nonverbal  in  nature.  It  is  a  series  of 
oxfminf^  bf  two  and  three  dimension^  objecte  which  the  test  sub- 
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ject  i4idt  relate  to.  The  problem  is  that  there  are  only  a  small  . 
himibeli^f  ways  to  represent  a  box  or  triangle  on  a  drawing,  which 
severely  limits  the  number  of  test  forms  that  can  ba  produced. 

lliid  is  one  of  the  primaty  reasons  for  our  t^tinlony  today.  If  the 
dental  admission  testing  program  was  required  to  disclose  the  actu- 
al'tests  after  e^ch  administration,  as  the  legislation  now  proposes, 
in  a  year  or  two  these  kinds  qf  manual  dexterity  tests  would  have 
to  be  discontinued; 

I  would  like  to  make  several. further  points  with  regard  to  the 
issue  of  disclosure.  The  DAT  is  the  only  entrance  examination 
program  that  contains  tests  that  measure  abilities  other  than  aca- 
demic. If  tjine  dental  profession  lost  this  instrument  it  would  suffer  ^ 
irrepiorable  harm,  since  this  is  the  best  proven  criteria  that  can  hfi 
used.        /  * 

A  dimin^ution  in  quality  of  the  other  i^rtions  of  the  DAT,  for 
example,  its  science  tests  or  its  reading  comprehension  tests  could 
be  compensated  Tor  in  part  by  other  criteria,  like  grades  in  college^ 

Without  ^he  manual  component  of  the  pAT,  however,  dental 
schools  would  have  no  criteria  to  discrimifiate  ability*  to  perform 
fine  manual  dexterity  and  as  consequence  it  can  be  predicted  that 
the  attrition  Tate  in  dental  schools  would  again  rise  to  where  it  was 
before  theJ)AT  was  introduced. 

The  American  Dejital  Association  asks  you  to  »ve  this  point 
very  special  consideration  in  your  deliberations.  1 
.  It  should  also  be  made  clear  that  the  American  Dental  Associ- 
ation does  not  disagree  with  the  objectives  which  the  disclosure 
clause  or  the  other  provisipns  the  proposed  legislation  is  trsdng  to 
.  accomplish.  To  the  contrary,  it  fully  endorses  these  objectives  and 
has  in  faqt  taken  steps  which  it  feels  are  beyond  those  taken  by 
meet  other  testing  programs  to  accomplish  these  objectives. 
^  In  fact,  the  American  Dental  Association  fe^ls  that  these  are 
merely  tilie  objectives  of  testing  which  have  for  naahy  years  been; 
clearly  womulgated  by  organizations  like  the  American  Pyscholo- 
gical  Affiociatioh  and  the  American  Educational  Research  Associ- 
ation. 

I  will  enumerate  a  few  of  the  measures  it  has  taken  to  accom- 
plish these  objectives: 

First,  jit  has  released  an  example  copy  of  an  exact  form  of  the 
dental  admission  tests  which* it  Y\aB  entitled,  ''Dental  Admission 
T^  Preparation  Materials.''  These  materials  are  distribute  free 
of  charge  to  dl  applicants  who  register  for  the^AT. 

it  hafi  done  this  to  neutralize  the  error  m^asur^ent  that  has' 
been  inti|)di|ced  into  the  test  scbres  by  test  preparation  course, 
sinc^  all  potential  candidates,  especially  those  whose  economic  cir- 
c^msjt^  backgrounds  or  geographic  location  ifc|the  9buntry,  do 
not  have  identical  access  to  preparation  courses^  T 

T^e  ADA  also  feels  thai  when  a  candidate  studia  for  a  tS^ltTn^t 
or  wtie  (m/ght  to  be  able|to  study  the  material  which  isjictually^ 
^containeoln  the  test  at  the  difflcultv  level  it  will  be  testea.  This  is 
especially,  important  for  tj|||0  ^om^rW  perceptual  and  space  rela- 
tion tests  bontain^  in  the  pr^prm^ .  ^  f. 

The  American  Dental  Ap^iation'$lsd  believes  that  it  is  assisting 
the  dental  schools  to  Tiiore  acpura^y  judge  the  ability  of  the 
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candidate  by.  eliminating  the  above?  types  of  bias  that  might  b^ 
I)re9eht  in  their  admission  decisions.  -  •  ' 

Second,  annually,  the  American  Dent«jl  Association  conducts  a 
complete  statistical  analysis  of  its  teslis  along  with  validity^  studies 
which  are  participated  fn  by  all  the  dental  schools  in  the  United 
States. 

The  statistical  analysis  contains  a  complete  item-by-item  analysis 
of  the  test  to  determme  riot  only  how  reliable  the  tests  wei*e  fifflf  a 
whole,  but  also  how  each  specinc  item  in  the  test  performed.  The 
analysis  %l80  contains  additional  studies  to  determine  the  efTect  of 
.  repeating  the  test  more  than  one  time. 

These  studies  have  been  carried  on  since  the  inception  of  the 
program  and  are  fully  published  and  distributed  free  of  charge^  to" 
anyon0  who  has  requested  copies  of  ttiein.  Thes6  studies  along  with 
other  Useful  admission  information  are  bound^ together  under  the* 
title  "Handbook  for  Pre-Dentel  Advisers"  and  annually  distributed 
free  of  charge  to  all  pre-denfel  advisers  at  all  undergraduate  post- 
secondary^  institutions  across  the  country. 

In  this  way,  the  Anierican  Dental  Association  feels  that  it  Has 
fully  mfbrmedsand  made  freely  available  all  information  tjiat  is 
necessary  for  an  applicant  or  his  adviser  to  judge  the  quality  or  x 
content  of  its  dental  admission  testing  propam.  A  copy. of  the 
Dental  Admission  Test  Preparation  Materifis  and  other  studies, 
just  mentioned  have  been  submitted  to  the  suScommittee  for  exam- 
ination. '  ,  ' 

At  thisfoint  T  would  like  to  briefly  address  our  concerns  as  they  ^ 
relate  to  the  national  board  examinations.  The  Council  on  National 
Board  Examinations  was  established  in  1928  as  a  standing  commit- 
tee of  the  American  Dental  Association  for  the  purpose  of  provid- 
ing and  conducting  written  examinations  for  use  at  the  discretion 
of  State  boards  of  dentistry  in  licensing  dentists. 
In  196i,  the  charge  of  fiie  council  was  expanded  to  include  pro- 
dding and  conducting  written  examinations  for  use  at  the  discre- 
.ion  of  State  boards  of  dentistry, in  licensing  dental  hygienists. 
Currently,  over  12,000  candidates  for  dental  licenses  and  almost 
6,000  candidates  for  dental  hygiene  licenses  participate  in  National^ 
Board,  programs  each  year. 

The  dental  examinatiolfluibattOTy  consists  of  seven  lOOritem  exaini- 
nations;  while  the  idfehtal  hygiene  examination  is  a  single  examina- 
tion consisting  of  350  items.  In  the  interest  of  Serving  the  public, 
,  State  boards  of  dentistry,  carfdidates  for  licensure  and  the  profes- 
sion, examinations  are  administered  three  tim^s  at/^testing  centdrs 
thnHnout  the  United  States.  ^ 

l^Vsure  examinatibns  of  high  quality  that  are  fair  and  just  to 
pajrticftants,  tv^o  or  three  new  editions  of  each  dental  examination 
and  o»  or  j|wp  edition^,  of  the  dental  hygiene  examination  are 
develond  each  year.        V  V    '     .  ^ 

During  any  year^  at  lea^t  four  diflerent  dental  examinations  are 
releas^  with  answers  and  sta^ticdl  analysis  of  test  items  to  licen- 
surr  crindlditteB,  uental  school  fscultjr^mbers  and  interested  iridi- 
viduds;  Deiital  hygiene  examinations  are  also  released  regularly, 
but  with  less  frequency  due  to  the  length  of  ^xam^ations. 

The  American  Dental  Ass^iation  supports  in  p}rinciple  the  dis- 
closure provisionis  contained  m  the*  legislapon.  The  American  Den- 
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:  tal  Association  believes  that,  thVough  its  current  policy  of  releasing 
National  Board  examinations,  it  fully  responds  to  the  extent  of  the 
disclosure  clause,  ^ 
Our  concern  relates  to  having  undu^  restrictions  placed  on  its 
examination  program  that  would  jeopardize  the  quality  of  exami- 
nations. Publishing  all  test  items  after  their  use  would  seriously 
deplete  the  test  item  files  and  causiB  examinations  to  become  less 
reliable  and  less  valid. 

The  American  Dental  Association  also  urges  the  rejection  of 
proposals  which  would  stipulate  that  Examinations  used  for  entry 
into  a  profession  must  be^  scored  without  relation  to  the  distribu- 
tion of  scores  produced     the  examination. 

National  Board  examinations  are  scored  using  a  distribution- 
referenced  scoring  system.  This  scoring  system  allows  for  consist- 
ency among  scores  and  equivalency  of  scores  from  various  editions 
of  the  examina^ons. 

Until  criteria-based  scoring  procedures  are  refined*. to  provide 
identical  interpretation  of  scores  from  testing  date,  to  testing  date, 
'"^^  a  distribution-referenced  scoring  system  is  the  fairl^st  and  most 
'  reliable  way  of  measuring  the  cognitive  skills  necessary  to  practice 
dentistry'^or  dental  hygiene. 
In  summary,  the  American  Dental  Association  does  not  believe 
'     that  legislation  such  as  H.R.  4949  is  necessary  for  those  programs 
which  I  have  described. 
.  .  If  Congrc^  should  decide  that  some  type  of  limited  legislation  is 
desirable,  then  the  disclosure  provision  6f  sections  5(aXlXa)  and 
^  5(aX2Xa)  should  be  deleted  or  the  exemption  in  section  5(b)  should 
Be  extended  to  cover  relatively  small  programs,  such  as  the  DAT 
.   which  Tire  adminstered  to  less  ,^han  10,000  subjeq^  .per  testing 
periokl.,       o  •  '    ^  .  X 

With  regard  to  H.R.  8564,  the  American  Dentai  Association  like- 
wise feels  that  this  legislation  is  unnecessary  as  applied  to  the 
association's  programs.  If  the  legislation  is  to  be  enacted,  it  feels 
that  section  60h!!K4)  should  be  deleted  in  that  it  niight  be  extended 
.  to  include  disclosure  and  that  section  6(c)  should  be  deleted  since 
.  ,the  theoty  of  criterion  reference  tests  has  not  been  sufficiently 
,    .  developed  to  warrant  its  indiscriminate  imposition  on  all  profic- 
iency ^testing  p^rograms. 
Mr.  Chaimlan,  this  concludes  my  remarks.. 
I  would  be  happy  to  attempt  to  respond  tia^  any  questicms^  which 
the  subcommittee  may  have. 

Mr.  WEissi  Thank  youi  Dr.  Graham. 
^Mr.  Millard  Ruud? 

STATEMENT  OF  MILLARD  H.  RUUD,  EXECUTIVE  DIRECTOR, 
ASSOCIATION  OF  AMERICAN  LAW  SCHOOLS 

.  Mr.  RuuD.  Thank  you,  Mr,  Chairman.       -  \. 

I  am  Millard  H.  Kuud,  executive  director  of  the  Association  of 
American  Law  Schools  and  for  80, years  a  member  of  the  law* 
faculty  of  the  University  of  Texas,    .  " 

While  a  member  of  that  faculty,  I  served  for  about  15  years  as 
the  chairperson  of  the  school's  admissions  committee  and  on  var? 
iofiB  committees  of  the  Law  School  Admission  Council,  the  national  . 
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organization  that  owns  the  Law  School  Admission  Test  and  ihan-^l 
ages  the  law  s<^ool  acknission  progrcu^  ^ 

I  served  as  its  chairman  from  1966  to  19159.  Today,  I  apmear  as 
the  representative  of  the  Asswiation  bf  American  Law  Schools, 
■  AALS.  ■  :   •  /  ■      ■  ■     \  • 

The  Association  of  American  Law  Schools  was  founded  irt  1900 
.  and  is  composed  of  186  member  law  schools,  iall  of  which  are 
approved  by  th^  American  Bar  Association.  The  association  is  rec- 
ogidlbd  as  a  national  accrediting  body  by  the  Council  on  Postsecon- 
dary  Accreditation,  a  nonprofit,  nongovernmental  association.  As 
stated  in  its  bylaws,  the  purpose  of  our  association  Iq  the  ^^improve- 
ment of  the  legal  pr6f(|9sion  through  legal  education.^' 
I  think,  Mr.  Gh^rman  and  members  of  the  ..committee;  that  our 
)  association  is  the  only  one  appearing  before  you.  that  represents 

the  admission  committee  users  of  the  test,  and  so  I  reflect  that 
perspective  and  the  perspective  of  the  concern  of  our  schools  for 
.  the  usesj:)f  the  test  and  their  c6ncems  for  their  applicants  and 
|k)tential  applicants. 

I  should,  to  help  you  understand  the  dynamics  of  the  use  of 
stan4ardi2ed  admissions  teste  of  the  Law  School  Admission  Coun- 
cil, I  should  emphasize  that  the  Law  SIchool  Admission  Council  is  a 
separate  entity  incorporated  under  the  education  laws,  of  New 
York,  govemea  separately  by  representatives,  by  liersons  elected  by 
representatives  of  the  schools. 

It  conducts  it  services  largely  und^r  a  contract  with  the  Educa- 
tioncd  Testing  Services.^  ' 
The  operating  relationships  and  the  institutional  relationships 
.  that  these  twb  organizations  have  are  excellent. 

While  we  are  not  unmindful  or  unsympathetic  to  the  substantial 
'     problems  that  these  proposals  have  for  the  Lelw  School  Admission 
Council,  the  testimony  often  is  offered  from  the  perspective  of  our 
member  law  schoob.  •  • 

I  should  emphasize  that  we  have  no  economic  interest  in  the 
LSAT,  no  economic  interest  in  thie  Law'School  Admissipn  Council, 
or.any  of  its  services.  ,  .        \  ^ 

My  review  of  the  two.  bills  before  this  committee  has  disclosed  to 
me  three  important  themes  or  jjurposes,  all  of  which  are  consistent 
vrith  the  interest  of  our  association. 
Let  me  turn  briefly  to  these  themes,  as  I  see  them.  _ 
One,  a  very  important  purpose  of  the  bill  enacted  in  California, 
the  bill  enacted  in  New  York,  arid  in'-the  two  bills  before  you  is ' 
that  of  ptoviding  potential  t^st  takerS4  with  as  much  information 
about  the^^  admission  test  as  possible,  so  as  to  place  all  who  tak^  the 
test  on  equal  footing,     /  "  '  ; 

The  special  role  that  tne  admission  test  score  plays  is  orie  item  in 
making  the  admissions  decision  that  of  providing  an  impartial  and 
nationallj^  uniform  basis  for  judging  appncants. 
Nolle  of  the  other  information  before  the  admissions  committees 
^   of  our  law  sdhoolU  have  a  common  and  impartial  basis. 

Now^  for  the  admissions  t^t  scores  to  truly  have  an  impartial 
and  common  basis,  it  is  essential  that  those  who  tak§  the  test  be 
placed  on  as  narrowly  a  common  b^is  as  possible.  ^ 

Muph  of  section  6  of  H.R,  8564  and  son^e  of  section  8  of  H.R.  4^49 
are  designed  to  serve  that  purpose.  , 
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In  my  written  testim<my  I  descrfbecjf  in  detail  the  efforts  that  are 
made»  starting  with  pubhcation  by  IpAC  of  500,000  copies  of  this 
document,  which  contains  a  form  of  the  test,  correct  answers,  a 
description  with  respect  to  each  type  of  question,  pf  why  a  given 
answer  is  the  correct  one.  . ' 

J  Rftr.  Wsass.  Mr.  Ruud,  without  objection,  the  entire  written  state- 
Wht  that  you  have  will  be  entered  into  the  record  and,  of  course, 
you  may  proceed  to  highlight  your  statement  as  you  desire. 
|The  prepaid  i^tement  of 

Prbparbd  Statebi^  of  Millard  H.  Ruud,  Exbcutivk  Director,  Association 

OF  Amsrican  Law  Schools 

I  am  Millard  H.  Ruud,  Executive  Director  of  the  Association  of  American  Law 
Schools  and.  for  30  years  a  member  of  the  law  faculty  of  the  University  of  Texas. 
^  While  a  membeir  of  that  faciUty  I  served  for  about  16  years  as  the  chairperson  of  the 
school's  admissions  commitOe^and  on  various  committees  of  the  Law  ochool  Admis- 
sion Council,  the  national  or^ization  that  owns  the  Law  Schpol  Admission  Test 
and  manages  the  law  school  admission  pro£^am.  I  served  as  itsthairman  from  1966 
to  1969.  Today  I  appear  as  the  representative  of  the  Association  of  American  Law' 
Schools  (AAL8): 

The  Association  of  American  Law  Schools  was  founded  in  1900  and  is  composed  of 
136  itnember  law  schools,  all  of  which  are  appceved  by  the  American  Bar  Associ- 
ation. The  Association  is  recognized  as  a  national  accrediting  boay  by  the  CounciLon 
Postsecondary  Accreditation,  a  non-profit,  non-governmental  association.  As  stated 
in  its  bylaws,  the  purpose  of  our  Association  is  the  "improvement  of  the  legal 
profession  through  legal  eoucation."  ^ 

The  Law  School  Admission  Council  (LSAG)  is  a  separate  entity^  It  wqs  established 
.ih''t948  and^^was  incorporated  as  a  non-profit  educational  corporation  under  the 
Education  Laws  of  New  York  in  1968.  It  is  governed  by Ja  Board  of  Trustees;  its 
president  (Dean  L.  Orin  Slagle  of  the  College  of  Law,  Onio  State  University)  is 
elected  by  representatives  of  the  member  law  schools.  Presentlv,  the  Lnw  Scnool 
Admission  Test  (LSAT),  Law  School  Data  Assembly  Service  (LSDAS)  and  other 
admissions  research  and  services  are  aq(ninistered  lateely  by  Educational  Testing 
Sesyice  (ETS)  Under  a  contract  between  it  and  the  LSAG.  Recently  it  established 
under  Delaware  laws  a  subsidiary.  Law  School  Admission  Services,  Inc.  (LSAS),  a 
non-profit  corporation;  LSAS  will  administer  the  LSDAS  and  other,  services  in  the 
near  future.  L^AC  and  not  ETS  has  the  policy  responsibility  for  the  law  school  • 
admission  services. 

The  operating  and  institutional  relationships  of  LSAC  and  AALS  are.  excellent. 
While  we  are  not  unmindfiil  of  unsympathetic  of  the  substantial  problems  that 
certain  of  these  legislative  proposals  nave  for  LSAC,  the  testimony  that  I  offer  today 
is  offered  from  the  perspectii^  of  our  member  law  schools.  I  represent  their  con- 
ceniB  for  their  appUcants  and  potential  applicants  and  their  programs  of  legal^. 
education. 

A  dlstiiiguished  legal  educator  has  observed  that  the  decision  as  to  whom  should 
be  taught  is  as  important  to  a  school's  program  of  legal  education  as  the  decision  as 
to  who  should  teflE.  As  I  will  make  more  clear  later,  our  member  schools  have 
found  LSAT  scores  to  be  a  significant  and  important  item  of  ihformatipn  about 
applicants  that  assists  them  in  making  sound  admiapions  decisions. 

In  my  testimony  I  will  address  the  important  ii^ues  prei^ented  by  the  two  bills 
befbre  the  conmiittee  in  terms  of -applicants  for  admission  to  law-^school,  the  LSAT, 
4fSAC  Sfrvicee,  admissions  procedures  and  criteria  of  law  schools,  programs  of  legal 
education,  the  Icf  al  profession,  and  the  public  interest  in  l^al  education  and  the 
legal  profession,  f  do  this  because  I  repr^se^t  AALS  and  its  Im  schools  and  bcicause 
is  Uie  part  of  the  postsecondary  education  admission  world  'that  I  know  ^  well. 

V  Ilappreciate  that  the  tight  schedule  >  of  jpnis  committee  permitted  it  to  invite  to 
present  testimony  only  one  association  that;  represents  educational  jinstitutions  and 
that  does  not  have  a  dir^  interest  in  anir  admissions  tests.  I  know  that  you  have 
invited  the  other  graduate^  and  professimai  school  associations  and  institutional 

'  associations  to  submit  comment  on  the  t^o  bills  that  are  the  subiect  of  this  hearing. 
I  recogniKe,  however,  that  I  have  in  a  sense  a  special  responsibOity  to  bring  to  you 

'  the  peiiceptions  of  the  host  of  admissions  committees  throughout  postsecondary 
eduipiti6n  that  are  some  of  the  verv  important  consumers  of  admission  test  scores 
BM  admission  test  services.  I  have  been  in  communication  with  a  number  of  these 
asociations  and  I  understand  to  some  extent  their  concerns.  As  is  appropriate,  I 


will  try  to  reflect  those  in  this 
may  ask  to  reflect  their  persp 
My  review  of  H.R.  3564  by 
Weiss,  Congresswoman  Chish(j 
portant  purposes  or  themes, 


Btimony  and  will  try  in  ^inswer  to  the  questioni^you 
lives  to  the  extent  that  I  can. 
[igressirffci  Gibbons  and  H.R.  4949  bv  Congressman 
1  and  Congressman  Miller  has  disclosed  three  im- 

^   ._   ,    _  if  whidi  are  consistent  with  the  interests  of  our 

association  and  are  purposes  fchat  responsible  educators  and  testing  agencies  have 
sought  tfserve./Let  me  turn  my  attehlioh  now  to  these  policy  objectives  of  the  bills 
-  before  yoii  s  , 

Wide  dissemination  ofinfoMatiOn  about  the  content  and  form  of  admissions  tests 
and  of  test  taking  strategies.^h  very  important  purpose  of  the  two  bills  before  you 
;and  of  the  legislation  enact^  in  California  and  New  York  is  that  of  providing 
potential  test  takers  with  as  much  information  about  ihe  admission  test  as  possible 
so  as  to  place  all  who  taike  the  t^st  on  an  equal  footing.  The  special  ro|e  that  the 
admission  test  score  plays  in  aamissions  (decisions  is  that  of  providing  ah  impartial 
.  and  nationally  uniform  basis  fpr  judging  applicants.  None  of  the  other  information 
that  law  school  admissions  committees  have  stbout  their  applicants  has'a'commoh 
and  impartial  basis.  The  grade'  poiht  averages  were  earned  at  several  hundred 
different,  colleges  and  universities,  the  letters  of  recommendation  are  written  by 
several  thousand  different  pn^rsons,  the  interviews  are  conducted  by  a  number  of 
different  individuals,  and  the  work  experiences  are  at  a  great  veriety  of  tasks.  In 
short,  every  other  item  of  information  about  the  applicants  is  on  4  perhaps  some- 
what comparable  but  not  common  base.  If  the  admission  test  score  m  truly  to  have 
impartial  and  common  basis,  it  is  essential;  that  those  who  take  the  test  be 
placed  on  as  nearly  a  common  basis  as  is  possible.\ 
Much  of  Section  6  of  H.R.  3564  and  some  of  Section  3  of  H.R.  4949  are  designed  to 
1    serve  this  purpose.  .  \ 

It  may  be  useful  to  you  if  T  describe  briefly  th^  steps  being  taken  by  LSAC  to 
serve  this  interest.  This  will  permit  you  to  detetmine  what  governmental  regula- 
tion, if  any,  is  needed  and.  If  so,  what  the  shape  of  ii  should  be.»About  500,000  copies 
:  of  the  Law  School  Admission  Bulletin  are  distributed  without  cost  each  year  to 
persons  interested  in  taking  the  LI^AT  directly  and  through  prelaw  advisors  on 
college  campuses^  law  school  admissions  offices,  career  counseling  offices  and  others. 
See  Attachment  A  for  a  copy.*  In  addition  to  describing  how  to  register  ftr  the 
XSAT  and  LSDAS,  where  the  test  is  administered  and  the  like,  this  bulletin  de- 
iscribes  the  purposes  and  content  of  the  test.  A  retired 'form  of  the  test  with  the 
correct  answers  for  each  question  is  set  out.  * 

For  each  type  of  question  it  is  explained  why  a  given  answer  is  the  cofrect  one 
and  the  oihem  are  not.  General  suggestions  for  test  taking  are  provided.  For 
example,  it  is  jmade  clear  that  this  admission  test  is  scored  on  the  basis  of  correct 
answers  only  ^d  that,  therefore,  it  is  best  to  try  to  answer  every  question.  Sugges- 
tions for  preparation  for  the  test  are  given.  Detailed  information  about  scores 
obtained  by  persons  taking  the  test  a  second  time  is  provided,  along  with  informa- 
tion as  to  how  law  schools  treat  multiple  scores.. 

^  The  concern  for  the  potential  test  taker  does  not  stop  with  the  test.  AALS  and 
lS AC  publish  an  annually  revised  Prelaw  Handbook.  This  contains  information 
about  the  legal  profession,  preparation  for  law  school,  the  application  process  and  a 

"  description  of  what  it  is  like  to  be  a  law  student.  All  law  schools  provide  a  two-page 
description  of  the  salient  elements  of  their  educational  program  and^he  great  bulk 
of  them  provide  an  admissions  profile  of  that  year's  entering  class.  This  perniits  a 
potential  applicant  to  determine  her  or  his  probability  for  admissWn.  This  is  all 
designed  witn  the  interest  of  the  LSAT  test  taker  and  law  school  applicant  in  mind. 
We  want  the  applicant  Mo  have  as  much  information  as  is  feasible  of  the  whole 
process  so  thai tTsne  or  he  may  do  and  choose. well.  /  . 

High  quality  of  admissions  teste.— Section  5  of  H.R.  4949,  Sectioiys  3  and  6  of  H.R. 

.  3564  and  statements  of  supporters  of  this  and  related  legislation  express  concern 
about  the  quality  of  standardized  adniissions  tests  and  interest  in  improving  further  , 

•  the  quality  of  standardized  ppstsecondary  admissions  tests.  Our  Association  sharjBS 
that  interest.  We  know  that  LSAC  has  in  its  three  decades  of  existence  conimis- 
sioned  considerable  research  to  improve  the  test  and  in  searching  for  additional 
forms  of  testing  the  aptitudi  for  law  study  of  applicants  for  admission.  The  research 
reports  are  published  in  the  annual  report  of  the  Law  School  Admisssion  Council. 

I  These  may  oe  found  in  every  law  school  library  and  in  moat  of  the  law  school 
admissions  offices.  HicfenUy  three  volumes  have  been  published  by  LSAC  setting  out . 
I    in  full  the  final  research  reports.  Should  the  committee  w£^t  copies,  LSAC  has 
.  loured  me  that  they  would  be  happy    supply  them. 


*  Retained  in  subcommittee  files. 
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It  has  been  charged  hy  some  that  admissions  testing  is  "shrouded  in  secrecy.' 
*  iWith  respect  to  the  LSAT,  the  test  is""shrouded^  in  secrecy"  only  from  thbse  who  are 
-  unawar^^of  the  research  reports      have  fail^  io  read  and  understand  them. 
LSAC  has  not  relied  alone  on  W^j^eaeSLVch  that  it  has 'commissioned.  It  has 
invited  members  of  the  facjilty^ioflheir  member  schools  to  uhdeitake  &dmi3sions 
research  and  has  offered  to  provide  financial  support  for  that  re^arch. 

AiMl(jher  step  that. has  been  taken  in  the  effort  to  maintam  and  improve  the 
quality  of  the  LSAT  has  been  a  publication  policy  of  ^ETS,  warmly  supported  by 
LSAC.  The  professional  staff  of  ETTS  are  encouraged  to  convert  the  researxsh  that 
they  undertc^e  for  client  agencies,  such  as  LSAC,  into  articles  publishable  in  their 
''^  learned  journals.  In-  this  way,  the  ETS  professionals  Se  subject  to  the  criticism  of 
their  peers— the  clinical  psychologists,  .psychometricians  and  other  professionals 
based  in  the  public  and  private  sector. 

I^blic  accountability  of  the  admission  ^nocesff.— H.R.  3564  and  H.R.  4949  both 
fecognize  the  substanlfol  public  interest  in  admissions  tests  and  their  use.  Section  7 
^of  H.R.  4949  seems  to  address  particularly  the  issue  of  accountability. 

[I  can  assure  you  that  the  LSAC  has  throughout  its  history  been  very  conscious  of 
its  stewardship  responsibility  to  ensure  that  the  interests  of  the  mojor  consumers  of 
its  pervice^  bur  member  schools  'and  the>ir  applicants  are  taken  fully  into  account.  To 
aslist  it  iii  discharging  this  responsibility,  the  LSAC  has  invited  our  officers  and 
proA|ii/onal  staff  to  attend  meetings  of  its  Board  of  Trustees  and  its  standing 
Goinmitteea.  Our  responsibility  at  those  meetings  has  been  to  provide  an  additional 
voice  for  these  interests.  By  this  I  do  not  mean  in  any  way  to  sugjg;est  that  the  LSAC  . 
leadership  has  not  alsoi)een  very  attentive  to  these  interests.  - 

The  LSAC  publishes  an  cmnual  report  that  sets  out  the  minutes  of  the  meetings  of 
its  Board  of  Trustees,  and  of^kpf  its  committees,  the  research  reports,  and 
extensive  financial  information..  These  are  distributed  to  all  of  the  law  schools  and 
are  available  ta  the  public, '  *   .  -  * 

LSAC  takes  a. number  of  steps  to  explain  to  admissions  committees  and  other 
admissions  personnel  the  test,  its  uses  and. recent  research  results.- At  its  annual 
June  meeting  one  or  more  admissions  persons  from  the  member  schools  pcurticipate 
in  one  and  one-half  dayisi  of  workshops.  A  week-long  workshop  is  given  annually  to 
60  t()  75  admissions  persons.  Five  one  day  regional  admission  workshops  are  given 
.  .  annually.  By  periodic  newsletters  to  admissions  persons  current  developments  are 
deiBcribed.  Each  admissions  office  is  provided  with  copies  of  the  Legal  Aff^rs  Man- 
u^  and  Operations  Reference  Book.  LSAC  has  just  distributed^fts  Cautionary  Poli- 
cies, which  is  an  excellent  guide  to  use  of  the  LSAT  scores  and  other  admission 
criteria  These  and  other,  meaiis  are  taken  fto  assist  the  law  schools  to  make  appro- 
priate use  of  the  LSAT  scores  and  other  admission  criteria  and  to.  report  to  them  on  , 
LSAC's  work  on  their  behalf.  Our  Section  oh  Prelegal  Education  and  Admissions  to 
Law  School  through  its  annual  program  and  otherwise  assists  in  these  efforts. 

The  LSAC  has  recently  started  meeting  annually  with  the  deans  of  t^eir  member 
schools  for  the  purpose  of  reporting  to  the  deans  on  LSACs  programs  asking  them 
for  suggestions  of  ways  in  which,  the  program  of  testing  and  admissions  servici^ 
.may  be  further  improved.  \ 
'  For  a  number  pf  years  the  LSAC  has  held  periodic  conferences  with  prelaw 
advisors  for  the  purpose,  of  hearing  from  them  wave  in  which  the  program  may 
better  serve  their  interests  and  those  of  their  students.  In  addition,  the  dpcerS, 
committee  chairpersons,  and  professiohl^  staff  have  attended  r^onal  meemngs  of 
the  prelaw  advisors  for  the  pur]^K)se  or  reporting  on  their  work  an^  hearing  their 
comments. 

With  respect  to  the  test  talkers,  th4  LSAC  has  over  the  yearp  conducted  periodic 
»  'surveys  for  the  purpose  of  receiving  their  commentS'-Tm^hovJ^.thd  test,,a|fid  tiBst 
y    services  inay  be  i^iproved.X)neWai  just  completed.    '  * 

Abolition  of  standardized  admissions  tests.— M  1  have  read  over  the  past  year  the 
statements  in  support  pC  legislation  like,  that  before  the.  Committee,  I  nave  come  to 
.  belteve  tiie 'purpofle  of  some  of  ttie  supporters  of  test  disclosure  legislation  4s  the 
elimination  of  the  use  of  standardized  admissions  tests.  The  etppareht  strategy  is  to 
requite  publication  of*  each  form  of  the  test  shortly  after  its^use.  It  is  assumed  that 
the  bstmg  agencies  will  be  unable  to  continue  to  prPduce  sufficient  number  of  new 
formtf  of  the  quality  equal  at  least  to  the  present  tests.  This  would  then  bring  these 
'programs  to  an  end.  Failing  t(/secure  abolitibh  by  these  means,  the  apparent  hope 
of  some  is  that  the  quality  of  the  tests  may  be  so  reduced  as  the  product  pf  a  greatly 
increased  production  required  by  disclosure  that  the  test  ecores  will  have  sknifi- 
cantly  less  value  and  so  will  make  less  contribution  to  the  prediction  of  profiable 
academic  peifftrmance  of  applicants. 
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bur  Association  ennft)hatically  opposes  this  objective.  Justice  Oliver  Wendell 
Holmes  observed  that  often  a  page  of  history  is  worth  more  than  a  volume  of  logic. 
The  history  of  the  Law  School  Admission  Test  is  this.  In  1947  Professor  Willis  L.  M. 
Reese  of  Columbia  University  School  of  Law  and  representatives  of  another  half 
dozen  law  schools  went  to  the  newly  established  ETS  lo  ask  President  Henry 
Chancey  whether  it  would  be  willing  to-try  to  establish  a  test  that  these  law  schools 
might  use  to  assist  tlie  schools  in  making  better  prediction?  of  academic  success. 
These  legal  educators  wished  to  treat  more  equally  applicants  with  college  records 
from  a  variety  of  schools  and  to  reduce  significantly  the  first  year  attrition  rat§s  by 
doing  a^better  job  of  selecting  those  with  more  substantial  probabilities  for  success. 
The  LSAT  was  not  something  that  Educational  Testing  Service  devised  and  then 
marketed  to  the  law  schools.  The  idea  was  ours  and  we  enlisted  the  assistance  of  the 
testing  agency.  '  1  u 

Our  member  schools  and  the  other  nationally  approved  law  schools  have  three 
decades  of  experience  with  the  LSAT.  Vhat  experie^ice  hajd  demonstrated  the  valid- 
ity and  reliability  of  the  test  and  the  substantial  contribution  it  Can  make  to  law 
school  admissions.  Our  Association  has  been  so  persuaded  of  the  importance  of  an 
admissions  t^t  score  to  sound  admissions  that  the  bylaws  of  the  Association  pror 
vide:  "A  member  school  should  determine  whether  an  applicant  iS  adequately 
equipped  for  the  study  of  law  on  the  basis  of  an  undergraduate  record,  an  admission 
test  score,  training,  experience  and  other  indicia  of  aptitude  for  the  study  of  laW." 
Standard  503  of  the  Standards  for  Approval  of  Law  Schools  by  the  American  JBar 
Association  similarly  urges  the  use  of  an  admissions  t^t  and  requires  a  school  That 
is  not  using  the  ISfgT  to  "establish  that  it  is  using  an  acceptable  test."  Th^  process 
of  our  Association  adopting  bylavvs  and  the  process  of  the  American  Bar 'Association 
adopting  its  standards  is  oneithat  ensures  deliberation  and  full  input  of  interested 
and  effected  parties.  In  short,  admissions  tests  are  included  in  the  accreditation 
criteria  for  sound  reasons. 

It  is  commonly  said  that  admissions  tests  are  culturally  biased.  In  a  strictly  * 
technical  sense,  this  is  true  and  it  is.  necessarily  true.  Linguists  wilKtell  you  that  all 
languages  reflect  the  culture  of  those  who  use  them.  The  question*  then  is  npt 
whether  the  LSAT  is,  strictly  speaking,  culturally  biased,  but  whether  it  is  fair  to 
applicants  from  racial  and  ethnic  minority  backgrounds.  The  purpose  of  the  test  is 
to  predict  academic  performance.  If  the  LSAT  underpredicts  the  potential  for  black 
applicants  generally,  for  example,  then  the  test  should  not  be  used  in  judging  the 
Ijaw  school  potential  of  these  applicants. 

Beginning  in  1963  LSAC  has  conducted  studies  of  the  LSAT  to  determine  whether  • 
the  predfction  formula  developed  upon  the  basis  of  the  validity  studies  works  as  well 
for  black  and  other  minority  applicants  as  it  does  for^hlte  applicants  or  applicants 
generally.  The  findings  of  these  studies,  from  the  first  one  published  in  1966  to  the  ■ 
most  recent  one  published  in  1978,  demonstrate  that  black  and  Mexican  American 
applicants  predict  in  the  same  way  as  other  applicants.  In  short,  a  Mhool  does  not 
discriminate  against  these  minority  applicants  when  it  uses  its' conventional  predic- 
tion formula  tb  establish  a  minority  applicant's  potential  for  law  study. 

This  has  not  precluded  law  schools  from  practicing  afTirmative  action  in  admis- 
sions. A  study  of  the  fall  1976  entering  class  suggests  that  had  the  law  schools  not 
taken  mto  account  race  or  ethnib  background  in  making  admissions  decisions,  the 
numben  of  bjlcks  receiving  offers  of  admissions  wj)uld  have  been  about  60  percent 
less  thap  they  were  and  Mexican  Americans  or  Chicanos  about  40  percent  less  than 
they  w*e.  Applications  and  Admission  to  ABA  Accredited  Law  Scljools:  Ah  Analy-  • 
sis  of  National  Data  for  the  Class  Entering  in  the  Fall  1976  ("Law  School  Admission 
Research,^' May  1977).  ^    i 

In  summary,  our  member  schools  find  the  LSAT  score  an  important^aint-relldbte^i,^ 
datum  concerning  the  potential  of  their  applicants  for  law  study.  We  would  object  T 
very  much  to  any  efforta  to  deprive  them  of  this.  .  f 

L^  me  turn  now  to  specific  provisions  of  H.B.  3564  and  H.R.  4949. 

Te^t  disclosure  requirement.--Th&  requirement  in  the  bills  before  you  that  pre- 
sents the  most  difficulties  from  the  perspective  of  our  member  schools  in  Section  5 
of  H.R.  4949,  which  requires  the  public  filing,  among  other  things,  of  each  test  and 
the  acceptable  answers  for  each  question  and  requires  the  test  Agency  to  send  to 
each  person  who  took  the  test  the  same  information  plus  the  **test  subjecjts  individ-  ^ 
ual  answer  sheet.''  Fortunately  for  the  future  of  admissions- tests  only  Chose  ques- 
tions used  to  calculate  the  teftt  subjects  raw  score  need  be  disclosed.  As  you  may 
know,  each  form  of  the  LSAT  contains  some  question^hos6  answers  do  not  go  into 
calculating  th^  candidate  s  score;  these  are  questions  heipg  protesjpd.  Test  questions 
are  developed  by  educated,  trained  and?  experienced  item  writers  according  to  estab- 
\  ^     •  ■ 

,   :      ■ ■  ■  .  .  ^        '  .     -      .  .  ' 


liflhed  guidelines  and  are  suhittH;  to  careful  review.  However,  they  are  not  used  until 
they  havllbeen  proven  eifTecn^  ^  ^ 

Ithe  oisclofiure  requirement  on  its  face  seems  eminently  fair  and  reasonable^  Let ' 
me  provide  you  with  some  background  to  permit  you  to  piake  an  informed  judgment  * 
about  this.  The  present  practice  of  LSAC  is  to  retire  any  form  of  the  test  that  is  | 
con)|promi|^  or  very  probably  compromised.  Thus,  if  .  there  is' an  established  unau-  ^ 
thorized  removal  of  a  test  and  if  there  is  a  possibility  that  some  distribution  has 
been  mad^  of  ihe  test,  the  form  is  retired,  "l^us  is^one  so  that  each,  person  who 
takes  the  LSAT  is  on  as  equal  a  footing  as  poi9sible.  If  there     a  probability  that 
some  test  takers  have  seen  the  form  of  the  t^t,  those  test  takers  nave  an  advan- 
tage. Therefore,  the  policy  is  to  retire  a  compromised  fomi  of  the  LSAT.  As  a  matter 
of  practice,  a  test  fprm  is  retired  after  its  use  in  three  regular  Saturday  administra- 
tions, three  Monday  administrations  and  some  special  administrations.  The  cost  of 
^  producing  a^form  of  the  LSAT /may  thus  be  amortized  over  six  scheduled  adminis- 
f  trations  pms  a  naoderate  number  of  special  administrations.  The  proposed  disclosure 
requirement  would  require  the.  retirement  of  the  test  after  "bne  administration.  It  u 
not  clear  just  wh^t  should  be^done  about  sjpecial  administrajbions,  but  more  aboin 
that  later.  This  means  that  the  cost  of  the  production  q^  a  test  form  would  need 
be  charged  entirely  against  a  single  administration,  (^viously,  this  substantimly 
increases  the  cost  for  that  administration;  X 

It  is  my  understanding  that  the  cost  of  p^ucing  a  single  form  of  th^^^AT  is 
now  between  $80,000  and  $120,000.  Presently  the  cost  of  retiring  about ^hree  forms 
a  year  are  charged  agqpst  the*  approximately  128,000  administrations  of  the  test.  | 

Increased  cost  is  only  one  of  the  difficulties  presented  by.  disclosjure  requirement. 
The  most  troubling  is  wlfether  there  is  an  indefinite  number  of  ^questions  that^  may 
%e  written  so  that  the  testing  agency  has  the  capaicity  to  continue  to  produce  more 
test  questions.  For  those  admission^  tests  that  are  anchored  in  a  base  of  informatibh  . 
there  is  a  limited  capacity  to  produce  additional  qu^iOns.  With  respect  tc  that 
form  of  admissions  tests,  the  disclosure  requirement,  is  a  death  sentence.  I  under- 
stand this  to  be  the  case  with  respect  to  the  New  ^f^ical  College  Aptitude  Test  and 
with,  resp^  to  the  Spatial  Perception  Test  of^he  American  Dental  Association.  It 
.  may  not  be  the  case  with  respect  to  the  LSA^.  While  it  is  anchored  in  information 
of  a  kin4f  the  information  is  of  a  general  sort  and  the  principal  purpose  of  the  test 
is  to  test  for  certain  skills  and  capaciti^.  There  may  be  practical  limits,  but*  the 
limits  are  not  so  severe. 

In  the  short  run  there  is  the  limitation  of  the  numb^  of  educated,  trained  and 
experienced  peirsonnel  to  write  the  test  items.  In  the  sHort  run,  too,  there  is  the 
time  needed  to  draft  and  re^ew  test  items,  subject  them  to  pretesting,  review  the 
-^ults  of  the  p'retesting^  to  determine  the  reliability  and  validity  of  the  test  items,  to 
etermlhe  which  may  be  used  and  to  determine  their  different  levels  of  difUculty.  In 
the  long  nin,  be  possible  io  produce  a  sufficient  quantity  of  tests  questions  of 

current  qualiw^  permit  disclosure  and  retirenient  after  a  single  use  of  the  test 
items.  That  tips  is  so  is  still  not  cle^r. 

If  it  were  ID  be  done,  a  number  of  adjustments  woup  need  ,  to  be  made..  To  hold 
the  inereasea  cost  to  the  testing  program  and  thus  to  the  test  taker  within  some  i 
reaM&iable  limits,  it  .vrill  be  necessary  to  reduce  the  numbe^  of  administrations  of  J 
the  test.  In  examining  costs  it  must  be  remembered  that  the  only  source  of  income^ 
to  support  the  LSACs  program  is  the  fees  paid  by  persons  taking  the  LSAT  and' 
registering  for  the  LSDAS.  Any  additional  costs  are  costs  that  the  Council  can 
on  to  no  one  other  than  those,  considering  making  application  to  law  schooL  ^ 

A  difficult;^  that  compliance  with  the  disclosure  requirement  will  present  our 
mei]({ber  schools  and  thebr  potential  applicants  fli^s  fipom  the  reduced  frequency  of 
admmiBtrationtof  the  LSAT.  To  hold  down  the  annum^  cost  of  t^t  constructioh  and 
to  ixiB^ite  production  of  quality  tests,  the  testing  agencies  wilUneed  to  reduce'the 
number  of  tests  that  must  be  retired.  This  can  be  done  by  Using  a  single  fbrm 
instead  of  one  to  three  fcips  in  a  giveli  administration  iemd  by  reducbig  the  number 
of  administrations  each  year.  .  j 

The  prime  candidates  for  eliminatio|i  are  the  low  volume  test  adminiArations.  - 
^The  test  is  administered  on  five  Mondays  a  ^ear  to  accommodate  those  whose 
religiipn  recognizes  Saturday  a#  their  Sabbath.  Should  the  Monday  administrations 
be  eliimihated  or  at  least  reduced  substantialM  Why  is  this  necessary,  you  may  ask. 
After  I  all,  HJS.  4949  does  not  reouire  publication  of.  the  test  given  on  Saturday  until 
30  days  after  the  scores  have  been  ret%ted.  Therefore,  the  Saturday  test  is  not 
m^de  public  ubtil  six  to  eight  weeks*'after  the  Monday  administration.  The  concern 
about  using  the  same  form  on  Monday  as  on  Satu^flay  is  that  a  few  persons  might 
take  the  t(»t  on  Saturday  under  an  assumed  nam(Pana  <ii  Monday  under  their  own 
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pame,  *In  this  way  they  would  have  an  opportunity  to  practice  taking  the  test  on  the 
very  test  form  that  they  are  going'to  take  "for  real.'* 

Onie  response  could  be  to  use  to,  a  new  form  but  offer  tl|e  test  on  Monday  only 
onep  a  year.  Another  response  would  be  to  offer^as  many  Monday  admin  istration8>.ns 
Saturday  administrations  and  ask  the  schools  to  as8um#that  the  special  religious 
commitment  of  these  test  takers  will  give  them  assurance  that  there  is  no  or 
virtually  no  test  misconduct.  That  some  schools  would  value  the  Monday  LSAT 
scored  less  in  these  cases  is,  however,  a  possibility.  In  either  response,  the  service  to 
law  school  applicants  and  our  rtiember  schools  would  be  reduced  as  a  consequence. 

I  suggest  that  the  Committee  consider  exenpypting  the  Monday  and  other  special 
administrations  from  the  requirement  to  disclose  the  test  questions. 

Presently  the  LSAT  may  be  administered  in  this  country  and  around  the  world  at 
virtually  any  date  in  addition  to  thetten  scheduled  Saturday  and  Monday  adminis- 
trations per  year.  Armed  forces  personnel  stationed  around  the  globe  may  arrange 
to  have' the  test  administered  to  them  where)jpr  they  are  and  at  any  time.  The 
Peace  Corps  worker  .who  returned  from  Africa  just  after  the  February  administra- 
tion and  needs  to  have  a  test  score  eautier  than^at  which  would  be  produced  by  an 
April  test  to  have  an  opportunity  to  enter  laiW  school  in  the  fall  can  arrange,  by 
paying  a  special  fee,  to  have  a  special  administration.  Some  handicapped  persons 
want  special  administrations.  It  is  not  readily  apparent  to  me  or  to  the  leadership  of 
the  LSAC  Council  how  thijB  valuable  program  of  special  administrations  can  be 
continued.  The  suggestion  that  the  form  of  the  test  used  at  the  most  recent  general 
administration  and  that  has  not  yet  been  published.be  used  in  these  special  admin- 
istrations encountel^  virtually  the  Same  problems  as  those  suggested  for  the  Mon- 
day administrations  of  the  test  form  used  on  Saturday.  Unless  H.R.  4949  is  amended 
to  exclude  the  special  administratidns  from  the  disclosure  requirements  as  now 
stated,  it  appears  that  there  is  no  practical  way  to  continue  the  program  of  special 
administration.  That  would  be  a  shame. 

What  are  the  implications  for  applicants  to  law  school  and  law  schools  in  the 
understandable  response  to  the  testing  agencies  and  t^t  sponsors  to  thcf  discto- 
8ure--increased  cost  and  decreased  frequency  of  test  administration?  Increased  cdst 
would,  of  course,  have  its  greatest  impact  on  the  economically  disiadvantaged.  The 
minority  applicants  are  disproportionately  represented  in  the  economically  disad- 
vantaged. It  would  be  a  national  tragedy  if  these  increased  costs  caused  a  significant 
.  number  of  economically  disadvantaged  and  minority  persons  to  fail  to  take  (the 
LSAT  and  thus  fail  to  complete  their  applications  for  admissions  to  law  school.  fThe 
LSAC  has  a  modest  program  of  waiving  fees  for  the  severely  economically  disadvan- 
taged. The  cost  of  that  program  is,  of  course,  bbrne  by  those  who  pay  the  fees.jThe 
increased  costs  cattsed  by  the  disclosure  requirements  will  significantly' increas^  t)ie 
-  cost  of  the  test  fee  waiver  program  at  its  present  level  and  so  would  mak^  it 
difficult  to  increase  signific^tly  the  level  of  that  pro-am.  /' 

The  decreased  frequency  of  administration  of  the  test  caused  by  the  disclosure 
requirement  causes  us  even  greater  concern.  We  understand  that  some  of  the 
support  for  the  bill  before  you  and  similar  bills  introduced  in  state  legislatures  came 
from  legislators  and  citizens  with  a  special  interest  in  the  minority  applicant  for 
law  and  other  professional  schools.  Our  Association  shares  that  interest.  Our  Associ- 
ation was  a  founding  member  of  the  Couhcil  on  Legal  Education  Opportunity,  which 
has  for  the  past  decade  played  an  important  role  in  increasing  the  enrollment  of 
♦  minority  and  dkadvantaged  persons  in  thevnation*s  law  schools.  It  iS  a  federally 
funded  program.  We  filed  an  amicus  curae  brief  in  the  Bakke  case  in  support  of  the 
general  p<«ition  of  the  University  of  California,  both  with  the  Supreme  Court  of 
California  |nd  the  Supreme  Court  of  the  United  States. 

Out  judgment  is  that  the  disclosure  requirement  .in  its  present  form  would  in  fact 
harm  and  not  help  the  minority  applicants  for  law  schcol.  I  have  mentioned  the 
probable  impgct  of  the  increased  costs  of  the  test.  The  leM  frequent  Availability  of 
the  test  is  liTcely  to  affect  those  persons  who  are  newest  to  access  in  nigher  educa- 
tion and  whofilfe  undergraduate  colleges  provide  less  structure  and  less  reinforcement 
foWdvanced  planning  for  the  complex  law  scl>ool  admission  process.  The  lead  time 
for  making  application  for  law  schools  iS  the  longest  that  it  has  been.  To  have  the 
full  opportunity  to  be  considered,  an  applicant  should  have  completed  his  or  her 
application,  including  the  taking  of  *the  LSAT,  by  March  or  April  1.  I  am  told  by 
deans  of  ^admissions  that  minority  applicants  as  a  group  tend  to  make  their  deci- 
sions to  take  the  test  and  apply  later  in  the  admissions  cycle  than  applicants 
generally.  The  reduction  in  the  number  of  test  administrations  would  seem  to 
disproportionately  disadvantage  the  minority  applicant.. 

Release  of  test  subjecVs  individual  answer  sheei-^rUJi.  4949  Seotioh  •5(aX2XB)t^ 
requires  the  testing  fifgency,  at  the  test  subject's  request,  to  send  to  the  test  subject 


the  ^'test.subject'B  individual  angwer  shciet/^ among  other  things.  I  would  strongly 
urg6  thelMmikttee  to  amend  that  to  read  "a  copy  of  the  test  subiect  s  individual 
answer  sheet/\  This  would  make  it  clear  that  the '  test  agency  should  keep  the 
origintf .  lip  it  must  surrender  the  original,  then  we  would  be  concerned  about  the 
resblution  of  disputes  about  scoring.  If  the  test  agency  had  a  copy  and  that  copy 
showed  that  the\test  subject  had  answered  certain  que^ions^difri^rently  from  that 
indicated  on  the 'original,  which  the  test  subject  offers  it|  ^violence  to  the  court,  the 
beet  evidence  ml^  might  require  the  court  to  admit  the  original  in  its  present  form 
as  evidence  andHplreuise  to  admit  the  copy  retcdned  by  the  test  agency.  A  moment's 
gr^flection  suggesurto  you  and  to  me  a  potentiality  for  successful  alteration  that  this 
rule  offers. Tcannot  believe  that  the  drafters  of  the  bill  intended  this  result.  It  is 
very  probably  an  oversight. 

I^ere  are  a  number  of  technical  problems  presented  for  the  testing  program  and 
oui^schools  by  the  specific  provisions  of  the  bills  before  you.  It  may  well  be  that 
these  are  largely  the  product  of  the  drafters  not  understanding  fUUy  the  practical 
consequences  of'^th^  biU'S  ' formulation  of  the  rule.  Let  me  provide  you  with  k)me 
examples  of  the  k^ds  of  provisions  to  which  I  have  reference.  It  would  trespass  too 
much  on  the  committee's  time  to  go  through  them  section  by  section.  I  am  certainly 
willing  to  make  n^self  available  to  the  committee's  staff  to'go  over  these  matters  in 
detail,  t  suggest  to  the  committee  that  it  may  wish  to  direct  ite  staff  to  confer  also 
with  representatives  of  figencies  like  the  Law  School  Admission  Council  and  testing 
agehcies  like  the  American  Collie  Testing  Program  and  Educational  Testing  Serv- 
ice for  the  same  purpose. 

Scort  generally  rw^ir^  for  admis8ion,-T-Section  6(bX3)  of  H.R.  S&W  require  the 
t^ing  agency  at  the  request  of  test  subject,  to  notify  her  or  him  of  the  "score  which 
is  generally  required  for  admission  to  institutions  of  higher  education."  With  re- 
sp^  to  the  LSAT  in  law  school  adi^issions,  there  is  literall]^  no  sUch  score.  First  of 
sll,  theicompetition  for  seats  in  our  136  member  schools  varies.  Secondly,  the  LSAT 
score  and  tne  cumulative  grade  point  average  aire  the  two  quantitative  factors 
usually  used  to  preBict  law  school  perform^ee  or  to  develop  an  admission  index. 
The  LSAT  score  needed  to  receive  favorable  consideration  at  a  given  school  obvious- 
ly varies  with  the  applicant's  gra^e  point  average. 

the  interest  this  provision  apparently;  addresses  is  now  dealt  with  in  the  law 
school  admission  program  by  the  publication  in  the  Prelaw  Handbook  of  a  profile 'tif 
the  most  recei^tly  admitted  entering  clat».  This  ,  may  more  directly  address  the 
interest  of  the  t^t  taker.  She  or  he  tends  not  to  be  interested  in  institutions  of 
highet*  education  generally  but  in  specific  institutions.  Is  it  not  more  appropriate 
that  the  applicant  obtain  that  information  directly  fh>m  the  institutions  in  ques- 
tion? It  may  be  inappropriate  to  place  on  the  testing  a|[encies  and  test  sponsors  the 
responsibility  of  getting  that  information  from  the  institutions.^Qur  Association  and 
the  LSAC  respect  the  autonomy  of  the  member  law  schools  and  want  to  ei^erci^ 
/Over  them  only.liiat  authority  that  is  absolutely  necessary,  not  sunply  potentialpr 
desirable.  f 

Subeequent  test  scores.— Section  6  of  H.R.  4949  provides,  among  other  things,  tlmt 
the  test  agepcy  wij;h  permission  of  the  test  subject  release  only  '^all  previous  scora^' 
to  designated  law  school.  Besearch  has  informed  our  membi^r  schools  thi^t  the  bdst 
way  to  .treat  an  applicant  who  has  taken  the  LSAT  several  times  is  to  avacoge^fdl 
scores,  unless  there  are  specitd  circumstances,  such  as  illness,  that  dicitate  that  a 
test  score  should  be  ignored.  Section  6  would  preclude  the  testing  agency  from 
sending  our  m|mber  schools  the  second  and  subsequent  scores  unless  expressly 
authorized  by  tM'test  ^bject.  Why  should  the  government  deprive  oursbhools  of 
this  valuable  ih^rmation?  Again,  this  may  be  simply  a  drafting  error.  Tfiei  testing 
agencies  certainly  should  be  authorize4  to  submit  to  the  schools  that  the  ^test  subject 
has  asked  scores  to  be  sei^t  to  all  iscores  a  person  earns. 

Disclosures  to  potential  test  reffstrants.-^Some  of  the  information  that  Section  3 
^  requires  a  test  agency  to  disclose  is  different  for  each  of  our  member  schools*  The 
jip^rent  assumption  of  the  drafters  is  that  it  is  the  same.  For  exami>le.  Subsection 
p  asks  that  "the  correlation  between  test  scores  and  future  puccess  in  schools"  b6 
provided.  The  correlation  varuk.  Does  H.R.  4949  contemplate  publishing  this  for  all 
our  186  inember  schools  plusfthe  32  additiobal  ABA  approved  schools?  Also,  is  any 
recognition  to  1)0  given  to  institutional  privajcy? 

,  Section  3  also  requires  the  test  agepc^  to  explain  "the  conre|ation  between  test 
scores  and  success  in  the  career  for  which  admission  is  sought:"  The  LSAT  is  not 
designed  to  predict  success  iif  the  lc«al  profession,  but  rather  the  probability  of 
suocesa  as  a  law  Bti^ent..The  LSAC  literatura|  contains  cautioiiary  stetements  to 
law  Btm  and  oth^  employers  of  law  gradualls  that  LSAT  scores  should  liot  be 
used  for  this  purpose.  Law  school  grades  are  a  much  more  x^appropriate  criteria. 
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There  is  «f  larger  problem.  What  for  these  purposes  is  "success?"  Is  it  measured  by 
income?  By  merely  gaining  admission  to  the  bar?  I  c^m  confident  that  the  drafters 
had  little  understanding  of  what  they  were  asking  foV  byHhis  innocent  looking  ten 
wolrd  clause.  The  cost*  of  the  research  to  provide  a  preliminary  answer  to  this 

Siestion  is  conservatively  estimated  at  between  $1  million  and  $2  million.  Should 
e  LSAT  test  takers  be  required  to  pay  for  this?  Will  they  find  the  results  worth 
the  cost? 

Subsection  3  would  require  the  Law  School  Admission  Bulletin  to  contain  "a 
comparison  of  the  average  score  and  percentiles  of  test  subjects  by  mcgdr  income 
groups."  The  LSAC  program  does  not  now  gather  information  concerning  the  in- 
come of  the  test  subject  of  her  or  his  family.  Does  this  prowsion  require  the  LSAC 
to  require  each  test  taker  to  provide  this  information  so  that  the  ttudies  called  for 
may  be  made  and  this  information  reported?  Are  there  not  questions  of  privacy?^ 
again,  is  the  cost  of  this  effort  worth  the  candle?  .     ^  . 

Regulation  of  the  use  of  standardized  admission  test  scores, — Some  of  the"  public 
statements  made  in  support  of  the  testing  regulation  legislation  like  that  before^this 
committer  has  stated  as  one  of  the  principal  purposes  of  the  legislation  to  be  to  ciire 
misuses  of  standardized  isidmission  test  scores.  H.R.  4949  as  introduced  contained  a 
version  of  Section  8  that  required  an  explanation  of  the  lise  of  test  scores  as 
criterion  for  selection  of  students  by  the  undergraduate,  graduate  and  professsional 
prcyrams  of  colleges  and  universities.  If  I  am  correctly  inform^,  this  provision  has 
now  been  withdrawn.  If  it  has  not,  then  it  would  seem  to  regulate  through  the 
means  of  publicity  the  use  of  test  scores.  The  concern  that  I  have  witK  the  provision 
is  that  this  publication  re<juiremQnt  is  likely  to  introduce  greater  rigidity  in  admis- 
sipns.  Litigktion  over  admissions  would  test  admissions  actions  against  the  institu- 
tion's stated  formula.  Aware  of  this,  the  adihissions  committee  is  more  likely  to 
follow  literally  the  steted  formula.  While  this  gives  an  appearane  of  greater  fair- 
ness, it  also  reduces  the  role  of  informed  judgment  in  making  admissions  decisions. 

If  I.  am  correctly  informed,  then  the  only  way  in  which  either  of  these  bills 
regulates  the  use  of  the  scores  by  our  law  schools  is  through  the  hope  that  some 
may  have  for  the  disclosure  provisions  of  H.R.  4949.  As  I  indicated  earlier,  it  is  quite 
clear  that  the  hope  of  some  supporters  of  the  required  publication  of  each  test  after 
it  has  been  given  is  that  standardized  tests  will  be  driven  out  pf  business.  We  are,  as 
I  said  earlier,  emphatically  opposed  to  that.  1 

Financial  disclosure,^lSkC  in  its  annual  report,  which  is  distributed  to  our 
member  schools  and  other  law  schools  and  which  is  available  in  law  school  libraries 
air  around  the' country,  provides  all  of  the  infoopation  requestea.  The  committee 
may  wish  to  ask  its  staff  to  consult  with  representatives  of  LSaG  and  other  test 
agehcies  to  detenhine!  whether  specifying  that  this  report  and  test  volume  report 
must  be  made  within  "120  days  after  the  close  of  the  testing  year"  presents  prob- 
lemd  and  whether  the  fiscal  year  instead  of  the  testing  year  sMuld  be  specified  in 
setting  the  reporting  date.  Clearly  the  revenue  and  volume  figures  should  be  in 
term$  of  the  toting  year.  / 

The  prices  for  all  of  the  testing  and  admissions  services  by  IpACi  are  set  at  levels 
to  generate  sufficient  income  to  pay  the  costs  of  the  progrefm.  By  ^estimating  the 
probaple  volume  for  the  test  ye;&r  and  the  costs  of  providing  the  service  under  its 
contract  with  the  Educational  Testing  Service,  the  Board  of  Trustees  of  LSAC  sets 
the  vaHous  fees  for  its  services.  To  demonstrate  that  this  is  not  an  exact  science,  I 
should  report  to  you  that  expj^nditures  exceeded  income  in  fiscal  1979  by  over 
$600,00lp.  Unexpected  decreases  in  volume  caused  the  deficit. 

In  cojiclusioh,  let  me  express  may  apprecfafion  to  the  Committee  for  giving  me. 
this  opiJNOrtunity  to  present  the  views  of  our  Association.  As  I  have  indicated,  we 
share  mbst  of  the  policy  objectives  of  these  two  l^lls.  Our  concerns  are  with  the 
means  cl^oeeh  to  serve  the  ends.  ,  I 

Thank  you.  | 

Mr.  HupD.  One  other  step  that  we  tftke  for  this  purpose  is  the 
publication,  and  in  this  case, /Ve"  is  correct. 

Our  association  and  the  Law  School  Admission  Council  jointly 
publish  jthe  Prelaw  Handbook  th^t  has  information  on  all  168  ABA 
approved  schools  with  admissions  profiles,  so  that  persons  consid^- 
ing  application  tx^  a  given  school  can  get  sofile  notion  of  what  the 
probabilities  are  of  gaming  aidmission.  -  ^  |  / 

*  ^  secoi^id  gurpose  that  I  seie  in  section  5  of  H.R.  4949  arid  sections 
3  and  6  <tf  Ii.R.  3564  is  a  concern  about  the  quality  of  standardized 
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admii^ion  tests,  and  ailt  interest  in  improving  further  the  quAy  of 
the  tests.      ^  \'  ' 

Our  dissoqiation  certs  inly  shares  that  interest.  We  know  of  three 
decades  of  commissioi:  research  by  th6  Law  SchooU  Admission 
Council  that  has  sought  that  very  end.  ^   ,  i    ^  ^ 

(  Here  are  thjree  volunres  summarizing \that  research.  It  has  been 
charged  by  s6me  thatjkdmissions  testing  is  shrouded  in  secrecy. 
With  respect/to  the  LSAT  at  least  the  test  is  shrouded  in  secrecy 
/  only  from  tlu)jb  who  are  apparently  unaware  of  this  information  or^ 
^   '      "  '  ^/understaAd it. 

;ht  is  jpubiie  .accountability -oflKe  adriiissipns 
jhare  tnat. 

[mission  Council,  I  know,  has  been  very  con- 
.  history  of  the  stewardship  responsibility  it 
resources  which,  as  someone  indicated  earlier, 
the  students  who  pay  the  fees  and  the  leader* 

^^..^^^  ^  ^iousofthat.  .     .  -  \ 

Among  the  wavs  that  they  try  to  serve  the  public  accountability 
puipose  is  the  publication  of  an^  annual  report,  and  those  are 
law  school  library  in  thet.  country,  ana  they  have 
of  the  governing  board  of  all  its  standing  and 
are  there. 

^ret  there.  It  may  be  found  and  used, 
heard  about  the  tests,  some  of  the  tests,  from 
Law  School  Admission  Council  takes  a  nun^ber  of 
e^lplain  to  admissions  committees  and  other  admis- 


available  in  an; 
complete  minu 
Special  commi^ 
There  is  no 
Like  what 
witsesses, 

ste^  to  try  ^  ^  ^  ^  ^ 

.sions  personnel  the  test,  its  limitations,  its  strengths,  how  best  to 
uise  it  by  conferences  of  a  variety  of  a  kind,  its  annual  meeting,  its 
annual  workshop  for  a  smaller  group,  regional  meetings. 

Ou^/^issocM  has,  a  section  on  prelegal  education  and  admis- 
sions to  law  siphool,  and  through  its  annual  program  and  otherwise 
seeldT  t0  sej^e  tlmt  purpose  over  the  past  vear. 

I  have  read  the^tatements  by  some  whc 
like}  thlat  before  you,  and  I  have  come  to  — 
confidibt-  [lone  of  the  authors  of  tile  legislation  have  this  purpose, 
but  I  hav«  COTne  to  believe  that  thp.  purpose  of  some  of  the  support- 
jprs  ^f  the  test  disclofiure  legislm&n  is  elimination  of  the  use  of 


w  vear. 

who  suppose  the  legislation 
to  believe" that  some,-!  am 


standardly  admissioiy  tests. 
•  As  I  un  i  erstand  the  si 


 strategy,  or  as  it  appears  to  me  to  be,  is  tO 

require  ptiblicdtion  of  each  form  oif  the  test  shortly  aifter  it  is  used, 
and  assimpng  that  the  testing  agencies  will  be  unable  to  continue 
to  produc^  enough  ttew  form^  and  tests  of  equal  quality  to  at  least 
the  p]0^nti)  ones,  this  would  bring  the  program  to  an  end. 
•  if^iat  doiasn't  work,  then  apparently  the  hope  is  that  the  quality 
of  what  caii  be  produced  may  be  so  reduci^  as  thi^  product  of  the 
greatly  inatefiw^  production  by  disclosure  of  the  test 

scordb  will  ttiavflb  significantly  less  value,  and  so  will  make  lefts 
contributioii  to  the  prediction  qf  probable  academic  performance. 

T(J  the  ttttent  that  that  is  anybody's  purpose,  our  association 
emphatically  opposes  f;hat  object. 
Mr.  Wbiss.\  would  y<)u  hold  vour  thought  right  there? 
The  second  bells  have*  sounded^.  ^ 
M^^tiow  have  about  9  minutes  to  get  our  vote  in. 
We  will  retorn  in  about  10  or  12  minutes. 


er|c 


Thank  you. 

Chaii^an  PERicms.  The  gentleman  from  the  law  schools,  Mr. 
Ruud;£ou  may  continue.  . 

Mr.illuuD.  When  the  committee  recessed  I  was  making  thejx^int^ 
to  which  some  support  for  the  legislation  before  the  committee  h&s 
been  aimed,  at  the  abolition  of  stanifardized  tests.  Our  'association 
Opposed  that  objective,  justice  Holmes  once  said:  "A  page  of  histo- 
ly  is  worth  a  volume  of  logic.^'  If  this  case,  it  is  good  to  recall  that 
the  law  sfehool  admission  test  was  not  som^hing  devised  hy  a  few. 
A  group  of  people  from  our  member  schools  went  to  the  fledgling 
Educational  Testing  Service  in  1947  and  said,  can  you  help  us,  can 
you  devise  a  test  j^hat^  will  be  helpful  to  us  in  making  better 
admissions  decisions  t^an  we  are  now  making  and  opening  up  the 
posdibilitv  of  considei^i^^applications  from  undergraduate  institu- 
tions with  which  we  have  had  no  experience? 

Our  association  considers  the  LSAT  or  some  standardised  admis- 
sion test  vital  and  very  |Valuable  to  the  admissions  process,  as 
manifested  l^v  one  of  our  ^  rv\es  of  membership  or  accreditation 
criteria^  .which  provides:  .  ' 

,  A  Member  school  should  determine  whether  an  applicant  is  adeouately  equipped 
for  the  study  of  law  on  the  basis  of  an  undergraduate  record,  an  admission  test 
score,  training,  experience,  tmd  other  mdicia  of  aptitude  foi*  the  study  qf  law. 

It  is  commonly  said  that  admissions  tests  are  culturally  biased. 
In  a  strictly  technical  sense,  this  is  true  and  it  is  necessarily  true. 
Linguists  vkll  teML  you  ^hat  all  languages  reflect  tlje  culture  of 
those  who.  us?  theraT  The  Question  then  is  not  whether  the  LSAT  is, 
strictljnitepeaking,  cuhurally  biased,  but  whether  it  is  fair  to  appli- 
catits  from  racial  and  igthnic  minority  backgrounds.  The  purpose  of 
the  tei3t  is  to  predict  ackdemic  performance.  If  the  LSAT  uhderpre- 
dicts  the  potential  for  blAck  applicants  generally,  for  example,  then 
the- test  should  not  be  used  in  judging;  the  law  school  potential  of 
these  applicants.  - 

All  the  studies— and  these  are  rjeported  in  these  three  volumes 
that  are  before  me,  the  volumes  setting  forth  the  research  of  the 
Law  School  Admission  Council— the  findings  of  these  studies,  from 
the  first  one  published  in:  1966  to  the  most  recent  one  published  in 
1978,  demonstrate  that  black  and  Mexican  American  applicants 
predict  in  the  same  way  as  other  appUcanti^.  In  short,  a  school  does 
not  discriminate  against  these  minority  ^ppli(^tiS  when  it  uses  its 
conventional  prediction  fortnula  to  estmiate  a  minority  applicant's 
potential  for  law  study.  '^V 

In  summary^  our  member  schools  find  the  LSAT  score  an  imppr- 
tant  and  reliable  data  concerning  the  potential  of  their*  applicants 
for  law  study.  We  would  oi^ec't  very  much  to  any  legislation  that 
had  the  efiect  of  depriving  our  schools  of  this  or  reducing  substan- 
tially the  access  of  applicants  to  LSAT  services. 

Let  me  turn  now  to  some  of  the  specific  provisions  of  the  two 
bills.  The  test  disclosure  requirement  is  one  that  presents  the  most 
'  difficulties  from  the  i>er8peftive  of  our  member  schools.  The  disclo- 
sure requirement  on  its  face  seems  eminently  fair  and  reasonable. 
Let  me  provide  you  with  some  background  to  permit  you  and  the 
members  of  the  committee  to  make  a  judgment  about  this.*The 

{^resent  practice,  as  I  understand  it,  from  LSAT's,  they  retire  any 
orm  of  the  test  th&t  is  compromi^  or  very  probably  compro- 
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ttdse^.  If  ther6  is  established  or  unauth(}^ize<i  taking  or  removal  of 
a  test  or  if  there  is  a  po^iUty  distribution  has  been  made  of  the 
test,  the  form  is  retired.  I^at  is  ^one  so  that  those  who  might  have 
-   a  copy  of  the  test  do  not^ave  a  special  advantage. 

^The  test  form  as  a  natter  of  practice  is  now  retired  after  three 
r^ular  Sbljurday'  adniinistrations^  three  Monday  administrations, 
and  some  special  administrations!  The  cost     produ|hig  that  form 
is  then  amortized  over  those  six  Inatiohally  schedules  administra- 
tions, plus  thp  nioderate  number  of  special  administrations.  The 
proposed  disclosui«  requirement  in  H.R.  4949  would  require  the 
1 .  retirement  of  the  test  alter  a  singl^  administration. 
\     It  is  not  clear  just  Mrhat  should  be^^bne  about  special  administra- 
'  tions  and  how  the  testing  c«encies  can  accommodate  to  this. 

It  is  my  understanding  the  clfat  bf  producing  a  single  form  pres- 
ently of  the  LSAT  is  between  $80to00  and  $120,000.  Presently  the 
cost. of  retiring  about  three  fonnsja  year  are  chained  against  ap- 
proximately 12^,000  administratiods  of  thje  test. 

Increased  c6st  is  only  one  of  the  difficulties  presented  by  the 
disclosure  jrequirement.  The  mosi  troubling  is  the  question  of 
whether  tl^re  is  ain  indefinite  number  of  questions  that  may  be 
vmtten.  For  thote  admissions  testd  that  are  anchored  in  a  base  of 
information  there  is  a  limited  capacity  to  produce  additionsil  ques- 
tions. With  respect  to  that  form  ofl  admissions  tests,  the  disclosure 
reqiiiirement  a  death  sentenCfjil  understand  this  to  be  the  case 
with  respect  to  the  new  medical  college  aptitude  test  and  with 
respect  to  the  spatial  perception  tebt  of  the  American  Dental  Asso- 
ciation. It  may  hot  Ilk  the  case  with  respect  to  the  LSAT.  While  it 
is  anchored  in  information  of  a  kind,  the  information  is  of  a  gener^ 
'  •  al  sort  and  the  principed  purpose  jof  the  test  is  to  test  for  certain 
'  skills  and  capacities.  There  may  Ije  practical  limits,  but  the  limits 
are  notr^severe. 

-    The  principal  purpose  of  the  test  is  to  test  for  certain  skills  and 
abilities.  \  I  ,.  . 

There  are  practical  limits  in  the  short  run,  but  the  lunits  on 
production  of  test  items  seem  no^  to  be  as  severe  as  it  is  in  other 
kinds.  1 

^In  the  short  njn,  there  is  a  limitation  on  the  number  of  educated, 
trained  personnel  one  can  employ,  get  <m  the  job  to  write  the  test 

•    item.  "  ,  ,  , 

In  the  short  run,  there  is  the  problem  of  the  tmi6  needed,' the 
lead  time  heeded  to  draft  and  retnew^and  pUt  through  pretest  and 
■  ■  SQ  on'.  1     ■    .  ■  •         '  ■ 

In  the  long  ruii,  it  may  be  posaible  to  produce  a  sufficient  quanti- 
ty qtieat  qn6$tionB  to  permit  disj^lpsure  and  remren^eht  alter  jingle 
use  of  the  test.  I  '  ,    ^  , 

After  I  prepared  this  tes^imoijiy,  I  was  told  if  the  length  of  the 
LSAT  was  £rom  3%  to  7  hoursJ  they  would  be  able  to  do  enough 
pretestiiag  to  be>  able  to  mroduce  the  quantity  of  tests  needed, 
fif  LSAT  can  accomn^date  to  this  disclosure  in  terms  of  main- 
t^dning  the  quality  of  the  test,  i  number  of  adjustments  need  to  be 
brade,  m  adijustment  that  involves  reduction  in  the  number  of 

adi^ni^tidns  of  the  test'.  '^'-^  '  

annual  cwt.  Ydb  then  have 


ERLC 


A. 


is  one  V^ay  to  hold  down  the 
retire  fewer  tests  in:a  given  ye4r. 


356 


•  348 

The  prime  candidates  for  elimination  are  of  course  the  ibw- 
volume  test  administrations.  One  of  those  low-volume  groups  are 
the  five  Monday  administrations  that  are  administered  to  those 
who  honor  Saturday  as  their  Sabbath.  How.  should  they  respond? 
Eliminate  perhaps  all  but  one? 

Why  is  this  necessary,  you  may  ask?  After  all,  H.R.  4949  does  not 
require  publication  of  the  test  given' on  Saturday  until  30  days 
ftfter  the  scores  have  been  reported.  Therefore,  the  Saturday  test  is 
not  made  jAiblic  until  6  to  8  weeks  after  the  Monday  administra- 
tion. The  concern  ^bout  using  the  i^me  form  on  Monday  as  oh 
Saturday  is  that  a  few  persons  might  take  the  test  on  Saturday 
under  an  assdmed  name  and  on  Monday  under  their  own  name.  In 
this  way  they  would  have  an  opportunity  to  practice  taking  the 
test  on  the  very  test  form  that  they  are  going  to  take,  for  real. 

One  response  could  be  to  use  a  new  form  but  offer  the  te^  on 
JMonday  only  once  a  yfear.  Another  response  would  be  to  offer  as 
hiany  Monday  administrations  as  Saturday  administrations  and 
ask  the  schools  to  assume  that  the  special  religious  commitment  of 
these  test  takers  will  give  liiem  assurance  that. there  is  no  or 
virtually  no  test  misconduct.  That  some  schools  would  value  the 
Monday|LSAT  scores  less  in  these  cases  is,  however,  a  possibility. 
.In:  either  response,  the  service  to  law  school  applicants , and  our 
member,  schools  would  be  reduced  as  a  consequence! 

I  suggest  th^t  the  committee  consider  exempting  the  Monday 
and  other  special  administrations  from  the  requirement  to  disclose 
the  test  questions. 

Presently  ^he^LSAT  may  be  administered  in  this  country  and 
around  the  world  at  virtually  any  date  in  addition  to  the  10  sched- 
uled Saturday  and  Monday  administrations  per  jtear.  Armed 
Forces  personnel  stationed  around  the  globe  may  arrange  to  have 
the  test  administered  to  them  wherever  they  are  at  any  time.  The 
Peace  Corps  worker  whb  returned  from  Africa  lusLafter  the  Febru- 
ary administration  and  needs  to  have  a  test  scot^  earlier  thaji  that 
which  would  be  produced  by  an  April  test  to  have  an  opportunity 
to  enter  lay  school  in  the  fall  can- arrange,  by  paying  a  special  fee, 
to  have  a  special  administration.  Some  handicapped  persons  want 
sjiecial  administratioris.  It  is)  not  readily  apparent  to  me  or  to  the 
leadership  of  the  LSAC  Council  how  this  valuable  program  of 
special  administrations  can  be  continued.  The  suggestion  that  the 
form  of  the  test  used  at  the  most  recent  general  admihistratibn  and 
that  has  not  yet  been  published  be  used  in  these  special  admiliis- 
trations  encounters  virtually  the  same  problems  as  those  suggesle(i 
for  the  Monday  administrations  of  the  test  form  used  on  Saturday.  ' 
Unless  H.R.  4949  is  amended  to  exchide  the  special  administrations 
from  the  disclosure  requirements  as  now  stated,  it  appears  that 
there  is  no  practical  way  to  continu^the  program  of  special  admin- 
istration. That  would  be  a  shame.   «  , 

What' are  the  implications  for  applicants  to  law  school  and  law 
sponsors  to  the  disclosure — increased  cost  and  decreased  frequency 
of  test  administration?  Increased  cost  would,  of  course,  have  ite 
greatest  impa(jt  on  the  economically  disadvantaged.  The  minority 
applicant  are  disproportionately  represented  in  the  economically 
disadvantaged.  It  would  be  a  national  tragedy  if  Hhese  increased 
costsc  caused  a  significant  number  of  economically  disadvantaged  ^ 
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and  minority  persons  to  fail  to  take  the  LSAT  and  thus  fail  to  . 
complete  their  applications  for  admission  to  law  school.  The  LSAC 
has  a  modest  program  of  waiving  ^es  for  the  severely  economically 
disadvantaged.  The  cost  of  that  program  is,  of  course,  borne  by 
those  who  pay  the  fees.  The  increased  costs  caused  by  the  disclo- 
sure requirements  will  significantly  increase  the  cost  of  the  test  fee 
waiver  program  at  its  present  level  and-  so  would  make  it  difficult 
to  increase  si^iificantly  the  level  of  that  program. 

ll^e  decreased  frequency  of  administration  of  the  test  caused  by 
'the  disclosure  requirement  causei^  us  eyen  greater  concern.  We 
understand  that  some  of  the  support  for  the  bill  before  you  and 
--gSnailar  bills  introduced  in  State  legislatures  came  from  legislators 
and  citizens  with  a  special  interest  in  the  minority  applicant  for 
.  law  and  other  professional  schools.  Our  association  shares  that 
interest.  Our  association  was  a  founding  member  of  the  Council  on 
Legal  Education  Opportunity,  which  has  for  th^. past  decade  played 
an  important  role  in  increasing  the  enrollment  of  minority  and 
disadvantaged  persons  in  tha  Nation's  law  schools.  It  is  a  federally 
funded  program.  We  filed  an  amicus  curiae  brief  in  the  Bakke  case 
in  support  of  the  general  position  of  the  University  of  California, 
both  with  the  Supreme  Court  of  Ccdifornia  and  the  Supreme  Court 
of  the  United  States.  \ 

Our  judgment  is  that  the  disclosure  requirement  in,  its  present 
form  would  in  fact  h£urm  and  not  help  the  minority  applicants  for 
law  school.  I  have  mientioned  the  probable  impact  of  the  increased 
costs  of  the  test.  The  less  frequent  availability  of  the  test  is  likely 
to  affect  tiiose  persons  who  are  newest  to  access  in  higher  educa- 
tion and  whose  undergraduate  colleges  provide  less  structure  and 
less  reinforcement  for  advanced  planning  for  the  complex  law 
school  admission  process.  The  lead  time  for ^iftkihg  application  for 
.  law  schools  is  the  longest  that  it  has  been.  To  have  the-full  oppor-. 
tunity  to  be  considered,  an  applicant  should  have  complieted^his  or 
her  application,  including  the  taking  of  the  LSAT,  by  March  or 
April  1.  I  am  told  by  deans  of  admissions  that  minority  applicants 
as  a  group  tend  to  make  their  decisions  to  take  the  test  and  apply 
later  in  the  admissions  cycle  than  applicants  generally.  The  reduc- 
tion in  the  number  of  test  administrations  would  seem  to  dispro- 
portionately disadvantage  the.  minority  applicant. 

There  are  a  number  of  technical  problems  relating  to  the  testing 
program  and  our  school  by  the  specific  provisions  of  the  bill  before 
you.  It  may  be  these  are  largely  the  product  of  the  drafters  not 
understanding  the  billys  formulation  of  the  rule. 

Let  me  provide  the  committee  with  some  examples  of  these  kinds 
of  provisions.  Pelfhap»  a  few  examples  of  this  would  illustrate  the 
problem. 

*  ■  ■  *        .         ■  ' 

RELEASE  OF  TEST  SUBJECT'S  INDIVIDUAL  ANSWER  SHfiBT 

H.R.  4949  section  5(aX2XB)  requires  the  testing  agency,  at  the 
test  subject's  request,  to  send  to  the  test  subject  the.  test  subject's 
individual  answer  sheet,"  among  other"  things.  I  would  strongly 
urge  the  comMttee  to  amend  that  to  read  "a  copy  of  the  test 
subject's  indiviSlual  answer  sheet."  This  would  make  it  clear  that 
the  test  agency  should  keep  the  original.  If  it  must  surrendei^  the 

' "'  ■•  ■         .       '  .  . 

^"      ■'  ■*  .      .  ■         ■  ■   '■  ^  ■  . 
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original,  then  we  would  be  concerned  about  the  resolution  of  dis- 
putes about  scoring.  If  the  test  agency  had  a  copy  and  that  copy 
showed  that  the  test  subject  had  answered  certain  questions  differ- 
ently from  that  indicated  on  the  original,  which  the  test  subject 
offers  in  evidence  to  the  court,  the  best-evidence  rule  might  require 
the  court  ix)  admit  the  original  in  its  present  form  as  evidence  and 
to  refuse  to  admit  the  copy  retained  by  the  test  agency.  A  mo- 
ment's reflection  suggests  "to -^ou  and  to  me  a  potentiality  for 
successful  alteration  that  this  rule  offers.  I  cannot  believe  that  the 
drafters  of  the  bill  intended  this  result.  It  is  very  probably  an 
oversight.  » 
Mr.  Weiss.  You  are  right. 

Mr.  RuuD.  My  responsibility.  Congressman,  i^o  tell  you  where 
we  live  and  what  the  bill  in  its  present  fornf  is  Ukely  to  do  to  us. 
We  share  common  interests  and  we  want  to  do  the  right  thing  for 
the  folks. 

Section  6  of  H.R.  4949  provides  among  other  things  that  the  test 
agency,  with  permission  of  the  test  subject,  may  release  all  previr 
ous  scores  to  the  designated  law  school. 

Research  has  informed  our  member  schools  that  the  best  way  to 
treat  an  applicant  who  has  taken  the  LSAT  several  times  is  to 
average  'all  scores  unless  there  may  be  special  circumstances  to 
dictate  a  given  score  should  be  ignored. 

Section  6  precludes  by  law  the  testing  agency  from  sending  to 
our  member  schools  the  second  and  subsequent  scores  unless  ex- 
pressly authori*ed  by  the  test  subject.  Why  should  the  Government 
deprive  our  schools  of  this  vialuable  information?  Again,  this  may 
be  simply  a  drafting  error.  The  testing  agencies  certainly  should  be 
authorized  to  $ubmit  to  the  schools  that  the  test  subject  has  asked 
scores  to  be  sent  to,  all  scores  a  person  earns/  ' 

There  are  several  items  in  section  & 

Section  3  also  requires  the  test  agency  to  explain  "the  correlation 
between  test  scores  and  success  in  the  career  for  which  admission 
is  sought."  The  LSAT  is  not  designed  to  predict  success  in  the  legal 
profession,  but  rather  the  probability  of  success  as  a  law  student. 
The  LSAC  literature  contains  cautionary  statements  to  law  firms 
anU  other  employers  of  law  graduates  that  LSAT  scores  should  not 
be  used  for  this  purpose.  Law  school  grades  are  a  much  more 
appropriate  criteria. 

There  is  a  larger  problem.  What  for  these  purposes  is  ''success"? 
Is  it  measured  by  income?  By  merely  gaining  admission  to  the  bar? 
I  aril  confident  that  the  dr^ifters  had  little  understanding  of  what 
they  were  asking  for  by  this  innocent  looking  10-word  clause.  The 
cost  of  the  research  to  provide  a  preliminary  answer  to  this  ques- 
tion is  conservatively  estimated  at  -between  $1  million  and  $2  mil- 
lion. Should  the  LSAT  test  takers  be  required  to  pay  for  this?  Will 
they  find  the  results  worth  the  cost? 

Subsection  3  would  require  the  Law  School  Admission  Bulletin  to 
,  contain  "a  comparison  of  the  average  score  and  percentiles  of  test 
subjects  by  major  income  groups."  The  LSAC  program  does  not 
now  gather  information  concerning  the  income  of  the  test  subject 
of  h^r  or  hiis  family.  Does  this  provisy)n  require  the  LSAC  to 
require  each  test  taker  to  provide  this  information  so  that  the 
studies  called  for  may  be  made  and  this  information  reported?  Are 
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there  not  jHuestions.  of  privacy?  Again,  is  the  cost  of  this  effort 
wwth  the  candle?  . 

K^ulaiion  of  the  Us^  of  Standardized  Admission  Test  Scores. 
Some  of  the  public  statements  made  in  aj^pport^of  the  testing, 
regulation  legislation  like  that  before  this  committee  have  stated 
as  one  of  the  principal  purposes  of  the  legislation  to  be  to  cure 
misuses  of  standardized  adiftission  test  scores.  H.R.  4949  as  intro-- 
duced  contained  a  version  of  section  8  that  required  an  explanation 
of  the  use  of  test  score?  as  criterion  for  selection  of  students  by  the 
undergraduate,  graduate,  and  professional  programs  of  colleges  and 
universities.  If  J  am  correctly  mformed,  this  provision  has  nbw 
been  withdrawn.  If  it  has  noU  then  it  would  seem  to  regulate 
through  the  means  of  publicity  the  use  of  test  scores.  The  concern 
that  I' have  with  the  provision  is  thdt  this  publication  requirement 
is  likely  to  introduce  greater  rigidity  in  admissions.  Litigatioii  over 
admissions  would  test  admissions  actrons  against  the  institution's 
stated  formula.  Aware  of  this,  the  admissions  committee  is  more 
likely  to  follow  literally  the  stated  formula.  While  this  gives  an 
appear^ce  of  greater  fmrness,  it  also  reduces  the  role  of  informed 
judgment  in  making  admissions  decisions. 

If  I  am  correctly  informed,  then  the  only  way  in  which  either  of 
these  bills  regulates  the  use  of  the  scores  by  our  law  schools  is 
through  the  hope  that  some  may  have  for  the  disclosure  provitions;- 
of  H.R.  4949.  As  I  indicated  earlier,  it  is  quite  clear  that  the  hope 
of  some  supporters  of  the  required  publication  of  each  test  after  it 
has  been  given  is  that  standardized  tests  will  be  driven  out  of 
business.*  We  are,  ag  I  said  earlier,  eriiphatically  opposed  to  that. 

■      ^iInancial  disclosure  . 

LSAC  in  its  annual  report,  which  is  distributed  to  our  member 
schools  and  other  law  schools  and  which  is  available  in  law  schobl 
libraries  all  around  the  country,  pro^d^  all  of  the  information 
requested.  The  comniittee  may  wii^fb  ask  its  staff  to  consult  with 
representatives  bf  LSAC  and  other  test  agencies  to  determine 
whether  sp^ifyihg  that  this  report  and  test  volume  report  must  be 
mad^  within  "120  days  after  the  close  of  the  testing  year''  presents 
problems  and  whether  the  fiscal  year  instead  of  the  testing  year 
should  be  specified  in  setting  the  reporting  date.  Clearly  the  reve- 
nue and  volume  figures  should  be  lii  terms  of  the  testing  year. 

The  pric^  for  all  of  the  testing  aim  admissions  services  by  LSAC 
are  set  at  levels  to.  generate  sumcipnt  income  to  piay  the  c^sts  of 
the  program.  By  estimating  the  probable  volume  for  the  test  year 
^nd  t^ie  costs  of;  providing  the  service  under  its  contract  with  the 
Mucational  T€tfd;ing  Service,  the  board  a(  trustees  of  LSAC  sets  the 
Varipus  fees  fo^its  services.  To  demonstrate  that  ,  this  is  not  an^ 
/exact  science,  i  should  report  to  you  that  expenditures  exceedecr 
lilicdme  i^  fiscal  1979  by  over  $600,000.  Unexpected  decreases  in 
Mume  c^usied  the  deficit. 

In  cox\cliision,  let  me  express  my  appreciatiojn  to  the  committee 
for  giving  me  this  opportunity  t|)  present  the  views  of  our  ass6ci- 
ation.  As.I.have  indicated,  we  share  most  oCgthe  policy  objectives  of 
these  twb  bills.  Our  concerns  are  with  the  means  chosen  to  serve 
the  ends.  ' 


Chairman  Perkins.  We  appreciate  your  testimony  this  morning, 
Mri  Ruud.         (        •  . 

Our  next  witness  ♦is  Mr.  Jon  Haber,  consultant,  U.S.  Student 
Association,  who  is  accompanied  by  Mr.  Andre  Burnett.  Then  we 
will  hear  from  Dr.  Roger  T.  L^nnon,  Harcourt,  Brace,  Jovanpvich, 

You  may  proceed.  ■  w  ■ 

[The  prepared  sta|;ement  of  Jon  Haber  follows:] 

Prepared  Statement  oi?"  Jon  Haber,  U.S.  Stud^t  Association,  Accompanied  by 
Andre  Burnett,  DmEcrroR,  Natioi^l  TJinRP  World  SrubENT  Coaution,  U.S. 
Student  Association  .     '  t 

Mr.  Chairman  and  menii^  of  the  siibcomtnittee,  I  thank  you  for  the  Opportunity 
to  ipppear  before  you  today.  My  name  is  Jon  Haber  and  I  am  representing  the 
United  States  Student  Association  (USSAj.  I  was  formerly  the  Gkpirdfctor  of  the 
University  of  California  Student  Lobby  and  was  the  prinemal  drafter  of  the  Califor* 
nia  Truth-inTesting  legislation,  I  am  accompanied  by  An^re  Burnett,  Director  of 
USSA's  National  Third  World  Student  Coalition.  We  are  speaking  oh  behalf  of 
USSA's  3,000,000  student  members  attending  over  350  colleges  and  universities. 
■We  join  many  other  organizations  in  strongly  endorsing  H.R.  4949— the  Educa* 
tional  Testing  Act  of  1979,  including  the  National  Parent  Teachers  Association 
(PTA),  National  E&catibn  Association  (NEA),  NAACP,  National  Public  Interest- 
Research  Group  (P^G),  Coalitioii  of  Independent  Colleges  and  University  Students 
(COPUS),  the  Americans  for  Democratic  Action  (ADA),  as  well  as  many  statewide 
student  associations.    "        /  * 

The  Educationar  Testing  Jict  of  1979  is  designed  to  provide  more  information 
about  standardized  tests  anji  promote  a  wider  understanding  of  these  tests  amongst 
students,  educators,  parent  admissions  officials,  and  the  public  in  general. 

Equally  important  is  v^nat  this  Act  doA  not  do.  It  does  n6^  regulate  test  contents 
nor  testing  procedures  d(  the  teisting  companies,  nor  any  aspect  of  their  admissions 
testing  progrefc.  Neitlier  does  it  specify  how  collegeiJ  and  universities  shall  use 
standardized  tests  in^heir  admissions  programs.  This  Act  is  simple  disclosure  legis* 
lation — no  more  ano  no  less. 

It  is  also  impoirant  to  stress  th^t  we  are  not  anti-testing.  We  do  not  support  the 
abolition  ,  of  the  testing  companies  or  the  tesfe  they  make.  We  simply  believe  that 
tests  measure/a  narrow -range  of  characteristics  and  are  therefore  subject  to  misuse 
and  misunderstanding.  Through  the  information  provided  them  by  H.R.  4949,  stu- 
^eviifs  and  tne  public  will  gain  a  better  understanding  of  the  nature,  purposes,  uses, 
and  limitations  pf  standardized  admissions  tests.  We  also  believe  that  this  Act  will 
ensbre^tnat  tests  are  used  prpperly-ra  goal  ETiS  and  other  testing  agencies  supports 
ed  before  this  Suhcommitt^  yesterday. 

L^tly,  WQ  have  little  to  say  about  H.R  3564  (Gibbons).  While  we  applaud  the 

•  intent  of  the  legislation,  if  passed,  it  would  have  no  impact  on  the  tests,  and  would 
rtbt  improve  or  change  the  amount  of  information  presently  prpvided  to  stqdehts.  It 

/'essentially  codifies  the  testing  companies'  current  practices.  . 

American  colleges  and  universities  rely  hedvily  on  standardized  tests,  often  using 
them  as  the  critical  factor  in  deciding  what  students  to  admit  to  their  undergrad- 
uate, graduate,  and  professional  programs.  Although  not  covered  by  this  legislation, 
standardized  tests  also  play  an  extensive  role  in  determining  which  students  will 
qualify  for  financial  aid,  which  students  will  be  awarded  adyanced  placement  credit, 
arid  irttimdtely,  which  students  c^n  be  professionally  licensed  after  th^ir  college 
training.  ♦  • 

I  have'  been  involved  with  the  question  of  standardized  testing  for  three  years.  I 
hav^^ken  and  met  with  thousands  of  students  about  tests  and  at  this*  point  will 
share  some  of  their  concerns  with  ypu.  I 

Students  feel  that  they  are  victims,  not  consumers,  of  standardized  tests.  They 
have  little  choice  but  to  take  the  test— their  college  or  university  has  made  it  a 
mandatory  component  of  the  admissions  process;  And  although  the  test  will  be 
macle  by  one  of  two  testing  companies,  the  student  will  usually  not  be. allowed  to 
ctecide  whether  to  take  ETS'  pr  ACT's  test— the  college  has  already  made  that 
dnoice  for  them.  «  '  , 

Preparing  for  and  taking  the  test  is  extremely  stressful.  Not  only  are  the  tests 
,  taken  during  crucial  periods  in  students'  Ijves — when  they  are  deciding  what  paths 

*  to  Yollow  after  high  school  undergfadpate  or  graduate  schooling— but  also  because 
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each  knows  that  their  test  ^score  may  ind^  decide  their  prbfessioMal  and  occupa- 
tional fiiture..  ' 

While  students  do  not  know  the  test's  liiargin  of  errors  predictive  valuer  or  bias, 
students  are  weU  aware  of  one  fact— theiif  score  may  mean  the  difference  between 
being  accepted  or  rejected  at  most  coll^ies.  As  a  result,  many  students  turn  to 
Qizpensive  coaching  schools  or  coaching  books  in  hopes  of  better  test  scores. 

Students  are  frustrated  at  being  unable  to  see  their  questions  and  answers.  They 
can  never  kiCiow  which  questioniBi  they  answered  correctfv,  or  in  which  subjects  they 
need  m6re  work^  Perhaps  they  misnumbered  their  an»ver  sbeet  or  the  computer 
has  made  pother  scoring  error.  \  . 

Students  ^  often  reMntftil  When  they  receive  theiricores.  They  often  feel  that 
the  test  did  noV^eally  reflect  their  ability.  ^  ^ 

Many  feel  thaMssay  tests  would  have  been  fairer  indicatory  of  their  talems. 
Students  belie veHhat  the  tests  are  overpriced.  A  student  applying  to.  seven  ilaw 
schools  must  spend  as  miich  as  $35  simply  to  take  the  test  ana  nave  his/her  score 
and  grades  mailed  out^.  Additionally,  this  student  might  pay  as  much  as  $140  in  ' 
schofu  application  fees,  %ot  to  mei^tion  the  costs  of  coaching  books  or  coaching 
schools  to  prepare  for  the  test. 

I  am  not  speaking  of  a  handful  of  students.  Rather,  many  students  feel  this..  In 
ld7Z-78,  some  1,488,300  students  took  the  Scholastic  Aptitude  Test  and  Achieve- 
ment Tests,  1^,000  took  the  graduate  Manc^ment  Admission  Test,  314,000  took 
the  Graduate  Records  Examination,  and  128,000  took  the  Law|  School  Admissions 
Test— all  tests  made  by  ETS.  (mS  1978  Annual  Report.)  In  l$76-77,  923,241  stu- 
dents took  the  American  College  Testing's  ACT  Assessment;  an^  60,000  took  AtTT  s 
Medical  CoUegfS  Admissions  T^.  (ACT:  General  Information,  1977.) 
'  If  students  are  provided  with  the  basic  information  required  by  this  Act,  these 
tests  will  looscnmuch  of  their  mystery.  Students  will  have  a  better  understanding  of 
^  what  the  testi^  can  and  cannot  predict  how  their  score  is  determined,  if  preparatory 
courses  ar^  a  worthwhile  expense,  and  whether  testing  fees  llevels  are  proper. 

In  addition  to  the  question  of  what^he  individual  student  is  io  be  told,  tnere  is 
the  larger  question  of  what  the  public  should  be  told  about  !the  limitations  of 
standaraized  tests,  most  notably  problems  with  predictability  and  bias. 

One  problem  with  predictability  is  the  lack  of  preciseness  of  the  test  score.  For 
example,  it  a  student  received  a  600  on  his  or  her  SAT  (with  possible-scores  ranging 
from  200  to  800  pdhts),  this  only  means  tnat  there  is  a  two-in-three  chance  that  the. 
student's  ''true4Core"-^the  score  the  student  ,would  receive  if  all  external  factors, 
such  as  luck  in  guessing,  could  be  eliminsed^would  fall  somewhere  between  570 
and  630  points.  Ote  ETS  booklet  revealed\that  ^a  72  point  difference  oh  the  SAT 
math  section  (and  66  points  on  the  SAT  vg^bal  section)  is  so  statistically  insignifi- 
that  ''it  cannot  be  taken  seriously."  F^r  the  LSAT,  a  difference  of  67  points 
_  __...x  .^j^^  difference  of  otie  student  being 


at  that  a  student's  sdbre  will  vary  up 
There  is.  a  5%  ^hance  that  the 
\g  more  than  60  poinis  over  or  under 


i  be  taken  seriously.  Yet  67  points  can 
^  ed  or  not  to  most  law  schools, 
"addition,  tibere  is  a  one-in-three  chance  tl 
V  to  60  points  over  or  under  his/her  ''true  sc( 
variance  may  be  even  greater  than  this— rang_  _ 

his/her  "true  score.^  That  meaps  that  a  student  whose  "triie  scoi^e''  is  550,  m^v 
receive  a  score  oyer  610  or  under  4&0.  Since  l.sWillion  students  tak^  the  SAT  each 
year,  75,0()0  students  would  fall  into  this  categoiy; 

A  recent  UC  Berkeley  study  by  Dr.  Hatrisoh  Gough  also  qiiestioneid  the  predicta- 
bility of  test  scores.  He  found  that  high  schocil  students  with  high  grade  jp^int 
averages  but  low  SAT  scores  did  as  well  as  those  with  high  SATi94-in  fact  ^they 
were  more  apt  to  take  the  BA  degree  (within)  four  years."  .    \  . 

Most  important,  the  tests  cannot  n^easure  creativity,  ludRement,  experience,  or 
idealism— characteristics  which  should  funire  into\any  schooT's  admissions  formula. 
,     As  many  colleges  rfely  heavily  on  standardized  testate  make  admissions  decision8.(tp 

Nthe  exclusion  m  all  other  factors,  except  grades),  th^  traits  rarely  en tcir  admissions 
d^ecisions*  Jl       a  1 

Testing  expert  and  mathematician  Benesh  Hpfman, /m  of 
Testing,  also  ciitioized  the  limited  valiie  of  multiple  choicjb  ttets.  contended  that 
the  multiple  choice  tests,  such  as  the  SAT,  LSATi  " 

and  penalize  the 


superficiality,  ignore  creativity,  an  . 
mind."  IVoieesor  Plotkin,  a  testing  expeH,  has  stated!  "( 
to  muse  over  a  test  question,  or  who  sees  a  sublety.  Aif^d  I 
idea  while  hc^'s  taking  the  test  .  .'.  These  tests  look 
divergent  thinking  " 
There  has  also  been  tremendous  concern  r€tardihg  \l 


E,  and  GMAT,  •  "reward 
n  with  a  subtle,  probing 
od  help  the  kid  who  stops 
^rod  help  him  if  he  gets  an 
convergent  thinking,  not 


t  bias.  While  the  racial. 


sexual,  regional,  and  ethnic  bias  of  these  testis  is  still  hotly  debated,  it  is  clear  that 


erJc  • 
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there  is  a  boeitive  and  progref»ive  association  between  teat  scores  and  family  in- 
come.. A  1977  study  by  the  California  Postsecondary  Education  CommiMion  noted 
that  "the  average  family  income  for  students  who  earned  650  or  more  pomts  (out  of 
800)  on  the  SM*  was  $26,400.  gtudents  in  the  lower  range— below  350  or  more 
(points)— had  a  mean  family  income  of  $14,500."  r.^  \ u      r  i 

A  1975  UC  Berkeley  study  supported  this  conclusion.  Students  whose  family 
income  was  below  $6,000  scpred  92  points  lower  than  a  student  whose  family  income 
$30,000.  I  ^  u,. 

Even  some  of  the  data  of  ACT  suggests  this  is  true.  In  theirjwent  publi^^^^ 
^  College  Student  Profiles,  Norms  for  the  ACT  Assessement  (1978-79  Edition).  ACT 
compares  the  test  score  of  students  from  varvin|f  economic  backgrounds.  The  mean 
scores  for  students  (on  a  scori|ng  scale  of  1  to  36)  is  as  follows:  students* 


Annlial  family  mcome:  - 
Under  $3,000  -  •  \li 

$3,000  to  $5,999..  ^   ,       J2  o 

$$6,(»0to$7,499.:  •  •  ' 

$7,500  to  $8,999  .  -   ]ll 

.  ^$9,000  to  $11,999..  '  •   - 

$12,000  to  $14,999  

$15,000  to  $19,999:  ;  v  H  I  I 

Over  $20,000  ...f  i  — •  •  20.6  i 

This  chart  indicates  a  wide  disparity  between  student©  from  different  economic 
backgrounds.  The  student  from  the  hoghest  economic  background  will  average  7 
pointe  higher— or  20  percent  of  the  scoring  scale— better  than  the  student  from  the  / 
lowest  economic  background.  ^  Ar»r 

The  same  publication  by  ACT  suggests  some  trends  m  regional  bias.  The  ACl  / 
score  for  students  enrolled  in  four  yefig-  colleges  in  the  foUowmg  regions  of  the  | 
United  States  is  as  follows:  $tudeiiu*  \ 

Region  where  student  is  enrolled  in  college:  mean^l 

Midwest  ^  •  • 

Rocky  Mouritaiiols/Gteat  Plains  -   K 

West  Coast....;.  :  •  •   X 

East/Northeast  :  :  :  •   }°  o 

South/Southeast  ^   Jb.^ 

'  Southwest  -  .  .^  ;    ^^'^ 

A  student  from  the  midwest  will  average  4  points— or  11%  of  the  scoring  scale*  ^ 
better  than  a  student  from  the  sputhwest.  t.      t..  n  / 

The  same  publication  also  notes  that  male  students  generally  have  higher  scor^ 
on  the  ACT  assessment  than  do  female  students,  although  women  generally  Hcj 
betterontheEngUshpwrtof  the  test.      ,    .    ^.0       ,  .  \i.  k^ 

Questions  of  predictability  and  bias  need  to  be.di&ussed.  As  this  Act  wilj  inspire  a  r 
healthy  intellectual  debate  on  testing,  the  public  can  become  better  mformed  a*  # 
well.  In  addition,  as  independent  researchers  analyze  test  questions  and  aniwers, 
their  research  may  provide  the  basis  for  making  these  examinations  fairer.v 
I  would  like  to  now^iscuss  some  of  the  more  important  provisions  pfrthis  Act. 

SECnON  S:  INFOttBlIATlON  TO  TEST  sIbJKCTS  ANP  POSTSBOONDARY  EDUCATION 

'  INSTITUTIONS 

This  section  would  require  that  bcisic  information  be  provided  t6  Students  taking' 
the  test  and  that  information  be  proVldwkin  clear  and  understandable  lwiguage» 
This  infoimation  is  necessary  to  cleAr  understanding  of  the  t^ts,  includmg:  the 
putpoee  of  the  test;  the  subject  matter  of  the  test  and  the  knowledge  to  be  tested-, 
pfedictive  value  of  the  test;  margin  of  error;  explanation  of  the  scoring  sc^e; 
privacy  rights  of  students:  date  student  Mi*ill  receive  their  scores,  special  servi<^  t^r 
handicapped  students;  ability  of  test  preparation  courses  to  irfprove  students 
s;  how  the  student's  score  will  be  reported;  and  relationship  of  students  scores 
iheir  economic  background,  .    ,      ^,  ^      .        *j   ^  4j 

r^ite  the  importance  of  these  tests  on  the.  livw  of  AmencanBtudents.  most  do 
have  a  clear  understanding  of  what  their  test  scores  mean.  This  is  due  in  part  to 
information  which  prospective  test  takers  receive^  regardmg  a  test 
i  as  consumers'of  tc«t  services.  .  jf\  ^ 

*u  u^^i.^  that  some  of  the  wganizations  sponsoring  the  tests  have  been  extremely 
responiive  in  this  area,  The 'brand  new  descriptive  booklet  for  the  GRE  provides 
much  of  the  information  required  by  this  section,  presumably  because  of  the  pres- 
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suiie  of  legislation  in  New  York  and  California.  Hovyever,  if  this  preafture  no  longer 
edsts,^!  the  testing  companies  return  tp' their  old  Ways^f  /  ^ 

Oflioii  colleges  and  universities  ai^e  told  some  of_the  information  required  by  this  .f 
sectioA  while  students  are  not.  In  his  testimony  yesterday,  Conereissmah  \%eiss 
mentioned  that  students  applying  to  law  schools,  v  ho  had  taken  Ihe  LSAT  more  . 
than  once,  had  their  testing  transcripts  tagged  if  the  failed  to  indicate  that  they  had 
takeii  the  LSAT  previous^.  The  students  'were  ne^er  told  that  this  information 
would  be  sent  to  law  schools  to  which  tjh^y  were  apphring. 

Lastly,  this  section  requiree  the  testing  agencies  to  immediatelv  notify  the  student 
and  college,  to  which  he  or  [she  is  applying,  of  any  reporting  del^  of  a  students 
score.  Although  students'  sc6r^  fave  peen  delayed  far  a  number  of  very  legitimate 
reasons,  some  students  have  been  denied  admissicn  because  an  excessive  delay 
caused  them  to  miss  a  college's  application  deadlin  e  This  provision  woulc^  ensure  . 
ihAi  both  the  student  and  college  would  be  aware  of  the  delay  and  that  the  college 
could  take  this  Into  account  if  the  delay  was  excessiy  s. 

'SACnON  4:  REPORTS  AND  8TATI811CAL  DATA 

This  section  requires  release  to  the  Commissioner  jof  studies,  evaluation,  or  statis- 
tical reports  for  which  the  testing  agency  prepares  or  supplies  data.  A  provision  is 
included  to  protect  the  cdnfidentiality  of  the  individual  student  when  this  informa- 
tion is  made  public.       v      *  ^ 

The  largest  body  of  research  on  test  validity,  bias»  and  predictability  oh  the  tests 
are  produced  by  the  test  agencies  themselves.  This  research  serves  as  the  basis  of 
improvement  of  the  tests  and  testing  procedures,  weighting  of  tests  in  college 
admissions  formulas,  and  development  of  new  services  to  be  offered  to  students  and 
tmivefsitiesti  Clearly,  thi^  ipfonnation  should  be  available  to  the  public  and  to  the 
scrutiny  offindependent  researchers  to  foster  a  better  understanding  of  the  tests  and 
thejproper  me  they.  shpMld  play  in  coll^  admissions  decision. 

The  testing  agencies 'argued  against  thiia  provision  during  the  hearings  on  the 
New  York^nd  California  tiding  legislation.  They  claimed  that  test  research  is 
routinely  pimished  and  available  to  the  public,  academic,  and  research  libraries, 
.  and  io  any  individual  who  may  request  it. 

-  This  simply  hot  true.  Many  important  studies  are  not  disclosed  by  the  testing 
agencies.  Iliree  examples  of  studtuss  which  witnesises  at  the  New  York  testilg 
hearinm  indicated  were  withheld  by  ETS  include:  1^ 

a)  statistical  reports  known  as  "Test  Analysis"  equating  procedures  (OS  / 
refused  to  disclose  such  data  to  a  researcher  who  %uf[gested  that  ETS  mad#&  ^ 
serious  mistake  in  equating  the  Multi-State  Bar  Exammation)!        '      m  u 
(jl)ainjigog  ETS  study  on  "Cultural  Bias  in  Testing:  Ch^lenge  and  Resj^se  ; 
,    ira)  a  study  on  law  school's  use  of  the  LSAT.  i  ,  i 

'TheUate  Dr.  Osc^r  R.  Buros,  publishen  of  the  Mental  Measurements  Yejrbook, 
winnef^the  ETS»award  for  Distmguished  Service  to  Measurement,  and  member  of 
the  testing  fraternity  who  frequently  praised  ETS  tests,  discussed  th&  issue  at  a 
March  1977  speech  at  the  University  of  Iowa.  Buros  thanked  ETS  and  ACT  for 
making  copies  of  secure  tests  available  to  his  revievfers,  but  criticized  the  testing 
firms  for  withholding  important  data  about  test  characteristics.  "The  information 
availabk  to  permit  an  adequate  assessment  to  be  made  of  these  secure  tests  is  quite 
imsatinactory,''  D^.  Buros  said.  "Although  our  reviewers  received  some  in'-'house 
material,  which  is  not  available  to  other  educators  an^^  psychologists,  even  this 
material  is  inadequate."  %  \ 

E^ntially,  this  section  would  «isure  the  free  flow^^f  information  concerning 
important  testing  studi§^  It  would  encourage  independent  research  aiid,  in  our 
view,  lead  to  a  wider  oucussion  and  better  understanding  Of  standardized  tests. 

SVmON  6:  PROMOTING  A  BK1TSH  UNDBWflPANDINO  4)F  TESTS  : 

This  section  requim  testing  agencies  to  file  copies  of  test  questions  and  answers 
with  the  ConmuBsioner  of  Education  oill^^dfter  the  test  is  given  and  td  provide  test 
takers  with  a  copy  Of  th^irtiWirauestiojrfs  knd  tiEnswers.  Test  subjects  can  be  charge4^ 
AsmaUfeetocoverthel^nte'shandM^  ...  .    .       ,  ^  V 

This  infonxiation  shall  be^ade  public  and  copies  will  be  forwarded  by  the 
CommissioBer  to  state  educatmal  ageiioi^.  As  this  secti9n  is  essentially  the  same 
as  the  recently 
California  law,  j 
apd  ailiswers  toj 
each  ^te  thai 
j0gencito  time  i 


jting  legislation  and  similtir  to  the 
iy  forward  one  copy  of  the  qultotioas 

  lotliave  to  file  the  information  virith 

has  tru|h-in-Testing  laws.  This  provision  wo^d  save  the  testing 
'  money! 


New  YoriL^ti^ion 
[6  testing  agency  would  ,  sim; 
;he  Commissioner  and  wbuld 
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This  section  of  the  bill  is  important  for  a  nunAer  of  reasons.  First,  d  basic  tenent 
of  faimeas  dictates  that  people  have  the  right  ih  review  the  criteria  used  to  evaluate 
their  ability.  Presently,  hoWever,  students  (wHb  must  take  these  tests  in  brder  tai}e 
admitted  to  poetsecondary  educational  instilutions)  cannot  see  copies  pf  the  test  ' 
questions  or  tneir  own  answers  even  after  theltest  is  given.     \         ...  . 

Second,  standardized  admissions  tests  are  ni^or  instruments  of  public  concern  as  . 
they  influence  decisions  about  who  is  admittedto  undergraduate,  p-aduate,  and 
professional  schools.  It  ia  essential  that  such  ihstruments  of  public  concern  be 
available  for  ^ftublic  discussion  and  review.  ■       .  , 

.  Third,  pubfic  access  to  test  contents  is  Essential  iso  that  independent  researchers 
can  evaluate  the  tests.  Independent  revii^  should  be  welcomed  as  a  way  to  improve 
the  quality  of  tests.  While  researchers  are  occ^issionally  granted  access  to  test 
contents  now,  it  is  very  difficult  to  obtain  this  privilege.  Furthermore,  the  conditions 
of  granting  access  are  thkt  the  results  of  this  research  not  be  published  noi;  dis- 
cussed with  colleagues  outride  the  testing  industry.  t.   ,     ,  , 

Fourth,  students  who  can  afford  to  attend  expensive  coaching  schools  already 
have  access  to  test  questioyis.  These  schools  systematically  send  staffers  in  to  take 
tests  and  memorize  the  questions  for  review  in  tiTe  course.  Niimerous  studies  have 
been  cited  that  indicate  that  coaching  can  improve  a  test  taker's  score.  (See  Steve 
Levy,  "E?rS  and  the  'Coachi  ng^  Cover-up",  New  Jersey  Monthly,  March  1979).  Grant- 
ing all  students  accesis  to  past  test  contents  would  eliminate  par^  of  this  severe 
economic  discrimination.  .  ■  ,  ^ 

Fifth,  contrlily  to  claims  madefy  tha  testing  agencies  yesterday,  release  of 
questions  will  Bot  cause  problems  with  "equating",  the  process  that  makes  test 
^oies  comparable.  This  is  lecause  the  bill  aljows  the  testing  agencies  to  ke^p  secret 
questi&is  used  for  equatinf  ;.  As  Dr.  Walter 'Haney,  Staff  Director  of  the  National 
Consoltium  on  Toting;  testified  before  this  Subcommittee  yisterdaiy:  'Arguments 
dealing  with  pretesting  aid  equating  of  tests  are  essentially  irrelevant  to  the 
presdp  version  of  Hil.  494J ,  sinc6  current  proviaiojis,  allow  for  maintaining  security 
with  respect  to  items  which  are  used  solel]^  for  the  purposes  of  pretesting  and 
equating,  and  which  do  hot  contribute  dijreftly  to  an  individual  test  takers  raw 
score.  'I 
Sixth,  contrary  to  testing  compahy  claims  made  at  the  New  York  Truth-in-Testing  I 
hearings,  i^elease  of  test  questions  and  answers  will  not  result  in  a  large  increase  in 
test  taker  fees.  The  cost  of  writiiig  new  questions  would  be  minimal  according  to 
ETS'  internal  cost  studies  (ICTS  "Activity  Analysis':,  ;^uary  31,  1972).  Actual  costs 
of  test  development  for  the  SAT  and  Achievement  tests  was  $.32  or  5.7  percent  of 

  jfct  Subjects  ($5.75).  By  contrast,  the  surplus  of  income  over  expenses 

bm  these  two  tests  was  J.93  or  16  percent  of  the  test  subjects'  fee.  In 
3  percent  pf  the  income  frotn  these  two  tests  was  spent  on  test 

\ 
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the  fee  paid  by  J 
(i.e.  ''profit")  fq 
1976,  less  ths 
development. 


CHART  I:  HOW  MUi 


A  breakdoWn  of  these  cos  »  for  these  and  other  tests  is  as  follows: ' 


OF  CANDIDATE'S  FEE  GOES  Tj^TEST  DEVELOPMENT? 


Test  iKOgraitt 


S(5wce:  "Activity  Analysis"  interMl  ETS  study.  Jan.-31.vl97Z. 


College  board  LSAT 


GRE 


AT6S6  im 


Fee  paid  by  candidate    A.   ■  $5.75  ■ 

Total  cost  (pef  session  candidate)  to  ETS  L   $4.82 

Cost  of  test  developnient  ;..:...L.-.  |  $.32 

Test  devetopmenl  as  percent  of  total  cost  to  ETS^     6.7 


$13.50 
$10.83 
$.49 

4.5 


$9.00  $10.00 

$7.17  .  $9.22 

$.62  •  $.44 

8.6.  4.8 


CHART  llrADMjjSION  TE^NG  PROGRAM  REVENUE  AND  EXPENSES 


Revenues  Expenses 

1974  41975..!  \    $16,036,276  :  $12,550,511 

1975  iff  1976  ■  ■  \     16,260,652  13,232,474 

1976  to  1977  »  :.  \     17,640,000.  v  14,099,000 


Surptus- 


)!ii 


Pe/cen! 
p(ofit 


$3,485,735  .27 
3,028,178  22 
3,541.000  25 


4    1  Projected. 

/Source:  CoHete  l)oard  4ta(efnefll  of  revenues,  expenses  and  fund  Iniancel  year  ended 
n  current  prelections.  •  O  ^ 


1 30.  1976.  With  comparable  figures  lOr  1975  awf  for 


CHART  III:  ETS  TEST  DEVELOPMENT  SPENDING^R^KDOWN  AND  BUDG^  FOR  COLLEGE  BOARD 


ADMISSIONS  TESTING  PROGRAM  ISATi 


AND  ACHIEVEMENT  TESTS) 


Test  construction  expwses  ^J. 

Program  administratjon  expe^  

Test  construction  as  perbent  of  program  administration  expenses  

Adrnissiofts  testing  program  volume  (in  number  of  test  subjects)  ^. 
TotaJ  construction  expenses  per  candidate  *  ;    


•/    1976  aclual 


r 


1977  budget 


,..../...■       $291,000  .  $389,000 

../.       :  $10,079,000  $10,864,00a. 

2.9  3.6^ 

1,73?.( 


3?.0()0  '  1.430,0Q|f 
$0.17  $0J 


*  Tesi  subjecb  vohkne  figures  are  from  ETS  In  Fact,  an  rrs  put)lication. 

*  Uvtiaei  pef  caodklate  calculated  \ff  dividing  test  construction  expenses  t^  candidate  volume. 

Source:  "ETS  confidential  project  operating  statement  by  position— category/^oject,  period  ending  Mar.  31,  1977,"  a  66  page  computer  printout. 

Seventh/ contrary  to  claims  made  by  testing  agencies  at  the  New  Yo^k  Truth-in- 
Testing  hearings,  disclosure  of  test  questions  and  answers  will  not  result  in  reduc- 
tion in  the  quality  of  the  tests.  Test  questions- and  answers  will  soon  be  available 
through  legislation  pa$sed  in  New  York  and  California.  In  addition,  this  Act  will 
improve  the  Quality  of  questions  writing  by  subjecting  the.  process  to  the  scrutiny  of 
interested  subject  matter  experts,  educators,  and  the  public.  In  one  case  where 
questions  of  a  secureJBTS  test. were  disclosed  for  public  scrutiny  (the  February  1973. 
multiple-chdice  Multistate  Bar  Examination)  law  professors  at  the  Georgetown  Law 
Center  and  other  Washington,  D.C.  law  schools  disagreed  on  the  correct  answers  to 
25  percent  qf  the  questions.  FoUowing  this  disclosure,.  ETS  and  its  client  conceded 
that  five  of  the  questions  seemed  to  nave*  more  than  one  correct  answer.  No  tests 
are  known  to  have  been  disclosed  since. 

In  general  the  quality  of  now-secret  staiidardized  test  questions  and  a/idwers  has 
been  a  matter  of  controversy  in  academic  circles  for  years.  Professor  Benesh  Hoff- 
man of  Queens  College^  the  mathematician,  physicist,  and  former  Einstein  collabo- 
rator,, has  published  extensive  criticism  of  the  scientific  accuracy  of  the  questions 
and  answers  Which  ETS  has  disclosed  in  its  test  booklets.  Independent  research  can 
verify  or  refute  charges  such  as  this. 

Last,  contrary  to  the  claims  made  by  the  testing  agencies  at  the  New  York  Truth- 
in-Testin^  hearings,  test  makers  will  not  run  out  of  new  questk)n8  to  ask.  This  claim 
is  incbnsistent  with  the  fac^  of.  current  ETS  queatioii-writing  procedures  as  de- 
scribed in  th(  internal  ETS  "Manual  of  Information  for  Test  l3evelopment  Prof^- 
sional  Staf^^  Tq  illustrate,  this  the  Manual  use^  this  example  of  the  January  and 
May  1971  Physics  Achievement  T^st:  On  each  version  of  the  Physics  Test,  16 
questions  wer;  drawn  from  the  old. item  fil^s  and  39  questions  were  newly  written 
by  the  physics  committee  of  exaniiners  and  ETS  staff.  The  Committee  met  twice  and 
was  budgeted  to  produce  400.  new  questions  (only  56  were  actually  needed  for  each 
test).  The  Maifual  notes  that  sillplus  questions  are  produced  as  a  matter  of  proce- 
dure: ''The  number  .bf  items  pretested  may  exceed  the  number  of  useable  items  by 
aa  little  as  25  br  30  percent  or  by  as  much  as  300  or  400  percent.  In  the  absence  of 
appropriate  rules  of  thumb,  one  should  plan  to  pretest  about  twice  as  many  items  as 
will  be  needed.y  .Since  motit  questions  are  already  being  written  anew  anyway  (with 
no  sign  of  exhaUstion  in  sight),  the  surplus  questions  will  provide  a  cushion.  Those 
found  to  be  satLsjlactoiy  are  already  stored  for  futu^  use. 

I  8KCTI0N  7:  TESTING  CpSTS  AND  FEES  1 

\  This  section  requites  testing  agencies  to  file  limited  amounts  of  financial  ir^fornla- 
tion  with  the  CommH^ioner.  It'  requires  far  less  information  than  does  the  Califor- 
nia Truth-in-Testing  legislation.  This  section  is  still  necessary  because  it  Will  pro^ 
vide  nationwide  information,  while  Califorriia  law  only  applies  to  that  state.  , 
.  Linfited  release  of  income  atld  expenditures  will  enable  the  public  to  better 
understand  the  procedures,  devjalopment.  and  administration  of  standardized  tests. 
As  I  mentioned  earlier,  students  must  take  one  or  more  standardized  tests  made  by 
one  0^  tWo  testing  companies  to  be  admitted  to  many  colleges.  They  have  nd  choice 
bA  to  which  test  they  may  take  and  are  riot  able  to  shop  around  for  the  best  price. 
Thus  students  are  captive  consumers  of  the  testing  compsfhies  and  provide  much  of 
the  companies'*  income.  And  since  two  companies  make  nearly  all  the  testa  coveiped 
under  this  bill^  each  has  little  Incentive*  financially^  to.  compete,  with*  the  other. 
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Questions  have  been  raised  »s  to  the  large  amount  of /'profit     .e  jev^^^^^^ 
expenses)  of  these  companie*,  w  well  as  some  of  the  expenditures  made  from, 
sffit  few  (sVh  as  the'^luj^uriouB  400  acre  ETS  caimpusAt  ft;mceton.  New  Jersey). 

to  addZn/these  tests  We  used  to  all^te  a  limitef  public  ^-educdtion- 
which  makes  the  test's  martufacturers  com|arable  to  P"bhc  utihti^^Tlus  incr^^ 
'the  puWic's  right  to  knoWmore  about  the  operations  and  test  devfiopment  proce- 
dures ^the  limited  number  of  testing  companies.  .  ^ 

Lastl*.  limited  release  ef  income  and  expenditures  wilLensure  reasonable  oompli- 
ance  wth  this  Act.  Thi^  section  requires  disclosure  of  profits  and  test  qaMtion 
development  costs  of  ttJe  testing  agencies,  If  these  agenciM  ra«e  t^t"?  f^^. 
conSenlfttte  for  release  k  test  queitions  and  answers  of  Section  5  of  the  Act  they 
wM'doT^li^  and  wiU  have  to  justify  to  the  pubUc  that  the 

itjfirease  was  necessary/  ,  ^ 

\      ■  CONCLUSION 

In  sum'  the  Educiional  Testing  Act  of  1979  would  provide  aU  those  concerned 
with  standafdized  Admissions  tests  with  more  information  about  the  tests  and 
encourage  the  responsible  use  of  standardized  tests. 

I  urge  your  support  Of  this  Act.        /  I.  . 

Thank  you.  .  '  \ 

STATEMENT  OF  JON  HABER,  CONSULTANT  (M  STANDARDIZED 
TESTING,  UNITED  STATES  STUDEJ^T  ASSOCIA^TION,  ACCOMPA- 
NIED BY  ANDRE  BURNETT,  DIRECTOR,  NATIONAL  THIRD 
WORLD  STUDENT  COALITION,  AND  ROGER  T.  LENNON,  AS- 
SISTANT  TO  THE  CHAIRMAN  IN  MEASUREMBpJT,  HARCOURT 
BRACE  JOVANOVICH,  INC.  /  , 

Mr.  Haber.  I  have  a  rather  lengthy  statement^  which  the  coin- 
/mittee  has,  and  I  dan  submit  that  and  summarize.  '  .„  . 

Chairman  PERidNS.  Without  obje|:tion,  the  statement  will  be  re- 
ceivied  for  the  record.  'n  ,       .         -li.  t 

Mr.  Haber.  Mr,  Chairman  and  members  of  the  subcommittee,  1 
thank  you  foi/the  opportunity  to  appear  before  you  today.  My 
name  is  Jon  Haber  and  1  am  representing  the  United  States  btu- 
dent  Associatftn  (USSA).  I  was  formerly  the  Codjrector  of  the 
University  of  California  Student  Lobby  and  was  the  prmcipal 
drafter  of  the  California  truth-in^sting  legislation.  I  am  accompa- 
nied by  Andre  Burnett,  director  USSA  s  National  Third  Worl4 
Student  Coalition.  We  are  speaking  on  behalf  of  USSA  s  3  million 
student,  membfirs  attending  over  SSLfiolleges  and  universities. 

We  join  many  other  orgamzations  i4  strongly  endorsing  H.K. 
4949— the  Educatipnal  Testing  Act  of  ISTO— including  the  National 
Parent  TeacherTAssociatidn  (PTA),  National  Education  Associ- 
ation (NEA),  NAACP,  National  Public  Interest  Research  Group 
(PIRG),  Coalition  of  Independent  CoUeges  and  University  Students 
<COPUS),  the  Americans  for  Democratic  Action  (ADA),  as  well  as 
many^tatewide  student  associations.  ^ 

The  Educational  Testing  Act  of  1979  is  designed  to  provide  mom 
information  about  standardized  tests  and  promote  a  wider  under- 
stAiding  of  these  te^  amongst  students,  educator||parente,  admw- 
sions  olficiQle,  and  the  public  in  general.  ^        ♦  , 

Equally  importent  is  wl^t  this  act  does  not  do.  It  does  not 
regulate  test  contents  nor  testing  procedures  of  the  testing  compa- 
nies, nor  any  aspeet  of  their  admissions  testing  program.  Neither 
does  it  specify  how  colleges  arid  universiti^  shall  use  standardized 
teste  in  their  admissions  pro-ams.  This  act  is  simply  disclosure 
fegislation-T-no  more  and  ^ 

■  .  ■         ■'       '      '  t'     ■ "   '  ^  ■  '  ■ 


4  would  take  exception  to  the  testimony  Mr.  Ruud,  who 
claimed  that  the  motivation  behkid  this  bill  ii  that  many  people 
want  to  eliminate  standardized  testing.  That  is  not  bur  intention  at 
all.  We  simply  believe  that  tests  measure  a  nart^ow  range  of  chaf-  / 
actenstics  and  are  therefore  subject  to  misuse  aid  misunderstand- 
ing. Thurough  the  information  provide  them  by  H.R.  4949,  students 
and  the  public  y^l  gain  a  better  understanding  of  the  nature, 
purposes,  uses^  and  limitations  pf  atandardized  admissions  tests.  Wer 
also  believe  that  this  act  will  insure  that  tests  are  used  properly— a 
feoal  EaS  and  other  testing  agencies  supportied  before  this  subcom- 
mittee yesterday.  , 
Lastly,  we  have  little  to  say  about  H.R.  3564— Gibbons.  While  w^ 
applaud  the  intent  of  the  le^slation,  if  passed,  it  would  ha^e  nb 
impact  on  the  tests,  and  vyrould  not  improve  or  change  the  amour/t 
of  information  iM^sently  provided  to  students.  It  essentially  codifies 
the  testing  companies'  current  practices. 

Anierican  colleges  and  universities  rely  heavily  on 'standardized 
tests,  often  using  them  as  the  critical  factgr  in  deciding  which 
students  .  to  admit  to  their  undergraduate,  gjjKhiate,  aip 
professionsQ  programs.  ^Although  not  covered  by  this  legislatiJh, 
standardi^  tests  also  play  an  extensive  role  in  determining  which 
students  will  qualify  for  financial  aid,  which  students  will  be 
awarded  advanced  placement  credit,  and  ultimately,  which  stu- 
derits  cm  be  profesijionally  licensed  after  ^  their  college  training. 

I  have"  been  involved  with  the  question  of  standardized  testing 
for  3  years.  I  have  spoken  and  met  with  thousands  of  students 
about  tests  and  at  this  point  will  share  some  of  their  concerns  with 
you.  = 

Students  feel  that  they  are  victims,  not  consumers,  of  standard- 
iMd  tests.  They  have  \  ttie  choice  but  to  take*  the  test— their  college 
or  university  has  made  it  a  mandatory  component  of  the  admis- 
sions process.  ^ 

Preparing  for  and  taking  the  test  is  extremely  stressful.  Not  only 
are  the  teste  taken  during  crucial  periods  in  students'  lives,  but  the 
•teste  are  often  the  critical  factor  in  college  admissions  decisions. 

While  studente  do  not  knovAthe  test's  margin  of  error,  predictive 
value,  or  bias,,  studente  are  well  aware  of  one  fact— their  score  may 
mean  the  differeqge  between  being  accepted  or  rejected  at  most 
colleges.  As  a  result,  many  studente  turn  to  expensive  coaching 
sqhools  or  coaching  books  in  hopes  of  better  test  scores. 

Studente  are  frustrated  at  being  unable  to  see  their  questions 
and  answers.  They  can  never  know  which  questions  they  answered 
correctly,  or  in  which  subjecte  they  n*d  more  work.  Perhaps  they 
misnunv>ered  ^hjg^  answer  sheet  or  the  computer  has  made  an- 
other scoring  Qiror.  # 

Studente  are  ofb^n  resentful  when  they  receive  their  scores.  They 
often  feel  that  the  test  did  not  really  reflect  their  abil|^v.  Many  feel  ^ 
that  essay  teste  would  have  been  fairer  indicators  of  their  talente.  • 

Studente  believe  that  the  teste  are  overpricied.  A  sttxdent  apply- 
ing  to  seven  law  schools  must  ipend  as  much  d$  $35  Simply  to  take 
the  tfst  and  have  his/her  score  and  grades  qjpiled  out.  Additional- 
ly, tms  student  igtnight  pay  as  much  ds  $141ir  in  school  application 
fees,  not  to  mention  the  coste  of  coaching  hd^ks  or  coaching  schools 
to  prepare  for  the  test.         '    .4  ^  «       .  * 
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I  am  not  spewing  of  a  handful  of  students.  Rather,  many  stu- 
dents feel  this.  In  1977-78,  some  1,488,300  students  took  the  Scho- 
lastic Aptitude  Test  and  Achievement  Tests;  166,000  took  the  Grad- 
uate Management  Admission  Test;  314,000  took  the  Graduate  Rec- 
ords Examination;  and  128,000  took  the  Law  School  Adn)isSions 
Test— all  tests  made  by  tTS.  [ETS  1978  Annual  Report]  In  1976-77^ 
923,241  students  took  the  American  College  Testing's  AGT  Assess- 
ment, and  60,000  took  ACT's  Medical  Collfeges  Admissions  Test. 
[ACT:  General  Information,  1977.]  V 

It  is  our  belief  if  students  are  provided  with  the  basic  informa- 
tion required  by  this  act,  these  tests  will  lose  much  of  their  mys- 
tery. Students  will  have  a  better  understanding  of  what  the  tests 
can  and  cannot  predict;  how  their  score  is  determined;  if 
preparatory  cqjiirses  are  a  worthwhile  expense;  and*  whether  testing 
fee  levels  are  proper.  ■      i  ' 

In  addition  to  the  question  of  what  the  individ^ual  student  iskto  be 
told^  there  is  the  larger  question  of  what  the  public  should  be  told 
about  the  limitations  of  standardized  tests,  most  notably  problems 
with  predictability  and  bias. 

>yhen  I  was  working  in  California,  the  University  of  California 
was  trying  to  decide  how  to  solve  a  basic  problem.  The  average 
freshman  could  not  write  as  well  as  the  faculty  s^t  this  time  wanted 
him  or  her  to  write.  That  is  a  very,  very  importaht  concern.^ 

So,  what  happened?  The  president  of  the  Uiiiversity  of  valifo^* , 
:  nia,  David  Saxon,  formed  a  committee  of  distinguished  ifacuMHr 
members  of  the  university  to  look  at  the  problem.  The 'commit^pF 
decided  they  would  use  the  SAT  to  solve  the  Problems.  Th^ir  first 
proposal  would  have  eliminated  one-half  the  /minority  studejnts  at- 
tending the  University  of  California.  There /was  such  an  uproar, 
the  pi;p5ident  sent  the  faculty  back  to  the /drawing  boardt  They 
came  up  with  another  proposal,  the  Saxon  plan,  which  wenti^before 
the  Board  of  Regents.  An  interesting  thing  happened,  peoplfe  start- 
.  ed  asking  questions.  They  said,  you  are  trying  to  improve  writing 
ability  of  the  students.  What  does  the  SAT  have  to  do  ^ith  that? 
We  found  that  the  SAT  could  not  predict  writing<y  ability.  All  it^ 
could  predict  was  word  association,  mathematical  reasoning,  and  so 

on.'  ,  •        1  A. 

So,  we  found  out  that  some  of  the  moc^  knowledgeable  acaden^ 
experts  in  the  area  did  not  completely  knowW  the  limitations  qf^ 
standardized  tests.  It  is  our  hope  that  this  hi\\  will  provide  more 
information  so  this  does  not  occuWagain. 
Ttiere  is  a  real  objection  in  the  lack  of  precisejness  on  the  stand- 

"^aMized  tests.  For  example,  if  a  student  received  a  600  on  his  or  her 
SAT— with  possible  scores  ranging  from  200  to  800  pomts— this 
only  means  that  there  is  a  two-in-three  chance  that  tl^ /stiident's 
"triie-score"— the  score  the  student  would  receive  if  O  external 
factors,  sXch  as  luck.in  guessing,  coul^  be  eliminated-^vould  fall 
somewhere  between  ^70  and  630  points.  One  ETS  booklet  revealed 
that  a  72-ppint  difference  on  the  SAT  niath  section— and  66  points 
on  the  SAT  Verbal  section— is  so  statistically  insignificant  that  it 
cannot  be  taken  seriously.  For  the  LSAT,  a  difference  of  67  points 

^  cannot  be  takerf  seripusR  Yet  67  points  can  be  the  differeAce  of 
pne  student  being  admitt^  or  not  to  most  la\v  schools.^ 


In  addition,  there  is  A  one-ih-three  chance  that  a  student's  Score 
wm  vary  ugto  60  pointi^  over  or  under  his/her  true  score.  There 
\  siso  a  5-percent  chance  that  the  variance  may  be  even  greater  than 
this— ranging  more  than  BO*  points  over  or  under  his/her  true 
a?ore.  That  means  that*  a  student  whose  true  score  is  550,  may 
receive  a  score  over  610  or  under  490.  Since  1.5  million  students 
I    takeHhe  SAT  each  year,  75,000  students  would  fall  into  this 

category.     «        •  '  .     .  , 

"  Most 'important,  thefts  cannot  measure  creativity,  judgment,  ^ 
experience,  or  idealism— charactiBristics  which  should  figure  into  < 
any  school's  admissions  formula.  As  many  colleges  rely  heavily  on  i 
standardized  tfests  to  make  admissions  decisions— to  the  exclusion 
of  all  other  factors,  except  grddes-^these  traits  rarely  enter  admis- 
.  4^ions  decisions.  •  '  ■. 

"Testing  expert  and  mathematician  Benesh  Hoffman,  in  his  book. 
Tyranny  of  Testing,  also  /criticized  th^  limited  value  of  multiple 
\   choice  tests.  HLe  contended  thatethe  multiple  choice  tests,  such  as 
Vthe  SAT,  LSAT,  GRE,  and^GMAT^  "reward  superficiality,  igmte 
*creativityj  and  penalize  the  person  with  a  subtle,  probing  mi^d." 
There  are  other  problems  as  well,  such  as  the  question  of  validity 
of  the  test.  While  the  racial,  sexual,  regional,  and  ethnic  bias  of 
'     these  tests  is  still  jhOTly  debated,  it  is  clear  that  there  is  a  positive 
and.  progressive  association  between  test  scores  and  family  income. 
A  1977  study  by  the  California  Postsecpndary  Education  Commis- 
sion noted  that  "the  average  family  income  for  students  who 
earned  050  or  more  points— out  of  800— on  the  SAT  was  $26,400: 
Students  in  the  lower  range— below  350  or  more  points^-had  a 
Aean  family  income  of  ^14,500."  ^ 

A  1975  UC  berkeley  study  supported  this  conclusion.  Students 
whose  family  income  was  below  $6,000  scored  92  points  lo^^er  than 
a  student  whose  family  income  was  $30,000. 

Even  some  of  the  dat^  of  ACT  suggests  this  is  true.  In  their 
recent  publieatioh.  College  Student  Profiles,  Norms  for  the  ACT 
Assessment— 1978-79-r-edition— ACT  compares  the  test  score  of 
students  from  varying  economic  backgrounds.  g 
The  student  from  the  highest  economic  backgrouiW  will  average 
4 .  7  points  higher— or  20  perCentof  the  scoring  scale— better  than  the 
^  ^student  from  th^o^est  econopiic  background.  o 
The  same  puMlcation  by  ACT  suggests  some  trends  in  regional 
bias.  A  student' from  the  Midwest  will  average  4  points— or  11 
percent^of  the  scoring  scale— better  i^nan  a  student  from  the  South- 
west.  ■  '  '  ■ '  '         ■  ■ ' 

-  I  The  same  publication  also  notes  that  male  students  generally 
•have  higher  scores  on  the  ACT  assessment  than  do  female  stu- 
dents, although  women  generally  do  better  on  the  English  part  of 
'         test.  '       *  . 

We  have  really  tried  veia  hard  to  ^irk  with  the  testing  associ- 
'  ations^Aast  August,  after  the  California  legislation  passed,  a  num- 
ber oTstudent  leaders  met  with  1*ie  College  Board.  We  raised  a  lot 
of  vfery  tough  questions.  We  were  promised  responses;  we  .were 
promised  another  meeting.  We  have  not  seen  those  respon&eS;  we 
have  not  seen  that  meeting,  and  we  have  been  told  therei  is  no 
.    meeting  scheduled.  .,•  • 

/.       .■■  .      •   -I     ■     '.  ■ 
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In  addition,  Joel  PaCkeu,  director  of  the  U)S.  Stodent  Association, 
sent  a  letter  last  December  to  the"  College  BCard  president  request- 
ing that  he  be  able  to  attend  one  meeting  of  the  College  Board  to 
discuss  student  participation.  It  ^  took  3  months  to  get  a  resoonse/ 
and  the  answer  was  no.  The  .letter  ^aAie  from  Robert  Kingston; 
.         president  of  the  College  Board.  Let  me  read  you  part  of  this  letter: 

'       Well,  the.  executive  committee'  has  now  held  its  late  winter  mee^ingt  l  duly 
presented  to  theiti  your  interest;  aYid  they  have,  for  the  present,  decide  that  it 
would  not  be  appropriate  to  invite  "auditors"^generally  during  the  . course  of  their 
business.  I  think  I  have  to  point  out,  Joel,  that. the  trustees  of  an  organization  Ifte  ^ 
the  College  Board— nke  other  boards  of  directors,  perhaps— ^re  routinely  confronted  * 
I  With  extremely  heavy  agendas,  a  great  deal  of  sometimes,  detailed  and:  complex 
1  backup*  material,  and  must  make  decisio'ns  thoughtfully  but  expeditiously.  This  is 
not  a  strange  process,  but  I  think  youlL  agree  that  it's  oh©^ requiring  great  concen-  . 
tration— concentration  of  a  different  kind  from  that  required  in  a  political  farunripr 
a  public  thpatre.  This  particular  sense  of  responsibility^  has  always  led  the  truBtfe^ 

5  to  discQurage  attendance,  by  any  who  are  not  directly  involved  ih  the  specific  items 
immediately  before  them,  although  they  customarily  and  frequently  invite  special 
presentations  from  individuals  profeasiJonally  and  expertly  concerned  with  the  jssues 
which  are  ^fore  them.  Nobody  on  the  executive  coitimittee  has  any  illusions  about 
the*  special  relationship  of  students  to  the  work  of  the  College  Board;  but  in  a  . 
carefully  reasoned  discussjjon  .they  did  conclude*"  that  tl)is  relatiol\ship  would  not 
justify  the  serving  of  a  precedent  fbr  attepdance  during  the  general  cqnduct  of  their  ' 
business.  /  %       .  .  .  , 

■       ■  <.  .    '  ■  ■  ■ 

'  .As  of  this  time,  we  have  observed  rto .meetings.  These  meetings 
'}    ate  secretive  artd  we  have  been  denied  permission  to  attend.. 
.         '"i.  woAiM  now  like  to  discuss  certMn  provisions  of.ffiis  act. 

Section  3,  which  requftes  information  of  test  subjects  and  post- 
secondary  institutions,  is  fairly  important  because-  it  provides  b^ic  ^ 
,;.inforraation  to  teSt  subjects,  because  many  test  subjects  do  not  have 
'      a  clear  iinderstanding  of  what  their  test  scores^ jiiean.    ^  • 
.  0         I  want  to  mention  that  some  of  the  testing 'companies  have  been 
very  responsive  in  this  area.  For  exatnple,  in  the  GRE  booklet,  the 
/  \    College  Bokfd  gives  students  much  9f  the  infosmation  required  in 

V  this  bill,i)ut  this  is  the  first  year  they  have  done  it.  We  think  it  is 

V  as  a  result  of  the  legislation  passed  in  Califoriiia  and  New  York.  , 

V  v We  wonder  that  if  the  threat  of  legislation  disap|fears  will  the 
."••testing  compaijies  revert  to  their  pld  w^s?  *  ,  «^ 

Section  4  of  the  bill,  simply  requires  repor^p  and'.statistical  d^ita  i 
,     .b?  submitted  to  the' Commissioner  of  Education.  The  largest  bodyii  / 
^    /  of  research  done  pn  the  validity  of  tests  is^conducted  by^he.  testing 
;/  companies  themselvejs^  This  research  ^serves  as  a- basis  for  improve- 
•.-^  ment  oi  tests  and  testing  procedure?,  weighting  of  tests,  andfdevel- 
opment  of  new  sei-vices.  K  clearly  is  impOTtarit  that  'independent, 
"v;  ;     research0rs  in  the  field  have  a  chance  tb  look  at  te^      '  - 

n       '  There  Avere  arguments  made  yestei-day  that  niuch  of  this  re- 
A 3j&arch  js  available  to  the  public.  This  is  not  tfue.  I  would  like  to 
list  three  examples  of  rSesearch  cited  in  the  NeW'  York  truth-in- 
testing  hearings  that^ar^ot  ma^e  available: 
/ '  (1)  Statistical  reports  known^vas  t^st  analysis /equating  procedures 

'  (ETS  refused  to*  disclose  ^uch  data  to  a  researcher  who  gjugges^l^d  , 
that  ETS  mad^  a  seripus  mistake  in  ^equating  the  Multi-State  Bar  ^^^ 
.  •    Examination);^  ■    /  *  \.  "         '      \4  , 

(2)  A  majot  ETS  study  oii  ''Cultural  Bias  in  Testing;  Challerijg^e 
'i*-  and  Response^- ;    ^  '     ^     7  * 

i3)  A  schools'  use  oWhe  LSAT.  '  ' 

'  Sfectioflb  Fequires  release  of  test  questlbtis  and  ^risweri^. 
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ThiJ  section  of  the  bill  is  important  for  a  number  of  reasons. 
First;  a  baafc  tenet  of  fairness  dictates  that  people  have  the  right  to 
review  the  criteria  used  to  evaluate  their  ability.  Presently,  how- 
ever, students— who  must  take^hese  teste  in  order  to  be  admitted 
to  postsecondary  educational  institutions— cannot  see  copies  of  the. 
test  questions  or  their  owi>  answers  even  after  the  test  is  given. 

Second,  standardized  admissions  teste  are  mcgor  instrumente  of 
public  policy  as  they  influence  decisions  about  who  is  admitted  to 
undergraduate,  graduate,  and  professional  schools.  It  is  essential 
that  such  instrumente  of  public  policy  be  available  for  public  dis- 
cussion and  review. 
Third,  public  access  to  test  contente  is  essential  so  that  independ- 
researchers  can  evaluate  th0  teste:  Independent  review  should 
welcomed  as  a  way  to  improve 
archers  are  occasionally  granted 
y  difficult  to  obtain  this  privilei 
anting  access  "are  that  the^'r^ 


ality  of  tests.  While  re- 
test  contente  now,  it  is^^ 
rmore,  the  conditions 
[  his  research  not  be 
lide  the  testing  indus- 


expensive  coaching 


puDlished  nor  discussed  with  coUeai 

^olrth,  studente  who  can  affbirA  ^o 

already  havei  access,  to  t^st  questions.  These  schools  system- 
nd  staffers  in  to  take  teste  and  memorize  the  questions 
in  the  course.  Numerous  studies  have  been  cited  that 
at  coaching  can  improve  a  test  taker's  score.  Granting 
access  to  past  test  contente  would. eliminate  part  of 


schoo. 
aticall: 
for  re 
indicate 
all  studei 


this  severe  Economic  discrimination. 

Fifth,  conlrary  to  claims  made  by  the  testing  agencies  yesterday, 
release  of  questions  will  not  cause  problems  with  equating,  the 
process  that  liiakqjs  test  scores  comparable.  This  is  because  the  bill 
allows  the  testing  agencies  to  keep  secret  questions  used  for 
equating.  * 

Sixth;  contrary  to  testing  company  claims  made  at  the  New  York 
truth-in-testing  headings,  release  of  test  questions  and  answers  will 
not  result  in  a  large  increase  in  test  taker  fees.  The  cost  of  writing 
new  questions  would  be  minim^  according  to*ETS'  intiernal  cost 
^studies,  • 

Seventh,  contrary  to.  claims  made  by  testing^gencies  at  yester- 
day's hearings,  disclosure  of  test  questions  and  answers  will  not 
result  ifi  reduction  in  the  quality  of  the  tested  Test  questions  and 
answers  will  soon  be  available  through  legislation  passed  in  New 
York  aiia  California.  In  addition,  this  act  will  improve  the  quality 
of  questions  writing  by  subjecting  the  process  to  the  scrutiny  of 
interested  subject  matter  experte,  educators,  and  the  Jiblic. 

In  one  case  where  questions  of  a  secure  ETS  test  were  disclose 
for  public  scrutiny— the  February  1973  multiple-choice  Multista 
Bar  Examination— law  professora  at  the  Georgetown  Law  Center' 
and  other  Washington,  D.G.,  law  schools  disagreed  on  the  correct 
answers  to  2^  percent  of  the  questions.  Following  this  disclosure, 
ETS  and  iW  client  conceded  that  five  of  the  quCltions  seemed  to 
have  more  than  one  correct  answer.  JNo  teste,  are  kpown  to  haife 
been  disclbsed  since.  ,  .  • 

Last,  contrary  to  the  daims  made  by  the  testing  agencies  at 
yesterday's  hearings,  test  makers  will  not  run  out  of  new  questions 
to^k.  This  claim 'is  inconsistent  with  the  *  facte"  of  current  ^ETS 
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question-#riting  procedures  as  described  in  the  internal  ETS  "Mail* 
ual  oif  Ittformatj^n  ibr  .Test  Development  Professional  Staff."  Tq^ 
illustrateithid  the  Mcmiial  uses  this  example  of  the  January  and 
May^  lOTLtf'hy  Test.  Qn  each  version  of  the  phys- 

ics test,  ID  questions  v|pre  drawn  from  the  old  item  files  and  39 
questions  were  newly  written  by  the  physics  committee  of  examin- 
ers and  ETS  st^tff.  The  committee  met  twice  and  wad  budgeted  to 
produce  40p  new  questional;  only  56  were  actually  needed  for  each 
test./'tTie  manual  notes  that  surplus  questions  are  produced  as  a 
matter  of  procedure:  "The  number  of  items  pretested  may  exceed 
the  ilumber  of  usable  items  by  as  little  as  25  percent  or  30  percent 
^or  bj  as  much  as  300  percent  or  400  percent.  In  the  absence  of 
^appropriate  rules  pf  thumb,  one  should  plan  to  pretest  about  twice 
^  as  many  items  as  will  be  needed."  Since.most  questions  are  already 
being  written  anew  anyway  with  no  sign  of  exhaustion  in  sight,  the 
surplus  questions  will  provide  a  cushion.  Those  found  to  be  satisfac- 
tory are  already  stored  for  future  use.  So,  it  is  our  feeling  therp 
will  be  more  than  enough  test  questions  and  answers  to  ask.  f 

The  last  section  of  the  bill,  section  7,  is  an  important  section  as  * 
well.  Siniiply,  this  sectionNrequires  testing  agencies  to  file  ^imited 
amounts  of  financial  information  with  the  Commissioner.  It  re- 
quires far  less  information  jthan  does  the  California  truth-iiiTtesting 
legislation.  This  section  is  still  necessary  because  it  will  provide 
nationwide  information,  while  California  law  only  applies  to  that| 
State.  -         -  o-  ^         «  ' 

Limited  release  of  income  and  expenditures  will  enable  the  pub- 
lic to  better  understand  the  procedures^  development,  and  adminis- 
tration of  standardized  tests.  As  I  mentioned  earlier,  students  must 
take  One  or  more  standardized  tests  made  by  one  of  two  monopolis- 
tic testing  companies  to  be  admitted  to  many  colleges.  They  have 
no  choice  as  to  which  test  they  mav  take  and  are  not  able  to  shop 
around  for  the  best  price.  Thus  students  are  captive  consumers  of 
the  testhig  comi^anies  and  provide  much  of  the  companies'  income. 
Arid  sinpe  two  companies  make  nearly  all  the  tests  covered  under 
tMs  bill,  each  has  little  incentive  financially  to  compete  with  the 
o^er.  Questions  have  been  raised  to  tbo  large  amount  of  profit; 
that  is  revenue  over  expenses  pf  these  companies  as  well  as  some  of 
tne  expenditures  made  from  student  fees — such  as  the  luxuridus 
400racre  ETS  campus  at  Princeton,  N.J.  ,  ' ' 

Ih*  addition,  these  tests  are  used  to  allocate  a  limited  public 
good— education---Which  makes  the  test's  manufacturers  compara- 
ble to  public  dtilities.  This  increases  the  public's  right  to  know 
more  about  the  operations  and  test  development  procedures  of  the 
limited  number  of  testing  co||lpd!||ifes.  Testing  companies  are  like 
public  utilitiep.  It  is  iroi;|ic  that  we  spend  a  lot  of  time  fe^lating 
the  cost  of  electricity,  bu|  we  have  yet  to  insure  in  mcSt  ietreas  that 
adequate  information  is  provided  to  test  subjects  who  must  Jake 
these  standardized  tests  in  ordef  to  go  to  colleges  and  universities. 

Mr.  Weiss  [presiding].  Dr.  TLennon,  )jpu  jare  our  next  ^vitness. 

[The  prepared  statement  of  Ro^er  Lennon  follows:]  • 
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STATEMENT  OF  ROGER  T/lENNON,  ASSISTANT  TO  THE  CHA^^^ 
^  V      MAN   IN  MEASURE1M[ENT,  HARCOURT  '  BRAJpE  JOVANOVICH, 
•   INC.  '  ■     '  \  ■  • 

'       Dr.  LennOn.  Thank  you,  Mr.  Chairman,  committee  members.  % 

I  shall  read  an-;  abbreviated  version  of  it  and  I  request  the  entire 
:   document  be  piit  into  the  record. 

Mr.  Weiss.  Without  objection.  .    ^  ■  . 

Dr.  Lennon.  My  name  is  Roger  Lennon  and  I  appear  here  as 
.  repre|pntative  of  the  publishihg  firm,  Harcourt  Brace  Jovanpvich, 
Inc.,  where  I  am  employed  as  associate  to  the  chairman,  for  testing 
and  measurement  matters.  Harcourt  Brace  Jovanovich,  through  its 
subsidiary,  the  Psychological  Corporation,  is,  we  believe,  the  largest 
'        of  the  commercial  test  publishers,  A  test  publisher  since  1918,  it 
proffers  a  comprehensive  8|t  of  more  than  100  tests » of  achieve- 
,      ment,  abilitv,  aptitude,  interests,  personality,  and  other  attributes. 
Its  test  publishing  interests  are  preponderantly  in  elementi^ry:  and 
•    secondary  schools,  but  it  also  serves  private  practitioners,  industrir 
al  and  commercial  organizations,  postsecondary  institutions,  profes- 
sional organizations,  hospitals,  ciiriicsT— in  short,  all  types  of  test 
'UserSi 

The  Psychological  Corp.,  founded  in  1921  by  a  group  of  profes- 
sional psychologists,  engages  in  the  .conduct  of  testing  programs  for 
admission  to  postsecondary  institutions  and  occupation^  such  as 
those  addressed  by  the  legislation  here  under  consideration— such 
institutions,  for  example,  as  schools  of  pharmacy,  nursing,  optom- 
etry, veterinary  medicine,  and  other  health  professions.  It  offers 
the  Miller  analogies  test  program,  used  as  a  basis  for  admilBion  to 
some  graduate  school  curricula.  The  corporation  al^o  offers  testing 
^programs  for  licensing,  certification,  and  counseling  for  such  di- 
verse^groups  as  joc(lupational  therapists,  cosmetologists,  operating 
'  room  technicians,  neurosurgical  nufses,  personnel  and  industrial 
relations  professionals,  computer  professionals,  marketing  commu- 
nicatm-s,  et  cetera.  These  latter  programs,  or  some  of  them,  probr 
ably  come  within  the  purview  of  the  Gibbons  bill,  though  not  of  the 
Weiss  bill. 

From  1948  until  last4year  1.  was  responsible  for  all  of  the  Har- 
court Brace  Jovanovich  test  publishing  j^ctivity,  p?idi  from  1970  for 
all  the  test  publishing  activity  of  the  Psychological  Corporation.  I 
am  president-elect  of  the, National  Council  on  Measurement  in, 
Educffeion,  the  professional  organization  of  persons  concerned  with 
test  devdopment  and  use,  though  I  am  not  appearing  here  as 
?represenfetive  of  that  body  or  of  any  organization  other  than  Har- 
court Brace  Jovanovich.  It  is  my  understanding  that  the  Asisoci- 
atioh  of  American  Publishers,  representing,  most  qf  the  commercial 
test  publishers  though  Hot  Harcourt  Brace  Jovanovich,  is  submit- 
ting a  statement  to  this  committee  on  the  legislation  under  diseus- 
sion.  V 
%  We  welcome  the  opportunity  to  appear  before  this  committee  and 

to  shar^  with  the  committee  our  views  on  l!he  proposed  testing 
legisTfij,tion.  We  endorse  the  purposes  which  the  Gibbons  and  the 
:  Weiss  bills  seek  to  achieve:  that  persons  required  to  take  examina- 
tions  as  a  condition  for  entry  into  postsecondary  institutions  or  \ 
oc^Aipations  be  fully  informed  about  the  nature  of  the  examinations 
and  their  use;  that  the  .public  have  access  to  appropriate  informal 
■  ■•  •  '      .         '■    •  /  •  .  ■  ■■ 
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Hon  ^ifegarding  the  development  and  uses  of  siich  tests;  and  that 
tests  ^e  used  in  a  mariner  that  insures  fair  treatment  and  equal 
rigjfhts  for  all  examinees.  We  have  sought  in  the  condilft  of  the 
testing  programs  for  which  we  are  responsible  to  achieve  these 
purposes?  T  append  to  this  statement  information  booklets  for  sever- 
al of  the  programs  which  Wfe  conduct,  typical  of  those  placed  in  the 
hands  of  subjects  in  all  such  programs,  in  aid  of  these  purposes.' 
[Booklets  retained  in  subcommittee  files.]  ; 

Dr.  Lennon.  At  the  same  time  wa  question  (1)  whether  there  has 
been  a  substantial  showing  of  need  for  legisl?ition  of  this  kind;  (2) 
whether  the  controls  and  refinements  of  practice  sought  by  the 
bills  are  riot  better  handled  through  the  appropriate  professional 
organizations,  such  as  American  Psychological  Association,  Ameri- 
can Educational  Research  Association,  and  National  Council  on 
Measurement  in  Education  which  have,  in  fact,  addressed  them- 
selves, through  the  developn^ent  of  test  standards,  to  many  of  the 
issues  of  test  information  that  these  proposed  bills  look  to;  (3) 
whether,  irt  fact,  the  bills  here  under  consideration  will  achieve  the 
heightened  level  of  knowledge  and  understanding  on  the  part  of 
examinees  and  the  general  public  that  are  intended;  and,  finally, 
(4)  whether  tile  Specific  provisions  of  the  bills  are  workable  and 
cc^uld  be  complied  with  by  testing  agencies  without  inordinate  addi- 
tions to  their  costs  ahd  thus  the  qharges  to  examinees. 

Turning  first  to  H.R.  3564,  the  Gibbons  Truth  in  Testing  Act  of 
1979,  we  respectfully  invite  the  committee's  attention  to  the  Tollow- 
.  ing  points:  . 

Section  6(a).  Here,  as  elsewhere,  questions  arise  as  to  the  locus  of 
responsibility  for  compliance.  In  admissions  testing  programs,  a 
variety  of  arrangements  may  prevail- among  testmaking  agencies, 
receiving  institutions,  sponsoring  organizations  and  others,  with 
varied  divisions  of  responsibility  for  program  elements  among 
them.  These  variances  in  arrangements  and  thus  compliance  re- 
sponsibility, jShould  be  addressed  in  the  bills. 

Section  6(aX3>  'It  is  ndt  always  possible,  prior  to  testing  or  at  the 
time  of  administration,  to  provide  experimentally  obtained  infor- 
mation on  the  reliabiity  of  a  test,  particularly  if  it  is  required  that 
new  tests  be  created  for  each  test  adniinistratien.  It  is  not  inappro- 
priate to  ask  that  information  on  reliability  be  provided  withirua 
—reasonable  time  after  the  administration  of  ^e  test. 

Sectionr6(a)(5).  Jt  is  not_clear  what  is  intended  by  the  phrase 
''related  facts."    '  ^  _  _ 

Section  £(bX2).  This  provision  s6ems  to  require  aTrint^retation 
of  an  individual's  performance  aa  compared  with  the  performance 
•  of  other  examinees;  Jkhis  is  the  on^y  meaning  thiit  we  can  attach  to 
'''ranked."  find  vxis  requiremerltsinconsistent  with  that  of  sec- 
tion  6(c),  which  prescribes  grading  of  tests  bf  knowledge  or  achieve- 
ment on  the  basis  of  the  relative  distribution  of  scores  of  examin- 
ees.      '  ^ 

Section  6(b)(3>.  This  calls  for  reporting  of  cutoff  scores  for  admis- 
sion to  institutions  of  fiigher  education  or  occupations.  Not  only  are 
these  generally  unknown  to^the  testmaking. agency  but,  in  many 
cases,  the  Use  of  cutoff  scores  is  discouraged  as  conducive  toward  a 
*  mechanical  way  of  utilizing  the  test  iriforniation,  .possibly  to  the 
V  minimization  of  use  of  other  admissions  criteria. 
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Section  6(c).  In  calling  for,  different  modes  of  grading  tests  of 
knowledge  Or  achievement  and  tests  of  aptitude,  this  section  im- 
plies a  distinction  in  the  drafter's  mind  between  these  types  of  tests 
that  is  haijfd  to  reconcile  with  the  treatment  of  these  terms  in  the 
'professional  li^rature. 

Given  appropriate  handling  of  drafting  infelicities  such  as  those  ^ 
mentioned  abovis,  we  would  ri6t"nrid  compliance  viatli"H.Rv^5^64^^t^ 
require  great  departure  from  our  current  practice.  Nevertheless, 
we  advise  against  its  enactment.  Compliance  would  entail  additions 
to  our  costs  which  would,  of  course,  be  reflected  in  the  costs  ulti- 
mately borne  by  examinees.  We  do  not  believe  that  the  interests  of 
examinees,  or  of  the  public  generally,  would  be  appreciably  served 
should  this  legislation  be  enacted.  We  urge  the  conimittee  to  evalu* 
ate  carefully  the  evidence  of  the  extent  and  seriousness  of  the 
needs  supposedly  being,  addressed  by  this  bill,  as  well  as  Weiss. 
^  We  respectfully  raise  one additional  point  in  connection  with 
H.R.  3564,  namely,  its  proposed  title,  the  Truth  in  Testing  Act  of 
1979.  This  title  seems  to  us  a  too  facile  borrowing  from  truth-in- 
advertising,  truth-in-packaging,  et  cetera,  legislation,  clearly,  and 
perhaps  intentionally,  implies  that  heretofore  there  has  been  an 
absence  of  truth,,  or  perhaps  untruth,*^ in  representations  about 
admissions  tests.  iThis  is  an  implication  to  which  our^organization 
takes  vigorous  exception.  We  have  been  governed  in/our  test  pub^ 
lishing  practices  of  the  standards  of  test  description  and  reporting 
enunciated  by  the  professional  groups  I  mentioned  abqve.  It  would 
seem  to  us  that  a  less  prejudicial  and  pejorative  title  for  the  bill  is 
in  order. 

Let  me  now  turn  to  the  WeisB  bill,  the  Educational  Testing  Act 
of  1979.  This  ,  bill  has  many  of  the  same  purposes  as  the  Gibbons 
bill:  examinees  should  be  fully  informed  about  the  content  of  ad- 
missions tests,  the  public  should  have  access  to  information  ^bout 
the*  tests,  and  there  should  be  assurance  that  all  examinees  are 
treated  with  equal.  fairnesS— worthy  goals,  alU  In  seeking  to 
achieve  these  goals,  however,  the.  Weiss  bill  g6e§  far  beyond  the 
Gibbons  bill  in  its  disclosure  requirements  and,  in  our  opinion, 
imposes  such  heaVy  burdens  on  test-njaking  agencies  as  ultimately 
to  be  counterproductive:  ^the- v61un)€|  of  information  to  be.  iAade 
available  to  examinees  and  others  ana  the  costs  of  providing  it  are, 
in  our  oj)inion,  disproportionate  to  any  manifest  need  or  likq(ly 
beneflt.  .    .  * 

In  particular,  we  invite  the  attention  of  the  c<!taimittee  to  the 
following  provisions  of  the  proposed  bill  as  matters  of ^  concern: 

Section  3(aX3)  calls  for  inrormation  on  the  correlj^ition  between  . 
test  scores  and^cai^eer  success.  Such  information  is  almost  never 
available,  in  large  part  owing  to  the  extreine  difficulty  of  defining 
and  measuring  cdveer  success.  Moreover,  most  tests  Used  fpr  admis- 
sions purposes  purport  only  to  predict  success  in  training  programs 
or,  wherQ  used  for  certification  and  lipensure  purposes,  to  measure 
only  the  kfijwledge  requirement  and  ndne  of  the  other  attributes 
that  ma^e  for  Career  success.  Incidentally,  the  stipulation;  that"  /. 
correlations  he  reported' is  hprd*  to  reconcile  with  the  provision— 
sectioil  3(a)— that  information  be  provided  in  easily  ur^derstahdable, 
language;  very  few  candidates  would  understand  the  significance  of 
correlations  of  the  typfe  called  for.  .    -   ^   '.    ■  * 
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Section  3(aX4XAX  The  type  0/ reporting  called  for,  nam^y,  the 
extent  to  which  test  scores  improvjB  prediction  Of  grade  point  aver- 
age, expressed  as  a  percentage,  is  k  virtually  meaningless  statistifc, 
•as  well  as  one  that' would  be  scarcely  comprehensible  to  most 
candidates.  -  , 

„„  Section  3(aX4)(B).  This  calte  for  a  comparison  of  test  perfbrfnance  ^ 
by  major  income  groups.  Most  pr(|grams  do  not  solicit  information 
about  income  from  candidates,  and  such  inquiry  would  be  distaste- 
ful to  many  examinees;. but,  even  if  there  were  dependable  infor- 
mation on  the  incon^e^of  examineeis  or  their  fan)ilies,  comparisctns 
of  test  performance  by  income  groups  is  likely  to /give,  rise  to  far 
more  misunderstanding  than  clarification  of  the  appropriateness  of 
tests.  /-  ^  V  \  ^ 

Section  3(aX4)(C)  calls  for  ihforihation  on  thd  extent  to  which  test 
preparation  courses  improve  exam^inefeS^  scores  on  the  average, 
again  expressed  as  a  percentage.  Sa6h  information  will  rarely  be 
available;  witness  the  difficulty  the  Federal  Trade  Commission -had 
in  locating  data  on  the  effectiveness  of  SAT  coaching  programs. 
Again,  the  stipulated  reporting  mode— percentage  improvement— is 
statistically  inappropriate.  , 

Section  3(aX5)  calls  for  information  oh  the  manner  in  which  test 
scores  will  be  used,  alone  or  with  other  information,  to  predict 
future  academic  performance.  In  many  cases  the  test  agency  has 
jio  way  of  knowing  how  receiving  institutions  ^use  test  scores,  wTiiat 
weight  they  are  assigned  in  the  institution's  decisionmaking  proc- 
ess,, what  other  variables  are  combined  with  them  in  making  ad- 
inission  decisions,  et  cetera. 

In  a,  word  we  believe  that  many  of  the  reporting  requirements 
with  respect  to  information  to  be  provided  to  examinees  prior  to 
test  taking  are  unrealistic  and  impractical.  While  coiiftpletely  sym-.' 
pathetic  to  the  desire  that  candidates  have  a  better  understanding 
of  thie  nature  of  the  tests  they  take,  we  do  not  believe  that  such 
understanding  would  be  greatly  advanced  for  most  candidates  by 
the  information  called  for,  even  if  it  could  be  accumulated. 

more  serious,  however,  and  pote|itially  more  hurtful,  is  the 
requirement  in  section  5  that  copies  of  the  tests  themselves  be 
released*  ijoth  for  ir^spection  by  any  candidate  so  desiring,  and  foi: 
deposit  with  educational  agencies.  The  destruction  of  security  of. a 
test^  consequent  upon  making  it  available  to  all  examinees,  greatly 
complicated  the  task  of  providing  an  instrument  at  the  time  9f  each 
testing  that  will  be  equally  Jair  to.  all  candidates,  in  the  sense  of 
equally  familiar  or  unfamiliar  to  all  candidates.  We  do  not  advance 
sheer»  increase  in  difficulty  and  expense  to  testmaking  agencies  as 
per  se  basis  for  nonenactment.  We  do,  however,  urge  the  committee 
to  £^ttend  most  •seriously  to  the  effects  on  costs  to  examinees  and 
^  avQjilability  of  examining  services  of  the  required  compliance,  and 
to  balaAce  the  putative  benefits  to  some— and  probably  few— candi- 
dates against  ah  ii^crea^  in  costs  to  all. 

We  urge  the  comTTTitteeHo  consider  whether  there  may  not  be 
ways  of  achieving- the  goals  of  these  bills  to  a  reason^lp  d^lfree 
without  the  kind  of  total,  promiscuous  disclosure  of  tfie  tests' them: 
selves  here  contemplited.  * 
;  For  example^  could  there  hot  be  created  in  the  Office  /of  the 
Comihipsioner  of  Education  ^  test-monitoring  agency  with  which 
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copies  WQuld  be  filed,  which  w^uW  arrange  upon  request  of  elxMn- 
inees  for  {un.-'impartial  review  ancbanalysis  of  any  test,  but  under 
conditions  that  s^eguird  the  security 'of  the  test  itself?  „ 

Similarly^  would  it  not  be  fairly  easy  to  provide  for  a  mechanism 
that  would  msure  independent  cheating  on  the  accuracy  of  scoring 
of  a  candidate's*  test  short' of  making  the  test  questions  and,  answer 
key  available  to  all  upon  request?  ' 

We  are  aware  of  and  sympathetic  to  legitimate  consumer  con- 
cerns in  this  context.  Tests  are  important  for  adinission  to  institu- 
tions of  higher,  education,  and  thus  potentially  of  crucial  signifi- 
cance to  an  individual's  career;  and  that  an  individual  may  feel 
entitled  to  see  the  test  questions,  study  theli  at  leisure,  find  out 
where  he  made  mistakes,' arid  so  on,  is  eminently  understandable. 

Yet  it  is  true  that  with  respect  to  the  programs  that  we  have 
conducted  over  many  years,  reaching  thousands  upon  thousands  of 
examinees,  there  have  been  very,  very  few  requests  from  examin- " 
ees  that  they  bfe;jermitted  to  examine  copies  of  their  test  booklets, 
and  it  is  hard  for  us  to  see  how  their  fortunes  have  been  hampered 
by  virtue  of  their  not  having  had  access  to  the  tests. 

We  judge  that  candidates  in  these  admission  testing  programs 
understand  the  advantages  of  test  security,  which  is  the  only  way  ^ 
of  insuring  that  no  candidate  have  the  advantage  of  familiarity ' 
with  some  or  all  of  the  test  conteiA.  To  maintain  test  security  in 
the  face  of  the  disclosure  provisions  of  the  Weiss  bill  would  create 
substantial  and  unmistakable  added  costs  for  the  testmaking  agen- 
cyand  thus  tht examinee,  for  dubious  benefits. 

Equally  ill  advised,  in  our  opinion,  are  the  provisions  of  section  7 
with  respect  to  the  reporting  of  financial  information  ^nd  volume 
of  activity  for  all  admissions  testing  programs,  purportedly  to  en- 
sure that  tests  are  being  offered  at  a  reasonable  cost  to  test  sub- 
jects." 

In  our  system  of  government,  the  Federal  or  State  Governments 
should  nevet  become  involved  in  determining  competitive  prices 
except  in  those  instances  where  there  is  a  nationwide  consensus  to 
combat  inflation,  t3b  penalize^  acts  of  monopoly  or  price  fixing  that 
are  contrary  to  law,  to  meet  a  national  emergency  that  applies  to 
all  mdustry,  and  to  regulate  those  industries  which  use  public 
proplrty  such  as  roads,  tracks,  and  so  on.  ,  v 

The|e  has  been  no  showing,  as  far  as  we  are  aware,  that  charges 
to  exaAlneis  have  been  unfair.  Tests  making  and  test  publishing  is 
a  rela^ely,  small  business  in  tetal.  In  our  judgment,  the  price  Of 
''tests  anq  answer  sheets  and  scoring  cannot  ie  reduced  by  means  (of 
Federal  State  ej^ination  of  publishers^  financial  records  arid 
^monitprbffi      thei^  compliance  with  the  provisions  of  either  of 

^^S^SiJ^dld,  s^wild:  such  procedures  be  undertaken,  publishers 
will  ■  emptojnkfewer  peoplfe,  government  will  spend  considerable 
jnonejC  ani  testing  will  not  be  for^  the  consumer  a  single  dollar 
cheaper,  if  one  considers  that  t^t  makers  and  test  takers  are  twth 
taxpayersHwhereas,  examinees  could  be  severely  handicapped  if 
publishers  find  that  test  publishing  is  too  expensive  to  continue 
under  the  proposed  procedures.  ,  .  . 

In  a  wordj^e  test  and  financial  disclosure  provisions  seem  to  us 
discriminS^ry,  possibly  iUegc^,  an4  certainly  unworkable.  ^ 


For  the  reasons  enumerated,  Harcourt  Brace  Jovanovich  strong- 
ly urgiBs  tha^^  the  two  bills  here  considered  not  be  approved  by  this 
comipittee,  •  ^ 

As  an  organization  with  ^^proprietory  interests"  in  admission 
programs,  we  see  threat  to  those  interests  in  the  Gibbon's  bill,  and 
serious  harm  in  the  Weiss-  bill.  .        •    '  •  

Please  let  me  reiterate  that  even  if  what  is  proposed  in  these 
bills  proves  to  be  constitutionally  correct  and  popularly  sought,  we 
believe  that  it  may  be  impossible  for  us.  as  a  major  test  publisher  to 
conduct  our  business  under  the  constraints  and  costs  imposed.  This 
is  not  an  idle  threat. 

Rather  than  break  the  law>  should  one  or  both  of  these  bills  be 
passed^  it  is  possible  that  we  would  gradually  withdraw  frorti  a 
business  in  which  we  have  invested  more  than  $40  million  over  a 
period  of  six  decades  and  at  present  maintain  with  a  staff  of  more 
than  23  Ph.  D's  and  209  other  employees  which  we  believe  would 
hot  be  in  the  interest  of  candidates  in  the  sehse  of  reducing  the 
available  supply  of  purveyors  of  materials  and  services  ibr  such 
programs. 

I  thank  you,  Mr.  Chairman  and  conmiittee  members. 

Mr.  We|ps.  Thank  you  very  much.  Dr.  Lennon. 

I  am  going  to  ask  two' questions  which  relate  to  drafting,  and  let 
Mr.  Goodling  ask  questions  of  the  panel. 

Mr.  Ruiid,  I  have  tried  to  confirm  the  area  of  concern  that  you 
had  expressed  about  some  of  the  drafting,  in  regard  to  the  avail- 
ability or  the  return  to.  a  test  taker  of  copies  of  the  tests  and  the 
answers. 

IdaOk  on  page  7  of  the  bill.  It  is  possible  that  they  had  not  used 
the  word  "copy"  but  the  final  draft  does.  That  has  been  corrected 
and.  Dr.  Lennon,  with  regard  to  section  3(A)(5)  where  you  express 
some  concern  about  calling  for  information  on  the  manner  in 
which  test  scores  will  be  used  alone, -or  where  other  information  to 
predict  future  academic  performance,  and  you  say  in  many  cases 
the  test  agency  has  no  way  of  knowing  how  the  teceiving  institu- 
tions use  the  test  scores. 

In  3(a)(5)  there  is  a  provision  which  says: 

"And  the  manner,  i?  any,  the  test  agenc^^  will  use  the  test 
scores";  so  I  think  that" that  concern  probably  has  been  anticipated 
and  responded  to.      >  " 

Mr.  Goodling? 

Mr.  Goodling.  There  are  so  many  people  and  iso  many  questions 
to  be  asked,^and  I  am  8  minutes  late  for  the  next  meieting. 

Mr.  Weiss.  Feel  free;  take  as  much  time  as  you  like. 

Mr.  Gt)ODLiNG.  I  could  hear  you  while  I  was  on  the  telephone  out 
4n  the  lobby.  v  -  * 

I  could  hear  most  (n^our  testimony  loud  and  clear,  so  I  am 
aware  of  what  you  were  saying.  In  adc^ltion  I  have  read  a  great- 
deal  of  the,  testimony.  * 

First  of  all,  Mr.  Herndon,  contrary  to  your  expeditious  hopes,  I 
would  hope  that  we  go. slowly  in  this  whole  business  of^passing  this 
legislation,  either  p^ieces  of  legislation,  We  have  great  opportunity 
now  to  See  what  happens  iri  New  York.  They  don't  know  whether 
the}!!  have  created  a  monster  or  Something  go&d  and  holy,  and  we 
can  sit  backiind  wait  and  benefit/ from  their  mistakes. 
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Also,  I  think  National  Science  Academy,  and  other  organizations 
are  currently  looking  into  this  whole  testing  area.  But,  let  me  ask 
you  a  couple  ot  questions.         /'  ~  ^ 

I  notice  that  you  supported,  and  I  am  sorry  to  notice  that  you 
and  AFP  appear  to  be  together  oti  these  particular  issues,  you  are 
supporting  this  legislation.  As  I  understand  it  you  have  a  real 
opposition  to  standardized  testing,  period. 

Am  I  not  correct  in  saying  that?  '•^ 

Did  you  not  take  such  a  stand?  * 
f    Mr.  Herndon.  The  NEA  cabled  for  a  moratorium  on  the  use  of 
standardized  tests  that  many  of  the  kinds  of  questions  that  were 
addressed  in  this  legislation  were  answered. 

We  have  opposed  many  contemporiuy  uses  of  normal  reference 
standardized  |!ests,  but  not  the  whole  concept/ of  standardized  tests. 

Mr.  GooDUNG.  Knowing  that  teachers  feel  very  threatened  with 
standardized  tests,  I  read  somewhere  you  were  in  a  different  posi- 
tion. 

Mr.  Herndon.  Our  position  has  been  pushed  and  distorted  to 
extremities  by  a  number  of  people  that  would  like  to  make  it  look 
extremely  absurd. 

Mr.  GooDUNG.  Do  you  believe  all  standardized  teste  should  be 
graded  and  returned  to  the  test  taker.  This  is  contrary  to  many 
teachers  that  I  worked  with  who  didn't  return  tests  or  who  re- 
turned them  and  allowed  students  to  look  at  them  ia  second  or  two 
and  then  they.took  them  back  for  some  reason  or  another. 

Do  you  believe  all  standardized  tests  should  be  returned  to  the^ 
taker?       /  ^  - 

Mr.  Herndon.  That  answer  has  to  be  a  function  of  the  Use  of  the 
test,  what  it  was  intended  to  do,  and  thfe  decisions  that  are  going  to 
relate  to  the  scores.  ^ 

Mr.  GobDLiNG?  Much  of  what  I  have  heard  in  relationship  to  the 
legislatidn  is  to  do  that  kind  of  thing.  , 

Mr..  Herndon.  I  believe  in  regards  to  the  use.  of  the  SAT  for 
college  admissions  or  the  use  of  the  LSTA  for  law  school  admission, 
the  use  of  the  graduate  record  exam  for  graduate  school,  the  use  of 
many  of  these  examinations  for  entry  into  professional  schools, 
that  that  is  a  very  reasonable  provision,  that  it  ought  to  be  done. 

Mr.  GooDLiNG.  Do  you  beUeve  that  this  is  the  sole  way  of  getting 
into  schojols;  et  cetera,  in  most  instances? 

Mr.  Herndon.  I  cannot  answer  for  most  instances.  There  aae  a 
number  of  institutions  where  we  believe  the  scholastic  aptitude  test 
is  almost  the  sole  determinant  of  adniission, 

Mr.  GooDUNG.  End  of  commerit?^  /■ 

Mr.  Herndon.  Yes,  sir.   r  . 

Mr^  GOODLING.  I  can  only  say  it's  contrary  to  my  experience,  so  it 
must  have  Ranged  considerably  in  the  last  5  years,  l^cause  it 
certainly*  was  contrary  to  my  20-some"  years  experience  prior  to 
that.  .  • 

Let  me  ask  you  one  or  two  other  ^questions.  /       '  .  , 

Yesterday  I  tried  on  numerousi  occasions  to  find  put,  and  I  didn't 
get  an  answer  to  my  questions,  whether  these  two  pieces  of  legisla- 
tion we  are  talking  about  at  the  presi^time  will  in  aSny  way  help  y 
the  youngster  from  the  low-income  family;  ttie  ijiinority  youngster 
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who  we  are  told  from^time  to  time^  and  I  Rave  documented  that  in 
many  instances  does  more  poorly  in  these  types  of  examinations. 

Do  you  see  anything  in  these  two  pieces  of  legislation  which  is  in 
soma  way  gbihg^to  help  those  youngsters?  y 
.   Mr,  Herndoi^.  I  think  there  is  a  potential  for  helR  Whether  the 
help  will  automatically  follqw  is  prospective.^  ~ 

The  Weiss  bill  will  generate  for  once  the  data  tha^;  are  necessary 
to* make  accurate  decisipps  and  accurate  conclusions  as  to  how 
these  tests  and  the  decisions  that  relate  to  these  tests  actually 
affect  those  from  low-income  groups. 

Now,  what  the  Congress  or  the  educational  institutions  choose  to 
do  with  these  indications  is  another  matter,      *  ^ 

We  would  hope  that  they  would  respond  constructively. 

Mr.  GooDLiNG.  Yesterday  I  heard  on  numerous  occasions  that  it 
was  going  to  do  something  about  the  business  of  the  more  wealthy 
student  who  is  able  to  for  preparation  for  taking  the  exaiminations. 
I  am  wondering,  fol-  instance,  about  handing  out  these  tests  after 
they  have  been  scored  to  the  people  who  took  them.  What  is  that 
going  to  do  to  generate  help  to  the  low-income  person? 

He  is  still  going  to  have  to  have  someone  then,  I  suppose,  to 
tutor  and  prep  him  in  order  to  take  the  next  test.  On  the  other 
hand,  it  seems  to  me  it  works  against  him,  because  it  gives  even  a 
great  opportunity,  I  would  think,  for  tutoring  purposes, 

Mr;  Herndon,  It's  very  safe  to  point  out  that  the  statute  as 
proposed  does  not  offer  copies  of  examinations  to  people  prior  to 
the  time  they  take  the  examination,  and  it  would  be  available  to 
researchers.  . 

Mr,  GooDUNG,  I  am  talking  about  the  second  and  third  time  you 
take  the  test,  does  it  in  fact  give  it  an  advantage  or  a  disadvantage 
to  the  low-income  person? 

Mr,  Herndon.  This  bill  as  written  does  neither  of  those.  It  gener- 
ates data  that  allow  us  to  make  decisions  as  to  the  real  effect, 

Mr.  GooDUNG,  It  does. permit  the  student  to  have  the  exam  after 
he  has  taken  it, 

Mr,  Herndon,.  Yes,  sir,  but  I  think  it  most  unlikely  the  produc- 
ers and  purveyors  of  the  examinations  are  going  to  be  rendering 
the  identical  examination  to  th^  same  student.  ' 

Mr/ GooDLiNG/ Not  identic£\l,  but  how  many  times  can  you 
change  the  same  routine? 

Mr,  Herndon;  The  factor  that  you  are  describing  is  in  existence 
at  the  moment.  The- student  scores  do  go  up .  as  they  take  these 
examinations  more  times.  / 
•  Mr,  GoODLiNG.  How  will  this  legislation  improve  the  possibility 
of  low  income  or  minority  students  doing  better  pn  thege  tests? 

Mr.  HERNDOiSi^.I  think  that  the  statute  as  )^ritten  does  not  direct- 
ly address  the  question.  ^       V  . 

It  does  provide  us  with  data  that  allow  us  to  make  decisions 
about  the  actual  effect  on  low-income  students.  \ 

Mr.  GooDUf^G*  I  think  we  have  all  of  that  data  already.  But 
Ijeyond  that,  it  does  make  those  tests  avall^ible  for  a  better  tutoring 
program,  I  would  think;  and  again  people  who  can  affprd  it  then 
would  have  a  better  opportunity  than  they  presently  have  for  such 
tutoring  purposes  because  of  the  availability  of  more  tests. 
'    It  is  just  ari  observation.  I  have  not  been  able  to  find  out. 


'  I  was  trying  yesterday  to  find  out  what  the  push  was  behind  this, 
whA  was  the  m6tivation,  ^dValso  if  mdtivation.  was  the  low- 
income  knd  giinority"  students*.  ,  '  /  "J'' 
— ^Mr.  Herndon^  It's  my  belief  that,  as  these  data  are  available,  the 
provision  of  this  statute  is  implemented  we  will  have  better  tests 
that  wad  .  Qne  of  the  quotations  I  rendem}  from  Mr/  Buros. 
It  is  hw  belief  o  OAd^^^^^^  are  a  nrfhxber^  of  people  , 

capable  6f  qSoritributing  to,  the.  refihem0nt  of  these  ii^stitutions, 
because  they  couidn^t  work  for  one  o^a  handful  of  ^corporate 
ests  that  promidgate.  the  exaurnmatio^^^^^  '  •  ^    .  Y  > 

Mr.  Weiss.  In  the  course  of  iny  tes 
indicate  agaiii^  ittdependeht  researchers  in  the  field  who  have,^  pn 
'  i.  the  basis  of  some  «malysis.  and  studies  ; 
I  cated  their  belief  that  there  are  unintentional  inherent  bia^ 
f  tare  built  into  sonie  of  these  tests.  Making  those  te^  "jpubHc  an 
j  Rowing  independent  researchers  to.  revieW  them  and  piclc  dijt  the 
I  problem  areas  and  eliipinate  thi&  unintentional  biases  that  hav^  ,  ; 

crept  m,  will  itnprove  chances  for  those  it  would  advet^ly;  af^^ 
f  '    Mrv*  GpGDUNa  i  have  no  problem  with  your  independ^htTj^e-^  ' 
searchersV  review,  but  "  that  is  different  than  Handin&  th^m^ 
gtudente:--  '   .  \^  . 

I  am  thinking  in  rdatipnship  tq  standardly  tests,  f  ii^ vef  used ;  V 
^  .  them  othef  than  to  determine  to  somle  degree  what  the  youngsters'*  - 
:i  wtehtifJ  is,  and  then  if  he  is  not  reachihg  that  or  why  he  is  no^^  : 
^   .TO    jiiayb^  I  can  help  a  student  from  that  standpointV.Biit,  I  al^gn^ 
•  iQliknow  whep  you  get  the  standardized  tests  out,  for  ins|aiicfe,  ihf  : 
fiiiBt  district  I  ias  a  counselor,  they  had  this  ci^iuqr  idea 

^  that  y^qu  had  to;  homogeri^0Ul^ly  wbsitever  that 

^  ^  mesmt/  Sb^  1^^  w^re  standjardi^^^  ; 
•^■.^^bned'teacheb.'' ' '-v'-'' i-'-v'^i/  "'  ^' 

^  ^ey'^feej  if  ^students  don^t  do  wdl  ^tfl^*  ^standardized-  test  if  is 
:  b^aos^  of  ItBe  -teaqher*  Soj  I  would  fuid      to  , 
: ' : '  vi?ottlrf*0ine[  ihSvith  to\it&tfiuii:^  Mcajiiii^^^^h^        « | 

We  liad  „^ne  groUp^^^^lAt^l^  W6r0h't  any 

^^  map6  pCitstaiiding  tliah  the%ext;gifo^  Jfc^^ 

a  Utiflft  «ffiart©t  and  al^^^  ' 
■  '  M^  Wp89^  l^mjB.<8t^ 
V  •  •  ofjM^etutorin^  v.:-'-J;^'^\<*".V^      ? , 

fit*  you  ai:0  not  answering question  alsrto: how 
doesNthis  legislation  neTp  tJ^e '  l^«income  indlvlduifl^  He^oigi:  have  / 
all  of  thos6  testa  that  he'^waft0,.>biiiiV^^  ;( 
those  tests  unless  he  is  tutbyed.  '^  :^^^^^^^  -  :^ 

Mr.  Weiss.  Tijjtoring  i^^        aya  of  tli^  Beholddlr,  t][iaitwtorge^^  a^^ 
.  tutoror,  and  it  seems  to  me  ifisoniebody  j^ets  a^^test  jpind  goes  to  ^his 
or  her  teacher  or  parent  or  fnetitfi  and  say>^ 
took;  these  are  the  results  that  4;  got^^^^ 
•    wrong?"'  ■  '  ^-^ 

.  .  Mr.  GooDLiNO.  Mr.  Haber,  is  it?7  a^  ^^  .  . 
Mr.  Haber.  Yes.         ^  ^        ^  ^ 

Mr.  GooDUNO.  I  notice  you  say  you  represent  so  many  millions 
of  students,  %ind  I  ain  always  conc^irned  about  that.  We  get  all  sorts 
of  people  in  front  of  us.  If  they  can't  get  something  dowjcuDiL  the 
local  level,  then  they  come  to  us  and  say,  those  stupid  people  on 
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the  local  level,  we  can't  get  them  to  go  along  with  us  $ince  they 
only  represent  a  minority'thinking.  . 

You  said  you  talked  with  a  couple  of  hundref.  I  am  talking  about 
representing  millions. 

Hav6  you  done  any  kind  of  poll? 

Mr.  HabeiC.' Let  mp  say  two  things: 

We  have  3  million  dues-paying  members.  I  have  spoken  to  many, 
many  students  abont  ^  wide  variety  of  issues,  everything  from 
i  financial  ai*  to  tuition  to  collective  bargaining,  ^d  there  is  no 
other  4ssue  that  gets  students  more  excited,  more  involved  than 
this  issia..     !  .  •  ■  ■      '        /'^^  ,  ' 

i  1  (jjin't  qai^' d^^  to  a  student 

"  conference,  if  ydli^ike.  "'       7  0^- ^^^^^    '  V  ,  • 

Ther>  is  gpifigtrbe  one  in  10  d^js.ift  MauB^achudetts,  and  I  would 
::  i*e  hdppy.to  Mke;you.  there,  but  thei^^  a^e  j^^  other  issues  which 
■^studehfeaiemdre^cpncera^^^^^^^  '  j 

Mr.i(jGopLiK6.»P5"^  from 
ihescBtudentithat  bnecoiiM"^^^ 
Nfr.  HaberV  Letters-  ari4  thjh^  iik6  that?  v  ^   »  ;  '  ' 
r, '  Mr»  GoopiJNG.  Yesj;  as  to  Vlf^iat;  their^^oncerr^S  are. ; '  * 

■  "■'■•■'"i  MrotiABEitt<iSure;  ...      ■    V-v,.,  '  .  ' :  '     "  • „ ;     .    ...  ^ 
.  Mt>  GodbUNO.  ^  want  to.  make  sure  who  we  are  talkmig  about. 

The^M  and  FSE^re  my  district  told  ttie  that  the 

teachecs  ere  «uiipw  for" of  Education,  whith  be> 
kcame  the -"fieljianment  o*- Sortie  IJducatidn'-jind  not  some  Educa- 

r  jouidn't  find  15  t^chers^in  xAf  district  "that  Would  tell  me 
lyijhing  oth^r  than  send- money  back  and  keep  your  cotton^picking 
«fingeii8i3!fF  of  our  business.  t  '  .... 

Mx^^^i^^,.V£.yQ}x  like,  I  would  be  more  tlfen happy  to  set  up.,a.  ^ 
;  meetingmth  fib  ttia&y  Btudent8^  €^  yon  would  JHjce:  .  "  . 

Mr. -GOODU^^^  / 
Let:  me  mj^e  one  bmwo  -  observations  with  the  gentleman  ^ora  • 
-New  York,  and  I  appreciate  your  coming  down,  and  I  appreciate - 
"-:t]tet  yiu 'We  this  trial  €J£^^         going.  We  should  ta*,e  time  to  ,  - 
iWn.nfrom  your  errofp»  or  your  good  points,  in  n|y  ei^^aliion, 

:,beforewejum|>intQ\8omethingwithJ^^  ■  ; 

:,^WeWthat  so  often,  ^a^^  then  we  get  burned: .  -  ^  /      •  - 

■  Do  -you  still  administfei'  that  barbaric,  testing  program^  froni  the 
v  jp^irl^  Agts  Called  regents?  ^^^^^^        V  .,  L  ' 

Mr:  LA^ULLE.-'fhe  answer  is  ''Yes,"  we  do/':*rhe  very  mterestihg 
thing  ^about'the-regtsntsr  wHen     was  a  young-maii,  there  was 
»  always  the  threat  that  tjiey  were  going  to  ^away  vvjith  the  re- 
■■g©i%'an^  I  guessi  about  30  j^ears  have  passeJ'and  the  rumo|jr«as; 
^^pifemstedfeit  tneregen^^  *  * 

H^  -Otte  Of  OTe^fbrrtier  C^^  e^^en  indicated  thait  form 

^"task  force*  and  the  task  fore^t^ommend^  tl5^^:^|lp|hi 
j-egjraa^fitiiid-^tf  CoihteiHS^  and  we  8t|! 

those^re^fe^.  '  '  .     ..■  •       "  'V'-'-  '  '  '''^ 

Mr  GoomjNte,  I  don't  notice  in  your  legislation  that  yoU  c6vepd». 

them.      -f^  ■    .  ^  \ 

•Was  there  any  particular  |eason?  , 

Mr.  LaValle.  Very  interfflting  factor,  my  colleague  here.  Sena- 
tor Halperin,  as  a  mat^r  oft  fact,  in  the  debate  in  the  Senate  on 
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this  legislation  and  Senator  Lack  indicated  that,  for  instance^  we 
almost  had  a  truth-in-testing  in  the  use  of  the  regents. 

If  you  conle  tQ  New  York  Statfe  and  come  to  a  high  school  you  see 
.  every  boy  and.  girl  toting  a  little  book  of  former  test  questions  and 
so  forth,  and  the  teachers  very  vigorously  teach  to  those  test  ques- 
tions tQ  prepare  them,  both  in  giving  them  a  test  awareness  and 
also  to  fry  and  ziero  in  on  the  format  of  specific  questions. 

The  most  standard  one  that  we  all  joke  about  is^a^  the  train 
leaves  from  Chicago  and  one  leaves  from  New  York  and.  they  are 
both  going  at  x  number  of  miles,  when  will  they  meet^kind  of 
thing,  and  to  give  them  that  kind  of  an^^areness  oh  the  rate  arid 
distance  question,  along  with  hoy/,  to  take  it^ 

.  Njp-  GooDUNG.  Why  didn't  you  cover  the  ^AT's?  I  don't  believe 
I  you  covered  the  achievement  test  either. 

Mr.  LAt^ALLE.  We  had  a  meeting  ^th  the  ETSspeople  Allowing 
our  hearing  and  that  meeting  lasted  several  hours,  from  mjemory  of 
the  2-hour  meeting,  a  good  portion  was  spent  by  their  people  on  the 
achievement  tests,  that  they  were  very  specific  kinds  of  questions; 

They  use,  for  instance,  the  Russian  exam.  Very  few  students  take 
that  exam,  and  we  felt  and  on  balance  that  their  input  in  terms  of 
replacement  of  a  highly  (Specialized  tjrpe  of  question  as  given  on  the 
achievement  test  made  some  sense,  so  we  exempted  the  aphieve- 
ment  test,  as  we  did  on  two  other  kinds  of  tests,  the  equating 
questioris,  and  the  pretest  questions  that  do  not  in  many  o/  the 
tests  make  up  the  raw  score,  so  we  did  in  our  legislation  look  at 
.  certain  kinds  of  tests,  for  instance,  licensing  exams,  tests  that  are 
given,  certain  kinds  of  elementary  school  tests  that  are  given,  civil 
.  service  tests,  and  we  exempted  those  kinds  of  tests  and  we  even 
exempted  certain  kinds  of  questions  to  come  under  thei  disclosure 
provigSpns.  •  * 

MrT^rOODONG.  Did  ypu  respond  to  my  question? 

Why  you  didn't  include  regents? 
/I  didn't  hear  a  specific  reason  as  to  why  you  didn^'t  include 
regents. 

Mr.  LaValle.  We  are  talking  about  specifically  postsecondary 
admissions  to  get  into  college  or  graduate  schools,  and  so  forth. 
Mr,  GpODLiNG.  Your  bill  qn\y  deals  with  postsecondary? 
Mr.  LaValle,  Yes. 

Mr.  GooDLlJiG.  Why  did  you  stop/there?  Is  that  as  far  as  you 
:  wanted  t9  bite  off  at  that  particular  time?  ^ 

I  think  the  n^ost  damnable  testing  progranis  that  go  on  go  on  in. 
p^ibly  grades  8  through  12. 
TOr.  LaValle.  The  thrust  of  the  legislation  in  terms  of  standard- 
.   ized  testing  is  beyond  or  is  in  the  postsecondary  area. 
•  '  Mr.  GoODUNG.  I  consider  regents  to  be  very  standardized.  * 

Mr.  Burnett.  I  would  like  to  make  a  couple  remarks  with  regard 
to  your  question  about  what  this  legi8latjk)n  will  do  for  loy/-inicome 
'  students. 

I  think  that  you  should  be  aware  that  these  minority  studerits 
who^re  takit^g  these  tests  nowadays,  these  people  ar^  moti;^ated  to 
go  On  to  college  and  ^stgraduate  work,  and  so  that  this  legislation. 
|lis  telling  them  they  can  get'these  tests  back  and  they  can  study' 
from  these  tests,  arid  that  will  stimulate  ,  more  self-mbtivation  dn 
their  part  to  study  on  their  own  for  the  test^as  wfeU  as  to  go  out 
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and  seek  counseling,  the  emphasis  to  continue  on  and  study  more, 
so  next  time  around  they  will  do  better. 

With  regards  t6  students  and  how  they  feel  about  this  legislation, 
the  whole  field  of  testing,  the  minority  students  have  a  great 
distaste  for  standardized  testing. 

Those  students  with  whom  I  have  talked  across  the  country  are 
in  favor  of  this  legislation,  becjiuse  now  it  gives  them  an  opportuni-* 
ty  to  see  exactly  what  they  are  paying  out  for  and  exactly  what 
their  tests  mean  and  how  they  are  being  judged  by  the  institutions 
or  whatever,  what  the  test  actually  means,  and  seeing  what  the 
testing  companies  are  doing  with  their  tests  and  what  they  are 
trying  to  judge.  ^ 

When  I  came  in  1  wgsvery  naive;  I  thought  that  it  was  gomg  to 
be  strictly  medicine,  /oTstudied  all  the  medical  type  things  and  all 
of  these  other  areas  I  was  not  aware  of  were  on  the  test,  and  that 
is  the  type  of  thing  that  students  need  to  do.  , 

Everything  is  being  covered,  and  this  type  thing  will  let  them  see 
exactly  what  i^  going  to  be  covered  so  they  have  a  way  of  studying. 

Mr,  GoODLmG.  MCAT  does  have  a,  very  extensive  tutoring  pro- 
:gram  that  you  can  get  your  fingers  on  beforehand. 

Mr.  Burnett.  That  is  an  expensive  program  as  well.  I  got  the 
book  and  t^fe  book  alone  costs  me  $10.95,  and  it  has  probably  gone 
up  since  then. 

Mr.  .Weiss*.  Senator  Halperin,  do  you  have  a  response? 

Mr.  Halperin.  I  have  here  material  which  was  provided  bv  one 
of  these  coaching  courses,  and,  I  make  the  follo>ying  offer,  that  if 
the  test  preparers,  although  they  said  under  certain  circumstances 
they  might  make  Iheit  information  available,  and  you  said  that  by 
making  the  test  questioi^s,  past  test  questions  available,  they  might 
in  fact  be  helping  the  coaching  school/ 

It  is  my  feeling  as  someone  who  took  one  of  those  courses  anfl 
knows  they  haye  professional  test  takers  who  t^ke  those  tests 
solely  for  the  purpose  of  going  in  and  evaluating  them  and  bring- ^ 
ifcg  out  questions,  that  the 'material  which  I  have  in  front  6f  me  in 
^Tact  will  be  very  cfose  to  the  questions  and  in  some  cases  may  be 
the  exact  questions  that  were  given  the  ETS,  these  are  for  the 
LSAT's,  this  .particular  material,  and  will  allow  us  to  go  in  and 
compare,  maybe  we  can  get  th?  answer,  y 

Maybe  your  concern  is  really  not  a  concern,  because  I  feel  that 
information  is  already  public.  /  « 

Mr.  GoODLiNG.  Maybe  it  Was  onaxM  those  prof^sional  test  takers 
that  delayed  my  daughter  for  about  an  hour,  because  one  fewer 
Jtest  was  turned  in  than  was  handed  out.  She  couldn't  get  out  of  the 

room.       '  . 
Mr.  HaLperin.  I  would  also  like  to  reflect  on  one  other  issue,  the 
ppBirtunity  of  the  individual  who  is  taking  the  test  to  review  the 
'St      '    '        ■    '  »  ^ 

I  brinfe  this  up  with  a  little  bit  of  enibarrassment,  since  when  P 
ran  for  office  l' also  was  studying  for  the  bar  ex&m  at  the  same 
time,  and  you  can't  succeed  in  everything  all  at  once.  , 
I  had  an  opportunity  to  ^qyiew  my  bar  exam  which  was  only 

fiveh  to  those  who  were  not  quite*  as  successful  as  some  others  and 
found  to  my  amazement,  in  one  sense  relief,  that;  the  reason  fcwas 
not  so  successful  is  th?it  \  had  in  fact  failed  to  answer  a  whole 


series  of  .  questions  beca||e  o(  the  particular  way  in  which  these 
booklets  were  prepared,  m . 

They  weren't  the,  normS^Wpe  of  booklet  .which  you  turn  back  by 
page.  Th^y  opened  up  in  amaccordion  fashion  and  I  omitted  20 
short  answer?  entirely  and  t       told  that  that  in  ^act  might  have^ 
made  the  difference  between'-i^  passing  ofii  not  p^ing  the  bar 
exam.  ....  v'v  v^. 

Mr.  QoopuNG.  The  poor  guy')rM  were  tepre^  have 
gone  to  the  electric  chaif  because^^rab^  madeNftiat  mistej^  , 
Mt.  Weiss.  Great  exit  line,  I  mus^%|^    '  ^  w  \^ 
Mr.  Halpbrin.  1  have  yet  to  see  af  ^JJ^  bool^.tB^         up  with 
accordion  folds.  \^   ^  a 

Mr.  Weiss.  Or  a  complaint  or  an  indrcp^ent.^; 
Mr.  Williams?  :  :  \ 

»    Mr.  WiLUAMS.  Thank  you,  Mr.  Chairmfifin.^^ 

I  want^  commend  you  and  the  otKersl^o  have  shown  an 
interest  in.  this  matter.  .  ^4 

It  certainly  is  a  very  important  issue.  Testing  ftas  clearly  become 
a  mcgor  part  in  the  American  way  of  life  and  the  American  way  of 
success.  Particularly  when  those  tests  are  given  at  «try  to. college 
level,  at  that  point  where  a  person  yi/'AnJ^  to  entei'Aa  prof 

I  believe  the  institutions  which  design,  distribute,  aiWgiviB  tests 
really  have  a  greater  innuenQ&  although  momentary ,\  greater 
momentary  influence  on  student'  lives  than  does  government. 

Mr.  Williams.  A  far  greater  influence.  If  one  does  not  wieve 
that,  just  ask  the  student  who  is  preparing  for  a  test  or  wnp  has 
failed  a  test.  Ask  him  at  that  nvoment  which  has  the  greatest 
influence  on  his  life,  the  test  booklet  or  the  U.S.  Governine'nt.  He 
will  tell  you  very,  very  quickly.  So,  it*  is  an  important  matter. 

It  is  important  to  me  for  another'*  reason,  too,  and  that  is  I  think 
that  some  of  the  professions  in  this  country  have  virtually  closed 
shops.  1  do  not  know  if  that  is  good  or  bad.  The  dental  profession 
has  it,  the  medical  profession,  the  ABA,  I  think  George  Meany 
should  be  envious,  and  I  understand  he  is  envious  of  the  union 
these  people  operate.  The  reason  they  are  so  closed  is  because  of 
admission  standards  and  licensing  procedure.  Licensing  is  a  whole 
Qther  matter  that  someday  we  will  g^t  into. 
"  Having  said  that,  I  would  like  t6  ask  Dr.  Graham— L  was  im- 

Sreflsed,  Doctor,  by  4he  testimony  that;  said  in  the  1930'8  or  1940's, 
ental  schools  Tiad  an  attrition  perhaps  three  times  as  great  as  you 
had  after  you  instituted  the  dental  testing  program.  You  had  a  20- 
or  25^percent  attrition  rate  before  you  put  in  the  dental  admissions 
testing  program,  then  a  7-percent  rate.  So  you  obviously  kept  data 
on  that.  Let  me  ask  you  to  expand  on  that  data  and  tell  me  if  you 
know  which  students  were  eliminated,  t'tussume  the  reason  the 
attrition  rate  was  down  is  because  you  eliminated  some  students. 
iWhich  students?  Hqs  the  ADA  collected  that  as  well?  -  . 
-  Dn  Graham.  No,  it  has  not,  not  a?,  to  who  was  eliminated,  no. 

Mr.  Williams.  I  would  thiijk  that  would  be  one  of  the  things  any 
profession,  would  want  to  kAtiw  for  its  own  future  an^l  for  those 
-who  are  being  served  by  the  legal  or  medical  community.  That  \a,  if 
you  are  going  to  eliminate  perhaj^s  as  many  as  1,200  people  a  year, 

you  should  wfjnt  to  know  which  ones  you  are  eliminating. 

•  ■ .  .      •       '  ♦     •  ■  -  *  .  \  ■ 


Let  me  ask  another  question.  Did  the  ADA  or  did  the  dental 
schools  consider  other  ways  to  reduce  the  attrition  rate?  For  exam- 
ple, did  they  check  to  find  out  which  courses  were  causing  this 
attrition  rate  and  then  check  the  relevancy  of  those  courses.  Maybe 
they  were  courses  in  Frencfh.  Maybe  dentists  ought  to  know 
French,  I  think  they  should,  "but  maybe  that  is  not  relevant 
being  a  gooii-dentist.  Did  they  audit  thatj  4 

Dr.  Graham.  I  do  not  understand  your  question. 

Mr.  WiLUAMS.  There  are  at  least  two  ways  to  reduce  the  attri- 
tion rate.  One  is  to  eliminate  through  an  entrance  tesft  those  stu- 
dents who  i&ay  be  less,  successful  in  school,  and  that  is  what  you 
chos6  to  do.  Now,  there  is  another  way  to  accomplish  it.  That  is" to  ' 
change  the  Curriculum,  not  necessarily  diminish  the  quality  of  the 
curriculum,  but  go  in  and  fin(J  those  areas  where  the  student  is 
having  trouble  and  see  if  those  courses  are  relevant  to  the  student 
being  a  better  lawyer.  Do  they  do  that? 

Dr.  Graham.  Yes.  They  would  get  students  in  medical  school  not 
able  to  perform  the  manual  work.  The  students  found  put  after  1 
or  2  years  in  dental  school  thev  could  not  perform  the  tvpe  of 
manual  dexterity.  The  1,200  students  were  not  thrown  put  by  the 
schools,  it  was  voluntary. 

Mr.  WiluAms.  It  becomes  difficult  to  know  

Dr.  Graham.  When  you  go  day  after  day  to  try  to  do  some  very 
fine  work  that  you  cannot  get  and  you  fall  further  and  further 
behind,  and  you  realize  the  profession  that  you  have  chosen  will 
require  this  fine  work — that  is  what  happens.  WeYeel,  if  we  do  not 
provide  the  Student  some  kind  of  a  task  that  they  .can  judge  for 
themselves  before  they  spend  4  years  in  college  and  another  2 
^years  in  dental  school  

Mr.  \^iLUAMS.  Mr.  Haber,  does  the  United  States  Student  Associ- 
ation concern  itself  with  attempting  tP  determine  the  relevancy  of 
the  courses  which  the  students  are  required  to  take  with  regard  to 
the  profession  in  which  they  are  trying  to  proceed? 

Mr.  Haber.  We  try,  but  usually  those  decisions  are  made  by 
faculty  members  who  are  very,  very  skeptical  of  being  told  what  to 
teach  by  students.  , 

Mr.  WiLUAMS.  What'^rocedure  do  you  think  should  be  developed 
,  to  allow  students  some  input?  I  and  talking  about  having  students' 
input,  but  not  to  determine  curriculuni. 

Mr.  Haber.  One  of  the  things  v/e  do,  and  I  can  talk  as  to  what 
:has  happened  at  the  University  of  California,  on  a  -  number  of 
committees  there  are  students  wno  come  and  speak  with  the  facili- 
ty members  as  to  various  classes  or  sit  on  committees  that  help 
make  those  decisions.  We  are  more  fortunate  because  student  par- 
ticipation is  much  greater  in  other  parts  of  the  country. 

Mr.  Williams.  Senator  LaValle,  there  is  a  great  deal  of  criticism 
and  some  of  it,  I  must  say,  is  very  well  founded,  about  government 
today  rushing  in  and  trying  something  before  there  seems  to  be  an 
appropriate  reason  to  pass  the  law  or  to  make  whatever  atteinpts  it 
is  that  is  being  required.  I  am  wondering,  inasmuch  as  two  large 
^States,  New  Yptk  and  California,  have  embarked  on  this,  whether 
it  would  not  be  better  to  wait  until  we  at  the  Federal  level  see 
what  your  successes  are  before  we  commit  a  Federal  bureaucracy 
to  this  procedure, 


Mr.  LaValle..  I  would  think  we  would  want  to  tie  together  all  50 
States  in  a  unified  program.  There  has  been  considerable  interest 
throughout  the  country  on  tms  legislation.  As  a  matter  of  fact,  ^ 
California  initially  filed  legislation  very  similar  to  New  York's. 
.  They  lobbied  very  heavily  and  amended  their  law  and  have  a  much 
weaker  version  than  that  of  New  York.  They  WQuld  like  to  try  to 
ikiove  back  to  where  New  York  is.  There  are  many  other  States 
which  during  the  debate  contacted  us. 

You  can  see  that  New  York,,  for  instance,  some  of  the  problems 
where  we  have  to  get  to  the  bottom'  of  the  threats  by  both  the 
I  medical  and  dental  associations,  and  so  I  think  that  all  the  stu- 
'  dents  throughout  the  Nation  would  be  served  by  the  legislation 
such  as.Congressman  Weiss  has  introduced. 

Mr.  Williams,  r  was  informed  the  other  day  that  about  20  per- 
cent of  the  postsecohdary  students  are  enrolled  in  the  States  of 
New  York  and  California.  So  it  9eems  to  me  if  the  act  was  the 
same  .in  both  New  York  and  California,  all  you  need  ij9  another 
State  or  two  and  you  have  in  effect  required  the  testing  people  to 
meet  what  would  be  a  national  requirement.  If  you  are  going  to 
meet  it  for  30  jpercent  of  the^students,  you  may  as  well  meet  It  for 
airof  th^,  it  IS  more  expensive  not  to  do  it.  . 
*  Mr.  LaValle.  I  have  heard  that  as  a  strategy,  that  if  we  can  lock 
lip  another  couple  of  States  we  will  in  essence  accomplish  this.  But 
there  is  notWg  like  legislation  that  is  very  specific  so  that'  all  60 
States  will  have  that  coverage  and  that  umbrella  which  we  want. ' 

Mr.  WiLUAA^s.  One  final,  question  for  Senator  Halperin.  Are  you 
an  attorney  now,  sir?        .  \ 

Mt.  Halperin.  I  am\an  attorney  in  New  York  and  I  went  down 
i       to  Florida,  4  days'  study,  and  passed  the  Florida  State: 

Mr.  Williams.  In  either  of  those  States  have,  you  lost- anyone  to 
the  chair? 

Mr.  Halperin.  No. 
/  Mr.  Williams.  Thank  you,  Mr.  Chedrman:  * 
^      Mr.  Weiss.  Mr.  Kogovsek.  \ 

Mr.  Kogovsek/  No  auctions,  just  a  commendation  to  you  for 
submitting  this  legislation^  J  hope  it  passes.  If  it  does  not  pass,  the 
amount  of  dialog  that  has  been  generated  has  been  important. 

I,  in  deference  to  Congressman  ^)odling,  T  think  he  ws(s  asking 
the  wrgng  ques^on.  I  apologize  for  not  being  here  yesterday.  Hope-  . 
-  fully  the  questidn  was  asked. 

It  has  been  proven  standardized  testing  has  hBeti  unfair  to  mi* 
noritid^.  I  think  the  question  should  have  been,  what  haye  thi^ 
purveyors^of  the  standardized  test  done,  first  of  all  as  Congressman 
Williams  was  asking,  to  find  out  in  what  areas  the  standardized 
testing  has  been  unfair  to minorities?  Where  have  they  performed 
badly  and  what  have  the  purveyors  done  to  make  sure  it  is  recti- 
^  fied?  If  that  question  was  not  answered  ye^rday  by  the  purveyors, 
I  think  at  some  fixture  time  it  will  be  answered. 

Mr.  Weiss.  I  hope  you  will  bear^with  us.  I  have  a  series  of 
questions  I  hope  a  number  of  you  can  respond  to.  Some  of  the 
questions  ate  raised  by  some  of  the  testimony  we  have  had  over  the 
last  2  days. 

For  examplei  we  have  been  told  by  a  number  qf  those  who  say 
|hat  it  is  nom^ibessary  for  ys  to  have  new  legislation^  that  indeed, 
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all  right,  a  lot  of  informa^on  is  provided  to  students  in  advance. 
For  example,  I  think  Mr.  Ruud  gave  us  the  LSAT  manual;  Dr. 
Cooper  says  they  have  ^  manual  they  send  out  for  $3.25  and  so  on, 
I  think  the  dental  association  has  an  advance  booklet. 

That  being  the  case,  Mr.  Haber,  perhaps  I  should  address  this  to 
you.  ^Yhy  are  these  advance  manuals  and  the  kind  of  responses 
that  students  can  get  now  after  taking  the  exams  not  sufficient? 
WhV  do  they  not  meet  the  requirements  of  students? 

Mr.  Haber.  First  of  all,  I  think  in  regards  to  what  is  being  made 
available  to  students,  each  of  the  test  booklets  tells  students  things 
in  slightly  different  ways  and  in  some  instances  substantially  dif- 
ferent ways.  For  example,  the  booklet  on  LSAT  has  extensive 
infoi:mation  as  to  how  the  student's  raw  score  is  transformed  into* 
the  final  score.  .  .  ^ 

I  am  told  some- of  the  descriptions  of  the.  other  tests  are  inad- 
equate.  Just  a  short  sentence  or  two.  Much  of  the  information 
provided  is  now  being  provided  for  the  first  time.  It  is  obviously 
there  because  of  the  passage  of  legislation  in  New  York  and  Cali- 
fornia and  concern  about  testing  on  a  national  level. 

My  concern  is  that  some  of  this  information  the  companies  sup- 
ply begrudgingly.  And  if  the  threat  disappears  they  would  be  much 
less  willing.  - 

Mr.  W'Eiss.  Mr.  Herndon.  , 
*  Mr,  Herndon.  Had  Senator  Halperin  not  seen  .hi?  score  response 
^heet  he  would  not  have  known  he  failed  to  pass  the  bar  examin^a- 
tion  because  he  failed  to  answer  a  number  of  questions.  I  think  in 
many  of  these  questions  there  is  real  debate  over  the  adequacy  of 
the  answer,  whether  it  is  the  proper  answer,  whether  in  fact  that  is 
the  best  answer. 

^  The  student  .would  not  be  conscious  of  any  error  of  score,  error  in 
the  scoring  process.  One  might  say  that  is  extremely  unlikely,  that 
may  only  happen  in  the  extremely  rarest  of.  circumstances.  But 
suppose  that  rare  circumstance  is  me,  or  it  is  you.  Or  it  is  my 
^children  or  your  children.  It  really  matters  little  to  me  that  my  ' 
child  is  the  only  one.  I  still  would  like  to  have  the  opportunity  to 
examine  the  material  to  know  that  is  the  case  and-to  pursuA  my 
remedy  if  there  is  an  appropriate  remedy  available.  ^  i 

Neither  will  the  provision  of  that  handbook  make  it  |)ossible  for 
the  academicians,  the  cyclamatricians,  the  administrator  of 
instructions  J;o  examine  internal  studies  as  to  validity,  reliability, 
consent  reliability,  » 

I  think  there  are  many  deficiencies,  if  one  is  comparing  a  proto- 
type booklet  based  on  past  experience,  with  today's  reality  of  the 
test.  They  are  just  not  the  same, 

Mr.  Weiss.  Let  me  ask  Mr.  Ruud  and  Dr.  Graham,  what  do  each  . 
of  your  admissions  tests  test  for?  What  do  you  hope  to  get  oack? 

Mi^  Ruud.  Let  me  first  respond  by  isaying  it  is  not  ours  constitu- 
tionally. It  beloiKs  to  the  law  school  admissions  test. 

The  law  school  admissions  test  is  not  a  test  of  the  American  ' 
Association  of  Law  Schools,  but  what  it  tests  for  is  an  ability  to  try 
to  predict  performance  in  law  school.  They  are  designed  to  measure 
an  ability  to  read,  understand,  reason  logically  using  a  variety  of 

Quantitative  material  We  have  an  overall  SAT  jjcorfe  and  a  two- 
igit  writing  ability  score.  ^ 


}  ^  must  say,  if  I  mfiy  add,  I  remember  a  meeting  in  1955  at  the 
then  Ejtecutive  Ck)irifiilttee.  for  Law  School  Admission.  Council,  now 
Congressman  Orinan,  then  Dean  Dfinan,  serving  on  the  committee. 
We  wete  concerned  about  the  matter  qf  providing  widely  informa- 
tion about  the  test.  So  the  suggestion  that  we  are  new  m  concern 
about  the  student,  at  least,  is  not  applicable  to  (is. 

Mr.  Weissv  Let  me  see  if  I  ifiiderstand  what  you  have  said, 
though.  The  tests  that  you  are  involved  with  are  not  testing  for 
hard  factual  information.  They  are  not  achievement  tests.  They  are 
really  generalized  aptitude  tests,  testing  the  capacity  of  the  t^t 
taker  to  be  able  to  handle  the  curriculi^  of  the  law  schools. 

Mr.  RuuD.  It  obviously  has  rome  kind  of  information  base,  but  it 
is  an  information  base  that  would  be  commonly  shared  by  third- 
year  college  students.  It  is  not  an  achievement  test  bat  one  of 
^  certain  generalized  abilities. 

Th^re  have  been  validation  studies,  anyone  who  is  willing  to 
read  can  read  them  in  these  research  reports  that  have  been  going 
on  since  the»  beginning  of  the  test,  to  constantly  check  the  Validity 
of  the  test,  and  the  test  has  not  been  the  same— it  is  not  the  same 
test  today  that  it  was  in  1948  or  1955,  when  I  first  became  ac- 
^  quainted.  There  are  new  kinds  of  test  items.  What  shows  up  under 
test  development  in  the  Law^hpol -Admission  Council  budget  is  a 
relatively  small  item.  That  item  is  solely  devoted  to  the  dievelop- 
ment  of  new  kinds  of  test  items.  I  think  folks  need  to  be  careful  of 
what  kind  of  conclusions  they  jump  to  on  these  numbera.  But 
constantly,  we  are  at  work  trying  to  monitor  the  quality  of  test. 
,  Mr.  Weiss.  You  heard  the  testimony  yesterday? 
Mr.  RuuD.  Yes.  . 

Mr.  Wbiss.  So  you  do  not  find  yourself  in  the  situation  that  the 
MCAT  was  in.  If  the  testimony  was  valid — - 

Mr.  RuuD.  And  I  have  no  reason  to  believe  it  was  not. 
'      Mr.  Weiss  [continuing].  It  is  their  position  there  is  only  a  certain 
■  s  number  of  questions  they  can  come  up  with,  and  that  is  because 
they  test  achievement  at  the  first-year,  college  level  in  a  number  of 
scientific  areas.  You  have  no  concern  to  come  up  with  an  infinite 
number  of  questions?  - 

Mr*  RuuD.  We  have  concern  as  to  how  fast  it  can  be  done  and 
thecost  of  doingit. 
I  I  think  now  this  is  sqmething  you  cannot  sav  with  great  confi- 
dence, but  it  appears  that  by— as  I  indicated— by  lengthening  the 
test,  by  perhaps  tripling  or  ouadrupling  the  size  of  the  staff  at 
worl&iJroducing  tests,  this  kind  of  test,  the  kind  of  test  of  a  general 
ability,  but  geperal  ability  directed  at  the  kinds  of  intellectual 
tasks  that  law  students  must  be  able  to  perform,  I  think  there  is  a 
substantial  prolmbility  the  Law  School  €k)uncil  could  meet  your 
disclosure  requirements  at  some  cost  to  the  test  taker;  exactly  how 
much,  I  do  not  khow.  « 

But  the  leadtime  on  the  production  of  an  individual  test  item, 
from  what  I  understand  it,  is  a  matter  of  a  year  to  a  yeaj  and  a 
half  to  2  years.  j 

Mr.  KoGOVSEK.  Would  you  yield,  Mr.  Chairman?  I  have  to  run 
rather  qiifckly^  but  since  the  gentleman  iB  here  I  wauld  like  to  ask 
him,  what' is  the  process  in  most  of  the  States,  as  far  as  bar  exams 
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are  concerned,  for  correcting  them?  Who  does  the  actual  perusal  of 
the  test? 

Mr.  RuuD.  I  think  there  is  some  difference,  but  let  me  describe  in 
general  terms,  and  I  am  not  a  baiw  examiner,  but  I  meet  with  the 
National  Conference  of  Bar  Exannner  people  from  time  to  time. 

There  is  the  Multistate  Bar  Exam.  The  questions  th^t  did  have 
problems  in  the  beginning — as  you  do  with  any  kind  of  testing 
,  -  program— and  I  gather  now,  it  is  on  a  good  basis,  that  is  machine 
graded.  The  individual  States  are  told  the  number  of  rights.  The 
individual  State  then  decides  what  is  a  passing  score. 

NoWj  with  respect  to  th^  essfeiy,  which  is  more  like  the  typical 
law  school  problem-solving  examination,  I  think  perhaps  California 
is  the  model  of  .the  best,  way  to  go  about  it.  They  employ  peopl 
mostly  l^w  teachers  outside  the  State  of  California,  to  draft  the 
questions  and  prepare  a  model  answer.  Thpse  then  are  reviewed? 
That  is  the  function  of  the  Committee  of  Law  Examiners  of  the 
State  of  Caliiirnia.  It  is  an  integrated  bar,  a  State  agency,  as  you 
may  want — to  review  those  test  questions  that  have  been  produced, 
then  select  the  ones  they  want  given  the  apppropriate  mix  of 
subject.  Then  they  employ  graders.  If  my  recollection  is  correct, 
each  essay  qutestiori  is  graded  by  two  examiners.  It  is  an  anony- 
mous grading  system.. 

You  go  into  other  States,  my  State,  the  State  of  Texas— and  I 
have  been  up  in  Washington  for  6  years  now  and^  little  out  of 
touch — but  tl^e  examiners  themselves  produce^ the  questions  and  do 
the  grading  of  their  questions.  The  quality  of  the.  questions,  of 
course,  will 'vary  with  the  experience  and  so  on. 

Mr.  KoGQVSEK.  Thank  you. 
I        Mr.  Weiss.  Let  me  just  stick  to  this  point.  Dr.  Graham,  woi^ld 
you  try  to  respond  to  that?  What  do  you  expect  from  a  testflthe 
students  take  for  admission  to  the  dental  schools?  -  ) 

Dr.  Graham.  There  are  two  domains.  One  is  the  cogniz^arit  do- 
main, the  cognitive,  and  the  other  is  as  to  dexterity.  We  have  a 
science  test  test^ing  the  areas  of  biology,  general  chemistry,  et 
cetera,  and  also  reading.  It  is  parallel  to  the  text  used  in  dental 
schools,  and  we  try  to  see  how  fast  the  student  can  comprehend  the 
material.  _ 

The  other  is  a  verbal  aptitude  test.  Through  that,  we  hope  to  be 
able  to  give  some  kind  of  indication  of  how  a  student  will  perform 
in  his  Work  when  he  gets  into  dental  School.  \., 

Mr.  Weiss.  Say  on  a  time  basis,  what  portion  of  time  is  alitowed 
for  the  aptitude  test?       *  *  / 

Dr.  Graham.  The  aptitude  test  consists  of  three  bookl^tif.  The 
science  examination  is  usually — I  have  copies  of  it  here.  It  is'^a  90- 
minute  test.  There  are  100  items,  40  for  biology;  30  minutes  for  the 
reading  examination;  reading  comprehension  is  80  minutes,  and 
the  verbal  quantitative,  60  minutes.  '\\ 

The  other  part  of  the  examination,  which  is  a  spatial  perception 
examination,  which  includes  manual  dexterity,  there  ar6  two  ex- 
aminations in  that  area.  One  of  them  is  to  deal  with  two-dimen- 
sional relationships.  That  is  30  minutes  in  length.  The  other  is 
three-dimensional,  and  it  is  also  30  minutes  in  tength. 

Mr.  Weiss.  Except  for  the  spatial  relationship  test,  which  you 
"indicated  in  your  testimony  is  so  limited  that  you  really  do  not 
.  .  .      .  .  •        \  ■  - 
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have  an  infinite  number  of  those  to  create,  as  to  the*  other  parts  pf 
the  test,  do  you  know  of  any  reason  why  there  would  be  a  liniit  on 
the  number  Of  questions  thiat  qualify,  and  experts  in  the  field  that 
would  meet  your  requirements? 

Dr.  Graham.  With  regard  to  the  DAT,  it  would  be  expensive,  but 
it  could  be  done.  /  . 

'Mr.  Weiss.  OK. 

Dr.  Graham.  With  regard  to  the  National  Board  examinations, 
now  their  subject  matter  in  that  area  is  much  more  limited  and 
there  are  a  limited  amount  9f  items  Included. 

How  many  ways  can  you  ask  a  person  to  fill  in  a  blanks  There  is 
only  one  way  to  do  that. 

Mr.  Weiss.  Certification  or  admission  into  the  practice  of  dentist- 
ry? ■ 

Dr.  Graham.  The  admissions  test  on  its  facts  part  is  not  limited. 
I  should  explain  that  a  little  bit  more  carefully. 

I  think  we  operate  on  a  different  philosophical  principle.  In  the 
MCAT  principles  that  they  have  specified,  the  objection  or  the 
manner  of  the  tests  as  to  what  will  be  particularly  reqfuired  to  get 
into  medical  school,  we  do  not  accept  that  philosophy. 
"  We  feel  that  the  beist  performance,  the  best  indication  of  future 
periformance  is  past^rformance,  and  we  Want  to  see  how  well  a 
student'^^Tperforms  on  the  whole  domain  of  what  he  learned  in 
biology  or  chemistry,  or  whatever  else  he  took  in  college,  so  We  46 
not  try  to  limit  ourselves  to  what  is  required  for  dentistry  and  we 
want  to  test  what  has  generally  been  taught  across  the  country. 
And  we  feel^because  we  have  got  a  much  broader  domain,  there  is 
a  distinction.  /  ^ 

I  am  not  contradicting  what  the  other  people  said  

Mr.  Weiss.  Without  passing  judgment  on  which  is  the  best  ap- 
proach, it  is  fair  to  say  that  the  MCAT  people  thenisdves  are 
relatively  ^new  in  that  different  approach  as  they  testified  yester- 
day .-^And,  indeed,  after  they  get  through  reviewing  and  analyzing 
what  they  have  done,  they  may  decide  that  is  not  the  approach 
that  they  liki^  here.  *  - 

Dr.  Graha*W(.  We  have  very  close  contact  with  the  dental  schools 
as  we  operate^sthis  for  them,  and  we  did  poll  them  about  6  or  7' 
years  ago  and  took  that  kind  of  thing  before  them.  And  unanimous- 
ly they  chose  the  philosophy  that  we  had.         \  / 

It  wasn't  the  American  Dental  Association,  but  it  wjjs  the  dental 
students  and  dental  educators  themselves  who  made  that  decision 
to  keep  that  kind  of  philosophy.  • 

Mr.  Weiss.  Senator  LAValle,  I  think  he  indicated  in  his  testimo- 
flv  that  your  association  (|id  not  take  the  occasion  to  bring  to  the 
New  York  State  Senate's  attention  the  concerns  or  objections  of 
the  legislation  that  was  pending  in  New  York. 
•  Am  I  correctly  stating  that,  Senator  LaValle?  I  wonder  if  you 
have  any  iriformation.  Dr.  Graham,  as  to.  why  that  would  have 
been  so,  as  yoiir  association's  reaction  was  so  quick  and  strong.  I 
Hhink  that  is  a'n  understatement,  once  the  legislation  was  adopted. 
^9l^-€raAHAM.  I  wiu3  not  with  the  American  Dental  Association 
then.  I  spent  1  year  at  the  University  of  JUinois.  I  wias  there  for  7 
years  before  that,  and  I  am  back  with  the  association  now. 

Mr.  Weiss.  They  have  missed  you.  j 


Dr.  Graham.  If  I  were  there,  I  would  have  made  vigorous  protest. 
^We  were  informed  by  various  people  that  th^  legislation  was  not 
going  to  pass.       ^  ♦ 

*  Mr.  Wei^.  See,  a  dangerous  assumption.  It  in  very  difficult  for 
someone  in  Chicago  to  follow  all  of  the  legislations  that  are  going 
on  for  the  individual  StatM  really,  let  me  tell  you,  and  we  have  a 
difficult  time  doing  that.  V 

You  think  it  is  easier  when  you  have  a  Federal  piece  of  legisla- 
tion to  review;  right? 

Dr.  Grai^m.  The  third  thing  I  would  like  to  say  is  that  we  did 
make  writtcai  recommendations  in  there;  as  I  understand  it,  and 
this  is  my  understanding  of  it.  And  we  did  contact  the  dental 
schools  and  our  dental  societies  in  New  York  and  asked  them  to 
write  letters,  ,tq(  send  representation  to  government  hearings  before 
we  did  sigh  that.  ^  r 

Mr.  Weiss.  Before  he  signed  the  bill,  but  by  that  time,  as  you 
know,  the  legislative  process  is  completed. 

Dr.  Graham.  We  did  submit^  I  believe,  written  testimony  about 
that.  I  believe  we  did.  I  wasn't  at  the  American  Dental  Association 
atijthat  time,  but  it  is  my  understanding. 

Mr.  ,Weiss.  You  know  the  purpose  of  hearings,  this  hearing,  all 
legii^atiye  hearings  no  matter  where  they  are  held,  is  to  get  input 
in  sumcient  time  so  that  if  there  are  vadid  concerns  or  objections 
expressed,  the  legislation  can  in  fact  be  written  in  its  final  form  to 
take  note  of  legitimate  concerns. 

In  a  sense  you  are  unfair  tcTyour  own  organization — I  don^t 
meaiL  you  individually— if  that  organizatiQii  foregoes  that  opportu- 
nity pecause  when  you  come  in  after  the  fact  it  is  much  more 
difficult.   /  > 

Mr.  RuuD.  I  just  wanted  to  make  it  clear  when  I  responded  to 
you  about  whether  an  indefinite  quality  of  LSAT  test  items  could 
be  written  you  really  need  to  address  that  question  to  the  Law 
School  Admissions  Council. 

I  am  giving,  you  iny  impression  only  and  not  making  a  represen- 
tation. 

Mr.  Weiss.  Will  you  remind  me  before  we  fmish  the  session 
today  to  ask  you  to  go  through  again  what  the  relationship  of  the 
various  organizations  that  you  are  identified  with  is.  That  is  the 
hardest  I' have  had  in  these  2  days  of  hearing,  following  who  is 
involve  with  whom  and  in  what  fashi^. 

Mr.  Ruup.  I  witHdo  it  quickly  righflpow.  I  am  eniployed  as  the 
executive  mrector  of  the  Association  ofAmerican  Law  Schools.  We 
are  an  assBciatioh  of  186  schools.  We  have  nog[)ropriety  ^onomic 
interest  in  the  law  school  admissions  test.  The  law  school  admis- 
sions test  is  owned  by  the  Law  School  Admissions  Council,  incorpo- 
rated under  the  education  laws  of  the  State  of  New  York.  It  has  a 
contract  with  a  separate  entity  also  incorporated  under  the  State  of 
New  York  known  as  Educational  Testing  Servitor 

The  Law  School  Admissions  Council  has  just  incorporated  under 
the  laws  of  Delaware,  Law  School  Admissions  Services,  Inc.,  and  .it 
is  considering  having  it  perfoi'm,  and  it  may  perform,  quite  a  bit  of 
the  services  that  are  now  being  performed  by  Educational  Testing 
Se*^forLSAC.  ^ 
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Personally,  I  am  a  former  president  of  the  Mw  School  Admis- 
sions Council.  I  was  prdlident  when  we  were-  incorporated  in  thef 
State  of  New  York.  I  have  spent,  as  I  8aid,/^^me  25  y^ars  in 
adtaissidns,  and  I  think  T  know  something  fit  least  about  the  dy- 
namic]^ of  it  as  far  as  the  law  school  world  is  concerned. 
•  Mr.  Weiss.  So  that,  again,  I  can  relate  it  to  other  organizations 
^  that  appeared  befori^  us,  are  you  in  essence  the  equivalent  of  the 
College  Entrance  Examination  Board?  ^ 

Mr.  RuuD.  Not  in  any  sense  at  all.  The  Coll^a  Entrance  owns, 
as  I  understand  it,  TSAT,  and,  it  has.administered  or  has  a  lot  of  its 
work  done  in  the  administration  of  that  program  by  a  contract,^ 
with  Educational  Testing  ^Service.  We  have  iwrlnterest  at  all  in  the 
test  in  any  kind  of  propriety  sense. 

Mr.  Weiss.  Do  you  cnarge  a  fee  to  students  who  take  the  exami- 
nation? 

•  Mr.  RuuD.  The  Law  School  Admissions  Cquncil  does.  We  have 
nothhig  to  do  with  the -law  school  admissions  program  other  thart  . 
our  136  schools  of  the  168  nationally  accredited  schools,  accredited 
by  the  American  Bar  Association — we  are  consumers  of  the  test 
scores. 

Our  admissions  committee  uses  it,  grade  point  averages 'and  a 
host  of  other  tldngs  to  make  admissions  judgment. 

Mr.  Weiss.  Do  you  have  any  input  in  the  creation  of  those!  tests? 
Do  you  make  policy? 
Mr.  Ruui).  Institutionally  the  Association  of  American  Law 
I       Schools  attend  the  meetings  of  the  board  of  trustees  and  some  of 
our  staff  attend  meetings  of  the  LSAC's  standing  and  special  com- 
mittees on  a  liaison  basis  and  their  president,  their  executive  direc- 
tor attends  meetings  of  pur  executive  committee  and  our  annual 
\  meetings.  .  * 

We  do  speak  up  when  they  are  considerii^  a  matter  that  w6 
think  has  ^some  special  impact  on  the*  program  of  l^al  education 
.  generally.  ' 

As  a  practical  operating  matter,  we  tend^to  leave  the  labor  to  the 
Law  School  Council.^We  are  i^terest^,  we  observe  it  and  we  are  in 
a  sensqi  one  of  the  independent,  external  forces  to  which  that 
program  is  accountable.  . 

Mr.  Weiss.  But  you  are  not  saying,  I  assume,  that  the  individual 
law  schools  or  your  association  in  essence  turn  over  the  responsibil- 
ity to  determine  weight  ttiat  is  to  be  accQrded  to  particular  compo- 
nents o/  admissions  or  the  final  judgment  as  to^wnether  he  is  to  be 
'  ft  admitted  to  anybody  else?  ,  ' 

Mr.  RuLTD.  The  Law  School  Admissions  Council  offers  a  validitv^ 
service  to  Ihe  member  schools.  The  validity  service  is  one  in  which 
they  take  the  school's  experience,  the  class  that  was  admitted,  let 
.   us  say,  in  the  fall  of  1977,  LSAX  scores,  cumulative  grade  point 
average,  law  school  average  at'tfiie  end  of  tii6  first  year  and  then 
develop  through  a  regr^o^on  equation  formula  a  statement  that  ^ 
sajys,  tnis  formula  is  tn^  ^  that  on  the  basis  of  the  experienqe^ 
Vioth  the  fall,  1977  enterinS^law/ assigns  the  appi^^ 
grade  point  average  and  tol^AT  score.  '  ^ 

Then  as  part  of  the  Law  School  Data  Assembly  ServK^  which  is 
a  centralised  transcript  analysis  service,  a  school  may  ask  that, 
among  the  material  generated  for  the  school  is  a  predicted  firsts 
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year  average,  they  niay  usfe  t^^ 

*  has /been  dohe  at  ETS  undSr  the.:,LSAC  or  under  soiiie  athier 
j  /  ^  formula.  .  V  ^ 

;  '  /      .  '  They  m^de  judgment  as  to  which  prediction  formula  they  use  or 
admission  index.  My  sfchool  uses  a'four 'digit  admissions  index. 
\    '      Mr.  Weiss.  Four  y^iaf?  *    '  * 
f  *       ,  Mr.  RuuD.  Four  digits  They  use.  an  admission  fnde>^  as  a  way  to 
i      rank  students.  One  of  the  problems  we  have,  unlike  the  situation 
.that/exijsted  when  I  entered  the  law  school i  of  the  University  of 
Minnte80ta»  we  now  cannot  admit  everyone^  who  has  a  p^otabiUty 
fo^^'success.  We  have  to^  make  choices. 

A  very  import^t  item  about^an  applicant  is  the  prpbabilitv  of 
thf  success  and  where  that  person  is  likely  to  rank  in  the  class. 
These  are  only  probabilities,  they  are  no  more  th^gin  that,  and  part 
of  tl^s  judgment  th^tt^an  admissions  committee  makes  about  an 
fdividuaLjapplicant  is  in  a  sense  a.refming  on  the  ,b^e  of  judgmen- 
tal nonquantitative  factors,  whether  that  person  has  a  predicted  75 
at  my  law  school  which  is  the  bottom  B. 

Two-thirds  of  the  people  will  get  a  scbre  between  70  and  80,  One- 
sixth  will  get  above  80,  one-sixth  below  70.  The  question  is  how  to 
look  at  everything  you  can  find  out  about  the  applicant  and  figure 
dut,  is  this  applicant  going  to  beat  the  odds  or  not  beqt  the  odds? 

Here  is  a  person  who  had  a  very  heavy  workload  during"  his 
college  career,  we  are  able  to  arrange  some  financial  aid  and 
•    reduce  the>  workload,  your  guess  then  is  thii|  person  id  going  to  beat 
the  odds  because  the  grade  point  average  reduces  the  product. " 

That  is  only  a  part  of  the  admissions  judgment.  To  me  there,  are 
two  other  very  important  judgments  an  admissions  committee 
makes.  One,  you  are  going  to  admit  some  folks  to  your  class  be- 
cause they  are  going  to  make  a  very  important  contributid(h,'to  th0 
education  of  the  other  students. 

This  was  recognized  in  Bakke  and  recognized  by</Mr.Mustice 
Powell  as  a  basis  for  taking  into  account  minority  and  ethnic 
bacl^ound  in  making  the  judgment.  • 

I  don't  know  whether  you  are  a  reader  of  Doonesberry  but  Ms.- 
Caucus,  who  went  to  Berkeley,  I  would  admit  for  that  reason.  She 
had  the  kind  oiF  experience  to  make  her  a*very  important  member 
of  her  class.  / 
Mr.  Weiss.  I  missed  that  sequence. 

Mr.  RuuD.  That  was  a  while  a^o  before  the  move  from  the  Post 
to  the  Star. 

Tjften  a  thir^l^im  is  you  select  the  persons  likely  to  make  a  very 
special  contribution  once  in  the  bar.  Our  schools  have  been,  amoi^g 
other  reasons,  interested  in  minority  applrcants  for  this  reason.  We 
have  a  desperate  need  nationally  for  mbfe  minority  lawyers  and 
we  arer  trying  to  serve  that,  and  I  think  oar  record  is  good  and  our 
schools  have  beaten  the  numbers.  / 

To  suggest  that  the  quantitative  d4t^  about  the  minority  appli- 
cant has  kept  the  minority  applicant  out  is  to  fly  in  the  face  of  the 
^         findings.  :  J 

The  Law  School  Admissions  Couj^fitl^  had  a  study  made  of  the  fall, 
1976  entering  class*  We  were  very  interested  in  that  being  made 
because  we  wanted  4n  our  Bakke  brief  to  be  able  to  tell  the  court 
what  the  consequences  to  the  country. would  be  if  they  took  a  view 

39r: 


that  achnissions  to  liiqofessionalr^schoQls  could  -not  take  into  accoui)t 
iracial  or  ethnic  status.  )  V 
.That  study  showed  that'  if  it  had  not  taken 4hat  into  acco|int^  60 
perceotyof  tilie  blacks  vvho  attained  admission  would  not  have  at- . 
tained  admission  and  40  percent  of  the  Mexican  Americans  would 
not  have.  »  r      '  *  .  , 

That  is  to  dfemonsti'ate  the  importance  of  the  affirmative  action 
efforts  at  our  member  schools.      v  ^ 

.  That  is  perhaps  too  long  a  stateirient  to  tiy  to  ^ve  you  an 
iitipression  of  the  dynamics  of  the  l^w  school  admission  prpceiss. 

Mr.  Weiss.  I  am  apfiireciative.  It  i^.  an  intriguing  area.  I  think 
that  as  you  get  morci  and  more  into  ^t,  mpre  and^more  questions 
really  are  raised,  I  am  sure  not  just  in  our  minds,  but  probably  in 
your  mind,  as-you  work  with  this  constantly  as  to  the  basic  validity^ 
of  the  tests  themselves  b^dusie  if  those  turn  out  to  be  problem 
filled  and  to  be  flawed,  the  whole  system,  in  essence,  i&  biiilt  pn'a 
very  weak  foundation.  ^    v  . 

Mr.  RuuD.  Charley  Ruhyon,  how  at^he  Stat^^DepaHmept^/wsus 
then  ah  dissociate  dean  &t  Yale' in  the  ei^ly  sixties.  In  the  latest 
report  that  I  have  in  the  bound  volume,  on  page  7^  of  the  third 
volume  of  these  reports,  Jthey  have  indicated  that  the  tests  can  be 
used  in  the  same  way  wilbh  the  minority  applicants  as  thd.  ndn- 
minority  applicants.  ^ 

It  predicts  as  well.  In  fapt,  the  last  Btudy  in^cated  with  respect  • 
to  blacks  it  iha^  predict  a  little  better.  By 'that  we  mean  that  the 
bell  cikve  is  a  little  higher  and  not  as  flattened  out  '  ^ 

Mr.  Wejss.  One  phrase  that  you  used  in  the  course  j|pf  your 
response  again  I  And  signiflclmt  bieicause  I  thin]^  even  today  you 
imay  have  expressed  some  caution  about  ,  the  bill  using  the  Ian- 
*guage,  and  certainly  y^terday,  we  got  (into  a  great  big  debate  over 
the  question  of  the  approi)riatene^  of  using  the  word  ^^success''  in 
thie  predictive  factor  built  ihto  the  legislation. 

We  feot  into  quite' a  dia|og  as  to  what  in  fact  we  were  doing  by 
using  that  word  in  predicting  the  success,  either  academicallV  or  in , 
a  x^areer.  We  went  to  the  extent  of  finding  in  our  files  a  July  17 
release  from  MCAT 'where  they  announced  they  were  withdrawing 
from  the  State  because  of  the  new  legislation  in  which  it  was  said 
that  the  test  iS^esigne^  to  help  predict  how  well  a  student  will 
perform  in  mediqal  school  and  later  as  a  practicing  physician. 

There  seemed  to  be  the  suggestion  then  that  it  is  OK  to  predict 
performance  as  a  practicing  physician,  but  not  success,  because 
what  do  you  mean  by  success?  ' 

You  used  the  term  ^^probafoilitv  of  succei38'\  I  gather  fi^om  that,  - 
that  in  fact  it  is  not  such  a  forbidden  word  after  all;  that  the  word 
^'success''  is  used  in  predicting  ifuture  courses  of  conduct.  , 

Mr,  RuuD.  I  am  talking  about  performance  in  law  school  ^nd  we 
have  two  kinds  of  predictions:  One,  a  prediction  of  what  the  first- 
year  averqgd  would  be,  and  then  it  ii  po6dibl6  to  also  convert  that 
into^  let's  say,  six  chances  out  of  eight  of  getting  a  passing  |  rade  of 
65,  again  using  the  Texas  LAw  ^htiDl  numbers  which  W)uld  be^ 
success,  that  is  as  di^injo^hed  frdm  failing  out. 

I  «uesiB  that  is  an  appropriate  use  of  sticcess.  I  have  tt  e  same 
problem,  thou^.  when  we  use  the  term  Aiccess  in  speakmg  of  the 
profession.  We  aon't  use  it.  We  talk  about  profession^"^  perform- 
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ance,  but  even  that  is;  difficult  and  tKat  is  a  study  that  is  still 
under  way  if  we  can  find  the  funding  to  pull  jfrofF> 
\-       Mr.  /Weiss.  Let  me  ask  Dr.  Lennon  a  quest%i  and  again  this  ties 
-      into  this  area  of  achievement,  via  aptitude  test.  Can  you  give  us 
1  some  e^lightenmeiit  as  to  how  you,  view,  in  the  working  of  your 
organization,  the  difference  in  those  tests?. Are  the^ terms,  in  fact 
clearly  distinguishable?  Do  they  ove^flap? 
Dr.  Lennon.  r  tJiink  a  fast  summary  of  the  professional  litera- 
^      ture    that  what  we  will  caH  tests  of  cognitive  funding-^I  apologise 
for  sounding  a  little  grandiose.  Any  test  of  cognitive,  functioning  is 
^  /     really  a  measure  of  achievement.  It  measures  something  that  has  ^  ^ 
been  learned,  some  piece  of  lujowledge  or  skilj  that  ha?  been  ac:  . 
,  '      quired  by  the^examinee  as  a  result  of  what  has  happened^tb  him-fej: 

*  *  to  her  in  thatperson'sj^^l^^  '  ^;       ^  '        '  / 

,  '\       Therefore,  every  test  is  ^  achievement  test'  iii  a  senfie  that  it 
measures  something  that  has  been  learned  or  achieved^     .    .  ' 
The  distinction  between  test^  as^ichievement  measures^  ^ntf  apti- 
/ tude  measures  is  not  a  function*  of  the  partiqular  question,  that  is 
thQ  skills  or  knowledge,  but  rather  of  the  purpose  for  which  the 
:  :     tests  are  used.  /  "  . 

Where  the  purpose  is  ta,4ook  ahead,  to  foprecast  probable  future 
\   pedformaiice,  we  tend  to  aay  thati  is  ^im  ^Btitude  measure.  In  a 
•  sense  that  is  different  from  the  man  in  the:<weet's  use  of  the  term. 

The  typical  Hian-in4heH3l;r^t  inter^^ 
/  other  is  fairly  close  to  som^  consfi^it©^  only  or  inborn  or  invar-  . 
iant  characteristic.  That  is  not  the  ufife^s  of  the  measurement^f 
the  professional.  ^ 

Achievement 'teste  in  the  sense  in  which  We  have  used  that  term 
here  today,  la  connection  ysrith  the  medical  adniidsion  tests,  are  a 
real  measure  of  biolbgiccd  information,  clearl^ri  achievetnent  test  v. 
biiVin  terms  of  the  purpose  for  which  |he  sccfce  is  used,  thal^is  an 
aptitude  f^st. 

We  publish  the  most  widely  used  test  called  an  aptitude  test  to 
high  schools.  If  you  look^at  that  test,  there  are  sections  in  it  th^it  to 
'    the  naked  eye  look  very  much'like  teste  that      call  achieyegicafit 
teste,  spelling,  English,  arithnietic.  a; 

What  is  the  justification  for  calling  it  aptitude?  It  is  tipt  fite 
purpose  is  dMferent  from  the  purposes  for  which  we  use  t^ste  we 
call  achievement  teste.  There  you  want  to  measure  pr^neat  stetus, 
'    you  want  to  treasure  how  touch  has  been  leam^  oyer  th^  period 
;  .    of  time  or  you  want  swne  diagnostic  information  ,ab6ut  slalls,  and  . 
•so  on.v      A  V  ,  .  ^ 

So  if  for  Whatever  reasons  it  is  thought  beneficial  to  maintain  in  - 
the  bill  Uiose  terms  to  connote  some  distinction  in  the  drafter's 
mind,  then  I  think  thqse  intentions  ought  to  bfe  madp  clear  in  the 
definition  section  because  they  fr&  not  in  the  present  language  - 
used  in  the  sense  in  which  no^  most  measurement  textbooks  Or 

•  other  measuring  literature  Vould  use.  '  v  . 
I  would  say  there  is  no  reason  why  the  terms  cannot  be  used  in  a  '  . 

special  sense  in  the  bill  as  long  as  the  intended  discrimination  is 
made  clear. 

In  the  GHlbbons  bill,  for  example,  I  think  I  understood  after  his 
presentsftion  yesterday— certainly  better  than  I  had  on  reading  the 
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bill-^what  it  is  he  has  in  nund  in  making  the.  distinction  himself 
between  measures  of  acMevement^  w  ef  aptitude*  < 

I  wolild  still  not  be  sure  thit  I  have  caught  on  to  whftt  he  is 
after.  All  I  would  say  is  I  would,  like  to  see  the  definitions  made 
clear,  of  ^which  kinds  of  tests  ar^  contemplated  where  there  is  a 
distinctidn  made,  between  them. 

^Mr.  Weiss.  We  now  find  ourselves  in  a  situation  where  L  have  td 
go  down  and  vote.  I  still  have  merer  questions.  I  don't  know  how 
tight  your  schedule  is.  We  could  just  as  easiljb^  handle  it  by  submit- 
ting written  questions  to  all  of  you  and  get  responses  back^:  and 
that  may  perhaps  be  the  most^effective  way^f  doing  it. 

I  am  very  grateful  to  all  of  you  for  your  participation.  You  have 
managed  to  raise,  I' think,  many,  many  more  questions  than  we 
had«  anticipated.  Tliiemk  you  Very  much  for  your  cooperation. 

The  meeting  stands  a4jpumed' subject  to  the  ccOl  of  the  Chair. 

[Whereupon,, at  12:57  p.m.,  the  subcommittee  was  adjourned,  to 
reconvene  subject  to  the      of  the  Chair.] 
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TRUTH  IN  TESTING  ACT  OF  1979;  THE 
EDUCATIONAL  TESTING  ACT  OF  1979 


'  MONDAY,  SEPTEMBER  10,  1979 

House  of  Representatives,  ^ 
Subcommittee  on  ELiBMENtARY,  Secondary, 

Ai^p  Vocational  Education, 
C0MMITTE6  ON  EpucATiON  AND  Labor, 

„      Washington,  B.C. 

The  subcommittee  met,  pursuant  to  notice,  at  9:30  a.m.,  in  room 
2175,  Rayburn  youse  Office  Building,  Hon.  Carl  D.  Perkins  (chair- 
man of  the  subcommittee)  presiding.  .  ■  v  *  1  1^*11 

Members  present:  Representatives  Perkins,^  Andrews,  Miller, 
Weiss,  Kildee,  Kogovsek,  Goodling,  Erdahl,  and  Hinson.  ■ 

Staff  present:  John  F.  .Jennings,  msgority  counsel;  Nancy  L. 
Kober,  staff  assistant;  Jeffrey  W.  Brennan,  staff  intern;  Richard 
DiEugenio,  minority  legislative  associate;  and  Martv  LaVor,  minor- 
ity senior  legislative  associate.  „,  <  .  C.  J 
Chairman  Perkins.  The  Subcommittee  on  Elementanr,  Second- 
Wy,  and  Vocational  Education  is  continuing  hearings  today  on  two 
pieces  oflegislatioii  dealing  with  standardized  tests. 

H.R.  3564,  introduced  by  Congressman  Gibbons,  would  require 
that  certain  information  about  educational  and  occupational  admis- 
siohj  tests  be  made  available  to  persons  before  and  after  taking- 
l/h^Bo  tests* 

'    6.R.  4949,  introduced  by  Congressman  Weiss,  affects  educational 
testing  for  admission  to  pdstsecohdary  institutions,  and  mandates 
^        disclosure  obtest  questions  and  correct  answers  after  an  examina- 
tibnlhas  been  given,  upon  request  of  the  test  taker.       ■.     . '  ^ 

The  subcommittee  held  2  days  of  hearings  on  these  bills  in  July 
and  ^August.  These  hearings  revealed  the  complexity  and  impoi^ 
tancfe  of  the  issues  surrounding  the  two  bUlB-  We  have  ^invited  a 
panel  of  distinguished  witnesses  today  in  order  to  more  thoroughly 
expldre  all  the  issues  raised  at  the  last  set  of  hearings.  .,  ^. 

I  will  call  the  panel,  and  we  will  withhold  our  questions  until  the 

totire  panel  testifies.  ,    n  ^        i.-     1  tvta 

Will  Mrs.  Virginia  Sparling,  president  of  the  National  Ki  A, 
come  around  and  tafee  her  seat?  '      .  « 

'       Dr.  Philip  Rever,  director,  Washmgton  office,  American  college 
testing  program;  Dr.  Vito  Perrone,  dean,  school  of  education.  Uni- 
versity of  North  Carolina;  Dr.  Frank  Snyder,  McGraw-Hill,  repre- 
^senting  the  Association  of  American  Publlshjers,  and  Dr.  Paul  b. 
nPottinger,  executive  director,  National  Center  for  the  Study  ot 
Professions.  / 

.       •         ,  -  .  -        (89t)  ,  ' 

•  "  '   .     '  ■  *•■.•' 
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;  We  will  hear  from  you  first,  Mrs.  Sparling.  We  are  delighted  to 
welcome  you  all  here. 
Co  ahead,  Mi^.  Sparling.|^ 

STATEMENTS  OF  VIRGINIA  SPARLING,  PRESIDENT,  NATIONAL 
CONGRESS  OF  PARENTS  AND  TEACHERS;  PHILIP  REVER,  DI- 
RECTOR, WASHINGTON  OFFICE,  AMERICAN  COLLEGE  TEST^ 
ING  PROGRAM,  ACCOMPANIED  BY  RICHARD  FERGUSON,  VICE 
•  ,  PRESIDENT  OF  ACT'S  RESEARCH  AND  DEVELOPMENT  DIVI- 
SION; VITO  PERRONE,  DEjAN,  SCHOOL  OP  EDUCATION,  UNI- 
VERSITY OF  NORTH  DAKOTA;  FRANK  SNVDER,  McGRAW- 
HILL,  REPRESENTING  ASSOCIATION  QF  AMERICAN  PUBLISH- 
ERS, ACCOMPANIED  BY  ROY  H.  MILLENSON,  AAP,  WASHING- 
TON OFFICE;  PAUL  S.  POTTINGER,  EXECUTIVE  DIRECTOR, 
NATIONAL  CENTER  FOR  THE  STUDY  OF  PROFESSIONS 

STATEMENT  OF  VIRGINIA  SPARLING,  PRESIDENT,  NATIONAL 
^    CONGRESS  OF  PARENTS  AND  TEACHERS 

Mrs.  Sparung.  Mr.  Chairman  and  members  ofihe  subcommit- 
^  tee/ 1  wish  to  thank  you  for  the  opportunity  to  offer  testimony  on 
.     H.R.  4949,  The  Educational  Testing  Ad  of  1979. 

I  am  Virginia  Spading,  president  of  the  National  Congress  of 
^  ;  Parents  aiid  Teacheryan  organization  of  over  6.5  million  members. 
*  The  PTA  endorsedRK^  Educational  Testing  Act  as  an  important 
step  in  providing  students,  parents,  and  educators  with  more  infor- 
mation about  standardized  tests.  The  PTA's  support  for  this  legisla* 
tion  is  not  to  be  constfued  as  opposition '  to  testing,  but  rather 
viewed  as  a  concern  that  the  public  be  better  informed  of  the 
nature,  purposes,  uses,  and  limitations  of  standardized  testing. 

The  PTA  feels  that  the  proposed  legislation  insures  the  proper 
use  of  tests  bv  requiring  testing  companies  to  disclose  information 
\  which  will  help  reduce  misunderstandings  and  avoid  misuse. 
*    I  would  like  to  comment  briefly  on  the  ms^or  concerns  of  parents 
and  teachers  that  have  prompted  PTA  to  endorse  this  legislation: 

(1)  Accountability  in  the  testing  process:  From  early  cnildhood 
through  entry  into  professional  schools  or  jobs,  standardized  tests 
/         make  significant  judgments  about  our  children.  Yet  no  portion  of 
the  public  school  system  is  less  understood  than  the  facts  about  ^ 
standardized  tests,  their  assets,  and  their  limitations.  ^  / 

The  National  P1?A  is  deeply  concerned  that  testing  programs  are 
being  authorized  without  ^y  broad  public  discussion  of  trie  issues. 
As  parents  and  teachers,  we  feel  it  is  important  to  achieve  a 
.  greater  degree  of  accountability  in  the  testing  process  yet  such  ^ 
review  of  public  discussion  is  difficult  because  of  the  security  that 
surrounds  these  tests. 

Due  to  the.npiask  df  security,  the  public  has  been  unable  to 
evaluate  dispassionately  the  claims  of  testmakers.  Information 
abbut  the  tests  and  the  testing  process  is  minimarand  is  itarely'* 
shared  after  the  fact  with  those,  most  intimately  concerned  stu- 
dents and  their  families^ 

Yet  these  tests  serve  as  gatekeepers  to  the  future  for  our  chil- 
dren; they  develop  patterns  of  expectation  by  teachers  and  school 
systems  that  often  are  totally  unrelated  to  a  child's  true  capabili- 
ties; and  because  the  power  to  X^s^M  the  power  to  influence  cur- 
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riculum,  thpe  is  a  tendency  to  reinforce  cuTrriculum 'patterns  that 
respond  on^  to  the  ultimate  goal  of  looking  good- pn  the  national 
•tests..  ■ 

An  evaluation  of  assessment  requires  a  great  deal  . more  informa- 
tion than  is 'now  available  to  parents  and  students.  The  barrier  of 
security  noW  keeps  us  at  arm-s  length  from  the  process.  That  is 
why  we  Iook  to  legislation  like  H.R.  4949  as  a  way  of  not  only 
accomplishing  specific  improvements,  but  as  a  riiethbd  of  providing 
us  with  more  information  about  the  testing  process  and  use  of  the 
besting  results  which  sha|)e  children's  lives.     /  ) 

(2)  the  purpose  of  testing:  To  improve  children's  education: 

For  years,  experts  have  told  us  that  th^re  are  flaws  m  the 
present  norm  referenced  standardized  testing  proc?ess  but  that  we 
must  use  it  because  ^Mt  is  all  we  have/'  As  parent^,  we  are  no 
longer  convinced  of  that  argument.  / 

Testing  must  be  responsive  to  the  majoj^  goal  of  a  public  school 
system,  improvement  of  the  education  of/children.  We  know  that 
many  school  systems  are  moving  toward/  testing  systems  more  in 
keeping  with  local  goals  and  that  children  are  being  tested  in  every 
classroom  not.  so  much  to  compare  them/ with  other  children  in  / 
distant  schools  systems,  but  te  determine  whether  they  are  learn- 
ing in  accord  with  the  objectives  of  each  local  school  system,  and  to 
determine  the  effectiveness  of  the  system  itself  in  implementing 
these  goals. 

(3)  the  impact  of  national  sampling  on  local  school  antonym: 
Sampling  of  a  national  basis  may  not  provide  meaningful  compari- 
sons. The  approximately  16,000  local  school  districts  produce  a 
variety  of  local  educational  objectives,  and  different  timetables  at 
which  specific  skills  are  emphasized.  Nationwtide  tests  are  not'  ade- 
quate substitutes  for  local  assessments. 

Unless  we  are  planning  to  move  into  a  national  curriculum, 
these,  differences  of  timing  and^mphasis  will  continue  to  exist.  But 
a  child  should  not  be  penalized  because  a  local  school  system  has 
chosen  a  different  sequence  than  the  itestmaker.  Nor  should  these 
important  determinations  Cjjass  from  the  hands" of  local  school 
boards  who  are  aqcounte})le  to  their  communities  to  the  hands  of 
test  producers  who  are  not  accountable  at  all. 

(4)  is  the  balance  of  time  use  in  a  classroom  changing  from 
"teaching''  to  "testing'7  As  public  schdol  students  return  to  classes 
they*  pan  expect  to  take  more  tests  tharf  ever  before,  which  leads  to 

.  questions  such  as:  Js  this  an  effective  use  of  the  professional  educa-^ 
tor's  time?  4         .     "  * 

Is  this  tl;e  most  productive  use  of  a  child's  limited  classroom 
time;  and  are  there  ways  we  could  ^get  the  answers  we  need  with- 
out further  disrupting  the  already  fragmented  schoolday? 

The  fifth  concern,  the  PTA  is  concerned  that  children  be  tested 
on  what  they  hav^een  teught.  \yithout  this  knowledge  we  do^^ot 
know  whether  the  sVstem  or  the  child  is^responrible  when  learniltig 
does  not  proceed  in  an  expected  rate  or  jpattern. 

If  there  is  to  be  ^anV  j||countability  of  local  schools  and  if  testing 
is  to  be  used  as  a  de^^^^mental  tool  so  that  a  teacher  can  specifi- 
cally pinpoint  the  ne^\appr6priate  steps  for  each  youngster,  this  is 


essential. 
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Parents  and  teachers  are  concerned  about  who  participates  in 
test  construction  and  the  bdsis  on  which  these  people  are  chosen. 
This  information  'Would  be  useful  in  understanding  the  way  in* 
which  tests  are  constructed.  » 

Knowledge  concerning  what  tests  purport  to  measure  is  critical 
80|  that  judgments  are  confined  only  to  what  is  measured.  Testing 
COTnparries  report  they  are  blameless  for  the  misuses  of  test  results 
yet  there  are  often  conflicting  paints  of  view  among  various  school 
sygtemg  about  what  the  test  results  indicate  and  what  information 
can  be  gleaned  from  the  test  scores. 

If  test?'  nianxrfacturers  must  define  th6  purpnoses  of  the  tests, 
parents  and  teachers  will  be  better  able  to  restrict  the  use  of  'Such 
data  to  the  purposes  for  which  they  are  intended;  arid  there  is  an 
information  void  on  how  standardized  tests  address  the  unique 
testing  needs  of  handicapped  and  disadvantaged  youth.  » 

T)ur  seventh  cpncern  is  test  usage,  how  tests  are  used,  when  and 
by  whom  is  information  desperately  needed  There  is  some  concern 
about  a  redundancy  of  testing  and  a  discussion  is  necessary  to 
determine  how  selective  we  have  been  in  accepting  a  whole  range 
of  testing  to  which  we  subject  children. 

Multiple  choice  or  short  answer  type  of  questions  iiriiit  the  abili- 
ty to  measure  a  full  range  of  skills.  For  example,  the  ability  to 
write  well,  to  organize  and  transfer  thought^^to  paper,  requires 
testing  of  a  written  sample,  yet  for  many  years  we  haye  tested 
vi^riting  skills  by  multiple  choice  questions. 

/  Why?  Because  it  was  easier  to  score.  We  reduce  writing  to  the 
/rote  principles  of  grammar,  spelling,  and  punctuation,  and  then 
(wondered  why  children's  writing  skills  deteriorated.  We  must  rec- 
ognize that  methods  of  testing  must  be  made  on  criteria  other  than 
what  the  computer  can  efficiently  score. 

There  is  no  clear  indication  of  who  is  iresponsible  when  national^ 
tests  backfire  or  are  misused.  At  present  some  problems  are  caught" 
by  random  spotting;  others  are  suspected  but  never  verified:  Is  the 
testmaket  responsible?  Is  the  school  responsible?  Or  is  it  only  the 
student  user?  .  '      ^     ■  ; 

Certainly,  tests  are  only  one  measure  of  a  person's  ability,  but 
because  they  are  so  broadly  used,  the  significant  questions  about, 
their  effect  and  reliability  must  be  thoroughly  aired  and  other 
potential  measurement  techniques  carefully  considered. 

I  would  like  to  insert  into  the  record  thetattached  excerpt  from  a 
decent  publication  of  the  National  PTA,  the  Testing  Maie.  Note 
pagiBs  16  and  17,  a  particular  excerpt  dealing  with  parents  and 
teachersV  concern  that  we  look  at  children's  strengths  and  weat 
nesses  in  d  realistic  manner,  and  suggests  many  ways  of  assessing 
a  child's  growth.  .     *  - 

[The  information  referred  to  above  follows:]         v  , 
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THE  TESTING  MAZE 

^  by  Dr.  Chtflottc  Ryan 


Testing  —  as  evaluation  of  experience  —  is  a  part  of  all 
teaching  and  learning.  Teachers  need  "feedback"  from 
students  in  Order  tordetermine  how  well  they  are  communis 
eating  and  to  check  on  student  profrtts  in  atuining skills  and 
grasping  ideas. 

Students  need  testing,  too.  in  order  to  determine  how  well 
(hey  have  absorbed  new  subject  matter.  Both  teachers  and 
students  use  the  results  of  tests  to  report  progress  to  parents. 
.  No  one  test or  group  of  tests  —  can  evalQate  liilly  a 
student's  work.  It  is  even  harder  to  evahiate  a  student's  abil> 
ily.  Any  single  test  can  tell^not  what  a  student  "can  do"— 
only  what  a  student  <//^</o  with  that  particular  content  at  thai 
particular  time.  Thus  schools  commonly  use  several  kinds  of 
tests  at  different  times  to  get  a  better  picture  oCa  student's 
strengths  and  needs. 

Some  qualities  such  as  individual  talenU  and  attitudes  can*, 
not  he  rDeasured:  they  can  be  identined  only  with  limited 
accuracy.  Recognition  and  appreciation  of  these  qualities 
are  beyond  the  realm  of  tesu. 

Parents,  teachers,  and  students  can  learn  more  from  the 
tests  given  in  their  schools  ifthcy  understand  that  (I)  there 
are  diXTerent  kinds  of  teats  with  different  purposes;  (2)  all 
tests  are  limited  in  what  they  measure  and  what  they  can 
telt  about  the  student;  and  (3)  misuse  of  tests  can  be  harmful 
to  students. 

Tests  have  other  purposes,  of  course,  beyond  providing  ^  ^ 
feedback  for  teachers  and  students.  Other  people  b#ides 
parents  and  teachers  want  an  account  of  student  pr^ress 
—people  who  want  t6  measure  pro^reu  by  comparisons 
with  other  students  in  other  sch(>ob. 

School  administrators,  for  instance,  seek  a  basis  on  which 
to  evaluate  the  curricula  and  the  quality  of  instruction  in  their 
schools  —  a  basts  ofi  which  they  can  consider,  improvements; 
also  a  buis  on  which  they  ean  report  to  school  boards  and  to 
the  public. 

People  who  move  into  a  new  community;  employers  and 
college  people  who  are  critical  of  higH  school  preparation: 
legislators  and  taxpayera  who  question  the  use  of  public 
funds;  researchers  in  education  who  want  statistical  data 
all  IhcM  groups  are  intereeted  in  comparing  the  eftectiveneu 
of  one  school  v^th  another  according  to  some  common 
measures.  In  satisfying  aU  these  interesu.  schools  have  come  ' 
to  depend  on  what  is  known  u  "standardized  testing." 

Standardized  testing  is  now  a  regular  psrt  ofschbol  life  for 
90  percent  of  American  schoolchildren-  Prom  kindergarten 
through  high  school,  a  child  may  uke  six  full  "batteries"  of  ■ 
achievement  tesU  —  maybt  more  —  in  addition  to  other ' 
standardized  tests,  such  as  those  that  gauge  reading 
readineu.  IQ.  and  scholastic  aptitudes  for  college. 

These  ttsts  are  sent  to  be  scored  by  computer  in  a  relativdy 
few  ceaters  throughout  the  United  States.  Ordinarily,  the 
tests  are  developed  over  severiil  years  with  extensive  research 
and  ttmple  testing.  They  are  based  on  what  tHe  tesPnukers 
think  schools  will  be  teaching  a»(ar  u  ten  years  ahead, , 

Because  Ihe  test  items  are  kept  ^^Woire"  by  cont/act  with 


the  schools  that  use  them,  they  can  be  used  repeatedly  in  the 
same  tests  pr  in  other  corhbinations.  Test^makers  say  that  if 
new  tesU  had  to  be  developed  more  frequently,  the  costs 
wouU  be  two  or  three  times  as  great.  The  test  items  have 
ordinar|)yremainedJn  use  for  20  years.'  /  6 

Bothcommercial  publishing  houses  and  not-fof-pront 
organizations  are  among  the  43  publishing  rirmft hat  provide 
between  200  and  300  million  tesU  each  year.  / 

American  school  systems  are  estimated  to  hine  spvit  as 
much  as  a  quarter  of  a  billion  dollarsJast  year  in  the  variety 
of  activities  related  to  giving  standardized  tesu  to  more  thai} 
40  million  elementary  and  secondary  Khool  children.'  , 

This  would  include  the  owb  of  preparing  the  tests  as  well 
as  the  costs  of  scoring  them  by  computer.  Additional  expen- 
ditures for  textbooks  and  materials  resulting  frnm  or  relating 
to  tests;  the  time  spent  by  teachers,  stsff.  and  studenU:  the 
f  rowing  inves'tment  in  coachtng.studcnts  for  tests;  the  costs 
of  ccrtiHcalion  procedures,  as  well  as  colUge  placement  and 
Khoisrship'Krvices  dependent  on  the  tests    all  of  these  are 
thought  to  add  considerahly.  to  the  funds  spent  in  hehsif  of 
standardized  testing,  which  has  by  now  become  a  major 
industry  built  around  American  schools. 


WHAT  IS  STANDARDIZED  TESTING? 

How  does  a  "standardized"  test  differ  from  the  tests  that 
teachers  devise  and  give  periodically  to  students  to  check  on 
instruction  in  their  own  classrooms? 
.  The  first  difference  is  that  a  "standardized"  test  could  be 
any  test  which  large  numbers  of  students  take  under  similar 
conditions. 

A  standardized  nor'm'referf  need  achievement  test,  which  4s 
ihe  type  most  widely  used,  is  given  to  thousands  or  even  hun* 
dreds  of  thousands  of  students  in  many  different  schools  and 
school  systems  throughout  the  country.  The  tests  do  not 
relate  so  much  to  what  stvkdents  may  be  studying  in  school 
at  any  particular  time  as  they  da  to  general  "constructs" 
—  such  as  reading  comprehension,  number  concepts,  or 
compuution.  ' 

The  second  difference  is  that  the  scoring  of  a  norm-refer* 
eoced  stindardized  test  is  different  from  that  of  a  regular 
clauroom  test.  The  tests  do  not  represent  what  a  student 
should  accomplish,  but  rather  a  range  of  whit  students  on  a 
given  grade  level  ordinarily  accomplish. 

The  tests  are  set  up  so  they  can  be  scored  by  computer. 
That  hf^  a'student  is  given  a  choice  of  answers  to  each  ques* 
tion.  and  a  box  to  mark  —  which  the  "scanner"  picks  up. 

The  test  "items"  are  tned  out  with  samples  of  ftudenu 
who  itpresent  a  cross-section  of  students  to  be  tested.  The 
results  6f  the  sample  testing  are  used  to  establish  "norms"  of 
perfo/man'ce  by  which  other  students  who  take  the  test 
bes^red.  ,  .  • 

le  objective  of  the  test^makcrs  is  to  sort  out  ^nd  rank 


\  ^ 


itudcnu  iocordfflt  to  theic  nonfis  of  (terformince.  There- 
fore ihcy  d«vUc  ■  test  in  Whkh  htif  the itudeViU  will  ipore 
above  an  average  point  and  hair  Mow  (he.averife.  The  tests 
are  revised  until  this  outcome  is  achieved.  This  average  point 
then  becomes  the  **norm"  or  "grade  level"  Tor  that  group  or 
students.  Other  studenu  who  take  the  lest  are  scored  in  tela-, 
tion  to  that  norm.. 

The  .test  scores  ne  reported  in  terms  or"peroeotiles."  A 
student  who  scored  at  gride  level  would  be  reported  at  the' 
50th  percentile.  It  is  not  expect«d  that  many  studenu  will 
achieve  high  scores.  For  instance;  a  third  grader  who 
answered  correctly  33  or  60  items  on  a  certain  Stan  ford 
Achievem^t  Test  in  reading  wtAild  be  scored  at  the  SOth 
percentile:  eiwctly  aggrade  level. 

The  placing  or  a  student  in  relation  to  this  norm  may  not 
conform  very  closely  to  actual  dauroom  perrormance. 
Nevertheless,  those  whow  test  scores  Tall  under  the  norm  are 
likely  to  feel  --'or  be  made  to  feel  -~  a  connotation  of  failure. 


OTHER  STANDARDIZED  TESTS 

$ome  tesls  ask.  sifhply/'What  do  yoiAnowT ' 

A  norm-rererenced  test  asks.  *'What  do  you  know  on  this 
set  of  questions  in  comparison  to  what  other  students  knowT' 

There  are  other  kinds  or  standardized  tests  which  ask. 
"What  do  you  l^now  comi>ared  to  what  the  test>maker  . 
"  kriow^"  ■  > 

The  well-known  Schotqslfc  ApHtude  Test  (SAT),  for 
instance,  is  a  straight  measure  or  perrormance  on  Tairly 
ttripgent  tests  of  verbal  and  mathematical  skills. 

The  SAT  tests  college-bound  students  who  choose  to  Uke  ' 
the  test  ^  not  all  do^  for  likelihood  of  success  in  college: 
It  Is  not  norrn'referenced. 

Criterton-referencedtt$u  arc  gaining  in  popularity 
because  they  relate  directly  to  ceruin  ipeciHc  instruction. 
'  They  measure  a  student's  mastery  of  spedfic objectives  and 
thus  give  Tee^back  on  the  individual  student's  strengths 
and  weaknesses. 

Oomain-referenced  tests  are  similar:  they  are  based  on  a 
broader  area  or  study,  such  as  elements  or  English  or  math. 
They  might  give  a  longer-term  measure  orinsfruction. 

Teacher-made  criterion -re lerenoed  tests  have  some  advan- 
tages in  being  fitted  to  the  work  of  that  particular  clau. 
Some  say,  however,  that  the  tests  should  be  comparable  i- 
tbat  is.  standardized    irthe  scores  are  to  be  crWtible.  It  is 
said  that  the  instructional  obj^lves    and  the  icoring  —  ' 
should  be  given  the  benefit  ot standardizing  technology,  in . 
order  to  represent  a  child's  woriaocuritely. 

ir  a  school  accepts  externally  developed  criterion-rerer' 
enccd  tests.  It  must  also  accept  the  curriculum  on  which  the 
tests  are  based.  The  test  results  reajd  something  tike:  **kiiows 
how  t(f  do  long  division;  does  not  know  how  to  divide  frac- 
tions." The  tesu  ihemselvea^re  "secure.'*  so  that  parents  and 


sludenu  cannot  interpret  the  reiulu  Tor  themselves. 

The  problems  of  this  kind  of  standardized  testing  are  still 
belngexplored. 

The  National  Assessment  ofEducationsI  Progreu  is  a 
fedetilly  funded  national  program.  It  gives  standardized  tesU 
to  umples  of  studenU  and  others  aged  9. 13, 17.  and  26  to  35 
on  a  number  of  educational  programs. 

The  tesu  A  recycled  every  (hree  years  to  determine  trends, 
in  educatiofflprogress.  according  to  thf  followihg  schedule. 


Iwrofeduo 
UM^recyc 
onK)rogn 

fit 


Cydtl 

1969^70  CitlzenlC^,  Science. 
VVrtting 

1970-  71  Reading,  Li1er«luro 

1971-  72  Social  Studies.  Moak: 

1972-  73  Klalh, Science. 
't973>74  Writing.  Career  and 

Occupational  Devetopmant 
1974-75  Art.Cftsenahi^ 


Cyctoll 

1975-  76  Reading,  literature 

1976-  77  Music.  Sodal  Studies 

1977-  76  Math.  Science 
■1976-79  Writing.  Career  and 

Occupational  Developmeni 
1960-61  Reading,  literature 


The  resulu  will  not  help  ichool  districU  directly  as  other 
sUndardized  tesU  may  do.  They  are  reported  Tor  the  nation 
'  as  a  whole,  and  Tor  four  regions  ~  never  Tor  sUtes  or  school 
districU.  ^ 

Rather,  the  trends  shown  in  repeated  cycles  are  intended  to 
help  educators  in  aiseasing  educational  needs  in  a  very 
general  wa/.  For  example,  knowledge  of  science  —  which  is 
the  on|>  area  that  has. been  tested  three  times — has  been 
round^o  have  declined  seriously  in  these  last  ten  years. 

Those  who  take  the  tesU  respond,  naturally Trom  their 
whole  experience — not  from  their  school  experience  alone. 
The  aga  ofthe  children  tested  do  not  correspond  exactly  to 
grade  levels.  Thus  the  test  resulu  could  conceivably  be  of 
value  to  other  than  educators.  Publishers  of  various  types  of . 
materials,  for  insUnce.  might  find  the  scores  very  helpful. . 

The  same  tesU  are  available  to  sutes  for  asseMment  by 
umpling  of  their  own  stiidenU.This  is  a  possible  alternative 
to  other  sorU  of  sUndardized  testing  in  that  ( 1)  individual 
studenu  cannot  be  identified}  (2)lhe  time  burden  of  taking 
the  ume  set  9f  tesU  cari  be  divided  among  several  studenU  of 
the  ume  age:  and  (3)  daU  ate  available  fcoih  the  national 
'  atosment  for^mparisons. 

HOW  ACCURATE  ARE  TEST  Scores  UkELY  TO  BE? 

Norm-referenced  achievement  tesU  purport  to  tell  us  how 
any  group  of  studenU  comlhrei  with  other  gr'oups  of  studeaU 
in  the  ume  grade.  School  systems  use  t»  norm  of  each 
group  as  the  basis  of  compariaon.  How  accurate  U  this  com* 
parison  likely  (o  be?  . 

A  number  of  factors  affect  individual  test  scores.  For 
example: 

•The  /^umptiotu  underlying  many  test  items  may  be 


foreiftn  to  i  chlld't  thrnklni  aod  ex^rieocc.  Twtpmaken  do 
look  al  widely  used  textbooks  in  conalnictioi  1«U.  Never- 
Iheleu.  ftttdcau  takiitf  a  leit  in  Iowa,  Appaladila.  and  ioner- 
diy  Bofion  almoal  inevitably  have  had  dirterefll  idiiructiofi 
,a  Bcj  widely  diiTermi  experienoea  io  life. 

For  ljutance.  f  group  of  inner-city  children  were  baflkd 
when  they  were  uked  whether  a  lark  was  a  checK*  a  biid*  an 
.  aulomobtlc.  or  a  dog.  Tl^  all  knew  it  was  a  widely  adver- 
liaed  cigarette.  Other  c^ren  might  have  known  it  wu  both 
a  bird  and  the  name  of  an  automobile.  Which  should  they 
chooad? 

•The  lime  allowed  to  complete  the  test  Is  limited,  the  score 


a  child  achieves  depends  largely  on  how  much  of  the  testis 
^  coRipkted  within  a  given  lime,  since  all  incomplete  answers  * 
are  scored  u  incorrect.  Thus  a  dhild's  speed  in  doing  the  tesl 
could  be  u  important  f  s  giving  correct  answers. 

Teachers  in  most  schools  coiich  students  in  how  to  ta^e  the 
lest*.  "Work  fast,"  they  say.  "Fill  the  squares  neatly  —  com- 
puters won*l  score  a  right  answer  poorly  marked.  And  most 
ofall.  don't  think  loohard!" 

•  The  wording  of  many  test  quesli<^nsi<  ambiguous.  Because 
of  this.  imaginail)M  students  lend  lo  do  badly.  Place  yourself 
in  the  posilion  ofoie  child  choosing  answers  in  the  following  • 
typical  examples  of  questions  in  suodardizcd  tests:  * 


t.  An  orange  se^  grows  tnto 

a.  anorangetrte  ■ 

b  anorange 

c  sAMhefaeed 

d  ' an  orange  tAMom 
(Sa9nc9  Rmwch  A$M6«fee.  ^cMevemen/  5*^.  6lu9  Gf^n 

7  in  wvrnwMlher.waiarcnar^  MO  water  vapor  and  rieesiTYlo 
theair  1^  Ma  walar  vapor  changes  into  ram  or  snow  and  talis  to . 
the  earth.  Thia  procees  is  caHed 

a  tvapora^ 

b  condertsaiion 

c  precipfUtion  . 

d  the  water  cycle 
iStvilvd  Actii9Wn9nl  T9ti  Phmafy  L9Vh  1977) 

3  Whi^  one  o<  these  drawvtgamoalrwartyshowa  the  v^ys^und 


1^ 

M 

a 

H 

^AI#<ropoMitnAch^v«m«nrya«t  /nlarmed^lev«'«  1970/ 


.  In  each  case  a  thoughtful  ifudeal  could  Hod  reasons  to 
check  any  gne  of  the  answers:  but  a  standardized,  computer- 
scored  test  cannot  take  into  account  the  reasoning  of  a  ilu- 
.dent.  NoMoes  it  pretend  to  examine  how  much  a  student 
knowrs  about  any  given  subject.  All  ihe  test  does  is  tell 
whether  the  student  gives  what  the  computer  hu  been 
programmed  to  accept  u  the  answer  to  a  given  question. 

Perhaps  in  recognition  of  the  fact  (hat  no  question  which 
uks  for  any  degree  of  analytical  thinking  can  have  just  one 
answer,  large  numbers  of  standardized  tests  ask  for  the  bat 
answer  rather  than  for  the  answer. 

For  example,  a  reading  test  in  the  current  California 
Achievement  TesU  (CAT)  describes  the  sucoesn  of  t  wo 
itudenu.  Margo  and  Bert*  in  planting  a  garden  in  a  vacant  lot 
later  preempted  by  the  city  for  a  parking  lot.  The  studenU 
surveyed  the  neighborhood  people  for  their  views  on  what' 
had  happened. 

Several  queelioas  wiiA  multiplo^holce  answers  include  the 
following:  ''What  will  the  ttudtoU  probably  do  with  tbi  ' 


rciulu  of  the  lurveyT*  ind  **Which  of  the  followtnk  words 

'  c  latitude  suggctted  by.  the  quectiont  — Vhich 
1  have  been  euay  queslkwi  —  the  compMler  itil) 
lly  one  tniwer  correct.  Student*  Mmetlmet 
Rn  that  the  muttipk-choke  answers  ofTered  in  iBch 
queitioni  omK  ei^uaily  pUusihIc  or  even  better  answers.  It  is 
noi  dear  to  them  why  a  **tc$l"  should  not  require  correct 
answers. 

•Another  major  problem  for  children Js  that  many  items 
infeitded  to  test  ■  particular  skill  alto  require  ipcdal  knowl- 
edge. Forinsunce.  th^  following  is^n  excerpt  from  a  third- 
grade  reading  (est: 


A  c(n<^  it  a  piece  ol  ^ 
rock   tend  firabnck 
,  burned  coal* 


Is  the  child  who  does  n&t  know  the  answer  therefore  unible 
to  read? 

•The  tats  all  too  frequently  exhibit  insensitivity  to  the 
Ceelings  of  non-Caucasiap  chik^ren  —  an  insensitivity  that 
affeoti  the  self-eateem  of  (he  children  and  thus  their  learning 
p^ofreu. 

The  following  two  questions  reflect  this  insensitivity.  and 
also  use  language  generally  unfamiliar  to  children. 

When  a  dove  beg^  to  tjLoc^m  wKh  crowt,  its  feathers  remain 
but  its  hean  grows  Mack 


v 


a  black 
b .  wtute  ■ 
c  dwty  . 
d  spread 
e  0P<x) 

{LotQ9'  r/wn<*fce  Mu*'Lev»f  BdtWi,  L^\vafbal  Battery,  p  3) 


Howihe_ 


_  roses  itufth  up  in  the 


■  a  whde 
b.  pretty 
^  c  small 
d^ye«ow 
e  red 

The  "correcTaAtwer  it»''re<r  —  but  oo»y  if  tfte  cheek  ifi^i^non  « 
while  (SMmthLotg^rThoftxfiketa^) 

•  Children  think  difT^renily  from  adults.  A  Sunford-^inet 
subtest  for  tea>year>olds  asks  t^questions  concemingYwhy 
children  should  not  be  too  noi^y  in  school"  and  "itrhy  mdst . 
people  would  rather  have  an  automobile  than  a  bicycle. "*\ 
Quite  often  the  answers  the  ten-yeu-old  would  pick  would\ 
difTerept  from  what  an  adult  might  expect. 

•  Some  tests  reflect  other  "cuitu raises."  The  Wechsler 
Intelligence  Scale  for  Children  (Wlip)  General  Comprehend 
slon  subtest  uks.  "Why  are  criminal  locked  up?"  "Why  is  it 
better  (o  pay  bills  by  cUftck  than  by  cash?"  "Why  U  it  gener- 

.  ally  better  to  give  mon^  to  an  organized  charity  than  it-is  to 
a  street  bcggai?"  .\ 


TheK  questions  may  Ve|l  puzzle  some  children  from  very 
Ipoor  famUiet  who  have  se^  relatives  or/riends  jailed  for 
reasons  they  did  not  understand.  They  may  also  puzzle 
children  who  have  never  heard  of  a  bank  account,  or  have 
.  never  seen  evidence  of  organized  charity.* 

ChiMren  who  grow  up  in  more  orless  the  same  culture  as 
the  test-makeri  oo  far  better  6n  itandardized  tests  than  do 
childrcf)  from  a  difTerent  culture.  \ 

Numerous  studies  show  a  strong  c^rvlaiion  between 
parents*  education  and  income  le^  and  student  scores.  The 
president  of  the  Ecttgitional  Testing  Service  was  quoted  in  ' 
the  Marfan  SunJaMhl^e  of  November^  2, 1978,  as  calling 
this  "a  bias  of  oppdftnity." 

•Other  factors  thAnay  gttpci  how  well  kchild  does  on  a- 
standardized  test  -Kther  thin  knowledge  of  the  concepts 
tested  —  are  the  attitude  of  the  examjner  to  dirTerent  children 
in  a  dass,  an  attitude  which  frequently  expresses  an  expecu* 
tion  that  one  child  will  do  well  and  another  poouy;  whether  * 
or  not  the  child  had  breakfast;  the  child's  reaction  to  time 
pressure:!^  child's  view  of  the  importance  of  the\est;  and 
the  child's l^t^noe  of  ambiguous  or  trivial  quati^ 


WHAT  CAN  CTANDARDIZED  TESTS  TELL  US?  > 

»What  can  standardized  tests  actually  tdl  us  about  wHal 
.  children  have  learned? 

•The  objectives  of  sundardized  testing  are  generally  limit' 
to  content  of  facts,  definitions  and  their  applications,  4nd 
events  in  various  areas  of  language,  mathematicr.  science, 
and  sodal  studies.  The  test  scores  tdl  us  something  of  the 
child's  past  experience  or  instruction  in  relation  to  the 
curriculum  concepts  on  which  ihe  test  was  constructed,  end 
soinl^hing  of  Ihe  child's  recall  of  that  experience. 

•The  scores  givesome  measure  of  the  skills  required  to  deal 
with  the  test.  They  tell  us  somethin|  of  the  child's  n^tneu. 
facility  for  guefiinj^.  and  ability  to  work  reasonably  well 
Under  a  time  limit. 

•The  tesU  can  tell  ua  little  about  the  child's  ability  to  learn. 
(0  andyzc.  or  to  reason  —  and  nothing  of  the  child's  judg- 
ment, originality,  imagination,  or  creativity.  Nor  do  the  tests 
tell  us  how  much  a  child  knows  aboui  any  given  subject. 
Rather,  tests  simply  skim  the  surface  of  learning. 

•  Standardized  tests  are  of  no  use  in  diagn%ing  individual 
student  needs.  Test  jsreas  are  too  limited.  Further,  the  test 
questions  are  "secure."  and  returned  to  the  test*maker.  The 
student  or  parent  can  never  check  back  over  the  questions 
when  the  scores  are  returned. . 

In  some  instances  schools  can  ask  analyses  of  the  questions 
to  be  relumed  with  iheecoresi  but  that  is  not  the  same  thing 
as  having  the  quations  themselves.  Moreover,  thc^scores  are 
returned  weeks  and  even  months  after  the  test  was  taken. 

•There  are  wide  margins  for  error  in  the  individual  scores 
\themsdves.  For  instance.  a'Studenl  would  be  likely  to  $ive  ai 
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iMit  torn*  difftrM  tMw«n  00  Um  MfM  tMt  if  U  w«r«  givcti 
OB  difnpipnt  d«  w.  tbb  ■  rrMtl  what  U  c«lM  the  iiaiiUkiiJ 

iMtrmikef*  tVy  to  reduce  the  Hkettbood  ordirTcrtnt 
Ufwert  —  that  it.  to  iocr«|ie  the  tett'i  rcllabtUiy  —  by  giv. 
big  litrriUir  loits  to  Um  lamc  ttwkoU  at  dirferent  timet  and 
.by  comparing  their  awiren  for  a  "rallaUtay  coenkieot.  " 
Tbcy  remove  from  (be  tcet  it^mi  oa  whkb  itudenu  are  likely 
to  diante  their  miada  io  favor  of  a  group  ofltenu  for  wMob 
tbe"coefnokfit"itacoepu^.  ■  '     '  \ 

A  reliabOity  eoeffkieet  of  .9S  U  uld  Co  be  excellciit, 
■cc«p(aMe.and.80**notiogood."  , 

Some  of  the  moet  widety  uied  t«Mi  a  re  bated  00  a  relia- 
bility cocfrkient  of  .90.  adjMled  for  tnaveratef  tcore  of  500 
.  poinuwitbanaUowable*'itaiidirddcri>^on  of  iOOpolAU. 
This  dcviaiioQ  allow*  a  raage  of  teat  *'efror"  that  it  more  ' 
than  100  poiBU  wide. 

'  Tbat  ia,  if  a  child'i  ic^e  it  530.  it  it  "90  peicoot  ture"  that 
hiiorhertroeioor^ittoinewbcre  belwaenSOOandfiOO. 

la  perceotilea.  however,  at  icorec  arv  raoorded.  thii  meant 
that  a  icore  of  SOO  mav  be  reported  at  the  SOth  percentile, 
and  a  tSSh  of 600  at  the  Mlh  peroentile  —  a  major  dirTcreoce  • 
to  a  child,  the  child't  teacher,  and  the  chikt't pareot. 

At  the  aame  lime,  the  loorea  of  the  other  10  percent  of  the  . 
■  ttudeau  will  Ue  miulde  ihit  range  altogelher.' 

For  lucfareatOM  many  teat-makerfthemtelt^urgeatly  • 
warn  ichool  tyttemi  not  to  uk  ttandardbed^eat  icoret  for 
evaluatini  iiMfivldua)  ttudentt.  itreiting  that  the  tecU  are 
mea^tt  ooTy  to  meature  group  progreb.  Oq  the  other  hand, 
olhen  give  iutnietioot  for  interprctint  tecU  fbr  iodividualt. 

JyatkforoeoftheNatioiialupUnGdofTeachenof  . 
Efwlth  wirot  poreou  thtl  utlag  natiooal  taett  ''to  judge  an 
ioAdual  ttudent  or  to  compore  the  ttudepu  of  a  tingle  datt 
it  IVe  uiiat  the  lealea  In  a  ljru€k*weighill|  ttatloo  to  meature 
whether  everyone  In  the  family  gcU  the  aame  amount  of  ice 
cream.*? 

Almoct  univerialJy.  however,  the  tchoolt  have  badly  • 
abdted  the  tetU  by  vaing  them  to  catefOriie  it w(eoU. 
The  icorea  are  made  a  key  p^rt  of  ttudent  recordt.  Farentt 

k  \  ;  ■  ■         *  ■. 


whohaye  checked  their  tiudenu*  record  Tilct  tM^etimet  Hnd 
ftandardiied  teat  toorea  and  nothint  e|ie. 

Teat  toorea  are  uted  to  characterue  the  abililiet  of  ttudentt 
for  pventt;  to  make  clata  fuignmentt;  to  group  or  "tnick" 
itMeott  according  to  auppoted  abillly;  to  terve  u  a  batit  for 
guklaoce  in  telecting  counet  f  nd  toting  career  goalt;  and  to 
itand  at  a  prime  factor  in  awarding'W|olinhiiM. 
*  Following  the  example  of  the  fCoooK  parentt  often  give 
tett  tGont  far  too  much  importance  injudging  their  children. 
Theygiveemphaiitto*Ya0**tear«ing.whichhatrelatively  •  ■ 
Utile  itaying  power,  and  tend  to  i^re  devetopment  of  valuet 
and  ufiderttandingt.  which  contribute  to  the  groMh  of  the 
chlhl. 

Theae.abutea  of  tett  tooret  pgt  ttudenu  at  ritk  of  being 
permanently- mittabded  and  mitdirected.  while  miUiont  of 
parentt  and  ttudimtt  remain  una  wire  that  the  tcores  are  to 
,  »badly  miiuted.. 


THED1LEMMAS0F8TANDARD1ZED  TESTING 

Education  facet  a  number  of  djlemmat  in  uting  ttandardiicd 
•  tetting  ^dilemmat  that  deeply  concern  tett-maken.  and 
neccaurily  involve  parentt  and  teachert. 

•  Becaute  the  tettt'offer  tvch  an  eaty  way  of  comparing 
large  nun^rt  of  ttudentt.  tchool  tyttenu  general!/ have 
come  to  look  upon  ttandardlzed  tettt  at  a  way  in  which  they 
may  give  an  aceounjing  of  their  ttewardihip  to  the  public. 
Yet.  if  thetfitt  are  unfair  to  ttudenu.  are  they  fair  to  the 
■cfaooU?  *  .  ■  ♦  •  • 

•School  tyitemt  ordinarily  compare  their  normt  with  the 
nor'mt  of  other  tyttemt.  But  a  norm  it  an  averege  ^*not  a 
goal.  If  a  nalional  norm  bocomM  a  goal,  the  tchool  it  aiming 
,  for  mediocrity. 

'  »Standardi^  tett  leoret  acrou  a  ichobl  fyttem  can jivc 
curriculum  planner»for  that  tyttem  tome  tuggeitiont  of  ■ 
curriculum  needi.  by  comparing  local  inttru^on  againti  the 
nalional  nohnt.  The  tcoret.  for  example,  mav  tuggeti  a 
review  of  tubject  matter  or  a  change  in  teaching  methodt 
and  materialt. 

On  the  other  hald.  the  normt  on  which  the  tettt  are  bated 
relate  to  national  tarn plet  of  ttudenu.  At  we  havi  teen,  the 
attumptiont  underfring  the  tetu  may  not  fit  the  local 
ttudentt  in  motiVatln.  experience,  cull ui»i background,  or 
other  important  wayt.  Any  ute  of  (be  tettt  mutt  take  tuch 
differencet  into  account. 

.  •  A  teriet  of  tetUcao  lay  out  a  tequeoce  of  tkillt  by  grade  ' 
levett.  which  if  belpfUl  in  bujiding  ourriculum  devotied  to  the 
development  of  reading  or  mathematical  ekiltt. 

At  the  ume  time,  etandardized  intttuction  doet  not  alwayt 
provide  for  the  many  individual  differencet  in  the  wayt 
children  learn  -^Mifferehcei  that  are  ttfll  thetubject  of  (fiteh*. 
.  live  reaearch.    ^  . 

•  StandardiMd-tett  tcoret  c^n  locate  potential  problem 
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ireA  •mopg  liTfc  groupi  ofiludcnti.  Other  t#iU  are  ^ed. . 
however,  to  disttouie  ihe  niture  of  the  problem.  Still  other 
kihdiof  iMeumeni  ire  needed  to  help  individuil  iludenti.  . 
'  •  Becaiifc  ofihe  ne«r  univerulity  of  their  uk.  luadirdized 
tetti  ire  crediCed  with  niilng  the  level  of  education  acrou  tbe 
country  —  particularly  for  minoritlei  —  by  defining  a  let  or 
common  leaminp.  ^ 

Thii  auumption  could  be  more  Mly  Bcccp(ed  irthe  tetlt 
were  not  kepi  lecret  by  the termf  c^pe  contract  with  the 
Khooli  that  UK  them.  If  the  learning  level  of  itudenUU  to  be 
aiBcaied  accordrag  to  their  lesT  scores,  then  the  desirability  of 
the  questioflf  must  also  be  assessed  —  and  no  such  general 
study  is  noofr  possible.*  * 

•  Observers  say  that  fticreases  in  reading  lest  scores  in  some 
urban  school  systems  appear  to  be  related  to  extensive  prac- 
tice with  workbooks  stmilir  to  the  achievement  lesU.  It  is 

*  well  Icnown  (hat  coaching  for  staiMlardizedlesls  is  prevalent 
in  many  —  if  not  in  mosi —school  systems. 

This  poses  a  queetion  about  the  reliability  of  test  scores  as 
indicators  or«eademic  achievement,  u  opposed  to  an  in* 
creased  competency  in  ulting  tesU. 

Yel  the  credibility  of  standardized  test  scbr^ls  such  thal^ 
#they  are  commonly  UKd  as  reliable  indicators. of  student 
achievement  in  Bailment  of  new  programs,  school 
reorganiialion.  and  a  host  of  other  instances.  _ 

For  example,  an  Assodatttl  Press  dispatch  in  7*f/Vfv 
Yofk  Times  of  December  24. 1978.  reports  the  success  often 
years  of  integration  in  the  schools  of  B^crketey.  California, 
as  assessed  by  slgniricanl  improvements  in  standardized 
achievement  test  scores  amoflg  both  black^  white 
students.  I  . 

•  Sundardized  lestiqg  has  long  beeOJCtkMPy  related 4<^the 
ge-grading  system  by  which  most  aAboU  ar«  orgaAizc;^. 

Horace  Mann  used  it.  among,otheii.  in  seeking  ways  to  im* 
pftve  education.  In  the  nineteenth  cCnlu^  and  liter,  also, 
the^  have  been  times  whe(i  promotion  was  a  political  isspe  * 
'  Staiidardizedictlinf  pve  an  "outside  authoriW"  to  the 
leader  in  deferminlng  whether  6^ not  a  child  shj|^be  pro* 
mmed^o  the  next  frade.* 

The  Concept  of  "learning  disability"  appeared  at  this  time. 
Sludent^.wiih  whom  a  teacher  did  not  succeed  could  be  * 
IransferrM  to  a  special  class. 

Although  the  grading  system  has  persisted  as  a  convenient 
way  6f  manging  large  numbers  of  childreni  most  authorities 
agree  ihi|cH||dren  differ  in  the  amouAl  of  tlme.lhey  need  to 
.  «dhiev»  a  given  level  ofkaming. 

Chlldreo  coVmonly  firtd  themselves  at  difrcrent  grade 
levels  in  different  subjects.  A  Hfth  grfder  may  easily  be  at  the 
.  fourth-grade  level  in  math  ar(d  at  the  eighth-grade  level  in 
reading.  Teacberli^  frequently  pomplain  that  graded  t^t* 
books  do  not  fit  thtir  classes,  and  seldom  use  Ihe  same  t^xt 
'  for  all  studenVs.  ■  " 

The  emphasis  on  standardized  testing  adds  to  the  prot^tem 
that  Murray  Uvine  has  fo  aptly  described: 
•The  Imposition  of  '^  consunt  time  for  all  children  tb* learn 


*  a  given  amount  has  been  a  psychological  disaster  for  untold, 
millions  of  chiMren  and  their  parents  and  for  teachers  who 
had  to  make  agonizing  dectsions."** 
V     •  As  an  item  of  achievement  Is  mastered  by  more  and  more  . 
i  .  students,  it  becomes  less  useful  as  a  lest  item  in  measuring 
.  performance.  As  a  result,  lesljm'akers  turn  to  different  ways 
of  writing  Ihf  same  curriculum  itei^^  They  corffplicale  the 
j^orSingfOr  they  phrase'lhe  question  in  the  negative.  For 

example:  •  -  i  

Which  o(  the  Wtowing  ia  noJ  a  real  factor  «n  the  gcowlh  bl  slum 
areas?      " .  ,  '    -  • 

(  )  dtsease  *    .  •   .  * 

i  i  unemplovment  - 
j  ■)  cfime 

{  )  don'iknoW                                         .*  " 
(fdtUopoMtMnAmhitvoment  Tml  1959}   _^ 

Teachers 'obb#to  this  practice.  They  uy  that  a  negatively 
phrased  quesliqivften  bteomea  a  test  of  logic,  rather  than  a 
test  of  the  instriiKional  objective.''  ' 
♦The  limitations  Ihat  scoring-by-compuler  places  on  testing 

-  -Sr«  the  tttbject  of  widespread  debate.  On  the  one  hind,  the 

-  multiple-chqice  formal  is  wid  lo  bte  "objective."  whereas 
scoring  of  Mays  or  respoflset  to  openrended  questions  is  said 
to  be  more  "subjective."  ' 

On  ihO/blher  hand,  putljng  every  question  ini6  a  multiple-* 
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choice  format  rettrkU  the  content  of  Ihe  curriculum  covered, 
u  well  ai  the  degree  of  though^  required  of  the  itudent. 

English  teachers,  for  instance,  note  weslcneues  tn  the 
quality  ofstandardlMd  teku  to  measure  tuch  areas  as  ap> 
prectalioii  of  literatore;  lensitiveiiM  ofUnguage;  organi* 
utioo  of  ideas;  critical  reading  and  listening;  and^ipreuion 
of  valuea,  among  others."  ^- 

Social  studies  teachers  want  curriculum  to  "provide  yoQng 
Mopk  with  resouroes'for  making  decisions  alTecting  their* 
^blic  and  pri^^ate  lives  jiu  citizeDi""  -r-  resources  that  in* 
elude  ikill)  and  attitudes  that  are  not  measured  by  achieve- 
ment tests.  .  . 

Teachers  are  looking  for  tests  that  will  meet  these  needs, 
lesu  that  will  reflect  cultural  diversity  and  measure  actual 
teachi()g  objectives.  At  the  same  timf .  test-makers  are 
searching  for  ways  to  assess  the  reasoning  and  creative 
abijiti^  of  students.  This  is  slowly  bringing  about  a  long-  * 
needed  collaboration  between  test* makers  and  educators 
concerned  with  curriculum . 

These  are  questions  that  deeply  concern  PTA  people  as 
well.  Their  Investment  in  their  sdiopis  is  too  great  for  thern 
not  to  be  involved  in  the  ways  tests  ate  used. 
9 Standardized  tests  directly  afled  curriculum  development, 
textbooks,  teacher  cdac4loji.  admission  to  higher  education, 
and  the  dispeata  tioo  of  scholarship  fundi. 

•  Beyond  thwutliy  of  school  Hinds  for  the  teits  themiclves. 
the  tests  also  «st  heavily  In  staff  time;  in  learning  and 
teaching  time;  and  in  heavy  emotional  pressures  on  students, 
teachers,  principals,  and  parents. .  li 

*  Moreover,  the  exaggerated  importance  given  standardized 
teits  raises  grave  questions  about  the  directions  in  which  they 
are  taking  our  children,  their  parents,  and  their.schoob. 

•  Moct  students  will  meet  the  standards  we  set.  If  the  most  . 
important  tests  in  students*  lives  are  hinged  upon  the  average^ 
the  level  of  our  schools  len^a  to  mediocrity.  Are  we  asking 

of  Kbools  what  vwRally  want  of  eduettiofit 
•There  are  manylcindi  6f  tests,  and  tests  can  be  used  in 
'  different  ways.  If.  because  of  the  tests  we  use.  the  advance- 
ment of  students  In  school  depeoos  always  on  measuring 
themselves  against  their  ag^mates,  studients  tend  to*pUce  a  . 
low  value  on  themselves  and  their  own  differences. 

*  Ofl     other  hand,  what  realty  matters  iri  a  child's  educa; 
tion  cannot  be  measured  by  any  test  eJ^Uting  tdday.  Stephen  ' 
Mutseau  put  well  the  bisic  need: 

"What  are  the  steps  for  building  seifetteem  in  children?  ' 
Help  your  child  see  that  be  Is  bcaatiful  and  unique  just  u  he 
is!  Guide  him  away  froin  believing  that  he  must  slack  up  to 
Othersf  Succese  is  a  journey,  not^a  deftinatlon!" 


IQtEST»ARE  STANDARDIZED  TESTS  " 

Intelligence  or  IQ  testing  started  with  AlfMl  Binet's  experi* 
meots  in  France  at  the  bcginnthgoftheoentufy.  His  purpose  ^ 


wuiofindahasisforexemptingcliildren  whodidpoorlyin  * 
Khool  from  the  compulsory  attendance  laws,  or  to  substi- 
tute specUl  classes. ,  . 

Bfnet  himMlf  wafskeptical  of  Ms  work.  He  uidthat  the 
idea  that  "the  intelligence  of  an  Individual  is  a  fixed  quan*  . 
tity"  is  ii  "bruUl  pealmism."" 

Othen.  however.  Mized  upon^e  notion  that  children's  in> 
telligence  could  be  measured.  In  the  United  States,  intelli- 
gence tests  w^tc  first  died  to  test  thlH>oor  for  "feeble-mind* 
ednes).*\|o  assign  them  "a  suitable  place"  and  for  "cbrtail* 
ihg  q^prdniirtion."" 

Irf  these  decades  large  numbers  of  psychologists  and  others 
talked  about  "an  aristocracy  of  talent"  to  be  developed 
through  sorting  people  according  to  ability.  Sterilization  liws  - 
were  passied  in  several  states»-  ':« 
.  Later  a  massive  testirig  program  was  used  to  weed  out 
"undesirable  aliens"  among  immigrants  and  to  set  immigra> 
tion  quotas  for  various  countries.of  origin.  Thne  quotas  were  ■ 
based  on  the  United  States  Censui  of  1,890.  Because  the 
quotas  had  been  filled  at  the  time  of  need,  they  were  directly 
responsible  for  the  deaths  of  hundreds  of  thousands  of 
viciimtwhom  AdolfHitlerwa^willing  todeport. 

Duririg  Syorld  War  I  some  1 2S.000  draftees  weregiven.lQ 
tests  in  order  to  determine  who  could  most  easily  learn  cer> 
tain  tasks.  One  finding  noted  that  "foreignera  who  had  lived 
in  the  country  twenty  years  or  more  before  being  tested  were 
evei^  bit  as  intelligent  as  native  Americans.  Thoie  who  had 
lived  in  the  country  less  than  fiveyetn  were  essentially  ' 
feeble-minded."**/ 

These  daycare  long  past;  yet  the  same  ideas  still  turn  up  in 
newspapers,  in  ichool  conversations,  and  even  in  published 
research.  It  was  the  tesu  in  World  War  I  that  first  offered 
massive  "evidence"  that  non whites. Kored  lower  ori  IQ  tests 
than  did  whites.  In  the  last  decade,  books  asserting  the  same  .  • 
theories  about  the  "inferior  intelligence"  of  qon. Caucasians 
.  Claimed  wide  attention— theories  also  based  on  stahdardizM** 
tests  developed  with  Caucasian  children." 

Walter  LippmaDn  wrote  in  the  1920s: 

'ifthe  imprettion  takes  root  that  these  tests  really  mea- 
sut#intelllgence'.  that  they  constitute  a  sort  of  last  judgment 
on  the^child's  capacity,  that-they  reveal  'sdcntifkally*  his  pre* 
dMtined  ability,  then  it  would  be  a  thousand,  times  better  if  all 
the  Intelligence  testers  and  all  their  questionnaires  were  sunk 
without  warning  in  the  Sargasso  Sea." 
*  'The  Oxford  English  Dictionary  defines  ''intelligence"  ai* 
''the  faculty  of  undentandih|f."  The  American  Heritage  i. 
Dictionary  defines  it  as  "the  capacity  to  acquire  and  apply  1 
knowMge."  Wespeak  of  "nftive"  intelligence,  meaningan^ 
Inborn  ^ality  or  characteristic. 

"IQ"  Ibinds^or  "intelligence  quotient";  this  is  defined 
technicals  u  the  '*ratio  qr  tested  Aiental  age  to  chronological 
age^multiMiedbylOO." 

Mental  age.  then,  is  not  what  »youngster  was  born  with 
but  something  acquired  over  time  through  experietice  or  in*  • 
itruetion.  IQ  tests  meuure  learning  that  has  been  acquired.  1 


Th«  foMowini'tw  typtejUtemiMwiiolQtcm: 
1  HowtiNltth«iv«raMAmfr1c«niT>an? 
haHlnchmortorltM. 

2.  8om««noyWM«lny9or«»«fpHa  1  

1  )  wdH     '  (  )  (kMd  % 

3.  A  hiw<»Hl»» :  in        mUtef : . 
bf  oom :  vicoom  Qlttntr 

(  )  hMrid      (  )  tovf'  1^ 

&  doUar  p««>  milk  Sra-   

(  )  ch«)9«  -  ()  franc 
(  )  foft*gn    (  )  pwchM« 

A  htircenlury  after  Lippmann'i  alarmed  t*;^' 
available  cvWencc  doa  no*  ihow  how  iatelllicflce  te»u  differ 
from  achievwiwttl  teiU  -  In  whk*  children  are  win><»^^ 
make  protreu.  One  obkrver  collected  ten  quettloni.  half; 
from  roup  ability  OQ)  ^     half  from  achievement 
teaU.  Can  yixMy.tlw  difference  

2  B4«bo«oWrwopadiolpapefat25qeftiae«:KaAdfwrp«>tat 

%^!iS^hM<^  ($1,30.45*.  $1.04.  nooe 

ofttieee) 

3.  So6meafti(pre|odice.lo««mn.|igh,ioy.Wfld). 

4  vw»nanewWodolm«)hioelecraeleditlecaUed(anad^^^ 
l^Hi.aninven«oo.afiWc«ton.an<^  .  . 

6  VVhichlefnviert)iiihiglnihlet«l«e?3.6.7jl.137(^^ 
14. 16) 

*    9.  Vimtehltfm«ynetnt)d»nlhrtteriee7  64.45;30,^(31.M^ 
26.27)' 

■  7.  Ojiygeo  le  a'tcompowd.     •o"d.  cwbWe). 
8.  Top«velalo.(i9re*;veflty,iee.mf*nK 


0.  MacyboogWacomtabookfOflbcr^t^lomeiKimf^^^ 

a  clftSybi»  fof  6  oentfc  How  many,  centt  d  W  ahe  epend  In  HI? 
05*.2Oe.254.5O*.noneoHheee).  . 
10.  Tne.eefth-|cruet>eHi(tuitace.enefgy.hett.po<ee).''..  j 

The  lUtlfllcal  methodi  uied  by  teet-maken  to  determlwe 
"menial  agee"  for  Intelllfenoe  teaU  are  tlmilar  to  thoK  uaed 
to  dettfmlne  norma  oo  the  r«do..level  achievement  teiu. 

Thtfmenni  that  untold  number*  of  youngiten  havebeen 
labeM  with  Irrelevant  teat  acorea.  They  were  mjawred,  not  . 
rorMve  intelHienoe..  but  for  the  informal  on  Ihey  ^9f^ 
lolwvSteBiired  in  their  Uvea.  But  the  labeli  otdinarih^iUjd 
for  ihoMWon  of  their  yeirt  in  achool^and  often  affect  their 
Uvea 

Only  In  recent  yeafi  have  protetti  mounted  aialntt  the  uie 
of  iioup  IQ  tcrti  -  ctpedaUy  when  It  became  ctear  that  tuch 
factorial  belter  nutrition,  native-laniyageteachlji.  and  • 
flwre  percepliye  initructlon  railed  IQ  icor^  that  had  been 
tuppMOdtobeflxed.  .  ,,  ,j  i. 

orw  IQ   »^  ^ 

of  varioui  lorti  are  often  pert  of  more  inteniive  itudeot 
evaluatloni  for  diasnpali  of  learning  proWemt. 

Some  teit-makera  are  atill  convinced  there  muit  be  a  way 
to  meauire  Intelliienoe  deftned  u  oognillve  •P<«W  -  •  way 
that  would  bedifferent  from  a<»demic  achlev^ent  teiti.  but 
they  admit  It  hu  not  yet  been  diKOvered. 


EVERY  CHILD  IN  A  BELl^H  APED  CURVE  • 

Bolh  IQ  leiU  and  achievement  teaU  are  •»»«P«'  •f^J*"* 

wilVfall  Intonn  arbitrary  mold fialW  the  Wi'SfPy.^. 

curve."  ThU  U  the  theoretl^bMli  of  the  lUndardlied  teit  ^ 

scorint  described  earlier.  j  . 

Tei'maken — and  many  eduction  —  are  convinced  thai 

the  abimiei  of  moil  iludenU.  and  therefore  their  teet  ^corea. 

iVn  clorf  to  the  average;  ihpie  above  and  belpw  the  average 

thinout  oneither  lide.  When  the»w[eiare  pjjtled  ot  a  ^^^^ 

graph,  therefore,  the  curve  ihouM  follow  a  bell  {htpe,  vrilh 

thi  Korea  oThigheit  frequency  ^^f^^}^,Jl^l^^S; 
cufve,andthe$ldeioflhecufveriiingandralltagimooihly. 

It  ii  true  that  when  a  group  oCmeaturabU  ^i*^^^^,^^ 
are  recorded  on  a  greph.  the  likelihood  ii  that  they  wfll  follow 
the  bell-ahaped  curve. 

For  initanee.  ihefneaiuredWoodpreMuw  of  a  •ftnokof 
general  population  wal  found  to  take  a  bell  ihppe.  Indicating 
that  moit  people  ari  cloie  to  an  average  or  norm. 

OntheSan^l  theiiieaof  famlIie*A5n<Hchance 
eveoU  and  do  not  tA  a  bell  curve.  Neither  do  the  lUea  of 
famHy  income*.  BotSytbeie.  plotted  op  a  l"Ph. , 
iharply  at  the  beginnlnk  of  the  graph  (the  low  end)  and  fall 
.  ofTgra<%«llyettheolh2re«d.»«  . 
«ig  allfhree  of  lhae  cMei.1ncaniirei  can  be  exact.  Blood 


prciiurei  ire  recorded.  Family  lizet  and  family  income*  are 
veriHablc  numben. 

.  It  hai  b«en  Mid  that  the  incidence  of  native  intelligence 
oughttobt  »imilar  to  the  incidence  orblood  pretiure. 
Pouibly  lo:  but  until  lome  relbble  meaiuremeiit  of  intelli- 
gence hu  been  identiHed.  there  ii  no  basil  for  aiiuming  that 
childitn't  Inteillgence  Will  falljnto  a  bell  curve. 

Nevertheieti.  teet-maken  oonitruct  achievement  and  IQ 
test!  ai  though  the  tett  icorei  were  equivalent  to  meaiurei  of 
mtelligenoe  and  on  the  auumption  that  luch  meaiuret  would 
.  take  a  bell  curve. 

After  tests  hive  been  tried  out  with  Mmples  of  student!, 
items  are  chosen  (and  scoring  is  determined)  according  to 
the  way  the  scores  fit  the.  curve  -r-  called  the  "normal  distrl- 
button."  Items  that  do  not  bring  about  the  curve  are  ex- 
.  c|jided.  or  the  scoring  is  changed. 

Parents  and  teachers  should  use  the  knowledge  of  this 
background  to  keep  their  children's  scores  in  perspective; 
Neither  IQ  ncr  achievement  scores  should  ever  be  taken 
alone  as  describing  a  youngster's  abilities*  or  allowed  to  over- 
ride careful  day-to-day  perceptions.  Basing  all  expectations 
of  a  child's  abilities  on  so  imperfect  a  measure  borders  on 
child  abuse. 


WHATA^UTTHESATsr 

When  the  decline  in  SAT  (Scholastic  Aptitude  TesU)  scores 
broke  into  print  two  yean  ago.  it  seemed  lo  focus  for  many 
people  a  pervasive  uneasiness  about  public  education.  At  the 
same  time,  however,  it  strengthened  an  already  existing  con- 
cern about  testing. 

SATs  are  sUndardlied  tests,  but  they  are  different  in 
several  ways  from  the  stalidardrzed  IQ  and  achievement  tests 
we  have  been  discussing.  '  ' 

SATs  have  only  one  purpose:  to  predict  the  likelihood  of 
success  in  college,  particularly  in  the  llrsl  year:  SATs  have 
bten  used  since  the  1920s  to  help  college  admission  people 


sort  dut  applicants  ^hose  grades  were  earned  at  widely 
different  high  schools. 

K^ore  than  a  million  seniors  take  the  SATs  each^r  ~ 
^about  half  of  the  number  who  actually  go  on  to  college,  and^ 
about  one  quarter  of  the  IS-year-oM  age  group. 
.  The  SATs  are  ^^performance"  tests.  That  is.  the  scores 
reported  are  the  Kores  stvdenu  actually  earn  by  performance 
on  the  tests,  not  by  reference  to  a  national  sample.  SATs 
-  have  two  parts:  verbal  and  mathematical.  Scores  on  each 
part  run  from  a  base  of  2(X)  to  a  possible  SOO.  p 
.  The  verbal  portion  of  the  test  is  designed  to  assess  rea'ding 
skiils  and  understanding  of  word  relationships.  It  covers  four 
areas:  antonyms,  analogies,  sentencecompletion.  and 
reading  comprehension.  The  ipaterial  for  this  is  drawn  from 
sodal.  political,  sdeniinc.  artistic,  philoiophical.and  literary 
wfillnp.  For  example:** 


(1)  Chooe*  the  wofd  Of  phfase  most  nearty  opposite  in  meaning, 
(aniortymi) 

SsOMo:  (A)  irrigation  (B)  pollution  (C)  meaningful  spe«cti 
(0)  useful  obiect  (E)  helpful  peraon 

(2)  Choose  the  pair  best  expressing  a  limilar  retat^ship. 
(anaibgiee) 

CtHur :  Singers; 

'  (A) victory : tDtdltfs  ' 
•(B)ctas«:leKh«rs 

(C)  crowd :  pfotesters 
'  (D)  challenge  :  duelists  # 

(E)  orchestra :  musicians 

t3)  Choose  ttw  word  or  set  of  words  thst  best  fits  (he  meaning 
(senter)ce  completion) 

Intrica^  carved  and  beautitulty  proportioned,  the  priceless 
sculpture  was  the  work  of  a 

(A)  urvderslandabV  ■  dilettante 

(B)  tnd|j|bty..f  forger 

(C)  defffhstratily .' . .  bungfef 
-   (D)  unmlstakabty . . ,  master 

(E)  parMoxically . . .  perfectionist 

(4)  The  shident  it  giveri  a  pAiage  of  some  400  words  Which  may 
be  summarUed  as  foUows:  (rlading  oornpreher>sion) 
The  t>ehtvior^  Ktences  ata developing  rapidly  tn  understandlrtg. 
prediction,  and  control  ol  human  behavior.  At  this  ttm  the  public 
isignoiantordisbefievingofrtspoesibittties.  iustuin  1000  the 
put>tic  rsftecled  the  poseibHttH  of  seronautica  At  a  future  tim# 
the  public  will  accept  and  use  tbe  firvdtngi  of  the  behavioral 
sciences. 

Among  questions  based  6n  this  passage  is  the  following:  The 
author  auogests  that  the  next  change  in  the  public's  attitude  lowa/d 
'  behavioral  Miencewut  lead  the  public  k>: 
•   (A)  ignore  the  iindinga- 

(d)  Increase  the  use  of  the  findings 
(OdisbeReve  the  findings 

(D)  use  these  fiodinga  against  oech  other 

(E)  k>ee  inierHt  in  the  findings  -  # 
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ThemtlhemtllMlportionorthetciirequlreiMbwk-  . 
grouAd  mtthcmiUci  lypkiHy  Uught  in  grtdei  one  Ihrouth 
nine;  it  depends  ku  on  format  knowledge  than  on  gbaaoning. 
It  measures  itudenu'  problem-folvlni  ability  in  three  areu 
—  arithmetical  reasoning,  elementary  algebra,  and 
geometry.  For  example:  "  .  ■   

t  Tt)*numlw  Which  iiorve  hundred  le»  than  one  mHlk>n  It: 
(A)  990.800  <B)  900.000  (C)  999.990  (D)  099,900 
(Eri,pO0.9()0 

In  each  of  the  loHowing  two  questions,  choose': 
A  IHhequanWyi9COlumnAl8or.eaief 
B  il  the  QuanWy  hi  coiomn  Ska  greater  ^ 
C  HthetwoquantitleaBreequar 

0  ifthf  rtl«ltonshlpcanrw<bedeiem)lr>edfr<>mthelmofmatton 
given:' 

Column  A      Column  B 
2.        6x  +  3y  -  22 

X    .  y 


teo-x 


How  serioos  was  the  drop  in  SAT  scores  to  American 
education?  ■     ^  . 

In  1 952  the  average  verbal  teat  score  was  476,  and  the 
average  mathemalica  test  score  494.  In  1963  -  the  hi|p  point 
.^lheavertgeswert:verbal-478;math-502.ln  1977 
tl*e  averages  were:  verbal — 429;  maih  —  470.  In  the  last 
year  ^  two  the  decline  appears  to  hfve  leveled  off. 

The  49-point  drop  in  verbal  scorts  U  10.25  oerceni;  the 
32  point  drop  In  lAath  secret  Is  6.37  percent.  In  terms  of  pec- 
CMllget  thetfe  dedinet  do  not  seem  remarkable  in  them- 
lelvet.  But  educators  were  concerned  not  only  becattse  of  the 
steailiness  in  the  decline — however  slight  ^  but  tlso  because 
the  decline  increased  In  th^  last  three  yrtra.  Slpoe  the  educa- 
tional pwformancc  ofstudenu  bu  a  tremendous  influence  on 
our  country's  ftiture,  educatora,  parenu,  and  Jlhe  younptera 
tbemselvct  wanted  to  know  Ifthe  decline  retlected  upon  the 
vstudenu,  the  Bcfaoob,  or  our  society.  . 

TheCoW«eEnlftnceEji«ihlnaUonBoardappointedj 

/"blue  ribbon  paad'*  (often  called  the  WIrtt  Committee  from 
tbentmeoriuchalrmaa,WlllardWirti,cbalrmanorthe 
National  Manpower  Institute)  to  study  the  lmpli<^tion<  of 
the  declining  scores.  lU  report  U  calleAO/i  Further  Exmina- 
It  If  not  a  long  report  anddeservetPTA  reading.  . 
AsummarycannotdojustlceioiuthottghtfUi  writlng,but 

for  our  preaent  |i«rpotes  we  can  extract  Ibete  nndings: 
•The  p«nel  was  convinced  by  iu  itudiet  that  the  teau 
thems^  ire  sUll  consktent  in  predkUng  ability  to  do 
oollete  work;  that  the  decline  in  scores  did  not  reault  from 
chanfea  in  Mm  tetl  or  in  the  methods  of  scoring  it. 

At  the  same  tiAe,  the  panel  urged  a  broader  look  at  the 
whole  picture  ofiatlng:  Are  we  teaUng  In  the  beit  possible 
wijf  what^er  ouiptt  to  betcated7 


a  High  Khool  gnd^Bll  the  best  single  pMictors  of 
college  pcrformanwJ^Hrodes  combined  i*'lih  SATsooret. 
give  still  more  accurafjpiWlctions^.Even  so,  these  predic- 
tions are  far  from  perfect.  The  best  median  coefflcienl  for 
Sat  lopres  and  high  school  grades  combined  is  .56  —  which 
means  that  juii  over  30  percent  of  the  studenu  perform  as 

predictod,.  . . 

a  Part  of  the  decline  in  SAT  scprea  seems  traceable  to  the 
opening  up af  opportunities  to  allendcollege.  Fewer  drop- 
ouu,  less  di^rimination,  and  more  choice  in  colleget  played 
a  role  in  the  decline;  Another  factor  was  the  lets  than  ade- 
quate national  effort  to  prepare  lew  advanUged  studenu  for 
educational  opportunity  as  it  became  available. 

•The  panel  felt,  however,  that  no  more  than  one  quarter  of 
the  decline  since  1970  could  be  attributedio  the  larger 
number  of  studenU  Uking  the  tesu.  The^her  three  quartera 
of  the  later  decline  apparently  resulted  from  the  impact  of 
more  "pervwive"  forces  —  in  the  schools.  In  several  m^|or 
socieUl  changes,  and  in  student  motivaWon. 

•The  panel's  "firmest  conclusion"  wu  (1)  that  leta  iMHight- 
Ux\  and  critical  reading  is  now  demand^  in  high  school,  and 
(2)  that  careful  writing  has  apparently  |one  out  of  style.  The 
report  suggesu  that  *'increMing  reliance . . .  onilesU  r«ulr- 
ing  only  the  putting  of  X's  in  boxes  contributes  to  juvenile 
/writing delinquency."  ;  ^.  . 

RestoraUon  of  critical  reading  and  carefUi  writing  it  of^ 
central  importance:  ' 
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"•The  p4,iyl  "coAjectured"  thai  math  loorea  ikclined  leu 
bocauie  math  U  leu  dependent  on  the  .verbal  ikllU;  alio,  that 
•  .math  U  cticAtially  ichool-baied  Icarnlni.  white  verbal  ikilli 
are  more  influenoed  by  experience  in  the  home. 
*  AbienteeUm  (n  the  ichooli  It  another  probable  cauM.  **To  . 
the  extent  ichool  U  a  place  youngsten  flee  becauM  they  find 
themielvee  diminiihed  or  bored  or  both,  the  need  ii  plainly 
for  internal  reform.  Yet  without  the  right  alliarice  with  home 
and  community  the  tchooPrefTecUveneu  li  limited." ' 
•The  pand  probed  at  length  iiicfa  condiUoni  in  ichooli  as 
grade  inflation.  Mcial  promotion:  reduction  in  homework, 
and  the  "watering  down"  of  textbooks  to  lower  grade  ieveti. 
U  concluded  that  there  hai  indeed  been  a  lowering  of  educa* 
tlonal  ttandirdfl  and  (hat  this  is  a  major  factor  in  the  decline. 

But  the  aniwer.  they  said,  it  not  that  education  must  be 
more  rigid  —  rather.thtt  education  must  become  still  more 
diversifiiMl  to  meet  the  needs  of  all  studenu.  but  without 
being  watered  down: 

'The  situation  requiree  the  collaboration  of  teachers. 
studenU.  pcreau.  and  the  broader  community  in  theeitab-  • 
liihment  of  sUndirds  that  can  be  considered  higher  only  as  - 
they  recognize  youth's  essential  diversity." 
•Homt  learning  is  of  critical  imporUnce.  the  report  says. 
Both  changes  in  educational  practice  and  change*  in  faihily 
life-styles  have'  probably  contributed  to  a  strain  on  the 
teacher-perent  relationship.  That  strain  In  itself  may  have 
had  more  impact  on  students  than  anything  either  partner 
may  have  done  separately. 

•Too  little  is  known  about  the  impact  on  achievement  of  the 
o  "hanging"  state  of  childhood  and  adolescent  development. 

•The  report  quotes  E  B.  .White  to  the  effect  that  television 
is  the  test  of  the  modem  world.  It  is  probably  on«  cause  ofihe 
SAT  score  decline.  At  the  same  time,  television  has  the  poten- 
tial of  making  great  contributions  to  the  process  of  learning. 

•The  gneater  declines  between  the  years  of  1 97^  «nd  197S 
suggest  strongly  that  disruption  in  oatJoAal  life  in  the  im* 
mediately  pfeoeding  years  affected  the  prepe ration  of  these  ■ " 
.stiidenu  adversely. 

•The  apparent  decline  in  stwkat  motivation  suggests  that 
"during  the  past  10  years  the  curve  of  the  SAT  score*  has 
followed  very  dowly  the  curve  of  the  entire  nation's  spirit* 
and  self-esteem  and  seme  of  purpoee."* 

The  poaticript  is  that  in  1978  math  scores  went  down  tw6 
points  and  verbal  acore*  held  firm  at  te«t  year's  429. 
What  happened? 

High  schools  contend  that  more  attention  to  writing 
produced  higher  scores. 

At  the  same  time,  coaching  for  SATs  by  outside  agencies 
.  hat  lAcreticd  to  the  point  of  provoking  a  federal  investiga- 
tion. This  in  turn  increased  the  controversy  between  the  test-  - 
maker*'  advice  to  Mudent*  that  cramming  doe*  not  help  and 
the  documented  patten)  that  studenu  who  ulce  cramming 
couraea  achieve  MibctanQtllyhigh^  scores.*' 

The  end  of  the  decline  —  at  least  temporarily  —  suggests 
the  common  human  response  to  the  equeaky  wheel.  It  does 


not  ansxier  the  "value*  questiont"  that  have  been  raised 
fbout  how  we  can  best  um  testing  to  help  students  learn  — 
or  the  differences  between  high  i^re*  and  education. 


THE  COMPETENCY  MOVEMENT 

Public  reaction  built'slowly.  Over  the  past  three  years  rising 
dissatisfaction  with  schools.  Kbool  graduates,  school  taxes 
—  or  all  three  —  triggered  a  movement  called  minimum 
competency  testing.  It  spread  through  practically  all  stat^ 
with  unprecedented  speed. 

•  Business  people  complained  that  graduating  students  came 
to  them  ftinctlonally  illiterate  and  arithmetically  incom|ie- 
tent.  High  school  graduates  found  themselves  utiabie  to  find 
and  apply  for  jobs;  some  filed  suit  against  their  schools  fbr 
poor  instruction. 

•  Colleges  instituted  remedial  claslei  for  students  who  had 
acceptable  SATscore*  but  had  never  learned  to  write. 

•  Minority-group  citizens  widely  felt  their  youngsters  were 
being  shortchan^.  Minority-group  youth  suffered  even 
hi^er  unemployment  rales  than  youth  of  other  groups. 

•  Inflation  and  rising  taxes  focused  taxpayer  resentment  on 
schools.  Declining  test  scores  in  SATs,  in  the  National 
Assessment  of  Educational  Progress,  and  in  standardized 
achievement  tests  gave  substance  to  such  complaints,  People  . 
said  thai  high  Khool  diplomas  had  become  meaningless. 

•The  media  gave  more  than  ample  attention  to  all  of  these. 

Legislator^  responded  to  constituent  pressures.  It  was  a 
good  political  iuue.  State  educational  agencies  rushed  to 
secure  their  defenses.  In  the  minority  of  states,  either 
legislatures  or  state  boards  of  education  have  already 
initiated  or'are  planning  to  initiate  some  sort  of  statewide 
testing  of  every  student. 

For  instance,  the  California  legislation  yses  language  com- 
mon to  bills  of  other  states  in  requiring  thati  beginning  with 
the  class  of  1980.  ''pupiis  attending  public  schools  in  Califor- 
nia acquire  the  knowledge,  skills,  and  confidence  required  to. ' 
function  effectively  in  contemporary  society." 

With  such  promises,  the  "instant  popularity"  of  compe- 
tency testing  even  readied  the  point  that  bDli  were  introduced 
in  Congcessio  provide  for  national  competency  testing.  To 
date;  support  is  small,  but  the  pouiblKty  of  some  national 
program  is  not  to  bedtsmlssed.  (The  Natio;pal  PTA  Board  of 
Directors  has  expressed  it*  opporition  to  any  federal  testing 
program.) 


BASICSKILLS:  THE  NEW  EDUCATIONAL  GOAL 

In  the  previous  decade  a  number  of  states  had  been  working 
quietly  In  various  patterns  of  siate-tocal  cooperation  to  revue 
curriculum  through  setting  goali  an^  trinslating  objectives 
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into  locafcUtiroomilnin  cfTort  to*'fit'*  loctt  itudent 
populations. 

Iht  cbfnpdtciKV  movement  tooFthe  opposite  courac.  It 
la  id.  euentU1ly»  that  ichooli  were  too  ilow  or  were  liot  ivf- 
Tickntly  earnest  ift  their  endeavor  —  cerUinly  that  the  public 
was  unconvinced  that  schools  were  actually  improving.  Kthe 
.  atudcnu  weiPe  learning  basic  skills,  let  t)te  Khools  prove  it  by 
testing  every  child.        .  • 

Whal  has-hfippened  in  the  last  three  years  la  reminiscent 
or  iheman  who  jumped  on  his  horse  and  rode  oir  in  all 
directions. 

•The  ptonaer  lUtea  simply  madtf  competency  testing  «  ; 
requirement  for  high  Khool  gradulition.  The  nasty  a^oh 
confused  the  sdioois.  biit  they  trietf  to  comply. 
•In  1972  Oregon  required  local  districts  to  define  their  own 
requirements  in  each  of  13  categori^:  reading,  writing, 
speaking,  liatening.  anaiyziny.  and  computing,  plus  seven  . 
"survival  akills.**  such  as  being  an  inrocmed  citiien.  being  an 
Informed  consumer,  and  maintaining  nAHh. 
.   OiKdistrict  adopted  203  separate  competencies  in  these 
cale^ie;  another.  143.  They  included  driver  traintn|.  using 
a  (elSione.  writing  checka.  and  making  a  peanut  butter 
sandwich.  The  resulting  nightmare  of  paperwork  —  and 
parent  indignation — cut  tncnumber  of  competencies 
drastically.     .  - 

Thelesu  remained  relatively  eaay.  The  1978graduate«;— 
the  nrst  group  lb  meet  the  requiremenU  —  turned  in  varying  ^ 
failure  rales  of  1  and  2  percent.  - 

At  the  other  extreme.  Florida  made  statewide  tests  a 
'  graduation  requirement  for  all  students.  The  Educational 
Accounubitity  Act.  passed  in  1976.  speciHed  that  tesU  in 
"functional  literacy"  andmatheniatiG|^  given  to  all  eleventh 
graders  without  delay.  This  allowecB  short  year's  grace  for 
"remediation**  befor^diplomas  were  awarded  or  withheld. 

The  teats  given  a  few  months  later  required  the  customary 
pitting  grade  of  70.  Across  the  sUle  36  percent  of  the 
eleventh  graders  failed  the  math  tesU  and  8  percent  faUed^ 
reading  and  writing. 

Th4  tests  were  criticized  for  cultural  bias.  The  school 
system  was  charged  with  inadequate  instruction  of  minority- 
group  sludenu.  because  79  peroent  of  black  studenU  failed  in 
mathematics  and  26  percent  in  communications. 

The  tests  were  most  criticized  because  both  Khools  and 
students  felt  th^  had  been  given  insufncient  warning  that 
receiving  a  diploma  woukl  depend  on  pauing  this  test. 

Reaction  ranged  from  $  substantial  increasie  in  student 
dropouU  to  widespread  praise  of  the  sUte  administration  for 
moving  toward  higher  Khool  standards.  The  following  year 
the  ititejtepartment  of  education  couM  point  to  a  better 
record.  Inl978  an  estimated  73  percent  of  eleventh  graders. 
3Utewide.  passed  the  mith  tests,  igilnst  64  percent  in  1977:  . 
and  97  percent  pissed  the  communicitions.tesU.  igainst 
'   92*perccnt  in  1977. 

NevertheleMi  in  October  1978  the  law  was  cbailenged.in 
Federal  District  Court  as  unconstitutional.  The  complaints . 


werediKrimination;  ttiat  the  skills  exsnlined  were  not  the 
skills  taught;  and  that  the  test  was  not  a. valid  or  reliable  ■ 
instrument  ^  meaning  that  it  had  not  been  properly  pilot- 
tested  amoi^g  a  cross-section  umple  of  students. 
•Policy-makers  acrou  the  country  observed  the  experiences 
of  these  and  other  pioneer  sUtes.  A  host  of  question^  began 
to  emerge,  and  among  them  three  osnflicting  and  troubling 
problems:  '  i  «> 

1 .  how  to  devise  prognms  that  would  satisfy  political 
denftands  a  nd  at  the  u  me  time  address  fairly  the  very  reaV 
weaknesses  in  Khools; 

2.  how  to  impose  universal  standards  of  doubtful  levels 
upon  extremely  diverse  Khool  populations  without  destroy- 

.  ing  contemporary  achievements  in  individualized  education; 

3.  how  to  foresee,  if  possible,  and  take  into  aonie  account 
the  loivrange  imptlcations  of  thcK  actions  for  reuining 
excellence  aa  an  educational  goal  and  for  the  related  needs 
of  a  democratic  society. 


WHAT  COMPETENCIES  ARE  MINIMUM? 

Nobody  really  agrees  on  what  every  child  should  know.  It  is 
generally  agreed  that  virtually  all  youngsters  need  skills  in 
communications  and  math.  Beyond  thiit  there  are  stgniRcant 
differences  of  opinion. 

In  Ihe  last  two  decades  the  balance  of  employment  has 
been  reversed  to  the  point  that  less  than  9  percent  of  present 
jobs  are  unskilled.  Some  time  ago  Khool  administrators 
accepted  as  a  goal  the  idea  that  eVery  student  must  graduate 
from  high  school  "with  a  ulabtesMll."  The  standard  of  ^he 
competency  movement  appears  to  he  less  than  that. 
^  •Basic  skills  in  communications  and  math  are  the  major 
part  of  the  elementary  curriculum.  Mastery  is  expected  by 
the  end  of  the  eighth  gfide.  Some  feel  that  Khools  should 
.  Emphasize themastery  ofacademictkillsand  thatsti^|||s 
should  be  able  to  apply  mastered  skills  to  life  situationil^V 
they  arise.  Available  competency  tests  indicate,  however, 
that  some  state  and  local  school  systems^re  movirtg  in  a 
different  direction.  They  are  testing  for  •'life"  skills.  For 
example: 

Florida  tested  academic  skills  cast  in  "real*world"  terms. 
Some  of  its  spedHed  communication  skills  were: 

a  Determine  the  ma^  Kite  tnferrid  from  iselflction. 

b.  Find  the  wtK).  what,  wt>ere.  which,  and  how  Information  In  a  . 
Be(ectk)o. 

c.  Qistinouifth  between  (acta  and  opinions. 
.  d  Identify  an  unstated  opinton. 

e  Use  an  index  to  identify  the  k)catlon  of  Inlormallon  requiring 
the  use  of  cross  references, 
f.  Use  highway  and  city  mape. 
g  Accuratety  complete  forma  used.loippty  (or  a  driver's 
ttcerise.  employment  entrance  to  a  Khool  or  training  program. 
■  insurance,  and  credit   .  
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.  Maihcmatics  tests  were  based  on  quetUonsiuch  at  Ihe  - 
following: 

a  Ott«rmine  the  e^pee^  t)n>«  between  (wo  events,  ttaM  in 
seconde,  mindee.  hoofs,  days,  weeka.  monthe,  or  yeart 

b  Determine  equivatem  amounts  d  up  to  $100.  ueinoeo^na 
endpaper  cu^renc^. 

-  c  DetermWieit^sotution  ID reaJ  wofldpf ot)lerns  Involving  pur- 
chasM  and  a  rale  ol  discount  given  kn  traction  or  percenLform 
d  8oh«  a  problem  invotving  capacity,  uemg  unite  given  in  e 
table  (mrfttgrame,  grams,  kilograms,  mstnc  k)ns,  ounces,  pounds. 
bosMof  conversion  wHt^  the  system  » 


The  folloWiDfbomei  Trom  a  Vermont  graduation  test: 

■  U  someone  buys  a'^.aattemlrom  y 
wtial  ctxange  wilt  you  return? 


bandgtvesyouaStO  bill. 


Critics  point  out  that  some 
not  in  reading  ikiHs;  ncverthefl 
students  for  reading  first,  and 
instance: 


f 


ngsters  are  able  in  math  but 
most  ^'problems'*  test 
[athematics  second.  For  .  . 


T 


A  company  has  a'2. 5  meter  high  wire  fence  around  its  equ>pmen> . 
,  ttorege-vea.  The  area  maasures    metehi  by  SO  meters  The 
'  '  company  plana  to  add  extra  security  to  the  area  by  stringing  3 
strands  ol  barbed  wire  along  the  lop  ol  tfw  fence.  How  many 
meters  of  bart>ed  wire  doae  the  company  need  1or  this  job? 
teo.  240. 460.  or  960  meters?*?  .  

Some  competency  program'^  include  as  "basic  skills^' 
knowledge  of  coniun^erism.  the  democratic  proceu.  practical 
science,  health  maintenance,. social  responiibillty.  personal 
and  carecr'devplopment.  FoTjpxample: 

LIM  year  you  ioined  a  record  club.  You  tuiiiHed  your  obj[iat>on  to 
buy  the  specified  number  of  records.  You  caxed  the  record  ctub 
and  asKed  to  be  removed  from  the  matimg  ttst  The  c'ub  conHnueS 
toeend  records  amway  Whtch  of  the  foHowtngvcttons  would  be- 
approprtaie  tor  yoino  take,  and  which  would  not? 

a.  Keep  the  records  and  refuse  to  pay  any  bins  tor  them. 

b.  Send  a  registered  letter  asking  to  be  removed  from  the  maH>  . 
ingtist. 

c.  Pay  tor  the  records  that  camentier  your  phone  caH.  arvl  can 
aga^r)  requeettng  that  the  company  stop  sending  records 

d.  Refuse  to  accept  the  records  and  have  the  poet  office  return 
^•  the  records  to  the  compahy  i 

(N$iionglA8twmBniot  EduCMbongl  Pro^Mt,  1077} 

Another  example: 

.>       .  ■ 

■  Which  of  the  following  would  you  expect  to  find'in  a  democratic 
society?  ■ 

1.  Joe.SmiUigrves  voters  is  each  to'vote  lor  htm 
2:  Cittzens  legally  picket  and  protests  court  deciSKxi 

'  a.  A  group  ot  people  go  to  the  city  council  tojssk  tor  ar> 

investigation  of  tf>e  mayor.  ' 
4.  Congrees  overrtdee  a  Presidenttal  veto 
5  A  citizen  ts  arrested  tor  breaking  e  taw  that  IS  rtoi.  written 

down. 

(m$t»i69  HiQh  Schoot,  OwMha.  NtbtMBktr 

These  items  suggest  possible  questions.. Should  schools 
generally  be  expected  to  teach  methods  of  dealing  with  life 
prdbtems?  Can  they  cover  the  basic  laws  and  regulations 
involved  in  the  day>to*day  life  of  an  adult    or  a  repre-  • 
^ntative  part  of  them?  Should  this  take  precedence  over 
other  curriculum? 

Second.  U  it  reasonable  to  expect  thai  whatever  skills  are 

■  tested  in  a  minimum  competency  program  are  atialtiable  by 
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•  all  stud«nu  during  Khool  yuri?  Are  Iheic  ind  limilar  tMls 
"minimum"  learnin|?Or  are  they  detirable  learning!?  . 
mudi  or  such  content  could  reaionibly  be \tti  to  application 
or  batk;  sI(l)Ii  ind  common  lenM  in  later  lire? 

Third,  iviilabie  competency  teeti  of  "life  ikills"  apply  lo 
today's  world.  What  or  the  Tulure?  Credit  practicetcnange. 
.  Laws  change.  Schools  have  difncult  choices  l6  make  in  . 

I  .respoD^tng  to  ^^'t  they  hear  as  popular  demand,  and  in 

'  judgiDl  how  lo  spend  precious  time. 

Generally  missing  in  competency  tests  is  the  usual 
academic  material  or  second  ary  schools-~history.  Utef||urej 
science— the  background  of  li/elong  learning.  Oeneralty' 
mitfing.  also,  ire  the  social  skiHs  that  enable  people  t6 
ilj^tohAn  i  democracy;  the  person a^kilU  that  determine 
iHe  qiiilit)  or  lire  foi  an  individual;  and  ev6n  minimal  knowl. 

.  edge  or  the  rest  or  the  world  on  a  plaoel  (hat  grows  smaller 
everyday. 

Does  this  roreshadoW  gradual  change  inKhool  curricula? 
Schools  generally  teach  what  students  are  expected  tp  need 
IV  tens  that  both  the  school  4id  the  sludeiit  regard  as  impor- 
(fnt  —  an  understandable  protection  ror  both. 


WHAT  IS  FAIR?  ^ 

When  will  studentj  have  had  adequate  instruction  in  the 
'  content  on  which  they  are  tested? 

Due  process  pr^iples  eatablished  by  the  courts  have 
slowed  down  the  competency  movemeni  in  one  respect:. 
Adoption  or  competency  letu  as  graduation  requiremerits 
seems  (o  have  stopped  with  1 3  states.  The  present  trend, 
moreover,  is  to  give  tests  required  ror  high  school  graduation 
(0  ninth  graders  Hrst. 

'In  maiiy  states  it  is  provided  (hat  tests  be  repeated  until 
each  student  has  had  every  possible  chrfnce  to  be  tucc^rul. 
Some  states  require  remedial  programs. 

•  Some  states  are  recognizing  that  high  school  is  late  to 
correct  problems  in  basic  skills  and  are  beginning  to  rocus  on 
(he  early  elementary  grades.  '  . 

A  dozen  or  so  states  require  testing  at  least  four  times 
throughout  the  12  grades.  A  few  have  required  use  or  the 
tesl^  ror  g^ade  promotion;  others  intend  (hem  only  for  local 
school  guidance.  In  many  states  local  Khool  systems  have 
.  devised  their  own  competency  programs.  There  are  no  con* 
siitent  patterns. 

•  It  seems  to  be  just  «s  difHcult  lo  determine  #  fair  cutofT* 
requirement  for  achievement  levels  u  it  is  to  choose  the  com- 
petencies to  be  tested. 

Henry  M .  Brickell  has  dMcribed  the  experience  or  a  group 
orhigh  school  tbachers  who  devised  tests  in  math  and.English 
ror  the  end  or  tenth  grade.  The  tests  appeared  to  him  to  be  or 
abbul  nnh  g^ade  difncuUy.  A  pauing  score  or  60  was  re> 
quired.  Abou(  25  percent  or  the  tenth  graders  flunked  the 
English  section;  about  SO  percent  (lunk^  (he  math. 


AftenArards  he  askod,  "Suppose  remediation  does^n't  work. 
How  many  diplomas  caWvou  withhold?**  **Maybe  ^per- 
cent." they  said.  'Then  ft  percent  have  (o  pass  the  compe- 
tency tests.  What  level  or  wprk  cah  yoM  guarantee  that  97 
percent  or  all  graduatescando?"  /  •*> 

■  ''First-grsde  work  — >  maybe  second  grade,  if  you  mean  a 
guaraHtfed  minimum:"** 

Thill  does  not  mean  that  some  (enth  graders  are  doing  all 
second-grade  work.  It  meant  that  some  studeots  vary  widely 
in  their  abilities  in  difTerent  areas,  h  meads  that  some'schools 
will  have  a  diflicutt  tirn^  in  Hnding  a  "least  common 
denominator"  for  all  students. 
•There  was  a  time,  berore  the  present  age-grading  system 
became  established,  when  teachers  apparently  expected 
children  to  progress  at  difTerent  rates. 

What  schools  are  hearing  in  the  politics  or  the  competency 
movement,  on  the  other  hand,  is  that  the  community  expects 
all  studerits  to  re^ch  certain  standards  at  certain  points  in 
their  educational  programs. 

This  raises  wiry  dimcult  qutiitions  for  Khool  adminis- 
trators: Whal  ■  the  expectation  of  the  community  for  ^ 
student  achievinent?  On  the  other  hand,  what  percentage  or 
railure  will.the  community  accept?  If  the  level  or  failure  is 
.high,  is  the  community  prepared  to  pay  for  the  neoetsary 
remedial  programs?  Knot,  will  the  community  accept  the 
'  likely  increase  in  dropouts  ^  students  who  want  to  avoid  the 
admiuton  of  railure  ^  with  the  well-known  social  costs? 

I^or  example,  the  New  York  State  Regents  withdrew  one 
set  or  minimum  competency  tests  when  the  triviality  or  many 
items  drew  public  ridicule  and  substituted  a  more  difTicuh  set  ■ 
tobeerfectivein  1981.  Yet  even  the  old  tests  are  expected  to 
deny  some  7.000  New  York  City  seniors  theiif  d^lomas  (his 
year.  ■ 

Large  numbers  or  those  students  are  Hispanic.  Community 
organizations  charge  thai  the  students  did  not  receive  (ran- 
sidonal  help.**  ' 

The  city  of  Baltimore  undertook  to  reexamine  its  entire 
progrim  when  two-thirds  6r  its  students  railed  the  first  round 
ortists.  . 


V 


SoiMtchooldittrlcUintheSouthWett.with  Ut|enumblfi 
of  itudcflU  letrning  EnflUh  ai  ■  leoond  Un|O«|0r  reportea  i 
failure  rtle  of  50  Mrc«ni. 

:  Some  ichool  d wricU  have  arrived  at  aocep(ablc  compro- 
miiea.  For  example,  Denver  hai  malnlalned  for  more,than 
18  ye«n  a  competency  j^rogram  thai  pUoet  competency 
requiremenu  for  fraduaiion  ai  about » lixih-grade  level;  li 
JUo  maintaiiis  a  strong  remedial  program.  Iti  failure  rale  of 
graduation  hai  run  consitlenlly at  2  to 4  percent.       .  . 
•A  high  peroeoiageof  lucceii  In  iKeoompet«ncy  lesu. 
however,  does  not  of  itKifmean  that  the  program  U  fair  to 
iiudenu. 

i       school  one  minimum  level  may  be. top  hardfor  a 
ilow  iiudeni.  laughable  for  a  quicli  student .  and  unmotivni- 
Ing  for  both.  '  .  . 

.  On  the  one  hand,  the  old  Qrctham's  Law  of  economics  — > 
thai  cheaper  currency  drives  out  hard  money    seems  to  be 
warning  that  the  lower  standards  of  minimum. competency 
testing  could  drive  out  higher  academic  standards.. Some 
sludenu  who  have  parsed  basic  math  tests  have  actually  been 
counseled  against  tailing  fkirther  math  coufies  in  high 
school."  Should  not  Mstitig  the  competency  tests  hsve 
.  argued  competency  for  the  next  level  of  math  counts? 

On  (he  other  hind,  ninth-grade  testing  has  caused  schools 
to  place  academically  weak  students  in  lower  **trftcki"  in 
preparation  for  the  tests. 

Those  who  fail.  In  the  words  of  one  Phoenix-school  ad- 
ministrator, "are  so  loaded  with  remedial  courses  they  have 
no  chance  to  get  Into  humanities  or  other  courses  thiimight 
keep  them  in  school."**  - 

Even  if  such  students  Anally  suopped  in  passing  oompetency 
tests,  their  high  school  years  have  been  spent  in  the  bottom 
tier  of  the  *Hwo*ticred"  education  that  hopeleuly  4>vide<4o 
many  children  for  life  —  with  little  or  no  attention  to  their  - 
own  talents  or  education  for  growth. 

Along  with  the  dropouts,  and  with  the  youjigsters  who 
receive  a  '*certiflcate  of  compleiioo"  instead  of  a  fiill  diploma 
—  because  they  passed  courses  but  failed  competHncv  tests  — 
these  students  will  And  it  eiitremely  difficult  lo  establish  their 
competence  for  poeisecdndary  educilioil  or  for  desirable 
.employment. 

It  is  ironic  tbit  manylow'income groups,  such  as  Title  I 
councils^  seiB  the  competency  movement  ara  hope  for  secur* 
ing  needed  attention  fpr  their  children.  They  have  not  seen 
that  their  children  wiU  bear  the  brunt  of  competency  (eating 
;  aA  now  generally  constituted:  that  the  effort  to  make  the 
'  schools  accountable  may  actually  push  their  own  children  out 
of  school. 


WHAT  DOES  COMPETiENCY  TESTING  COStt 

One  Virginia  school  supeqntendent  reported  a  OOStlbf  half  a 
million  dollars  to  establish  competency  tests  for  a  school 


population  of  some  150.000  children.  A  preliminsry  Report 
from  Oregon  lilted  direct  cost»  ranging  from  $26,500  to 
$173,200  per  cQstrict  to  devise  plans  and  esiablish  programs. 

Costs  for  keeping  records  uid  reporting  results  mus( 
follow  the  establishment  of  a  testing  program.  These  have 
been  estimated  at  as  m|ich  asS25,00O  per  year  per  district. 

Costs  of  remedial  programs  could  be  heavy,  especially 
'  where  there  are  laige  numbers  of  minoriiy*group  students. 
Washington  state  hu  ettimatedremediar^tsof  $90  to  $1 00 
million.  Newiersev  estimated  a  cost  of  $7d  million  for  the 
current  year.  Michigan  is  spending  someS28  million. 
!    E>0veloping  new  tesu  periodically  averages  about  $100  per 
student.  Multiply  this  by.  say.  a  minimum  of  20  million  . 
Btu<tents«  year.  If  teals  are  to  be  made  available  to  students  . 
and  their  parents  aA^  tbey  are  given  and  scored,  new  tests 
will  have  to  becoDStructed  more  oAen.  .  '  . 

State  department  budgets  will  include  costs  for  either 
developing  and  admfnistartng  lest  programs  or  providing 
auislance  to  local  districts.  These  costs  arc  variously  esti- 
mated from  $65,000  to  $495,000  annual  ly.^^^"^ — 

Nobody  really  knows  hbwmuch  compeienq^  testing  will 
,cost  in  school  funds.  And  indirect  costs  are  also  possible. 

Many  teachers  are  concerned  that  basic  skill  remediation 
in  the  secondary  grades  may  displace  ourricula  in  humanities 
and  the  sciences.  And  it  is  the  lack  of  the  higher  order  skills, 
they  say  ~  the  real  basia  of  critical  thinkint  —  that  is  the 
actual  source  of  employer  discontent  and  college  diuatisfac* 
tion.  Sooner  or  later,  thcseare  cosu  that  will  have  to  be 
reckoned  with. 


WHAT  FORECAST  FOR  EDUCATION?  ' 

For  the  most  part,  the  competency  movement  was  thrust 
upon  the  schools  as  an  attempt  to  repair  our  neglect  of  large 
numbers  of  children—  particularly  minorily'group  children, 
but  also  many  others  who  have  been  slipping  through  schools 
without  iMrning  needed  skills. 

Even  in  thb  short  period,  the  competency  program  has 
•  provided  plenty  of  evidence  of  the  needs  of  children.  Meeting 
these  needs  is  another  ^natter.  By  ilMlf,  competency  testing 
can  do  nothing—  whatever  sanctions  are  imposed.  Testing 
'  has  underscored  weaknesses  in  basl&'SkilU  learning  that  were 
generally  known  in  schools  but  more  dr  leu  hidden  and 
ignored,  for  various  reasons.  *  * 

.   the  danger  now  is  that  hyty  action  will  leave  these 
studenu  virtually  untouched,  for  theinAuences  that  insist* 
upon  rpass  testing  and  are  inclined  to  rfiake  mau  JudgntenU 
of  schools  are  also  generally  u  naware  bf  the  prooessM  by 
which  children  team. 

Only  instruction  can  make  a  difference;  and  only  dedica- 
tion to  ^aching  every  child  in  the  early  grades  can  be  suth 
'  stiintialiysuGceuful. 

The  beat  possible  outcome  of  the  competency  movement 


■   ^-  . 

ctn  be  Um  brotd  natiottiLdifCuiiion  it  hii  provoked  of  tho 
goili  and  meani  of  ^caUod. 

If  the  oompeteoqr  movemimi  leadt  lo^a  Mhous  look  at 
poorteadiini  and  oUier  problemi  in  kamfair*  i^t  t«adi  to 
more  direct  inatru^ion  in  bailc  akiila  In  early  |iid«i;  if  it 
leadt  to  mo^  communicallqa  among  tcadkvt^  moire  **crou*  • 
over**  in  leacfaing  the  Mnw balk  ikilL  in  all  courtei;  if  f t 
Jeadf  to  more  cootkleration  of  wbai  li  Imp^ni  to  letch, 
and  involvei  the  toUl  school  oofiittiuoity  In  theee  con* 
sfcleralioni  r~  than  the  competency  moveinent  couMte 
^'watershed"  for  American  lehoob.  .  / 

On  the  other  bandt  competency  tettlng  ifiin'initrument 
withitt'owndtogentofchooU.  ' 

Goaii  of  mediocrity  oan  scarcely  restore  oredibility  to 
edluoation.'  A  oompcuncy  program  Implies  ^  however  un* 
juiily  a  lort  ofguarantee  ofpetrormanoe  In  basic  skills  oo 
the  part  of  ihoee  who  have  paseed  lu  leits.  The  direct  invite* 
lion  lo  "tracking"  students  can  lead  only  to  a  division  iof  our 
young  adults  by  eduMtlon  that  will  be  no  sohulpn  to  employ- 
meat  problMts  and  mil  only  deepen  oy  r  social  probleme.  . 

UMpolitkal  popvlariiy  of  competency  testing  coukt  lead 
from  atate-initiated  teating  to  state-controlled    or  possibly 
a  national    curriculum.  The  outcome  depends,  perhaps^  on 
both  the  efToru  of  Khopts  and  the  commitment  of  com- 
munities. 

Education  Is  never  going  to  be  a  neatly  ordered*  deliverable 
package.  No  **massV  rernedy  ever  hu  Men  sucoeesnil  in 
dealing  with  school  problems,  becausethey  are  essentially 
problems  of  indivklual  differences.  CQmp^en<iy  testing  Is  no. 
exception. 


WHATTO  LOOK  FQR  IN 

YOUR  SCHOOL'S  TESTING  PROGRAM 

•  Whatever  the  aueument  program  is  in  your  school, 
parents  should  learn  a^l  il.  Tbey  should  make- themselves 
aware  of  the  purpose  of  different  kinds  of  tests  in  a  child's 

•  educational  program.  They  shouM  be  able  to  see  the 
questions  or  other  directives  after  a  test,  in  order  to  monitor 
the  sludcni's  progress.  .    .  •  ■ 

•  Parents.ihouM  be  wary  of  allowing  others  or  themselves 
to  exert  pressure  on  students  in  relation  to  tests.  Testsjhoukl 
not  be  too  numerous,  or  loom  tog  large  in  a  child^s  school 
life,  or  parents  and  teachers  will  find  themselves  "pulling  up 
the  cnrrots  to  see  If  they  are  growing." 

•No  one  test  Is  a  fair  basis  of  assessing  a  sludertt's  progress. 
Individual  scores  are  al  most  a  minor  indicator  of  a  child's 
progreasA-  never  a  permanent  indicator  of  ability  —  and 
thou kJ  never  be  used  as  the  buis  for  any  administrative 
.decision. . 

The  ichool  probably  uses  standardized  achievement  tests 
of  soflK  sort.  Theee  scores  should  be  placed  alongside  a^  ■ 
chiM'Aclauwork;  scores  on  teacher-devised  $n6  other 
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criterion- referenced  teiti;  the  leacher*s  eslimaie  of  the  child*s 
abiliiiea;  and  the  parent*!  knowledge  of  his  or  her  talents 
and  interests. 

It  shoukl  be  understood  that  a  child's  abilities,  activities, 
and  attitudes  oannot  be  measured.  *- 
•  Parents  and  teachers  need  lo  look  at  their  children's  educa- 
tion u  a  whole  —  a  single  continuum  from  kin^rgarten 
through  twelfth  grade— with  a  systematic  evaluation  ofsiu* 
dent  progress.  Ttieonly  true  estimate  of  a  child*s  progress 
can  be  biued  on  chan^  over  a  period  of  time. 


NOT  ALL  CHILDREN  MATURE  AtTHESAMER 


.  The  **assembly  line"  grading  system  ignores  the  realities  of 
children's  uneven  growth  patterns.  Knowing  that  children 
differ  in  their  talents  and  strengths,  parents  and  teachers  can 

.  insist  that  instruction  be  related  lo  diildren's  growth  . 
patterns;'t)iat  teating  be  band  on  instruction;  and  that  coh- 
tinuous  efforts  be  made  to  improve  teaching  and  learning. 

It  is  not  reasonable  to  expect  strong  competencies  in  all 
skills  from  allthildren.  Very  often,  moreover,  development 
of  individual  strengths  also  brings  solutions  to  weaknesses. 
For  instance,  children  often  leant  lo  read  more  readily  when 
their  talents  in  one  of  ihe  arts  or  their  Interests  in  sports  are 
recognized. 

-  •Before  choosing  among  the  many  available  alternatives 
for  assessment,  schools  shoukl  make  a  suslalncd,  Innkpth  exami- 
nation of  what  teachers  need  to  know  «bout  ihe  procest-and 
content  of  their  students'  learning.  This  study  should  involve 
both  students  and  parents.  *  . 

Giving  parents  and  students  a  voice  in  curriculum  develop* 
ment  and  assessment  is  an  effective  way  for  a  school  system 
to  fulfill  its  responsibility  lo  account  to  the  community  for 
educational  performance.  SucKa  process  would  earo  Khools 
new  public  support    as  well  as  help  to  attain  a  better  quality 
of  learning  for  every  child . 

•  |t  is  most  important  that  emphasis  on  basic  skills  start  in 
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early  $nMt.  Hetptni  (Mchers  to  monitor  individuil  pro* 
§nmi  Troni  the  beginnlnf  oould  fO  Tartber  in  itrenitbcninf 
tbcieikilbthan  a  unirorm  t^Kiof  program.  If  a  tetttng 
program  U  adopted.  bowcVer,  it'also  should  begin  iathe 
primary  gradcsat  partofinitrucUon. 
•  In  the  caM  of  Mcondary  studenU  who  have  falM  to  ac* 
quire  reasonable  ikilU.  parenu  and  teachers  should  insist 
that  remedial  measures  be  supportive,  not  demeaning;  that 
they  be  appitopriatp  to  the  age  Wvel  of  the  student  and  con- 
ducive to  the  development  of  self*esteem;  and  (hat  they  leave 
room  for  oihef  insirpctloo  on  the. secondary  grade  level. 
•Teachers  should  be  enoouragedto  use  a  variety  of  ap- 
pfWhes.  Flexibility  in  ways  of  meatutjng  skills  —  the  uae  of 
other  methods  and  not  just  pencil>and-paper  teating  ^  helps 
the  teacher  helpthe  student,  "teat"  is  too  restrictive  a  word. 

Some  schools  use  a  packet  of  student  papers. journals,  in- 
terviews, talks  10 1  he  class,  artwork,  problem -solving  tasks  in 
community  projects,  consumer  tasks,  use  of  milh  in  construc- 
tion or  cookery,  snd  a  host  of  other  examples  of  practical 
application  of  basic  skills. 

Some  ktatea.  luch  as  Vermont,  have  directed  local  districts 
to  have  teachers  "check  off'  skill  achievemenlpK  each  child 
as  it  occurs  in  day*to<^ay  class  work .  It  is  \Mtlfpown  that 
any  vhitd  —  like  any  of  us  —  will  often  need  to  karn  a  skill 
more  than  once;  if  the  check^olTtask  is  not  top  burdensome, 
it  mikes  ihe'point  that  schievement  hss  occurred. 
«  Where  the  objective  of  a  testing  program  is  suoceu  for 
every  student  —  riither  than  ranking  or  sorting  —  the 
mianer  of  test  writinfjs  important.  There  is  every  reason 
why  tests  should  he  straightforward,  without  tricks  or 
.  negatives 

Writing  skills  should  be  judged  from  writing  samples,  with 
the  important  skills  of  editing  included  in  the  task.  That  is. 
students  should  be  given  an  opportunity  to  rewrite  a  piece. 
^t)iqg  skills  are  a  large  part  of  writing  skills,  and  more  oAen 
ignored  thaAnol.  Teachers  do  well  in  evaluating  a  student's' 
writing  b^yAking  first  for  content,  credibility,  clarity,  and 
organi/ajPn  — >  and  then  for  punctuation  snd  other  \ 
mechaniei. 

"Holistic"  scoring  is  a  skill  that  many  teachers  are  learn- '  - 
mg.  Pilot  tests  in  the  Massachi^tts  competency  program 
have  shown  thai  teams  of  teacHers  can  score  large  numbers 
/)f  student  papers  with  strong  agreement  in  their  evaluations 
and  with  a  surprisingly  small  axpenditure  of  lime. 

Oral  communication  should  be  judged  from  interviews  and 
debate  as  well  as  prepared  talks,  according  to  such  criteria  as 
focusing  on  the  topic  and  speaking  dearly  and  logically. 
Listening  and  viewing  skills  are  being  given  new  importance 
in  a  world  growing  dependent  on  oral  and  visual  communi- 
cation, and  the  nMd  for  performance  teats  in  ihete  areas  is 
obvious. 

Besidea  these  alternatives,  teachers  can  turn  to  various 
criterion>referenced  tests  —  whether  U^owrn  or  externally 
developed  —  to  check  on  mastery  of  pdkicular  subject 
matter.  Unambiguous  multiple-choice  questions  cah  fairly 


be  used  to  teat  spedflc  instruction,  such  as  grammar  or 
computation. 

•  More  open-ended  asieasmenti,  however  give  a  better  idea 
of  tiow  a  student  learns.  In  science  and  social  studiesj  the  use 
of  ''What  do  you  know?"  quesiiMki  ^  u  wdl  as  "Do  you 
know  what  I  knowT'  ^  removea  th< crutch  of  multipl^ 
choioe  iinswers.  because  such  questions  afford  the  child  an 
opportunity  to  show  comprehension  of  a  sequence  ofideas 
and  reasoning  abilities. 

Oiving  the  child  free  choice  in  the  library  for  independent 
reading  caj)  suggest  his  reading  level  —  ay  well  ak  developing 
curiosity  and  an  advepturottt  mlad. 
•Teachers  cart  develop  (heir  stimnts'  own  afoilitiea  to 
evaluate  p^ogreu  by  uking  them  to  correct  each  others' 
•  papers,  and  then  by  following  up  with  a  genera!  discussion. 

Teachers  can  also  lead  students  to  raise  questions  sbout 
literature  or  history    end  then  to  evaluate  those  questions 
'u<  I )  interesting.  (2)  U[erage,  or  (3)  trivial. 

Improving  student  Bwers  of  evaluation  throuah  such 
practices  also  improvf  leaniing.  Students  should  be  con- 
'  jinuously  involved  in  documenting  and  evalMating  their  own 
progrett. 

•  {ptematives  to  pa^r-and  -pencil  tests  recognize  that  indi- 
■  vidoals  differ  in  the  styles  in  which  they  learn  and  commu- 
nicau:  —  that  some  are  more  confident  in  writing,  some  in 

'  speeth.  some  in  artistic  expreuion..The  famous  composer 
Bruckner  once  expressed  his  difficulty  in  respornliqg  to 
honors  paid  tohim  by  saying.  "If  I'had  an  organ  I  could  tell 
you  how  I  feel" 

If  the  objective  is  competency  in  learning  "to  function 
effectively  in  contemporary  society."  it  seems  that  students 
need  not  attain  the  same  level  in  every  skill  at  the  same  time. 
Attaining  sk^ls  enough  to  (eel  the  "cadfidencc"  envisioned  . 
by  the  Califohiia  legislature  —  along  with  an  eagerness  for  ^ 
learning — may  be  the  best  foundation. 

Itrthe  end  we  have  lo  recognize  that  there  is  qo  way  to  test 
wha(  really  mstters  to  a  chiid'slearnjng.  Every  child  is  % 
uniqic  individual.  Children  share  s^e  abililJeSi  have  some 
talents  of  their  own,  snd  differ  in  the  way  thW  learn. 

As'tone  educator  put  it.  a  student  is  not  a  We  to  be  lighted, 
or  a  i^essel  to  be  niled,  but  a  being  whose  gr«vth  is  to  be 
nou'rjshed.  v 
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\A  PARENTS'  GUIDE  THROUGH  THE  TESTING  MAZE 
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PtrMti,  (MdMn,  tad  MiidMMi  wtti  btra  oiort  from  tMU  liVcii  •< 

UMir  NlMOl  if  tlMy  luMlcnUiM  llMt\ 

-  '  UMr«  irt  iilUmt  kbidi  of  l«u      jUttum  purpo^; 

■t)  UtU  an  Kmltid  Is  wbtt  llMy  m^ra  tftd  what  they  can  t«II 
aboai  Iht  Mudaat;  aji4  \ 
.   miMM  of  imU  cka  be  harmAil  tp  ^wmu.  ^ 

.  How  im  a  ^fCvidardiaad*'  m  (UHw  rrom  U«U  Umi  iMcbtn  |hr« 
l»  UMr  Hikkiii  pwiodtally  to  diack  en  iaitrvclloii  i«  ibcir  own 
dattfoom^ 

A  Maadafdbad  UM  ipaa  bt  aay  mm  that  Misi  MNnban  ofnudatu 
Ukc  ttMSar  ibiiaar  cmdklom.  The  nom-f^ffmeHl  sekkvtmtni  . 
.  tan.  liowcvar.  ii  ib«  moat  «iddy  itaad  iundardiaad  laal. 
'  TTkaa  kom-nkmoti  acMivimaal  taau  do  ao*  tvahiata  lo  mwch 
«4at  stadaaii  miy  bt  iUidylBf  Is  idwol  at  ^ba  tim«  byt  ratbar 
ovaluaia  lanaral  **90tmntU^^  raadlaf  combralHaaton.  nambar 
coacepU,  or  oompwlatUM.  \ 

JU  toofiaf  of  aorm-rafmooad  acbWrcroaal  tMi  tfoai  104  rapre- 
aant  what  a  nadaat  shoM  aoooinpUib.  bdt  raibar  a  raafa  of  what 
•tadcaii  00  J  givM  irada  M  ofdjaarily  do  aocompUah. 

Wby  ibotMd  paraali  ba  cooOaraad  abovl  iba  wayi  lo  irbkb  lUii- 
dardind  t«tf  ar»  aaad  ia  IbaU  icbooliT 

SUadardiiad  laaU  dlfactly  tthcH  corrkvlam  davalMoiaol,  text* 
booki,  laocbat  odooaUofl.^AdniiMkMi  to  bigKer  odiKotwa.  aw)  Ibc 
dkMwaboa  of  icbolanliip.ftMida. 

Suadardiaad  laMi  art  coally  —  ia  outlay  of  icbool  n«odi  for  tha  . 
(aiU  ibamaatvai:  ia  ^ff  tima;  la  Jaaralag  Md  laacUag  lima;  aad  ia- 
Iba  heavy  amoiloaal  praieyrw  tbay^y  pot  oa  UttdaflU.  taacban, 
^■rtadpak,  and  paraaii.  » 

|Suadardiiad  laMi  are  ht/H  oufiaratod  ImporUaca.- 
CoanqMf  Iky.  grave  aaeaUoM  era  niaed  oojKaniiag  ibe  dlreclioiu 
la  «bkb  ibay  are  lakliig  o«r  cbUdrca.  pereou,  and  ovr  KbooW. 
'  Ifibimoalimportajrt  Mill  iaitodeou' three  are  blfi|edi»poiiiba 
average,  at  lUiidardiaad  teiU  are,  ibeo  ibe  [level  of  otir  ecboole  will 
tebd  to  mediocrtty. 

ir.  becaaee  o(  ibe  teeu  we  >Me,  Ibe  adviacamaat  of  Modeaia  la 
edkool  i«  decermloed  by  coopartag  ibam  with  tbetr  cJaumeiaa  oTthe 
tame  age,  will  we  aoc  deetroy  Utfir  eelf  eiteem  aad  tbeir  epprecia-  . 
tloo  of  UidMdMl  dmenMa^ 

A  ataber  of  lUlee  bav«  BMadeted  oo«pe<eocy  leejti^ae  a  reqeiro* 
meal  for  Mgb  icbool  gradnatka.  Oaf  of  ibe  cxperiMoee  of  tbeae 
tute*  have  amergid  e  boel  of  qaeetloM  aad  a|  teoM  three  ooafll^- 
lag  aad  irovbMag  proWeme: 

How  todevlie  pregraiai  that  wodd  idUefy  poUilcal  deasaada  aad 
el  the  ame  iim  addreee  fairly  the  very  raai  wedkMaeee  fai  Kboob; 

How  to  impeee  aalvenal  madarda  of  dooblM  levele  apoa  Ix- 
tremety  dlveree  Nbool  ponUaUofle  wftbovl  deatrwiig  ooatem' 
porary  arbliMmwde  In  ladlvidaaHwd  edvoelioo;  aM 

How  to  roreeeejlhMeelb(e>aad  lake  bao  eoeae  acoouM  ibe  leaf- 
rei^  bnpHcatieoe  A;  iheee  adioM  for  ibe  related  aeadi  of  a 
demw^lic  eodeiy  aif^for  r^Ulak^  cteelki^  a»  aa  adiicalkwal 


•pedal  kaowledge?  Are  the  queniooi  itralghtforward.  aad  ikM 
deelgaed  lo  trkk  etudaau^^thar  than  tail  ihcm  hoocelly  ebout  what 
tbey  have  baao  iiNybtT 

How  much  preiMire  ii  being  put  oo  etodeoii  —  by  percfiU  or  by 
memben  of  the  Nbool  facvHy  —  to  do  well  oa  teet^ 

H  eve  the  leM  piibUebert  waraed  that  **gradc  ler^v  are  not 
abeolute  lUndardi  but  rough  ladkalore  of  evarege^ 

Hu  yoor  ecboo)  cauUofted  agaiait  usiag  tan  ioor«  lo  label 
nudeau  or  label  teacben.  «gd  hai  it  -warned  ibe  .media  that  tert 
KoriM  are  Onrettable  Informalloa  on  the  qoalily  of  a  ichootT 

Are  itandardlzed  teel  loofce  being  uied  elooe.  or.  at  tbey  ibould 
ba.  along  wiih  a  chlld'i  daMwork;  Korte  oo  teecber-devlwd  aad 
^othcr  Rllerioa-refervnoed  leets;  the  leacber'i  eiUmele  of  ebUklei; 
lad  Ibe  pafent'i  knowledge  of  Ukaia  ead  intereet^  One  lea  can 
oner  ei  moe<  only  a  minor  indkatioa  of  a  child*!  progreii. 

Ii  the  aducalloa  of  yoer  child  viewed  at  part  of  e  conliauum. 
kiadergarteti  Ihrougb  twdHb  grade? 

\i  a  lyetemeiic  evaluation  of  your  dilld'i  progreae  conducted, 
baaed  on  thii  continuum? 

It  iaitruction  related  to  Ibe  individual  growth  pattcmi  of  each 
child? 

And  it  the  leMiag  bated  oo  thai  initructloi^ 
Are  cooUauoui  efTorU  betag  made  to  improve  teaching  aad 
learning  at  your  icbool  ai  a  resull  of  teetin^ 

Did  your  icbool  conduct  ea  in-dep(h  eumiaatioo  of  what 
leachen  need  lo  know  eboul  the  pcooeu  and  conteai  ofibdr 
iludeou'  eurrloalum  before  cbboeing  the  teiU  to  be  given? 
Arc  parenli  and  Uttdenli  tiven  mn  opportunity  lo  have  a  voice  in 
It  and  aaaee 


curricaium  development 

Doei  emphaiU  on  the  baeka  begin  in  the  eeriy  graded  Do  the 
teacberi  moofior  indivldutl  progreM  In  tbeie  pMf  Doei  teeling 
begin  in  ibeee  early  gradai  at  a  pert  of  ihe  iaitrvcilont 

U  remedial  iMlnicitw  tuppoftive  rather  than  dameaninif?  Ii  it 
appropriate  to  e  tludent'i  ege  level  end  conducive  to  tHe  develop*, 
meat  of  eelf^eiteem?  Don  it  leave  lime  for  other  Inttruction  end 
adiviik^ 

Are  teadten  encottraged  to  uie  e  verieljr  of  letting  method^ 
Are  epproprlkte  performaiKc  letu  given  in  the  ercat  of  writing 

end  oral  communlcallon? 

.  Are  lome  of  the  tetu  given  opco<ended? 
Do  the  teeu  tUow  for  dilTerencet  emong  itudeou  in  itylet  of 

leamiag  and  90fnmualcatin|? 


MowkacbecUiatof 
amifta  tbek  w  ttMi'$ 
What  fcMofleeUtre 
Aaktoaeeiheieiii.Do 
or  racial  Ma^  Are  the 


[tibne  paienu  might  atk  wbe*  ibey  ei- 
I  pcogram. 

I  need  aad  for  wbai  purpoeeKT 
re  a  geotrapMcnt  cultural,  eeml<  - 
I  dear?  Do  the  quaiUeffe  reiqulm 
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Mrs.  Sparuno.  As  parents  and  educators  we  support  H.R.  4949 
as  a  means  for  requiring  the  disclosure  of  information  wW  will 
address  the  ^ight  concerns  just  raised  and  we  Yeel  that  the  follow- 
ing ar^allmarks  of  the  legislation/  "'^^       .  « 

W  Tnat  the  bill  jirovides  for  the  standard  error  of  measurement 
•  to  be  shared  notydnly  with  teachers  but  with  test  takers  and  their 

garents.  Many/of  them  will,  for  Che  first  time,  be  aware  of  the 
road  range  ^precision  evident  in  these  scores,  even  though  life 
and  career  decisions  are  being  inade  on  the  basis  of  a  few  points. 
1(b)  That  t)ie  legislation  includes  j^rotections  to  the  right  of  priva- 
<jy  of  family  and  test  takers  in  insuring  that  research  will  be 
limited  t6  data  which  is  not  personally  identifiable,  unless  ap- 
proved/by  the^test  taker. 

(c^That  need  to  release  to  test  takers  their  actual  test  questions 
and  answers  Mrithin  a  reasonable  period  following  the  tests.  Also 
important  is  a  procedure  for  review  Of  a  challenged  test  score 
within  a  Teasdnable  time  frdtale. 

are  hopeful  that  the  section  which  will  require  a  description 
of  special  services  t6  accomrniodate  handicapped  students  will  allow 
schools  to  deal  more  effectively  with  the  needs  of  such  students  for 
differentiateji  testing.  ^ 

We  are  finding  locally,  for  example,  that'  many  students  with 
writing  difficultieis  can  be  appropriately  tested  by  oral  tests.  To  tiy 
to  force  wi^itten  tests  on  such  youngsters  is  cruel  and  unproductive. 
'  In  closihg,  I  would  like  to 'emphasize  three  points: 

(1)  the  charge  has  been  made  that  these  proposed  changes  will 
dramatically  increase  the  cast  of  tes^gg.  While  data  are  available 
to  challenge  that  statement,  this  wo(0d  be  a  poor  excuse  for  main- 
taining a  system  of  testing  ^hic^  i^falling  under  serious  challenge. 
Schools  and  families  now  spend  over  a  quarter  billion  dollars  a 
year  on  testing,  and  the  appropriate.question  might  well  be:  Are 
we  already  wasting  $250  million?  / 

We  cannot  evaluate  the  changes  that  may  be  necessary  unlei9S 
we  can  review  what  the  true  costs  of  the  present  system  cover. 

(2)  testing  is  a  large  private  tor  profit  industry  which  has  a 
tremendous  impact  on  a  public  phenomenon,  education.  The  public 
has  a.  right  to  scrutinize  this  Industrie  and  to  hold  it  accountable  for 
its  product.  >    -  , 

(3)  the  National  PTA  does  not  seek  an  end  to  testing.  But  we  are 
seriously  concerned  that  the  present  degree  of  the  art  of  assess- 
ment is  far  less  precise  than  We  have  been  led  to  believe.  |  , 

We  feel  the  questions  about  our  presept  testing  methoois  will  not 
be  put  1^  rest  unti}  parents  and  teachers^are  able  to  make  decisions 
based  oh  much  more  data  than  is  now  available  to  us.  That  is  why 
this  kgislation  is  so  important.  <^  « 

We  seek  the  information  that  will  give  all  of  us  dependable  data 
to  help  determine  the  course  of  our  public  schools  and  the  appro- 
priate direction  for  our  children. 

V  The  National  PTA  stands  ready  to  participate  in  any  reasonable 
^ort  to  reach  that  goal* 
Thank  yoU. 

Chairman  Perkins.  Tliank  you  very  much. 
We  will  now  hear  from  Dr.  Rever. 
Go  ahead.  Dr.  Rever.  '  V| 
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STATEMENT  OP  PHILIP  REVER,  DIRECTOR,  W'ASHINGTON  OF- 
t^ICE,  AMERICAN  COLLEGE  TESTING  PROGRAM,  ACCOMPA- 
NIED  BY  RICHARD  FERGUSQN,  ^VICE  PRESIDENT  OF  ACT'S 
RESEARCH  AND  DEVELOPMENT  DIVISION  ' 

Dr.  Rever.  Mr.  Chairman,  I  am  Dr,  Philip  Rever,  director  of  the  • 
Washington,  D.C.  office  of  the  American  college  testing  program. 
With  me  is  Dr.  Richard  Ferguson,  vice  president  of  ACT  s  Research 
and  Development  Division.  We  are  pleased  to  share  with  you  and  ^ 
your  subcommittee  our  statement  concerning  H.R.  3564  and  H>R. 
4949. 

ACT  is  a  not-for-profit  corporation  which  develops  and  publishes 
'   .      numerous  assessment  j)rograms  administered  to  students  in  behalf 
of  the  Nation's  secondary  and  postsecondary  schools. 

One  such  program,  the  AC5T  Assessment,  is  used  nationwide  to 
facilitate  students'  transition  from  secondary  to  postsecondary  edu- 
cation prbgranis.  Accordingly,  ACT  would  be  subject  to  the  provi-. 
•      sions  of  either  of  the  two  bills  currently  under  considieration  by  the 
/  subcommittee^  - 

We  do  not  believe  that  these  bills  are  in  the  belt  interests  of  the 
Nation's  students.  Neither  do  we  believe  that  they  serve  to  remedi- 
ate  any  pressing  problems  i^irectly  attributable  to  the  uses  of  tests 
in  this  country.  Consequently,  we.  respectfully  urge  that  the  bills  ^ 
^     npt  be  enacted. 

Wife  have  prepared  quite  an  extensive  statement  for  the  commit- 
'  tee  which  we  have  submitted  to  the  committee,  and  I  would  like  to 
'  summarize  out*  reasons  for  the  opposition  for  your  two  bills. 
Our  comments  iu'e  directed  specifically  at  R 
"  is  our  intention  th^t  jihey^  be  extended  to  the  corresponding  provi- 
sions of  3564  as  appropriate. 
Thef  Ibestimp^piy  contain^  herein  deals  with  both  the  general  but 
,  highly ^significant,  edw^ 
vated  and  enveloped^disd(!*i^     of  the  two  bills,  and  with  the 
r      specific  sWrtcomings  ;0f  t3he  bjlls.  ^  f 

I  will  review  foi?  you  this  n&niing 
.  .     thoughts  are  fiiwHt  lioth  Mis  rather  than  a  section  by  section^ 

9nalyQiB»  '  %  . 

r  We  believe  that"  tlie  proposend  le^^ilation  is  ill-advised  due  to 

maiiy  factors,  ioxne  political,  some  educational,  and  some  simply 
reflecting  a  piisundetstanding  of  the  truly  significant  edueationial 
^  ^  ifl^ue^of  theday.  ■  ,  t.^/ 

^  •      We  iregret  that  so  mayiy  resources  and  so  much  ene^  are  bfflfig  , 

invefitid  in  efforts:  to  place  unneeded  controls  on  the  to^  that 
"      have^s^rved  mi  continue  to  ser^e  students  and  education^  so  well. 
"        lament  this  occurrence,  not  out  (rf  any  sense  of  sejlinterest, 
hm  rather  in  recognition  of  the  futility  of  focusing  diSportipnate 
<*  attention  on  the  tools  that  repeatedly  remind  us  of  one  of  our 
society's  most  repugnant  shortcomings,  that  we  have  hot  yet  s,uc- 
'  ce^ed  in  assurmg  equal  eduati<ind  opportunity  for  all  of  our  ^ 
peoples*    ,  '  ^ 

>  %  l)eUe^  that  legisldtion  requiring  the  diss^tnination  of  all 

\       manner  of  toformation- about  firsts  Will  in  any  way  remediate  basic  * 

■  *  .  societal  illsTsome  of  Which  have  been  scores  of  Jears  in  the  ntak; 

■  Wj    ing,  is  to  engage  in  the  mpst  fanciftil  und  wishful  thinking.| 
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If,  on  the  other  hand,  a  goal  of  the  legislation  is  to  diminish  the 
value  of  tests,  then  the  bill  is  well  suited  to  this  pifrpose. 

We  do  not  believe  this  to  be  the  goal  inasmuch  as  the  realization 
of  such  a  goal  would  ultimaifely  result  in  the  laweeping  of  one  of  our 
Nation's  toost  urgent  problems  under  the  rug.  It  is  for  this  reason 
that  vfe  encourage  a  more  intensive  and  extensive,  study  of  the 
potehtieil  long-term  effects  of  the  provisions  of  the  bill. 

We  are  further  troubled  by  the  lack  of  awareness  on  the  part  of 
so  maiiy  as  to  the  potential  negative  effects  of  H.R.  4949  for  stu- 
dents, educa:tional  institutions,  and  ultimately  the  public  which 
depends  on  a  wellreducated  fcitizehry  iipr  its  future  well  being. 

The  prevailing  attitude  in  some  quartets  .that  enactment  of  the 
proposed  legislation  need  not 'be  preceded  by  a  thorough  study  of 
the  potential  impact  of  its  pr6visions,  because '^hese  provisions  are  , 
at  worst  discomforting  to  test  agencies  and  test  sponsors,  belies  the 
reality  that  many  provisions  of  the  bill  have,  potentials  conse- 
quences that  are  counterproductive  to  the  attainment  of  the  stated 
goal  of  the  bilL  '  i- 

.  Let  me  review  for  you  briefly  what  we  believe  the  msgor  signifi- 
cant iJfegative  torisequences  of  H.R.  4949  are, 

ACT  identifies  positively  with  the  stated  purpose  of  H.R.  4949. 
We  do  not  believe,  however,  that  the  provisions  of  the  bill  contrib- 
ute in  Si^ificant  ways  to  the  attainment  of  thipit  purpose.  To  the 
colitrary,  we  view  maiiy  bf  its"  provisions  $s  potentially  counterpro- 
dudtive.  Specific  illustrations  of  the  shortcomings  of  the  bill  in  this 
respect  are  provided  next.  i  • 

Essentially  we  have  divided  these  effects  into  t>vo  categories:  (1) 
political  and  legal,  and  (2)  educational' and  socialj 

With  regard  to  the  political  aiid  legal  effedts,  enactment  of  H.R. 
4949  will  preempt  responsibilities  reserved  by  the  U.S.  Constitution 
for  States. 'Although  two  States  have  enacted  ilegislationlsimilar  toV 
HM.  4949,  only  the  law  enactedj/ih  the  S^te  of  N^if  York  is 
comparable  to  the-propDsed  legislation.  ,* 

The  bill  enacts  in  Csflifornia  is  very  dissimilar  from  H.R.  4949. 
•  Of  particiUar  note  is  that  two  States,  ^atylarid  and  Coft)rado,  have 

Snsidered  similar  leirislfi|tion  but  rejected  it.  Moreover}  some  States 
nduct  intrastate  admifeion  testing  programs  which  they  develop 
without  the  assistance  of  any  testing  sponsor  or  agency.  "  *  • 

Thus,  enactment  of  H.R.  4949  will  impose  the  Will  of  the-  U.S. 
Congress  over  the  will  of  the  elected  representatives  of  at  Ipast  two 
States  And  extend  Federabjurisdictioh  to  testing  prograrfis  solely 
wdihin  the  province  of  St£^  education  agencies  ^rithout  compelling 
reasons.  ' 

.  It  is  noteworthy  that,  to  our  knowledge;  no  legal  challenge  has 
.  ever  been  brought  involving  a  test  sponsor's  violation-  of  the  Consti- 
tutional guarantee  of  due  process  and  equal  opportunity.  Specifical- 
ly, we  ai»  unaware  of  any  court  of  law  having  decided  in  favor  of  a 
challenge  to.  the  vaJidity  ftnd  appropriateness  of.  tests  used  in.  a 
college  admissions  process.  This  fact  speaks  strongly  to  the  lack  of^ 
a  comi)^ling  reason  for  Cohgress  to  enact  H.R.  4949.  '  . 

H.R.  4949  contains  prQvisiohs  that  violate  the  spirit  and  intent  of 
existing  Federal  law.  Sections  4(aX2)  and  5(c)  would  appear  to 
rescind,  p^prietary  rights  previously  granted  by  the  Congress  to 
test  sponsors  under  copyright  law.  ♦ 


\ 
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Sections  4(aXl)B  and  section  7  are  contrary  to  an  histork  intent 
of  the  Federal  Government,  maintaining  competition  by  protecting 
trade  secrets.  By  enacting  H.R.  4949,  the  Congress  will  thus  have 
reversed  protections  gjanted  under  previoiis  Federal  legislation 
such  as  the  Freedom  of  Information  Act  and  the  Securities  and 
tlxchaiige  Act.  ^ 

Withdrawal  of  copyright  and  trade  secret  protection  from  a  spe- 
cific group  of  agencies  is  discrithinatory  and  contrary  to  the  large 
public  interest. 

With  regard  to  educational  and  social  effects,  because  there  are 
marked  differences  among  admissions  tests  insofar  as  their  pur- 
.  poses,  theoretical  foundations,  content,  uses,  and  the  magnitude  of 
those  usei^i,  H.R.  4949  will  have  differential  impacts  on  the  various 
admissions  tests.  That  is,  some  programs  will  be  more  seriously 
affected  than  others. 

For  example,  programs  with  low  volumes,  and  even  those  with 
large  volumeS,  will  find  it  difficult  to  offer  the  complete'  seryices 
presently  offered  to  students  and  educational  institutions.  In  par- 
ticular, special  testing  provisions  nSay  be  severely  hampered. 

Special  testing  arrangements  for  persons  with  physical  handicaps 
on. with  religions  preferences  that  forego  testing  on  the  regular  test 
dates  will  he  affected.  Some  testing  agencies  also  provide  instRu- 
tiqns  with  the  facility  xo  test  students  on-caihpus  at  times  of  the  ^ 
institutions's  choosing.  Such  testing  would  have  to  be  restricted  or 
discontinued  altogether. 

The  release  of  secure  test  items  as.  required  by  the  bill  will  have 
nuriierous  negative  effects  of  an  educational  character.  Primary 
among  these  is  the  expected  impact  of  the  scope  and  content  of  the 
tests  on  high  school  cui^riculums. 

The  inevitable  result  of  releasing  test  items  will  be  to  encourage 
and/or  facilitate  niany  schools  and  teachers  to  strive  to  increase 
student  performance  on  the  tests,  not  always  in  a  pedagogically 
sound  manner.  To  the  extent  that  this  occurs,  tests  will  be  inappro* 
priately  leading  the  curriculums. 

A  related  effect  may  well  be  to  encourage  the  proliferation  of 
coachingifichools,  many  of  which  will  fail  to  engage  in  sound  educa- 
tional practices.  Since  it  is  not  established  that  the  efforts  of  such 
schools  produce  results  of  equal  benefit  to  all , students,  aiiy  such 
outeome  of  the  bill  would  ,  be  anathema  to  the  public  interest. 

We  believe  that  educators  and  educational  institutions  are  more 
likely  to  be  successful  in  serving  society  if  they  make  infot^med 
decisions  libout  the  educational  process,  whether  regarding  individ- 
ual studehts  or  programs  aff eating  those  students. 

Likewise,  students  are  more  likelvto  achieve  their  fullest  poten- 
tial if  tlyey  are  well  informed  about  their  capabilities  in  relation  to 
the  requirements  Of  Vl^riouB  educational  and  vocational  programs 
they  m,ay  be  considering,  and' about  ways  of  readying  themselves 
for  tho6e  programs. 
*  Sonie  of  the  tests  affected  by  the  bill  are  designed  to  accommo- 
date mich  informed  decisionmaking.  Indeed,  the  value  of  the  tests 
to  students  and  educators  in  this  context  far  exceeds  any  possible 
i'      value  of  them  in  t^he  selection  decisions  attributed  to  them. 

ERIC  ;  y 


Given  these^  uses  of  tests^  it  is  indeed  lamentable  that  they 
shpuH  be  subjected  to  provisions  which  Can  only  diminish  their 
percewed  value  to  students,,  educators  and  the  public. 

The  provision  of  H.R.  4949  that  would  require  the  release  of  test 
items  will  likely  have  such  an  enect.  . 

The  release  of  test  items  will  almost  certainly  subiject  the  items 
and  the  tests  to  highlylnappropnate  analyses.  The  probable  lack  of 
recognition  that  different  types  of.  tests  are  constructed  to  serve 
diverse  purposes  will  likely^result  in  invalid  interpretations  and 
critiques  of  the  iteiQS  by  individi||jl|  unschooled  in  testing  method- 
ology and  uninformed  about  the  intended  uses  of  the  tests. 

Such  occurrei^ces  will  result  in  a.  diminishing  of  the  confidence 
placed  in  te9ts  for  .  all  uses.  When,  this  occurs,  the  loss  to  our 
educational  system  will  be  significant;  the  loss  to  the  individuals 
who  are  helped  by  the  test  data,  either  directly  or  indirectly,  will 
be  even  greater. 

In  summary,  we  have  provided  in  our  statement  comments  on 
H.B.  3664  and  H.^.  4949  as  pact  of  what,  we  believe  to  be  our 
responsibility  to  American  education.  It  is  pur  conviction  that  the 
proponents  of  this  legislation,  while  well-intentioned,  have  concoct- 
ed a  remedy  whose  ultimate  consequences  will  likely  overshadow 
the  illness  supposedly  being  addressed. 

We  are  concerned  that  the  very  important  reach  of  these  bills 
within  our  educational  system,  both  in  terms  of  pedagogy  and  in 
terms  of  the  proper  role  of  gbyemment^  h^s  been  giyen  short  shrift. 

It  is  crucial  tnat  subsequent  study  of  the  bills  by  the  Congress 
emphasize  a  thoughtful  assessment  of  the  ^eed  for  this  legislation 
balanced  against  the  impact  it  could  have.  The  potenticd  negative 
.  consequenc^,  to  some  extent  motivated  by  lack  of  understanding  of 
the  nature  and  purpose  of  the  tests  themselves,  surely  deserves 
more  serious  attention  than  these  hearings  will  provide.  To  that 
end,  we  strongly  urge  thorough  subsequent  study  ^f  the  testimonies 
provided.  if  ' 

We  are  dealing  with  the  potential  of  literally  millions  of  persons. 
It  is  undeniable  that  teste  play  an  important  role  in  this  context. 
That  role  is  appropriate  in  the  educational  setting  and  has  beeii 
found  sound  in  the  occupational  getting  by  the  U.S.  Supreme  Court. 

This  legislation  jeopardizes  the  contribution  of  tests  to  our  educa- 
tional system  and  ultimately  poses  grave  problenis  for  the  auton- 
oniy  of  our  institutions  of  higher  learning. 

The  burden  of  proof  regarding  the  need  fbr  legislation  gn  steiid* 
ardized  testing  cannot  be  met  hy  political' sloganism  or  populist 
concepte  put  forth  without  benefit  of  data  that  verify  the  nature 
and  extent  of  the  harm  proppnehte  of  these  bills  assed;  applies. 

Unm  such  data  are  provided,  the  proposed  legislation  siiould  not 
be  enacted* 

Mi*.  Chairman,  vtre  are  here  to  answer  your  questions^  and  I  have 
provided  the  committee  with  a  catiflog  of  our  publications.  Should 
the  subcommittee^so  decide,  we  will  add  them. 

[llie  remainder  of  Dr.  Reveres  prepared  stetement  follows:] 


423 

Statement  OF  Phiup  Ryv£R»  Diiusctor/Washinqtoj^  Office,  American  Coixegb. 

^  /        Testing  Program  \ 

.shortcomings  op  h.r.  4949 


We  have  di/icu8sed  above  general  reasons  why  we  do  not  . 
believe  H.R.  4^49  it  on  appropl|^ate  means  of  addressing  either 
.  its  stated  or /isnplied  bbjectiye||(||^  This  judgment  resulted  ^  in 
pattf  from  a  jba^eful  study  of  the  Bill's  provisions,  and  the 
reluctant  conclusion  that  they  frequently  reflect  an  incomplete 
understanding  of  well  established  testing  methodologies  and 
picograms.    this  observation  is  best^  illustrated  by  specific 
commentiary  pn  each  provision  ol  the.  Bill. 

Section  2.  ja)  (I) 

Contrary  to  the  Bil,l's  declaration  that  no*  **proprie^ary 
interests**  of  tho  testing  i^ponsors  will  be  abridged  by  the 
Bill,  we  a;:e  not  convinced.     (See  our  comments  pn  Sections 
4(a).(l)BM  4(a)  (2),  and  5(c)  for  amplification.) 


Section  2. 


ta)  (6) 


This  provision  appears  to  establish  interstate  commerce 
:  as.  the  motive  of  Congress  in  governing  a  pjcocess.  within  the 
academic  domain Education  has  traditionally  been  the  province 
of  the  statesv  within  specific  bbnstitutior^al  limits.  Congress 
'  should  conslider  carefully  the  close  relationship  between  how 
an  institution  of  hightft  learning.  detetmineH  its  role  in 
society  and  Ithe  means  . by  which  it  choose*  its  students.  Despite 
statements  tb  the  contrary  by  the  sponsors  and  probpnents  of « 


i3i 


\ 


iFRir  , 


th« Bill/ the  . spectra  of  go^rornment  dontrol  of  or  involvement 
in  acadtmig  institutioni^  rights  to  self-determination  lies 
well  within  the  realm  of  this  proposed  legislation.  Though 
govermnents  frequently  encrpach  upon  this  ill*-defined  territory r 

i%  is  clear  that  a  ^fS^"^8t  be  drawn  defining  the  extent  to 

(    .  .  . 

wl^ich  the  federal  goVemroent>  in  particular,  phould  become 
in|Volved  in  academic  processes. 

'     Legislation  dealing  with  matters  similar  tO;  those  in 
H.R.  4949  is  in. effect  in  California  and  New  York,  Numerous 
otl^er  states  have  considered  legislation  and  found  it  to  be 
undesirable.    In  this  connection,  the  federal  government  is 
well  advised  to  consider  what  compelling  reasons  exist  for 
imposing  its  particular  views  on  these^twtes^  Furthermore, 
the  Bill^txtends  federa]^.  jjpriddiction  to  intrastate  test  programs 
that  ^redeveloped  and  adiministfiired  by  state  education  agencies. 
He  believe  the  legislators  and  citizens  in  these  states  should 
have  M^;he  right  to  determine  for  themselves  the  appjj^pr lateness 

of  'suclh  legislation  as  is  proposed. 

J .  .  .  . 

G^ven  that  <the  need  for  and  the  appropiriateness  of  itddxal 
.■  i        '         .  '    .      ■  .  ■■  .  ■  ■ 

action  are  highly  questionable,  then  such  action  seems  to  ^e  . 

an  abrogation  of  rights^left  to  thio  states  by  the  U.S.  Constitution. 

Section  2. Cb)  i  i 

'  He  endorse  these  purpons.    He  ha]^e  contributed  to  their 
fulfillment  for  many  years.  *  He  call  attention  to  the  large  gap 
between  these  purposes  and  the  Bill's  actual  provisions  in  . 


subMquant  patt^g«t  of  this  testimony.    We  emphasize  -  at  this' 
point,  Hpiieirpr,  thti  fpilowingt 
Section  2.(b) (2) ^ 

The  inclusion      the  word  **apjpropriate'*  to  qualify  this 
provlelon  is  highly  significant  and  deserves  strict  adherence. 
Tor  example,  if  strictly  applied,  we  believe  ^at  the  Bill's 
sponsors  will  be  unable  to  supply  evidence  and  reasonable 
rationale  fox  the  release  of  secure  test  items.    In  view  of 
the  harmful  impact  that  nuch  an  action  will  likely  have  on  t!^ 
I    educational  procesf,  the  action  would  be  highly  inappropriate.  ^ 

Section  2. (b) (3) 

H;R.  4949  will  not  substantially  protect  the  public  interest 
through  the  requirements  it  sets  forth  tor  testing  sponsors* 
The  standards  and  practices  of  the  testing  sponsors  are  presently 
jtiigher  thiin  any  ascertainable  outcome  of  the  BiU*s  provisions. 
j*u|:ther^  the  assumption  that  legislation  will  result  in  '^greater 
accuracy  I  validity,  and  reliability  .  .  .**  of  the  teste  involved 
is  highly  speculative.    In  fact,  the  proposed  legislation  will 

almost  certaij^tiy  have  the  opposite  effect  for  reasons  givlsn 

—  . 

later  in  this  testimony.  ^ 

'        .  *.         .  ■    .  • 

Section  2. (b) (4)  \ 

,     He  strongly  support  that  we  view  to  be  the  intent  of  this 
provision;    We. believe  it.  i^lnprqperly  framed  for  two  reasons,^ 
however*    First 1  it  appears  to  assume  tha^  'other*,  elements  of 
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thtt  '**multiple.  criteria**  postulated  in  this  provision  are 
viewed. by  Congrees  >s  equally  or  more  valid  and  reliable  than 
standardized  tests.'  The  facts  belie  this  assunption  and  are 
available  in  considerable,  detail  should  there  be  interest  in  . 
exploring  them. 

^    Second,  the  provision  seemi?  to  suggest  that,  many  criteria 
are  necessarily  better  than  one  —  without  regard  for . the 
validity  of  the  criteria  involved.    Thip  is  most  inappropriate. 
Indeed,  we  challenge  those  who  appeal  for  inclusion^ 6f  such 
variables  as  creativity,  compassion,  sensitivity,  motivation, 
etc,  to  produce  evidence  of  the  validity  and  Reliability  of 
available  measures  of  those' attributes.  * 

Section  3. (a) 

'  The  purpose  of  helping  students,  institutions  and  the  ^ 
general  public  to  understand  tests  and  their  uses  is  sadly 
confounded  by  the  provisions  of  thi&  section,  rather  than 
enhanced  by  them.    Effective  decision  makii>g  requires  not  only 
accuracy  in  the  data,  but  approj^iate  timing  in  the  delivery  of, 
information.    For  examples 

Section  3. (a) C3)  / 

This  information  should  be  .provided  to  students  at  tkz 
tim^  t^6t  6coK^6  a/ie  /la^ea^ed  rather  than  at  the  time  of 
registration  for  the  test..  Students  lose  or  discard  their. 
.  registration  materials  so  frequently  that  testing  sponsors  can 
serve  students  better  by  providing  them  t^e. information 


nfitssary  for  interpreting  and  understanding  teet  results  with  ^ 
l^e  score  reports  when  they  are  released*    students  will  be        /  \ 
disserved  by  this  pirovision  in  t^at  it  would  require  conscienU^us 
testing  sponsors  to- provide  the  ifSentical  information  on  t^wov* 
^dif^ereqt  occasions/ onoe  needlessly  and  at  |[;dded  expense  t 
students.    It  would  be  useful  if  pr6p<^ents  of  the  Biir^\y^^ 
Were  to  study^  carefttliy  the  thoughtful  means  by  which  almost 

all  of  this  section^s  provisions  are  already  achieved  by 

'  I 

testing  sponsors.    The' considerable. history  of  the  master 
/Should  not  be  ignored  in  drafting  legislation*  < 

The  requirement  that  the  testing  sponsor  proves 
institution*spedific  "correlation**  data  is  inappropriate. 
Such  data  are  generated  onl^  at  the  instruction  of  the 
institution  using  the' tests.    As  such  the  data  are  provided 
under  implied  contract  with  the  institution.    There  is  ireason 
to  question  th^  intent  of  the  Congresf^to  direct  institutions, 
to  provide  data  of  primary  interest  to  them. 

Section  4*  (b)  (4)  ur^s  the  .  use  of  multiple  criteria  in 
those  ptfidictive  activities  involved  in  granting  or  denying 
educational  benefitsr  while -section  3. (a) (3)  requires  test » sponsors 
to  report  correlations  between  test  scores  alone  tod  future 
success,  in  schools.    If  ii^  is  undesirable  to  use  a  test  score 
as  a  sole  criterion  for  Idmission  to  a . postsecondary  institution 
as  suggested  by  the  sponsors  of  the  Qill,  by  what  rationale  does 
the  Bill  rll<j|uire  that  test  acj^ncies  provide  correlations  between 
test  scores  aZone  and  **succtfss  in  college  c^r  4^  the  career  for 


whidh  admission  ,  is  sought •J^    Purtherinore,  the  drafters  of 
this  BilX  have  clearly  not  thought  through  the  implications 
oS||this  requirement  as  regaHfs  post-baccalaureate  admissions^ 
Indeed^ /the  provisions  indicate  a  definite  lack  of  awareness 

of  the*  natur^  ol-iihe  probleros^JLnx^vjsd-in,  J)bth  def inijcig:,«ad  

measuring  career  success. 

Congress  should. be  reminded  that  a  major  pu3^pose  of  the 
tests. in  question  is  typically  the  prediction  of  first-year 
academic  performemce.  '  The  developers  of  these  tests,  may  not 
wish  to  carry  their  pi^poses  far  beyond  thy;  considerably  more 
specific  ncope.    If  a  Bill,  isjphacted  that  iequiires  the  infor- 
mation flfbggested  by  this  provision!  Congress  will  have  ignpred 
the  proper  use?  of  the  examinations  and,  in  the  process,  will 
have  appeared  to  encourage  ein  invalid  use  of  some  tests* . 


section  3.(a)  (4)U)  ^ 

The  effects  of  compliance  with  this  section  will  disappoint 
students  and  the  public.    We  emphasize  the  importamce  of 
uiider standing  that  a  principal  purpose  of  the  examinations 
in  question  is  to  predict  grades  for  the  further  oppose  of 
facilitating  informs/ decision  making  of  many  dimreht  types 
(e.g.,  admission  to  postsecondary  education, jjplacement, 
sectioning,  counseling,  xr$inedi&tion  and  other  educational 
functions) .    The  purpose  is  to  provide  g  climate  in  educational 
institutions  that  will  enhance  development  of  a  curriculum 
suitable  to  student  needs.    This  may  require  considerable 


intervention  for  «ome  students,,  and  more  intervention  at  one 
institution  than  another,  to  enhance  learning. 

The  Bill  would  require  that  the  teat  sponsor  ,  provide  an 
understandable  indicator,  in  terms  ol^ a. percentage,  of  the  ex- 
tdnt  to  which  teat  scores  add  to  the  prediction  .of  future  grade 


pointX^erage  over  other  criteria.  T^e  Bill  appearii  to  suggest 
that  the^erivation  and  reporting  of  such  a  statistic  is  a  , 


routine  tasKs^r .psychometricians.    In  fact,  it  is  not.  The 
sponsors  of  the\Biil. should  be  required  to  specify  how.^uch  a 
statistic  is  to  b^\derived  and  also  to  provide  an  acceptabie 
rationale  for  that  s^tistic.  ^  >  . 

Even  if  such  a  statii^tio  could  b&  generated.,  abstract 
application  of  this  provision's  requirements  would  add  little 
to  the  understandihg  and  intelligent  use  of  standardized  tests. 
It  ma]^  be  siiople  to  deteriaine  ancK^state  that,  ^n  the  average, 
\    the  high  school  academic  record  con^ibutes  a  certain  amount  in 
pridicting  students'  academic  per formwce  in  college  and  that 
teit  scores  contribute  in  some  other*  amo;mt|  to  the  same  prediction. 
Hhat  ..should  be  of  interest  to  Congress  and  the  drafters  of  this 
Bill,  however/  is  hc^t  this  abstract  statistic,  ctut  that,  in 
actual  prictice>  the  cOiitributions  of  botft  test  scores  and  giiiades 
SfMy  across  )ii9h  sohotpls.  .  Horcfover,  since  the  standtrds  by  which 
high  schools  award  grades  also  vary,  standardized  test  scores 
Ik  l>eoome  an  tHtntial  external  equalizer  of  the  varied  grading  . 
^        practices  and  curriCular  offerings  of '  these^^^t^ousands  of  secondary 
« schools This  value  cannot  be  expressed  by  a  simple  percentage « 
*  ^ocus  on  ^his  isolated  mathlmatical  relationship  is 

JfJ    to  i^ole  one  of  ^e  principal  contributions  of  standardized 
testing  to  our  educational  system. 


i 
I 


r 
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The  predittion  of  grade  point  averages  is  only  one  of 
several  useful  applicjitions  of  the^esultis  of  these  tests. 
Abstractions  concerning  the  meaning  and  uses  of  such  predictions 
will  hot  add  measurably  to  achieving  the  objectives  of  the 
P^^PPJjj^jr^^l  P?  this  legislation,   ,        '  _ 

Section.  3,  (a)  (4)  J[B)  ,  ,  ' 

This  provision  appears  to>aiAum^  that  the  tests  are 

negatively  biased  against  students  from  low-income  families. 

This  conclusion  is  based  oif  the  well-known  fact,  that  test  ^ 

scores  are'  related  to  level  of  income.    It  is  also  a  well-. 

known  fact,  seemingly  ignored  by  the  Bill,  that  high  school 

grades  also  correlate  highly  with  family • income.    Please  refer 

to  the  table  attached  as  Exhibit  A  for  further  information  inr 

this  regard.    M«my  other  vari^ibles  correlate  in  the  same 

fashion  with  family  income,     sdch  findings  are  by  no  means 

evidence  of  bias.    We  do  not  wish  to  be  glib,  but  it  appears 

that  proponents  of  this  legislation  believe  they  have  dificovered 

a  new  social  phenomenon:    teJcen  in  isolation,  standeurdized  J 

test  scores  are  directly  related  in  some  way  to  family  income i 

If  we  are  to  conclude  that  we  sh(^uld  discontinue  using  test 

scores,  based  on  this  knowledge,  then  we  might  also  consider 

discontinuing  all  forms  of  college  education^  since  it  is  an 

established  fact  that . peoples '  success  in  life  —  at  l^^st  as ^ 

measured  ^in  economic  terms  —  is  directly  corr^plated  with  , 

-V  •     ■        •  . 

their  educatiohal  level.    Under  that- definition  of  bias,  it 


Y 
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Is  unfair  that  pome  persons  obtaiA  a  college  educatioa.  and 
others  do  not. .  .    •    .    *r   .  •  ^ 

Uot  only  is  it  shortsighted. to  attribute  biaa  to 
tests  because!^:  they  reveal  differences  in  the  developed  abilities  of 
students  from  different  level  income  groups  #  it  is  ill*^ informed* 
Research  data  3how  that  tests  are  effective  predictors' of 
academic  performance  in  college  for  persons  of  ^11  levels  of 

Qpcio-economic  status.    That  is r  students  who  score  low  on 

'  d  ■  '        '.       ■     .  » 
the  testsi  be  .they  blacky  white,  male,  female,  rich  or  poor, 

•   .  w  ■    *  •  ■  • 

also  tend  to  perforin  less  well  in  college  than  their  higher 

scoring  counterpaijts. .  .  .  ^ 

It  would  be  far  better  for  Congress  to  direct  its  full 

attention  to  wfit/  standardized  test  scores  (and  agademic  «  ^  ' 

performance  in  general)  correlate  with  s^ioeconomic  status, 

given  that  we  know  thaX  thty  do.    The  latent  implication  that  . 

■V  . 

there  is  something  wrong  v^ith  the  testd,  th^^^t  the  correlation 
has  something  ..to  do  with  rc^Ce,  is  superficial.    Data  clearly 
indicate  that  there  is  as  much  variability  on  test  performance  ^ 
within  racial  classif icaj^ion  as  be'tween  family  income  and  test 
scor^  performance  for  th^  population  in ^general.    That  is  to 
.  say,  high  income  minorities  score  well > on  standardized  tests 
because,  like  their  white  jsounterparts,  they  have  been  exposed 

^         ■  ;  ♦  -if 

to  strong  educatibi^^l  systems*    iThey  hold  values  siiptiilar  to 
those^held  by  j|i^h**a(||iieYing  people  as  judged  by  aj^^demic 
criteria  twhich  are  by  n6  m^ans  the  only  impprtan;^  criteria|by  - 
which  to  assess  our  people^ .  .   .  / 
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Concern  ii  sometimes  expressed  over  the  psycholog^dal 
effects  of  low  test  scores  on  the  ^.tudents  receiving  them. 
While  sensitivity  must  be  demonstrated  in  communicating  such 
scores r  sUrely.  there  is  no  merit  in  altering  the  tests  so 
that,  thiey  minimize  impoijtant  differences  in  the  developed 
abilities  of  students-    To  do  so  would  be  to  deny  atudents 
and  educators  factual  information  which,  they  cam  use  to 
plan  future  Educational  interventions  aimed  atr.  fa^cilitating  . 
access  to  desired  educational  programs  and  vocations* 

If  the  Bill's  sponsors  are  requiring  that  test  score 
information  be  reported  by  level  of  family  income  to  provide 
students  from  low  socioeconomic  status  with  an  acceptable 
rationale  for  their  lower, test  scores  when  they  are  attained* 
then 'they  are  doing  a  disservice  to  students.    To  suggest  that 
the  ^est  results  are  irrelevant  or  less  valid  for  the 
purposes  to  which  they  are  put  is  not  accurate.    Even  worse, 
it  does  nothing  to  address  the  basic . challenge  confronting 
the  .students  —  that  they  are  less  well  Equipped  »and  ready  for 

•  subsequent*  educational  experience. than  their ^igher  sspring 
counterparts .    '  '  - 

*  ;      We . acknowledge  that  the  requirement  of  this  section  can 
be  xnet.     Indeed,  we  currently  publish  much  of  this  information 
in  some  of  our  reports.    It  is  critical  for  Congress  to  con- 
template what  extending  the  requirement  means  and  what  it  may  imply 
for  our  people.    We  draw  no  conclusions  about  the  wgrth  of  an 
individual  as  the  result  of  his  Or  her  performance  on  our  tests.  ^  ' 


s 


Nor  do  w«  draw  generalizations  about  his  or  her  geneology  as 
the  result  of  testing.    Vfe  have  8L  kt6pon6ibility  to  asWist 
in  pointing  out  wh6n  he  or  she  appears  not  to  know  mathVatics; 
when  he  or  she  does  not  seem  to  understand  the  English  J^toguage 

,g  (aiid,  to  Ihe  extent  permitted       the  design  of  our  examinations ^ 
the  nature  of  that  misunderstanding) 7  when  she  or  he  does  not  . 
understand  southing  that  is  held  of  value  by  our  educational 

'    system.    '     :  ■ 

Likewise,  it  is  not  we. whti  determine  what  should  be  held 

^^f  value.    We  leave  that  ,  to  .educators,  who  are>in  tyrh  account- 
able to  legislators  and  ultimately  to  the  public.    When  a  . 
curriculum  is  determined,  we  are  capable  of  developing  instrument 
that,  when  properly  interpreted,  add  measurably  and  provably 
•  to  our  understanding  cff  what  steps  an  individual  should  tak^ 
in.  continuing  his  or  her  education.    Ole  cannot  May  why  thzKt 

*  may  be  dtiicltn<Ut6  In  th^^  pKtifrtjiatlon       an  Individual  ioK 
onwa/td  e^dacaXionat  expe^t.^ence^ .    To  ^ogoa  on  onK  inhtMm^ntt^ 
with  thi6  zxptOJtati^n,  to  blamz  thzm  <0A  thz6Z  void^  in 
pK£,paKation  oi  4ome  oi  OiUi  ptaplt,  i6  to  pKoioundl^  ignoKi 
oak  mo6t.  pA.t66ing  6ocial  p/iobltm't    we  aKz,  tdadatinQ  oaK  young 
people  uneven^t/*    We  have  ytt^o  addKt66  thi6  pKoblz'm  cogtntll 
Tht  pJLobUm  wa^  t£.it  to  th£,.6'jiat£,6  by  thz  Su^fiAmz'  CouKt  \ 

StJuiano  v6.  ?Kitit:    To  thf  extent  that  this  problem  is  . 
proper ly '  one^  f6r  the  fedei^al  government  >  •  it  would  seeil^  better 

•  for  Congrilks;  to'tprii  its  Attention  to  the  ^lea^pn^  for  the 
di^lparitieli  in  preparing  pur  youth  than  to  a«sail  tests  because 
they  daXl ' attehtion  to  the  disparffiiies . 


Section  3,  (a)  (4)  (C)  ;  .  • 

<<Complianoa /with  this  section  would  mandate  research  p£  a 
particular  character  by  testing  sponsors.    We  question  the 
wisdom  of  any  legislative  ma;l|^^e  for  research  by  Congress  ^ 
least  of  ^il  research  on  the  coaching  topic.    Logic  dictates 


»at  c 


thaPP'test  preparation  coiirdes^  that  are  of  sufficient  length 
and:  content,  to  be  considered^^^Mttc^Xon  need  little  investi- 
gation, since  their  worth  is  obvious-    They  will  help  some 
students  |nd  they  won't  help  others,  as  id  the  case  with  any 

'  •■■■|  ■ 

instructional  program.    To  the  extent  that  thesjB  "courses" 
^don't  qualify  as  instructional  in  nature,  study  of  them  by 
testing  sponsors  requires  the  sponsors  to  validate  or  invalidate 
the'' efforts  of  organizations  whos^  social  contributi^m^they 
spmatimei*^  believe  to  be  questionable  and  whose  procedures 
frequently  conflict  with  the  Qponsors^  teat  security  measures. 
Given  the.  patent  conflict  of •  interest  involved,  it  appears 
that  Congress  would  Jae  well  advised  to  secure  more  suitable 
avenues  for  both  developing  amd  disseminating  the  information  | 
required  by  this  section,  I 

We  point  out  thjBit  the  redent  FTq  study,  of  t^st  preparation 
courses  lead  the  Commissioners  to  refrain  from^  providing 
specific  guidance  to  students  and  testing  agencies  regarding 
preparatory  courses.    H.R.  494i  goes  beyond  the  FTC's  actions 
and  findings  under  the  assumption  th^t  accurate,  helpful  in:4or- 
idi|ion  is  known*    l^elling  students  that  "some  preparatory  '  ^ 
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courses  My  be  heli&al  to  Aner  studeat^^^o^^         tairts"  is 

hardly  helpful  r  buT'll:  is  tme  only  reasonable  st^atement  th^tt 

• .  •  ■  •  [  ii      ■   .  *  ■ 

be|made  given  present  knowledge  of  the  topic.  To^tate 
otherwise  would  be  Ibislea^ding, 


Section  3. (a) (7) 


I. 


The  definition^  of  "property  interests"  is  a  matt^^r  A)r 
the  courts*    Regardless"  of  the  nature  of  2Uiy  statemen|s  made 
by  testing  sponsors  on  "property  rights ,"  some  will  disagree 
I  and  seelc  judicial  judgment. 

The  rights  pf  students  with  xjespect  to  the  disposition 
of  the  information  they  provide  ACT.  are  described  in  considerable 
Retail  in  Exhibit  B*at  the.  end.  of  this  document  .(see^  ^Statement 
I    of^  Policies       Use  of  ACT  Data,  Pri^iacy,  Responsibilities  to 
Program  ParticiFlknts>"  attached).    These  policies  are  rigidly 
adhered  to.    They  predate^ any  legislative  initiative  or 
expression  of  concern  by  student  advocates.    As  can  be  s4in 
from  our  comprehensive  policy  statements  on  the  topics  covered 
by  this  section  (twenty*- thr.ee  pages) ,  the  task  of  communicating 
and  fully  interpreting  these  policies  in  emy  meaningful  detail 

to  ovfr  a  loiiiion  students  (os  within  the  coht^i^ts  of  the 

.•■»■'.*  .       '  ■  .  "  * 

2r700,000  registi^atipn  packets  we  distribute  annually)  would 

■  .  •  '     '  ■  t 

be  incredible  but  could  be  done«    Because  the  benefits  of  such 

i  ' 

an  ill- conceived  action  wou).d  be  almost  nil,  we  advise  against 
doing  so*.  Much  of  the  reC[uirement  of  this  section,^ is  already  ^ 
attended  to  by  our  materials  and  those  of  other  tening  sponsors. 


/ 


^Retatned  ip  Subcommittee  files 
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We  believe  tha%  Gongjc^sit 'should  be  mindf^l  of^hat  is  already 
feeing  doneT'and  with  what  conviction  by  testing  sponsors.  The 
legislative  requirement  in  this  section  adds  little  to  an 
alreafdv  thougl^ful  and  conscientiously-administered  program  6f 
p»olf^^development,  proceduraf^  implementation  and  communication. 

Other  testing  sponsors  have  and  adhere  to  such  policies, 
concomitant  with  their  substantial  responsibility  to  the 
American  public/,  and  within  the  purview  ojf  extensive  governance* 
by  bodies  accountable  to>  the  public.  . 

Section  3.  (a)  (8)  ..  '  . 

^    Much  is^said  in  Section  3.  about  describing  to  students 
any  proroiis^s^or  cdveneuits  made  to*  them  by^  the  testing  sponsors. 
Whether  the.. purpose  of  this  requirement  is  to  suggest  that 
there  ia  a  "contract"  between  the  testing  sponsors  and  the 
test  subjects,  or  to  suggest  that  testing  sponsors  are  casual 
in' matters,  that  could  result  in  delayed  score  reporting, . the 
legislative  '^solution*  posed  in  this  and  related  .sections 
(e.g..  Section  3,(c))  is  totally  withqlit  merit.     The  reporting 
and  system  requiremeilts  involved  subsequent  to  .release  of  test 
scores  are  extensive  and  hinge  entirely ^on  timely  and  effective 
.conduct  of  the  processes 'of.  test  administration,  scoring  and 
reporting.     It  -  is  totally  unwarranted  to  assume  that  there  is 
'  anything  to.  be  gained  by  testing  sponsors,  in  reporting  .test 
scores,  late,  incorrectly,  or  in  a  haphazard  manner .  *  Practically, 
speaking,  the,  BilJ?  will  invite  testing  sponsprs  to  inflate  » 


'«portln$  Ip^rl^od  stipulated  in  this  ^r^vision  to  avoid 
incurring  the  tiseleas  repotting  requlreiiwnti^^ 

fexperience  with  testing  systems  of  the  ^^ze  and  complexity 
.  involved,  with  undergraduate  adxaissions  indicates  •  that^  late 
test,  score  results  (which  are  extremely  rare)  v^juiA  reach  ^ 
students  and  institutions  about  as  quickly  as        Notice  this 
and  related  sections  would^require,   j^e  assure  ^Cojj^ress.  that 
operational  and  business  cbnsiderations^  not  to  mention  the  ^ 
totally  wasteful  additional  costs  to  students  thatWbald  be 
incurred  in  implementing' this  provision,  are  sufficient  to 
motivate  testing  sponsors  to  perform  their  services  to  s^dAts 
and  in6titu|ions  efficiently  an.d  effectively.    With  tl^  added 
consideration  that  |:he  testing  sponsors  bzlltvz  that  their  / 
primary  functions  are  services  to  the  public,  with  particular 
emphasis  on  the  needs  of'studen.ts  and  educational  institutions ^ 
and  in  cognisance  of  those  needs,  this  requirement  Is  without 
any  redeeming  value. 

Section  4. (a) (1) (A)  ^ 

.  This  section  implies  that  jbesti^g  sponsors  conduct  many  . 
research  studies  that  'they  do  not  make  public  out  of  self- 
'  interest.    Such  an  iif^lication.  is  totally  without  sub8taiigie« 
.It  Is  true  that  ccirtain.  studies  compiled  ^nualifty  for  thousands 
of  educational  institutions,  for*  example^  studies  that  provide 
a^roiple  of  the  students  at  individual  institutions,  are 
Lntaln^d  confidentially  —  for  good  reason.    There  Is 


0 


coi^sidenble  risk  in  requiring  testing  sponsors  \p  de|bsit 
such  studies  with  the  Coiomissioner  of  Education  or  .emy|Cther. 
office  or  agency,  IncoKKtct  and  oitQ.n  .pzjoKativQ.  cbnclulions  » 
about  the  quality  of  t^ese  institutions  will  be  drawn  by  many 
based  on  the  data.     Inappropriate  comparisons  across  institutions 
aure  inevitable-    It  is  equally  inevitable  that  m2my  institutibns 
will  discontinue  such  studies,  rather  than  face  the  gauntlet  ' 
of  ill-informed  public  conjecture.    The  result  will  jLikely 
be  itftzn^l\;z  j^ublic  scru^ny  of  the  uses  and  v^idities 

of  those  uses  ^f or  the  examihatfions.    The  irony  ^'^guishing.  . 

.    Pertinent  studi^  of  the  nature  of  the  testis'  covered  by    ^  . 
thi^  ^^^isiation  and  their  statiatical  cj>aracteristic|l  are  now,  . 
and  have  been  for  many  years,  freely  available  to  the  public 
There  is  no  need  for  a  legi^lative^dictate  with  x?espect' to    '  . 
these  data.    On  a  minor  note, ^  Congress  should  be  mindful  of 
the  sheer  magnitude  of  the  reports,  that  will  potentially  flood 
the  U.S.  Office  of  education  if  this  x^equirement  is  not  chemged. 
The  reports  could  easily  number  in  the  thousands  each  year  for 
all  testing- sponsors'^ combined.     Unless  a  plan  existed  for  the 

constructive  einalysis  and  use  of  the  data  in  the  reports,  it 

^    ■      ■    ■       .      '  \  ■  ^-  ■   •       ,  ■ 

i9  difficult  to  see  on  whatXbasis  Congress  could  justify. 

•requiring  their  submission.  .         ^  ^  ^ 

Section, 4.  (a)  (1)  (B)  ^       ■  .  ^ 

This  8e(;:tion  conflicts  .with  existing  fe4eral  law  on  freedom 
of  information  (protection  of  trade  seprets)  and  restraint, of 
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•  trade  (stifliing  competiltion  through  sharing  of'  cost/pricing  ^ 
.data).    Many  of  the  contracts  covered  by ^h is  Section  result 
from  a  comfjt^t^vt  bidding  .process.    Congress  must  give- careful 
thought  to  I  the  9ubvertin(g  impact  the  release  of  these  contracts 


may  have  on  that  competitive,  activity. 


Section  4j(b) 


The '^U|pose  of  this  section  is  unclear.    The  focus  on  . 
cQmpariflclns  between  the  variables^dentif ied  and  test  scores 
alone  touches  agf in  on  symptoms  rather  than  the  causes  of  the 
educational  ineqyi^ties  in  this  country.    The  mere  relationship' 

between  test  scores  and  th&  variables  cited  is  of  considerably 

■  ■  \ 

less  signific^ce  than  the-  cause  qf .  this  relationship r  something 
which  the  tests  do  not  address.     Whatever  the  relationships  / 
between  test  scores  and  the  variables  cited,  similar  relation-- 
ships  will  be  found  between  these  variables  emd  ot^her  acac^emi 
assessments,  thus  confo^yinding.  any  causal  interpretation. 

With  respect  to  the  report  concerning  the  relationship 
between  test  scores  and  the  completion  of  test  preparation 
courses;  it  should  be  made  clear  that  this  requirem^rit  is 
defective.     Tha  e^ttant  data,  on  thifil  topic  do  not  constitiit^^ 
an  adequate  ingv:jflry.     If  the  information  is  to  be  provided/ 
Congress  would  be  well  advised  to'  provide  resources  aftd  a 
^^<5harge  to  one  of  the  many  federal  agencies  (e.g.  ,  IJIE  or  NSF) 
/qualified  to  conduct  or  spoiisor -such  research  to  proceed  with 
■the  design  of  studies  aimed  at  shedding  light  on  the  issue  in 
.  'allfof  its . practical  complexities.  '  ^ 

r  ■■■■  \    ^ .  .  .  .  -  •  . 
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Section  5, (a)         .     .  ' 

This  Subcononittee,.  and  state  legislatures  considering 
similar  legislation,  have  heati  m^h  about  the  public  r^ease 

'        .  .     V  •    ■  \ 

of  "secure"  standardized  fee8t>;    We  cannot  add  greatly  to  \\ 
what  has  already  be«i>..said.    We  summarize  here  several  xssues, 
relating  the  apparent  objectives, of  te^t  release  proponents 
to  the  counterview.  ... 

"Students  Can  monitor,  test  scoring  accuracy**  by  viewing 
questions  and  their  corresponding  porryjt  responses.    This  is 
uncontestable;    It  is  a  simple  task  because  the  precision  with,  • 
which  the  testa  are  coyvfltructed  requires  avoiding  uncertainties 
aj^d  ambiguities  wherever  humanly  ppssibl^    The  result  is  that 
automated  scoring  from  a  key  is  hot  a  complex  task.    The  "manual" 
verification  of  this  process  by  millions  of  human  beings  is  the 
only  advantage  we  can_9ee  stemming  from  this  requirement.  Its 
necessity,  however,  is- gravely  questioncd^le.    Other  reasonable 
alternatives  exist  and  are,  in  fact,  in  f>lace. 

"The  public  can  scrutinize  the  contents  of  examinations" 
to  aS5;ertain  qualitative  information  r  a^nd  to  :examine  potential 
for  bias  and  discrimination  {in  the  social  as  opposed  to  the 
.psychometric  sense)..    The  tests  are.  developed  with  ^he  assistance 
of  experts  in  curricula  from  all  oyer  the  United  States « 
Development  involves,  minority  review.    Moreover,  t^sts  are 
already  made  available  to  qualified  researchersj^fhi)  have  the 
tools  and  the  professional  capacity  to  make  suoh  evaluations.  . 
Errors  in  test  items  9 f  the  nature  implied  by  this  objective 


arn  rare.    The  teikting  agencies  ue  the  first  to  ireact  when 
'th»y  are  noted,  as  they  must.    It  should  he  understood  that 
absolutely  nO  item  can  he^  constructed  that -won't  find  at 
least  one  disenchanted  reviewer.    The  tongue*- in^-cheek  mathr 
emat^Lcal  contest  of  2  f  2  ■  .4  presents  suitable  fodder  for 
challenging  the  inclusion  of  that  *  item  in  emy  k^d  of  assessment  r 
it  one  wants  to  indulge  in  suitably«-9ro longed  philosophical, 
^inquiry*    Carried  to  an  illogical  extreme^,  the  testing  sponsors 
could  not  successfully  construct  any  kind  of  examination  if 
it  had  to  be  designed  by  a  committee  of  the  whole ,  all  of 
.whom  would  concur  without  reservation  on  the  nature  and  content 
p£  the  itexnis  in^lyed. 

JHhile  there  is.  truXy  nothing  to  hide  from  mejiibers  of -the  pub 
lie  in  the  content  of  the, examinations  (they  see  Jthem  at  testing 
time,  and  faculties  can'  aund  frequently  do  review  I  them  before 
deciding  they  are  appropriate  for  theit  uses) ,  tijiere  is  much 
to  lose  by  saddling  testing  sponsors  with  responding  to  myriad 

i  ^  .     .  '  /  ■ 

inquiries  regarding  an  item  or  items  about  which  there  is 
absolutely  nothing  wrong.    Those  that  might  be  wrong,  however 
rare,  are  righted  by  test  ^kers  and  test  subjects  in  the  normal 
process  of  test  design,  construction,  *ad^nistlration  and  use. 
The  costs  to  students  for  the  test  sponsors  tp  respond  to 
potentially  thousands  of  letters  and  questiOhs  about  test 
items  must  also  i^e  considered  in  light  ,  of  the  ultimate  benefit 
6£  that  process.  '  .     '      .^  ' 


ients  can  l(6am"  from  seeing  what  they  missdd  on  an  . 
•  examinatklon .  and  knowing  the  cprrec^  an8wec(a)  .    This,  is  » 
undoubtedly  the  case,    the  ixnportamt  question  id:    how  much 
learn  emd.  to  what,  end?    Very  little,  and  tp  no  good 
Most  tests  covered. by  this  legislation  sample 
academiH  disciplines  ymd  domains  only  to^jj^x^ent  appropriate 

to  the/jdses  of  the  t6st(s)  in  questiion.'  These  tests  are  not 

■■"//■■'  ^ 
sufficiently  comprehensive  €6  allow  for  in-depth  diagnosis 

of  emacational  shortcomings  because  they  are  not  designed  for  ^ 

tha^purpose.    For  a  student  or  teacher  to  conclude  that  because 

he/pr  she  missed  two  or  three  algebra  items,  she  or* he  doesn't 

"Impw  algebra**  wpuld^be  distressing.    One||c2ufnot  conclude 

pom  any  rational  exploration  of  this  objective  that,  disclosure 

■>f  these  tests,  tests  that  are  not  designed  for  and  thoiUd  not 

^be  vutd  in  a  dlKzct  pedagogic  manner,  will  in  any  truly  roeeuiing- 

ful  way  provide  a  learning  experience  for  test  subject:^.  To 

conclude  that  these . particifLar  tests  would  provide  a  learning 

.experience  is  to  engend&r  test  abuse  beyond  that  alleged  by 

some  proponents  of  this  legislation,  ^ 

We  can  state  a  number  of  potentially  enormpus  disadvantages 

that  will  result  from  th«  release  of  these  tests  to  the  publ.icj 

.      Teachers  will  b^  tempted  to  teach  for  the  tests^ahd  many 

will  succumb  to  the  temptation  because  they  will  feel  duty- 

bo\ind  to  provide  tkeir  students  with  the  beet  opportunity  of 

performing  well.    They  will  ^Iso  be  tempted  to  teach  for  the 

tests  to  demonstrate  the  success  of  their  ow^fforjgs  in  behalf 

of  the  students.  .    .  ^ 


j        Teaching  for  the  specific  items  included^  in  a  test  perverts 
/t;h#  purposes  and  the  efj^ectiv^  uses  of  the  test.    We  willii^ 
I  further  elaborate  those  purposes  and  uses  at  this  point 
because  of  their  complexity.  %hey  should,  however^  be  of 
.interest  to  Congress  aiVd  ^  everyone  concerned  with  education.' 

The  validity(ies)  of  the  tests  released  will  likely  be 
lowered  over  tiioe^    This  expectation  is  partly  attributeible 

.  to  the  tendenc^"^  teachers  to  :teach  for  the  tests, 'zmd  for 
the  .teif^B  to  control  the  .curriculum  as  a  result  of  that 
activity.    The  curriculum  Should  dictate  the  content  of  the 
tests  rather  than  th'e  reverse,    Th^^'^rol^em  is  that  while 
increased  test  performance  might^result^rom  teaching,  for  the 
test^i,  the  post  secondary  Curriculum  wiAl  remain  defined  apart 
from  the^isecondiiry  school  teaching  Activities.  If .  inappropriately 
.^inflatedVtest  scores  are  used  in/predicting  first-year  college 
perfo)nDahce,\th'en  the  validit^/($r  the  decisions  made  using  those 
predictions  wil^  likely  not  be  of  the  quality  presently  enjoyed. 
If  the  objectiv^'  pf  releasing  secure  tests  and  test^  items  is 
to  destroy  the  contribiitions.  of  the  tests,  then  this  requirement 
has  merit.    If  that  ii  not .  the^objetfti^e,  if  instead,  the  objective 
is  to  improve  the  usefulness  of  the  tests,  this  requirement  will 

.  be  counterproductive  •  j-  *' 

Costs  will  increase.  This  tequires  little  elaboration. 
It  Should  not  be  the  sole  basis  f^r  determiQing  ^he  benefits 
to  be  derived  from  the  mandated  release  of  secure  test  materials. 
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Placjpfeent  of  college  students  in  cograea  will  be-  less 
^ffectiye  than  at  presents  if  dl^losure  of  the  test  materials 
results  in  less  valid  instruments, ^Jfe^ test  data  will  have  less 
value  for  course  placement*    This  coul^4  cause  a  disruption 
— to  some  extent,  unascertaihable  at  this  time  —  of  the      .  ' 
placement  procedures  and  Instructional  programs  at  "some  colleges.* 

and  universities,       f  ^  v*  ■  ' 

yhe  educgitjU)nally-advaritaqed  will  enjoy^  even  greater  / 
advantage  over  their . less" advantaged  peers^    ,The  better,    7  y  ■ 

ecortomically  strong,  school  districts  will  have,  as  they  v. 
always  have  ii>  the  past,  greater  success  In  teaching  students 
the  knowledge  and  skills  that  effect  test  score  performance 
than  those  schools  with  ^fewer  resdutces  and  other  non-educatiorffft^S«,^* 
distractions.  '  Some  argue j  to  justify  this  legislation,  that  . "        ,  . 
'  schools  with  strcjjp  economic  bases  presently  teach  tor  the.  . 
tests,  while-  thos^  with  fewer  resources  do  not:    If  this  is 
indeed  true^  it  does  not  meM;  that  releasing  the  tests-will 
result  in  Qventua^l  equity  in  balancing  this  teaching  effort, 
Rather^,  it  is  ^re  likely  tAiat  the  schools  with  more  resources 
will  do  an  even  better  job  of  teaching  skills  pertinent  to  the 
test^,  while  th6  less-advantaged  schools  will  Continue  to 
struggle  with  the  more  fundamental  problems  they  face,*  The 
test  performance  engendered  by  the  schools  has  nothing  to  do 
with  the  availability  of  the  tests.    Rather,  it  has  to  dp  with 
scarce  resources,  parental  and  peer  pressure,  students' 
aspiration,  levels,  and  related  factors,  as  mentioned  in  our 


V. 
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coininehts  .  above  concerning,  the.  implications  of  Serrtmo  vs^  Priest  > 

The  effect  may  be  to  exaggerate^ differences  l^etween  the  ricii 

and  the  poor,  cohtraty  to  thd' supposed  intent  of  this  legislation. 

SectioA  6.     •        .  . 


tie  term  "specif^^cally  authorized"  as  used  in  this  section 

^      X  ■  *        ■  •  ,        -  ' 

will  den^  students  And^  institutions  valuable  services  by  some  ^ 

testing  sponsors  .^^'  x^st  subjects  are  currently  offered  an 

opportunity  to  authorize  testing  sponsors  to  communicate  with 

them  about  educatic^^^l  experiences  that  may  be  of  interest  to    ^  < 

■    *  t 
them^  (yr  to  authorize  the  release  of  their  test  records  to 

institutions  and  scholarship  programs  on  a  non^-specif ic  basis » 

Most  students  elect  this  option,  and  must  do  so  before  their 

re^rds  may  be  so  released. 


•    Students  receiving  information  in. this  manner rhave  been 
pleased  with  the  results*    institutions  and  scholarship  agencie 
are  able  to  inform  minorities,  handicapped  students,  and  students 
^^ith  special  learning  disadvantages  of  their  educational 
offerings*    Requirement  for  "specific"  authorizatibn  obviates 
the  provision  of  such  services  by  the  testing  sponsor^* 

■The  final*  provision  of  Section' 6»  restricts  release  of 
test  recordd  (^.identified)  for  research  purposes  primarily 
concerning  the  tests  themselvea.    This  restriction  will 
unnecessarily  deprive  researchers  of  a  valuable  source  df  data 
related  to  a  variety  of  important  topics.    This  section  shouj-d 
be  modified  to  allow  research  with  teat  results  so  long  as 
identifying  information  is  expunged  prior  to  release  of  thelcia|a/ 


i.  ' 


ir 
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It  should  be  no^d  that  this  section  conflicts  with.l?oth 
the  spirit/  amd  the  letter  of  recent  recommendations  of  the 
Privacy  Protection  Study  Cpramission.    We  suggest  a  review 
of  the  Coinmission'B  reconiinendations  and  the  underlying 
rationale  for  release  of  research  data  before  Congress  acts 
further  on  this  provision. 

Section  7. 

We  dp  not  object  to  fiscal  disclosure.    Our  fiscal  infor- 
mation is  already  a  matter  of  public  record.     It  should  be 
und^r stood  that  the  form  in  which  it  is  disclosed  has  impli- 
cations for  competition  with  other  agencies.    Further^,  we  believe 
no  conclusion  should  be  drawn  about  the  operation  of  a  testing 
program  in  isolation  from  the  overall  plan  emd  developmental 
activities  of  the  testing  sponsor,  ^ 

Sections  8,  and  10, 

It  is  likely  that  few,  if  any,  testing^sponsors ican  meet 
the  Bill's  requirements  within  the  contemplated  ef fectivS^^date 
without  curtailing  services,    TjjtifS  is  a  simple  fact.     It  vfill 
take  up  to  two  years  before  compliance  with  the  requirement 
to  pydslish  test,  contents  can  be  met,  and  for  some  sponsors 
compliance  may  be  impossible  regardless  of  the  time  fraune  for 
implementation, 

■  k  .  ■ 

Summary  ,  . 

We  have  provided  the  foregoir>g  comments  on  H.R,   3564  and  . 

H,R.  4949  as  part  of  what  we  believe  to  be  our  responsibility 

to  American  education.     It  ie  our  conviction  that  the  proponents 
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of  this  legislation r  while  well-intentioned,  have  concocted 
a  remedy  whose  ultimate  qonsequences  wil}.'  likely  bVerahadow 
the  illness  supposedly  being  addressed.    We  are  concerned 
•that  the  vzKy  important  reach  of  these  bills  yithin  our 
educational  system  -r  botfTinT terms  of  pedagogy  and  in 
€e3niis  of  the  proper  role  of  govethmiarit  —  has  been  given 
'  short  shrift* 

It  is  crucial  that* subsequent  study  of         bills  by  the 
Congress  emphasize  a  thoughtful  assessment  of  the  need  for 

-     ■  i 

this  legislation  balanced  against  the  i^^ct  it  could  have; 
The  potential  negative  consequences,  to  some  extent  motivated 
by  lacH  of  understanding  of  the  nature  and  purpose  of  the  *  • 
tests  themselves/  surely  deserves  more  serious  attention  than 
these  hearings  will  provide.    To  that  end,  we  strongly  urge 
thorough  subsequent  study  of  the  testimonies  provided. 

We  arfe  dealing  with  the  potential  of  literally  millions 
of  persons.    .It  is  undeniable  that  tests  play  an  important 
role  in  this  context.    That  role  is  appropriate  in  the 
educational  setting  and  has  been  found  j^und  in  the "occupational 
setting  by  the  U.S.  Supreme  Courl:.    Thid  legislation  jeopardizes 
the  contribution  of  tests  to  our  educational  system  and 
ultimately  poses  grave  problems  for  the  autonomy  of  our 
institutions  of  higher  learning.    The  burden  of  proof  regarding 
the  need  forlegislatioh  on  standardized  testing  cannot  be 
met  by  political  sloganism  or  populist  concepts  pt|t  forth 
without  benefit  of  data  that  verify  the  nature  and  extent 
bf^the/heurm  proponents       these  bills  assert  applies.  Until 
Such  data  are. provided,  the  proposed  legislation  should  not 
be  enacted*  ^  * 


if 


....  *'  ■  ■  .tV  ■ 

ramliy  income i  kigh. School  GradeB  and  ACT  Test  Scores* 


Average  ACT  CoJt>o«it^  Sopre  f  ., 
-Average  High  School 


Average  I^CT  Coii^sita  Scoi^a^ 
Average  Hlg^  dbhopi  GjcaAe 


$3vODO 


1?  ,  5 
1.67 


$9«000*« 
It  ,9$  9 


3»0X  , 


$3,000- 
$,995 


15,2. 


2*82  ^ 


$12,000- 
14,999 


$6,000'- 
,7,499 

^  2.95r 


$15^000- 
19,999 


19..9 
3108 


$7,5d0- 
8,999 


17.6 
2 1^7 


$20,000  ; 

and  ove:^ 

20.6 
^.07  ' 
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♦college  Studen*  |o\  feh«  «^  >«i^«i»*ftfe*  liU'-i^  ^^^on, ^ 

1976-77/  Afifl  ^flll^iVii'^^^iW.'*^^  ot  the. 1,138  a|lle««e 
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.  Qiairman  Pebkins.  Thank  you  vei^ 
We  wiU  go|dong  to  Dr.  Perrone. 

Without  oqection,  alii  the  prepared  statements  will  be  inserted 
into  the  record.  i  " 

STATEMENT  OP  1 VITO  PENtONE,  DEAN,  SCHOOL:  OF 
EDUCATION,  pnVERSifY  OP  NORTH -  DAKOTA 

Dr.  Perrone.  Mr.  CSi^urman,  members  of  the  subcommittee,  I  am 
Vito  Perrone,  dean^  Center  for  Teaching  and  Learning,  University 
of  North  Dakota.        j  * 

I  am  pleased  to  haye  this  opportunity  to  address  the  House 
Subcommittee  on  Elenientary,  Secondary,  and  Vpcational  Educa- 
tion in  regard  to  the  i^roposed  Truth  in  Testing  Act  of  1979,  H.R. 
3564,  and  the  Educational  Testing  Actsof  1979,  H.R!  4949. 

My  testimony  grow^  out  of  my  expe^ence  over  the  past  two 
decades  as  a  student  of  testing  and  an  active  participant  in  the 
national  dialog  over  t^ts  find  test  use.  * 

In  my  roles  over,  the  years  as  an  elementary  and  secondary 
dchool  ^cher>  university  professor,  graduate  dean,  dean  of  a  pro- 
fessionayr  school,  coordinator  of  a  mcgor  national  study  group  on 
etaluation  and  ^^ident  of  the  National  Consortium  on  Testing,  I 
have  had  numerous  opportunities  to  observe  the  influence  of  exter- 
nally organized  tests  oh  the  lives  of  large  numbers  of  individuals. 

l%e  Study /Group  and  the  National  Qonsortium  on  Testing  >re 
orgcmizations  committed  to  such  goals  imbedded  within  the  pro- 
pos^  legislation  as  increasing  public  understanding  of  the 
strength^ and  weaknesses  of  standanlized  tests  and  improving  the 
qualit]^f  testing  and  assessment  practi^^ 
In  iny  work,  I  have  been  privil^ed  with  opportunities  to  intersect 
;ilarly  with  creative  scholars  who  are  concerned  about  assau- 
lt practices.  I  have  also  had  numerous  occasions  to  meet  with 
ticials  df  our  mcgor  testing  companies.  Having  said  who  I  am  and 
^something  about  my  experience  as  well  as  having  identified  several 
affiliations,  I  need  to  sfty  that  my  perspective  is  not  to  be  viewed  as 
an  official  position  of  the  University  of  North  Dakota,  the  Nonth 
Dakota  Study  Group  on  Evaluation,  or  the  National  Consortium  on 
Testing. 

Standardized  testing,  essentially  a  post-World  I  phenom- 
enon, has  beco^ie  a  way  of  life  in  America.  Tests  exist  for  almost^ 
every  human  socicd  trait  imaginable  from  intelligence7to..9lijpn-^ 
ation,  self  concept  to  maturity,  moral  development  to  creativity. 
'phey  are  being  umbto  select  people  into  and  out  of  a  wide  range  of 
^ucationi^  progralns,  private  and  public  projects/ and  a  varie^  of 
jobs. 

We  have  become  so  ^ccustomed  to  their  i|Be  and  their  seeming 
scientific  authority  that  we  have  often  fcdled  to  ask  whether  the  : 
tests  do  in  fact  assess  what  jthey  purport  to  assess  or  whether  the 
assumptions  ^that  .undergird  the  statistical  and  psychometric  con- 
structs used  are  acceptable. 

Increasingljr,  however,  unexamined  acceptance  of  testing  prac- 
tices and  use  is  being  replaced  by  critical  scrutiny.  To  some  degree 
tMs  has  occurred  in  the  wake  of  an  explosion  over  the  past  two 
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decades  in  tost  usruftd  in  the  growth  of  the  testing  industry. 
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Individuals  as  well  as  brganpiktions  a^^e  booming  increasingly  con- 
cerned about  reports  ojF  misuse  of  test  results. 

They  are  growing  in  their  concerns  also  about  the  limited  public 
information  available -about  te^ts  and  test  use.  The  two  legislative 
proposals  that  are  before  this  dommittee,  as  well  as  similar  legisla- 
tion passed  into  law  in  New  jbtk  and  being  prepared  for  legisla- 
tive action  in  a  number  pi^Mher  States,  are  reflective  of  these 
.  growing  concerns.  I 

\I  believe  that  opponents  ,43  well  as  proponents  of  the  proposed 
ffislation  believe  .philosophically  that  those  who  teke  tests  and 
use^the  results  of  tests  need  access  to  a  wide  rangeyof  information 
such^  what  th6  tests  are  about,  Vhat  they  purpprt  to  measure, 
scoring  mechanisms,  timeliness  of  score  reporting,  data  concerning 
reliability  and  validity,  et  cetera.  Where  they  differ,  I  suspect, 
•relates  to  how  much  information  needs  to  be  made  available,  the 
form  of  the  information  and  the  accessibility  of  the  information. 

The  legislation  before  this  committee,  princip?illy  sections  3  and 
5  of  H.R.  494ft  and  to  a  certain  degree  section  6  of  H.R.  3564,  calls 
for  all  information  to  be  a  matter  of  puplic  record  rather  than  that 
which  a  test  producer  chooses  to  mak^  available.  Public  account- 
ability in  the  largest  sense  is  what  the  llegislation  demands.  Given 
the  role  that  tesl^  play  in  American  life,  such  a  demand  is  not 
unreasonable./    \  1  • 

I  should  note  eaWy  in  this  testimony  that  my  remarks  will  focus, 
.  ftit  the  most  part,  uypon  H.R  4949,  inasmuch  as  it  addresses  exclu- 
sively an  area  in  which  I  have  tHe  greatest  amount  of  experience. 
H.R.  3564  is  less  comprehensive  in  regard  to  reporting  require- 
ments but  adds,  in  contrast  to  H.R.  49^9,  concerns  about  occupa- 
tional testing.  \  , 

'This  is  an  important  issue  that,  the  courts  have  been  involved 
with  for  some  time.  That  g^reater  public  accountability  for  occupa- 
tional tests  is  needed  ismnquestioned.  While  focusing  on  H.R.  4949, 
I  wish  to  acknowledge  that  the  bulk  of  my  arguments  about  open- 
ness relate  also  to  the  mwoA^iBVisions  of  H.R.  3564. 
'  Sections  3,  4,  and  5  of^H.RTi^^ft  which  would  requir9.  relatively 
complete  disclosure  of  all  information  relating  to  an  admissions 
test  and  its  content  anq  upon ,  request  return  of  corrected  test 
questions  to  individual  test  takers  go  to  the  heart  of  my  concerns.  I 
believe  they  are  the  critical  sections  for  opponents  as  well.  * 

Section  5,  in  pai:tic;urar,  comes  out  unequivocally  for  the  princi- 
ple of  fairness;  that  those  Who  are  judged  by  test  results  are  enti- 
tled to  know  the  basis  for  Whatever  judgiiients  are  made.  To  be 
able  to  examine  their  actuall  responses  in  relation  to  the  items  that 
made  up  the  original  tests  ismardly  unreasonable. 

In  its  ejditorial  of  July  24,  1^979,  in  response  to  the  passage  of  the 
New  York  truth  in  testing  bill,  tjhie/  New  Yjprk  Times  wrote  in  a 
straightforward  manner:  \ 

In  spite  of  some  concerns  there  trie  matter  of  d^ementary  fairness.  These 
academic  tests  help  to  shap  the  co^irs^  of  peoples  liyes»  their  schoo^Iing^  their 
careers,  the  very  sense  of  their  own  abilities.  Students  deserve  to  knoW  how  they 
aire  being  rated  and  judged.  There  are  fireedom  of  information  laws»  truth-in-lending 
laws,  truth^n-pac^kaging  laws,  Why  not  trlith  i 

One  of  the  arguments  originaUy  advanced  by  opponents  of  more 
openness  in  testing  was  that  release  of  items  used  for  equating 
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tests  across  forms  and  years,  for  purposes  of  determining  compara- 
bility, as  well  as  for  pretesting  process,  for  purposes  of  developing 
new  test  items.  H.R.  4949  recognizes  this  concern  and  allows  for 
maintaining  the  security  of  items  which  do  not  contribute  directly 
to  an  individual  test  taker's  raw  scores. 

This  acknowledgement  in  H.R.  4949  ought  to  assure  opponents  of 
the  legislation  that  the  intent  is  not  to  bring  an  end  to  standard- 
ized tests.  The  legislation  acknowledges  the  important  public  policy 
role  that  standardized  tests  play  and  seeks  improvement  and  in- 
creased fairness,  not  demise. 

Test  publis|^$rs  have  claimed,  in  response  to' calls  for  openness, 
that  the  tecmiical  qualities  of  their  tests,  including  validity,  reli- 
ability^and  item  quality,  will  suffer  irreparably  if  the  actual  tests 
are  released.  .   \  ■  - 

Such  critical  qualities  as  validity  and  reliability  should  not  be 
affected  negatively  if  test  publishers  bring  to  the  task  of  openness 
the  same  degree  of  knowledge  and  commitment  they  bring  current- 
ly to  the  promotion  of  secure  teats.  f  I 

By  m^ng  the  tests  and  background  about  the  tests  publicly 
available,  the  quality  of  the  public  debate  should  certainly  be  enr 
hanced  and  the  quality  of  the  tests  improved.  At  the  mom^t,  test 
items  actually  appearing  on  the  tests  are  not*  subjected |  to  the 
scrutiny  of  a  broad  range  of  subject  matter  experts,  educators  and 
citizens  with  a  view  toward  improving  them.  \ 

Reviews  of  items  made  available  on  occasion  have  not  p^en  par- 
ticularly positive,  and  in  my  presentation  to  this  committee,  I  have 
included  some  particular  examples  of  the  impreciseness,  the  ambi- 
guij^,  and  the  single  logic  that  seems  to  be  accepted. 

[EnrroR's  NOTE.-^The  paragraphs  in  the  written  statement  which 
were  omitted  in  oral  t^imdny  follow:] 

Banesh  Hoffaian's  analysis  of  SAT  items  in  ''Tyrannv  of  Testing"  (19^2)  is  9hly 
one .  classic  example.  And  reviews  of  other  standardized  tests  which  use  the ^nie 
technoloi^  incorporated  by  the  principal  developers  of  admission  tests|(ETS  and 
ACT)  do  hot  encourage  high  levels  of  confidence  about  existing  ftteni  /quality  or 
validity.  For  example,  critics  note  that  the  multiple  choice  formats  hecessarily 
provide  ambiguities,  the  po^bility,  even  if  well  wf'itten,  for  particular  individuals 
to  ar^e  for  more  than  one  of  the  answers.  The  problem  is.  however,  that  Qnl;u|bne 
Ic^c  is  permitted.  Let  me  provide  an  example  cited  Banesh  Hof^an  (NeW^  vork 
Times  Magazine,  24  October  1965)  and  elaborated  iipon  by  Judah  Schwartz  (Nation- 
al  Elementarv'  Principle,  March/ April  1975).  How  should  one  r^fjpond  to  the  follow- 
ing verbal  analogy:  bland:  Water,  (a)  Sand:  De&ert.  (b)  Mf»untam:  Ocean,  (c)  City: 
Meadows,  (d)  Lake:  Land,  (e)  Kver:  Banks. 

It  is  poflsilide  to  argiie  a  lojic  for  each  choice  and  I  will  do  ibis  if  the  Committee 
members  areMnterested.  What  is  clear,  howl^ver,  is  that  "the  quality  of  any  answer 
QfTered  to  a  verbal  an^ogy  can  only  be  judged  in  the  light  bflKe  respondeht's  stated 
rationale  for  hia  or  her  answer/'  (Schwartz).  Even  information  items,  depending  on. 
show  deeply  an  individual  thinks  about  tiie  potential  responses,  may  be  less  straight^ 
forward  thah  a  surface  examination  would  suggest.  ^ 

Dr.  Perrone.  The  test  publishers  and  their  client  groflps  argue 
that  item  quality  and  Vididity  will  necessanly<decline  if  tne  legisla- 
tion is  enacted  because  the  potential  pool  of  items  for  use  in  the 
tests  is  limited.  From  what  it  is  possible  to  learn^  and  it  is  not  easy 
now  to  get  much  information,  very  few  items  are  reused;  hence, 
every  form  of  most  admissions  teste  mak^s  substantia!  use  of  new 
items.  f  ^ 

The  potential  ^size  of  the  item  pool  has  not  yet  been  a  significant 
problem  and  is  not  likely  to  be  an  insurmountable  obstacle  if  the/ 
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propose4  legislation  goes  into  eflTept.  It  should  be  clear  that  in  mol^t 
areas  covered  by  admissions  testC  the  potential  item  p^l  is  almost 
infinite  if  item-generating"  algorithms  are  develoi)ed,  especially  if 
test  publishers  examine  seriously  the  potential  of  test  constructs 
Other  than  the  current  multiple  choice,  single  response  format.  If 
the  public  disclosure  requirements  cause  t^t  makers  to  cqnsider 
alternative  constricts,  another  useful  end  will  have  been  served. 
In  relation  to;  the  foregoing  issues,  it  should  be  noted  that  we 
.  have  a  histoiy  oiF  public  disclosure  of  tests.  External  certifying  tests 
<med  in  the  English  schools  were  made  available  to  the  pUbliq  soon 
after  administration.  The  Regents  examinatiorts  in  New  York|  have 
had  a  similar  history.  And  publicly  released  items  from  the  n?ition- 
al  .assessment  program  are  currently  used  in  a  variety  of  State 
testing  programs.  J  i 

'    Few  have  argued,  to  the  best  of  my  knowledge,  that  thcj  quality 
•of  these*  tests  has  suffered  from  the  puJ)lic  disclosure.  Rather,  the 
ooncer^n  has  been  that  public  disclosure  has  encouraged  teaching  to 
.the  tests.  Has'teaching  to  thfe  tests  been  absent  in  a  milieu  of 
secure  tests?  Obviously  not. 

Test  coaching  has 'become  a  major  new  industry  in  the  United 
States.  While  controversy  exists  al^ut  whether  test  coaching 
schools  kre  effective,  the  consumers  clearly  believe  they  are.  Those 
who  Qarrie^  out  the  FTC  study  in  Boston  are  also  convinced  that 
the,  coaching  is  effective  for  those  whose  economic  circumstances 
permit  an  expenditure  of  $300  or  more. 

The  openness  called  for  in  the  legislation  will  enlarge  opportuni- 
ties for  all  students  to  have  equal  access  to  testing  information 
and,  if  they  have  taken  a  particular  test,  to  lOTrn  from  their 
mistakes.  J  ^ 

If  students  learning  nothings  frpm  a  testing  progiss  Which  take^ 
their  time  and  money,  a  problem,  sutely  exists/Teachers  Mthih 
schools  and  within  cultural  and  community  sittings  might  also 
learA  enough  through  the  review  of  accessible  |[public  Jnfonqation 
4d  assist  all  s^tudehts  in  their  preparation.  Openness,  tlien,  n^  the 
potential  for  standardizijkg  to  a  larger  degree  than  now  exipi  the 
conditions  under  which  individuals  take  tests.  / 

I  realize  that  the  foregoing  is  one  of  the  argum^ents  now  used  by 
opponents  of  the  legislation,  that  teaching  to  the  tests/  will  be 
encouraged  and  test  scores  ^11  as  a  result  have  less  ci?edibility. 
.The  fact  is  that  teaching  to  the  tests  already  exists  but  more 
differentially  than  concerns  about  equity  should, support.  / 
It  could,  of*  course,  be  further  argued  that  public  discussion 
would^bring  about  greater  attention  to  the  importance  of  particular 
sldlls.  If,  *as  a  result,  "Teachers  teach  their  students  how  to  carry 
out  this  particular  task,  so  mUch^the  better;  education  wiU  have 
been  improved  in  the  process"  (Edwin  Taylor,  EDC  News,  'winter 
1978).  /,/    /  ^  •  ^  . 

The  test  scoresf  in  /the\new  circumstances  might,  aff  opponfnt||Of 
the  prop^d  leJ[sla.tion  suggest,  result  in  lower  levels  of  cr^ipil- 
ity.  This,  nowever,  does  not  suggest  uselessness.  A  lower  level  of 
credibility  might,  ijn  fact,  encourage  those  ^ho  v^ake  admissions 
/decisions  to  use  a/ brdhder  range  of  Criteria, 'a  purppseiButlined 
/  positively  in  RR.  4949,  section  2,  paragraph  4.  Eve^he  test- 
makels  stress  increasingly  that  a  stuc^ent's  performance ^  a  test  is 
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only  one  and  possibly  not  the  mo$t  critical  indicajtor  of  their  ability 
to  succeed  ija  a  particular  ^coUege  or  professional  prW 

Attached  to  my  formal' testimony  is  a  paper  which  I  prepared  a 
year  ago  on  cbll^^.  admission  t^ts  anG(  provides,  I  believe,  an 
important  perspective  on  the  foregoing  issues. 

Opponents  of  the  proposed  l^islation  argue  that  the  costs  for 
such  tests  a^  the  SAT,  MCAT,  LSAp]  are  likely  to  treble  if  the 
legislation  is  passed,  thus, working  a  significant  hardship  on  many 
students.  Information  presented  by  ETO  at  the  May  9  hearing  on 
the  New  York  truth-in-testing  bill  hardly  supports  such  a  claim. 

Andrew  St^enio/in  a  jp^r  prepared  for  the  National  Consor- 
tium on  Testmg  entitled  ''Open  vs.  Secure  Testing,"  which  will  be 
entered  int6  the  subcommittee  record  prior  to  October  8,  quotes 
from  several  documents  which  show  that  actual  test  develop- 
ment costs  range  fiY)in  4  to  8  percent  only  of  the  total  cost  of  a 
msgor  test.     [  ' 

In  this  amounted  to  $2  cents  of  th?  |5.75  paid  by  an  individual  taking 

the  SAT  and  62  cc  nts  of  th&  ^  paid  by  an  individual  taking  the  GRE.  . 


and  t\^e  like 

ThiS)  it -see] 
tenable  in  m( 
mistakes  ever 
question,  establ 
of  their  scoring 
ports  of  serious 
,For  example^ 


to  me,  is  an  intolerable  condition,  not  likely  to  be 
other  educational  or  emplo}nnent  settings.  Are 
ide?  The  m^jor  testing  companies  have,  without 
(bed  careful  procedures  for  assuring  the  accuracy 
d  reporting.  Nonetheless,  there  have  been  re- 
irs^^r  mismfoi^ation  during  the  past  3  yedrs. 

^   ^_,^*-^changed  the  content  of  the  LSAT  between  the 

July  and  October  1^  administrations  without  reporting  the  differ- 
ence to  law  s&ools.  Ti\e  result  was  that  students  who  took  the  t;est 
in  October  had,  on  the  Whole,  higher  scores  than  studdnts  who  took 
the  test  in  July  (New^  Y^rk  Times,  April  28, 1978).  ^ 

In  May  1978,  ACT»  wmch  administers  th|  MCAT^  wrote  to  medi- 
dal  schools  to  inform  them  that  medical  sch^l  scores  they  had  sent 
were  incorrect  (Boston  Globe,  May  23,  1978).  During  the  1975-76 
year,  ETS  acknowledged  that  it  had  erroneously  designated-softie 
law  school  students  as  ''unacknowledged  repeaters^^  (New  RepUonc, 
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cost  is  smcdl.  Admittedly,  returning' all  test  materials  to  a 
test  taker  would  create  some  additional  ct^ts  beyond  those  related 
to  test  develop  tnent.  These  increases,  however,  should  not  be  exces- 
sive m  relation  to  the  potential  gains  and  should  not  be  difficuU  to 
adminster.  Aclmowledging  thW  possibility,  H.R.  4949  in  section  7 
offers  support  for  t^maken^  to'^dd  the  actual  costs  of  providing 
such  services  t>  students.  *'  ,  , 

lifany  of  the  benefits  of  openness  have  been  discussed.  I  ^ill  add 
to  the  list  in  order  to  give  greater  credence  to  this  position.  At  the 
level  of  the  consumer— the  individual  taking  a  test— enormous 
anxieties  tend  to  exist.  They  uncTei^tand  that  their  lives  will  be^ 
influfencW  sigciificantly  without  knowing  very  much  about  the' 
sour^  of  the  influence^  feeling  inadequate  to  control  this  segment 
of  their  lives^  .  ' 

They  receivo  scores  in  the  mail  but  are  left  to  wonder  what 
partictilar  quesitions  or  typ^s  of  questions  they  missed  or  got  cor- 
rect; whether  the  scoring  was  accuiate  or  inaccurate;  v^hether  the 
scoring  procedures  were  consistent  with  other  test  administrations. 
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March  12,  1977).  How  m^ny  other j  errors  have  there  been?  How 
have  they  affected  mdividuals?  ,  I 
How  much  informjatibn  about  tests  and  testing  is  available  for 
public  consumption  4oyr?  Are  the  tests  faii^  in  a  substantive  sensep 
Do  they  ask  importa|tit  questions?/t)o  they  favor  particular  modes 
of  thought  over  other  modes?  Are  they  culturally  or  linguistiQg^iy^ 
biased?  What  under! — ^-  '-^   1 


ig  data  Mist  to  support  existing  validity^ 
'^claims  or  fairness  clainis?  '  . 

The  difficulty  in  Responding  authoritatively  to  tnese  kinds  of 


questions  is  that  iiiformation  is  not  easily  attainable.!  / 

[Editor's  note.— The  paragraphs  in  the;  written  statement  which 
were  omitted  in  oral  testimony  follow:]      ^  ^ 

While  toting  enterprise^  argue  that.they  make  infornTatibn  available  to  "quali- 
fied scholars/'  there  is  ampl;^  evidence  that  an  information  gap  exists.  Oscdr  Buros, 


who  has  been  the  principal  chronicle  evaluator  of  tests  over  the  past  forty  years, 
'eclared  in  his  valedict^nr  address  (Educational  Researcher,  July /August  1977)  that 
the  information  availiable  to  permit  an  adequate  asse^ment  to  be  made  of  (test 


.  makers)  secure  tests  is  quite  unsatisfactory.  Although  our.  reviewers  generally  Re- 
ceive some  in-house  material,  which  is  not  available  to  other  educators,  and  psychol- 
ogists, even  this  material  is  inadequate/' 

While  there  is  a  belief,  from  my  perspective,  substantiated  to  a  ; 
large  degree  among  many  groups  such  as  the  Association  of  Black ' 
Psychologists,  the  NAACP,  Mexican-Anierican  iDefense  League,  the 
Southiern  Regional  Council,  and  the  National  Council  of  Teachers 
Df  English^LamojQg  others,  that  current  tests  ate  subject  to  consider- 
able cultural  and  linguistic  bias  that  compromises  the  country's 
commitments  to  educational  equity,  public  accessibility  to  tests, 

.test  scores,  ylalidation,  demographic  and  ethnic  data,  et  cetera,  may» 
provide  the  substantive  information  th^.t  is  so  critical  to  addressing 
these  concerns  thou^tfully  and  authoVitatively. 

Section  6  of  H.R.  4949  addresses  the  conciern  for  privacjr  of  test 
scores.  This  is  a  sensitive  statement  that  groVs  out  of  considerable 
confusion  about  whether  privacy  is  currently  honored.  Many  stu- 
dent groups  are  currently  challen^ng  ETS  on  this  issue.  My  sense 

.  is  that  no  one  opposed  seriously  this  basic  provision  of  the  proposed 
legislation;  \  r 

In  closingVthis  statement,  I  msh  to  summarize  the  principal 
benefits  which  can  accrue  from  the  proposed  legislation:  Increased 
levels  of  public  information  about  standardi?^  tests;  public  ac- 

j  countability  of  those  who  produce  tests;  fairness  to  those  who  take 
tests;  improved  quality  of  test  items  and  validity;  encouragement  of 

\alternativfi  test  constructs;  greater  equity  in  relation  to  accessible 
\ty  to  test  taking  information;  more  authoritatiye  responses  to 

'  critical  questions  about  testing  and  test  use  that  have  plagued  us 

.  fo^^  a.  half  a  century,  es^ntially  questioni^  such  as  cultural  land 

'  linguistic  bias;  improved  ^admission  procedures  that  concern  them- 
selves with  a  broadbr  range  of  criteria;  greater  assurance  of  i)riva- 

cy.  •  ■  ■■     \       ■  "  "   '  *  ■ 

I  am  aware  that  requiring  public  disclosure  will  not  resolve  all  of 
the  problems  of  equity  or  assure  in  any  absobi^e  sense  that  the 
principle  of  fairness  is  guaranteed;  But  the  requirement  is  clearly  a 
step  in  those!  directions.  / 
I  encourage  this  committer  to  support  the/ proposed  legislation. 
iXhe  appendix  attached  to  thp  prepared  9taj;pmerit  of  Wito  Per- 
rrae  fi " 
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\ .  Appendix  to  thb  Prepared  Stjate^ent  of  Vito  Pbrbonb 


GbiXBOB  Admissions:  A  Pkrspkctivb  PRSsmT^o  to  the  1978  National  Forum  of 

\tHK  COLLBGB  B6arD»  VlTO  FoittONK  CknAr  FOR  TEACHING  A^D  LpiARNmQ,  JJNI- 

VBRSiry  OP  NORTH  Dakota,  ^CTTO^KR  80, 1978  I 

I  am  plaaseid  to  be  here  for  this  particular  diBcussion/)ri  the  "Role  of  Standardized 
Tests  in  Coltke  Admissions^  Cr^t  and  Placement"  programs.  While  I  belifeve  that 
standardized  testing  efforts  at  the  elementary  school  level-^especially  in  the  very 
early  yearsf-have  a  more  pernicious  quality^  college  level  testing  remains  jof  great 
concern  to  me.         i    '  • 

^  You  shoiild  know  at  the  outset,  if  you  don't  know  already,  that  I  aiA  not  an 
Mmix^r  or  the  standardized  t^ing  practices  that  have  become  so  commor^place  in 
our  country.  I  remain  unconvinc^tnat  the  gains  which  have  accrued— however  one 
wishes  ta  define  them— out^eighm  any  significant  manner  the  losses.  I  believe  we 
have  concentrated  considerable  energy  and  fiscal  resources  on  a  procesa  having 
ienormouB  limitations  without  makinc^  sufHciently  manifest  those  hmitattons.  We* 
\have  constructed  a  mechanism  and  related  support  systems  clothed  in  the  language 
and  mvstique  Of  science  with  restricted  accessibilitv  being  a  mi^or  by-product. 
Testing  has  become  lo  much  a  part  of  our  educational  structures— the  conventional 
wisdom— 'th.at*  its  purposes^ do  . not  receive  Sufficient  challenge  and  any  sig-*^'*"-* 
examination  of  how  well  those  purposes  match  use  is  left  wanting. > 

1  am  aware  that  we  are  in  a  msqor  ^'standaiBs  debate"  today  in  which  tesfl 
are  playing  the  role  of  Hermes.  Thid  70'8  dramaAunfortunately,  tends  to  restd 
ability  to  address  critical  issues  in  testing  at  a\time  when  wie  can  counteni 
least.  My  hope  is  that  we  can,  at 'least  for  the  sal^e  of  this  particular  discuss!! 
jlermes  messajge  aside.'  > 

At  the  heart  of  much  of  our  post  World  War  11  debate  about  testing  in  relation  to 
college  admissions  is  the  classic  tension  in  Americmi  society  between  eealitarianism 
and  meritocracy,  altemktive  definitions  of  democracy  in  practice.  Whether  that 
•  tension  surfaces  forceably  or  rwiains  obscured  is  determined  largely  by  a  wide 
range  of  social,  economic  and  political  circumstances.  In  periods  of  stagnation  and 
uncertainly  times  of  crisis,  which  may  well  describe  the  present,  argumeiXts  which 
tend  to  suppbr^  meritocracy  become  pajrticularly  visible.' 

It  m^ht  be  i^seful  to  place  before  you  an  historical  perspective  that  may  assist  in 
understanding  some  of^  the  present  concents  about  testing  and  college  admissions. 
(This  perspective  will  suffer  somewhat  from  its  summary  nature  but  that  is  the 
dilemma  ope  faces  in  this  kind  of  presentation.)  P^or  to  World  War  II,  testing  bad  a 
.relatiJely  benign  clmracter  in  relation  to  colle|;e^dmnBBton's.  Very  few  young  people 
were^mpleting  high  sch6ol  and  of  that  population  only  a  small  percentage  consid- 
ered mtry  into  a  collie  or  university.  At  the  turn  of  the  century,  for  example, 
fewer  than  2  percent  of  any  age  cohort  completed  high  school.  This  number  rose  to 
approximately  20  percent  in  the  eiurly  1920's,  reached  almost  40  percent  by  the 
beginning  of  World  War  n  and  in  my  high  school  graduation  year— 1950— hit  52 

^  I  have  not  attempted  here  to  outline  the  technicalproblems  which  exiflt  or  the  assumptions  • 
.  which  tend  to  undergini  stai^ardized  testing  efforts.  The  following  publications  might  be  useful 
— fbr-thtpsr  wbo  tune^not  yet  pvohed-in  thcL  Uterature:  Vito  Perrone,  Abiises  of  Standardized 
Testing,  Vhi  D^lta  Kappa  Foundation^  Wl-M^ng  and  Evaluation:  New  Views,  Association  for 
Childhood  Education,  1975;  Hezury  Ihrer,  "Hhing  Little  Children:  Some  Old  Problems  in  New  . 
Settings,  jMidh<i«d  Education,  /April  1978;  Edmund  Farr^ll.  "The  Vise/Vice  of  Standardized 
Teirting:  National  Itepreciation  by  QuantiTlation/'  National  Council  of  Teachers  of  English, 
Spring  1976;  Leon  Kamin,  The  Science  of  Politics  of  I.Q.,  John  Wiley,  1974;  Murray  Lttrine,^'The 
Academic  Achievement  Test:  Its  Historical  Context  and  Social.  Functions,  American  Psycholo- 
gist,  March  1976;  Report  on  Minority  Testing,  NAACP,  May  1976;  Barbara  Zailoff,  A  Bibliogra- 
phy on  Bias  in  Intelligence  and  Achievement  T^ing  of  Children  and  ^outh,  N.D.  Study  Group 
on  Evaluation,  1976;^aneeh  Hoffman,  The  TVranhy  of  Testing,  CoULftr,  1964;  Deborah  Meier, 
Reading  Failure  and  the  Tests,  Workshop  Center  for  Open  Ed,  1973;  Nati(^al  Elementary 
Principal,  Maixh/ April  1975  and  August  1976.  ^  ■ 

'  The  debate. about  how  to  interpret  t^st  score  declines  has  generated  considerable  yerbage  but  / 
not  much  enli^ditenment  Competency  testing  activities/ which  are  generating  considerable  en-  , 
thusiasm  in  a  number  of  state  legislatures  and  stiate  delpamients  of  public  instruction  represent 
one  response.  I  am  not  impressed  by  this  "movement."  it  is  fraught  with  a  wide  range  ofi 
t^hnical,^^pedogogical  and  social  problems.  College  Board  participants  might  And  the  following  . 
papers  helpful  m  understanding  competency  testing  activities:  Walter  Haney  and  George  Ma-  i 
daus,  "Making  Sense  of  the  Cpmpetency  Testing  Movement,'*  Hath^ard  Ed.  Review,  Winter,  1978;  ^ 
Gene  Glass,  Minimum  Competence  and  Incompetence  in  Florida,"  Phi  Delta  Kappan,  May  1978; 
Merril  McCluhg,  "Competent  Testing:  Potentkl  for  Discrimination,"  Clearing  House  Review, 
Sept.  1977;  A  Citizen's  Introduction  to  Minimum  Competence  Programs  for  Students,  S^E.  Public 
EdProgramoftheAmericail  Friends,  Feb.  1978.  , 

*  The  popular  press  has,  over  the  past  year,  carried  a  variety  of  features  on  the  ''revolt  of  the 
middle  classes"  which  in  many  ways  epitomii^  this  point. 
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percent.  For  much  of  that  half  century  pemod  individuals  were  not  ihmically  in  a 
disastroiu?  economic  or  social  position  by  virfue  of  a  schooling  deficit..  (This  is  not  to 
suggest)' of 'course,  that  maximum  bpportunities^existed  for  those  who  liiad  not 
completed  secondary  school.)  As  mgh  school  attainment  increased  by  1965  to  its 
present  level  of  76  percent,  parallffled  hv  an,  unprecedented  growth  in  the  popula- 
tion and  in  the  technological  natux^  of  our  economic  system,  not  having  a. high 
school  diploma  became  a  disaster  of  immense  proportions.  Tha.t  .the  disaster  has 
befallen  the  poor  and  the  minorities  almost  exclusively  exaceiibates  the  conse- 
quences, v. 

As  high  school  attainment  has  enlarged,  approaching  a  long  time,  egalitarian  goal, 
the. goaf  has  escalated;  jpost  secondary  education  is'  now  viewed  as'  the  minimally 
acceptable  level  of  education.  Given  the  democratic  ethos  that  fills  our  language,  if 
not  always  our  social  and  public  policy,  could  we  have  expected  anything  less?  Prior 
to  World  War  II,  those  who  went  on  to  college  tended  to  be  individuals  with 
financial  resources — essentially  persons  from  middle  and  upper  class  backgrounds— 
ancLa  desire  to  enter  a  professional  field  which  demanded  college/preparation.  As 
moerof  you  must  know,  the  list  of  fields  was  relatively  siftall  to  at  least  1940; 
.  certainly  it  didn't  include  most  areas  of  business,  the  college  boom  field  of  ^he 
ma's.  Only  10-12  percent  of  18--21  year  olds  wiere  in  college  in  1940.  By  1972,  in 
contrast,  the  number  had  r^ched  approximately  50  percent.  In  the  weuce  of  the 
burgeoning  numbers  seeking  colleg[e  preparation  0|f  one  kind  or  another,  testing 
ceased  its  benign  role,  becoming  in  the  post  World  War  II  period  a  principal 
selection  vehicle  for  our  major  institutions,  one  which  fit  many  individuals'  beliefs 
in  "meritocracy  in  practice.  / 

The  theoi^  accompanying  the  increased  power  of  an  aptitude  orachievepient  test 
for  purposes  of  selection  was  that  family  background  ana  financiiD  resources  should 
not  continue  to  be  the  principal  basis  upon  which  individuals  gmneid  access  to  the 
best  of  higher  education's  resources.  Testing  in  this  sonde  was  viewed  as'a'social 
equalizer.  The  theory,  even  as  scholarship  funds  enlarged,  never  quite  worked  in 
practice.  T^e  most  selective  of  our.  col^ges  and  universities  had  populations  after 
World  War  II  that  wete  not  radically  dissimilar  from  their  pre- WWII  populations. 
Sam  K^ndrick  raised  this  issue  . in  1967,  sug^gesting  that  too  heavy  a  reliance  on  the 
SAT,  a  condition  he  noted,  would  work  against  diversity.  He  wrote,  ''not  mote  thaii 
15  percent  and  perhaps  as  few  as  10  percent  of  Negro  high  school  seniors  would 
scorie  40  percent  or  more  on  the  verbal  section  of  the  SAT.  Onlv  1-2  percent  would 
be  likely  tq  score  50  percent  or  more."  ^  Now  many  schools  by  1970  Were  beginning 
to  make  lessi  use  of  test  scores  but  the  i>elief  has  persisted,  nonetheless,  that  test 
scores  are  tRe.  principal  determiners,  especially  for  the  poor  and  the  minorities." 

In  order  m  accommodate  the  growth  of  appucants  in  tne  txwtwar  period,  many 
colleges  andl  universities  expanded  and  new  mstitutions  were  established.  When  I 
began  my  undergraduate  study  at  Michigan  State  id  1950  there  were  15.000  stu- 
dents. By  1960  the  number  was  approaching  25,000  and  by  1970,  40,000.  And  that 
configuration  of  growth  w^  matched  bv  colleges  dnd, universities  in  almost  all  Of 
our  states.  WhOe  SAT  and  ACT  scores  atiring  this  period  began  to  play  a  I4rge  role 
in  the  mor^  selectivekof  our  colleges  and  determined  even  in  some  of  our  less 
selective  colleges  the.  level  of  enriched  opportunities  that  would  become  available, 
they  clearly  Were  not  nxed  barriers,  to  college  attendance— specially  if  one  wanted 
to  remain  close  to  home.  .  ^  ■ 

But  a#college  attendance  has  become  more  commonplace,  especially  in  a  sputter- 
ing economy  that  no  longer  absorbs  graduates  in  the  manner  that  was  true  in  the 
50  s,  60's  and  early  70's,  the  particular  college  one  attends  is  enlarging  in  conse- 
.  quence.  In  the  boom  period  we  established  willy-nilly  a  higher  education  tracking 
system.*  Our  upper  track  institutions  tend  to  be  better  supported  than  lower  track 

*&am  Kendrick,  "Thie  Coming  Segregation  in  Qur  Selective  Colleges,''  College  Board^Review, 
Wi|t«tti967;  J 

*  Harvard,  recognizing  the  effect  of  the  SAT  on  its  selection  processi  b^an  moderating  lAs 
valfie  after  1960,  giving  in  the  process  more  weight  to  what  was  called  ^Personal  ratings/'  Th^ 
class  of  1964  was,  as  a  result,  broader  in  most  respects  from  earlier  classes.  (See  Dean  Whitla, 
/'Evaluation  of  Decision-Making:  A  Study  of  College  AdmisAns/'  in  Handbook  of  A^asurement 
and  AsseAment  in  Behavioral  Sciences,  ed.  by  Dean  Whitla,  Addison  Wesley:  Re^ng,  Massa- 
chusettSi  1968.)  Harvard  has,  since  1964,  continued  to  make  le^  use  of  the  SAT  aq.  ^  significant 
factor  in  admissions.  While  I  haven ^t  carried  out  any  systematic  review  of  practices  everywhere, 
it  seems  clear  that  many  institutions  hav^  moosrated  tneir  use  of  admissions  examinations. 

'That  they  insist  on  the  test  score  being  presentMyhowever,  helps  keep  up  the  illusion,  if  not  the 
fact,  that  it  is  somehow  critical  and  that  a  tijnow  median  score,  regardless  of  other  circum- 
stance!, might  prevent  entxy,  -  I 

*  Jerome  ICarabel  is  beginning  to  address  tJie  eff^ts  of  thtS  tracking  system,  especially  as  it 
relates  to  minorities  and  poor.  See:  "Community  Colleges  and  Social  Stratifigation,'  Harvard  Ed 
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in8tituti6n8--tKe}r  tend  also  to  have  a  much  lower  percehtati^e  of  minorities  and  the 
poor  within  their  student  pppiilations.'  They  are  more  selective Jhbending  to  give 
greater  weight  or  the  illusion  of  greater  weight  to  the  SAT  or  A0T  in  the  admis-^ 
sions  process.  Increasingly,  employment  opportunities  for  graduates  of  the  upper 
track  institutiohs  have  expanded  in  relation  to  graduates  from  lower  track  institu- 
tions and  graduate  and  professional  schools^which  open  up  yet  additional  opportii-  • 
nitiee— are  qiore  accesisible.  So  much  for  a  brief  Jhistoncal  account.  It  may  have  been 
a  long  route  to  the  issues  that  I  wish  to  raise  but  I  believe  the  path  was  critical. 

What  happens  when  test  scores  are  made  the  m^jor  factor  upon  which  admissions 
decisions  are  Itidde?  Those  iselected  tendia  be  white,  middle  and  upper  class  persons 
from  families  endowed  ivith  college  and  post  .graduate  degree  holders.  If  high  school 
grades  alone  are  used,  those  selected  will  come  from  a  broader  socio^onomic  _ 
backgroimd,  with  more  minorities  represented.  Noiw  most- selective  admissions  insti- 
tutions insist  that  they  use  both  test  scores  and  high  school  grades  in  whatever 
formula  they  use.  (I  have  alluded  to  this  already.)  But  what  is  clear  is  that  a  student 
scoring  very  high  on  the  SAT  is  more  apt  to  be  selected  than  individuals  with  lower 
scores,  high  school  grades  notwithstandun^^.  Wing  and  WalUch,  using  only  the  SAT 
scores,  were  able  to  predict  actual  admissions  decisions  for  several  selective  institu- 
tions af  a  76  percent  level.^  f 

But  what  GO  the  test  scores  tell  tls?  They  predict— and  not  very  highly  at  that— 
first  year  grades.  And  their  predictive  value  is  not  as  high  as  that  of  high  school 
grades.  How  important  is  that  prediction?'*  Does  it  relate  as  closely  to  the  full 
baccalaureate  program?  And  do'  the  grades  bein'g  predicted  have  much  relationship 
to  success  in  one's  adult  life? 

Bowdoin  conducted  several  studies  which  showed  little  relation  between  SAT 
'scorei^  and  final  standing  and  ultimately  dropped  the  SAT  as  a  requirement.  To  my 
knowledge,  there  has  been  iio  decline  in  quality  aiBowdoin— though  the  population 
selected  nas  broadened.'  I  don't  believe  that  I  need  to  provide  for  this  group  the 
extensive  literature  on  the  relationship  of  college  gracies  to  t  adult  achievement.' 
ftoyt's  reviews*  I  suspect,  are  now  quite  commonplace.  I  , 

'^'•p  An  even  larger  literature  than  was  provideq  by  H^,  however,  exii^  in  the 
medical  field.  The  entrance  examination— sim/jlar  in  format  to  othejMiftiissions 
tests— has  denionstrated  little  relation  to  medical  school,  grades,  n«l&i  school 
grades  have  liule  relationship  to  practice  nor,  for  Uiat  matter,  do  scOniToh  medical 
board  examinations.  1  /  ^ 

Are  there  other  definitions  of  talent  that /might  flinctioh  ajs  well  as,  possibly 
better  than,  grades  and  test  scores  as  predictors  of  success  in  college  as  well  as  later 
life?  Holland  and  Richards  in  a  ntunber  of  studies  for  ACT  confirm  that  extracurri^ 
cular,  non-academic  achievement/accomplishment  can  be  identined  as  independent 
forms  of  talent,  having  negligible  correlations  to  ^ades,  aptitude  or  academic 
achievement  tests."  They  suggest  thdt  "if  a  college  wishes  to  fin^f  students  who  will 
do  outstanding  things  outsioe  the  classroom  and  in  later  ,  life,  then  more  att^htion ' 
needs  to  be  given  to  non-academic  acconiplishment.".  How  important  is  such  a 
perspective?  I  would  think  enormously  important.  This  is  the  megor  point  of^Wing 
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Review,  Nov.  1972,  pp.  521-562  and  "Social  Class,  Academic  Ability  and  College  'QfffWty  '\ 
Social  Fon»8  March  1975,  pp  881-398.  See  also  L.  C.  Solmon  and  P.  Wachtel,  Effects  ou 
Income  ofTVpe  of  College  Attended,"  Sociolo^qf  Education,  Winter,  1976  pp.  ^Ml. 

'CllfT  Wing  and  Michael  Wallach,  Collegi^Admifl^ons  and  the  Psycholosy  oMCaient,  Holt 
Rinehart  and  Winston:  N.Y.,  1971.  That  Wihg  and\Wairach  were  able  to  dermW»trate  so 
Ibrceably  the  power  of  the  SAT  in  actu^  admiMions  tfeciBions  doesh't  support— in  fcite  of  the 
claims  that  are  made^the  peiispect||6  that  it  plays  ^  "tfmalli  overestiihatea  role.'' 

■As  the  SAT  declined  in  importance  for  purposes  of  selectiqn  at  HlBirvard  between  1958  and 
1968,  ffrades  of  students  increased.  40  percent  of  the  19^\clas8  was  on  the  Dean's  List  compared 
to  51.8  percent  in  1968.  There  was  10.6  percent  failure  among  the  class  of  1958  compare^  to  4.8 
percent  for  the  class  of  1968  (Whitla,  p.  485).  And  it  should  oe  noted  thiat  a  number  of  selective 
institutions  never  made  use  of  the  SAT  or  other  instruments  of  lhat  kind.  For  example, 
Bennij^n  and  Hampshire  Colleges.  ^  / 

'Don  Hoyt  summarized  46  predictive  stuidies  concluding  ihay/jkeBeni  evidence  Btronglv 
uggests  that  coll^  grades  bear  little  or  nofrelationship  to  any  meAure  of  adult  achievement.  * 
J^e  Relationship  Between  College  Grades  and  Adult  Achievement:  X  Review  6f  the  Literature, 
AnkericanCoUeg^estinff  Service.  Report  m  7.  Sept.  1965.  . 

^•Jbhn  Wingard  and  John  Williamson.  "Grades  as  Predictors  of  Physiciani  Career  Perform- 
ance: An  ^aluate  Literature  ReWew.*'  Journal  of  Medical  Education.  Vol.  48i  pp.  811-822. 

^^Jo)^  Holland  and  James  Richaros,  Academic  and  Non  Academic  Accomplishment  in  a 
ReprtM^ntative  Sample  ^ken  from  a  Population  of  612»000»  Rssearch  Report  No.  1%  American 
College  Testing  Progra^  M^y  1966  and  Academic  and  Non  Academic  Accomplishment:  Corre- 
lated or  Urtcorrelated?  ^search  Report  No.  2,  ACT,  April  1965.  See  also  Leo  Munday  and  J.  C. 
I^vLB,  Varieties  of  Accokplishment  After  College:  Perspectives  on  the  Meaning  bf  Academic 
Talent,  Research  Report  lia  62,  ACT,  March  1974.  / 
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and  Wallach*8  researcTTon  College  Admissions  and, the  Psychology  of  Talent  as  Well 
as  that  of  David  McClelland.*^  How  one  defines  talent— the  weight  that  is  plaqed  on 
one' form  of  talent  in  relation  to  other  forms  of  taleftt— has  a  potentially  significant 
impact  on  our  society,  especially  when  important  decisions  result  from  that  defini- 
tion. 

When  Mfing  artd  Wallach  applied' to  Duke *s  application  pool  a  preference  to  non- 
academic  accomplishment,*'  with  minimum  SAT  scores  set  at  the  50th  percentile 
and  with  high  school  grades  falling  among  the  upper  two-thirds  of  a  class,  they 
ended  up  with  a  selected  population  radicallv  different— broader  in  every  respect— 
than  the  population  actually  selected  by  a  formula  w^ich  weighted  only  SAT  and 
high'  school  grades.  This  suggests,  I  believe,  a  reasonable  case  for  seeking  in  greater 
detail  what  have  tended  to  be  non-traditional  data  and  to  use  that  data  in  ouf 
academic  selection  procedures.  That  we  have  tended  to  place  more  emphasis  on  test 
scores  and  grades  than  seems  justified  is  becoming  more  clear  .and  the  need  to 
retreat  from  such  an  emphasis  is  gaining  adherents.  '  »r 

Being  an  historian,  I  tend  to  look  for  earlier  efforts  which  parallel,  in  some  ways 
current  circumstances.  As  we  think  about  alternatives  to  standardized  testing,  for* 
mats,  we  might  wish  to  refer  again  to  the  neglected  eight  year  study. which  involved. 
Wilford  Aiken  and  Ralph  Tylef 'n  the  1930's."  Twenty-nine  secondary  schools  were 
involved  in  developing  alternative  educational  formats  that  did  not  relate  to  t|ie 
traditional  requirements  for  college  entrance.  These  schools  presented  to  colleges, 
on.  behalf  of  studeri^  who  wished  to  go  oh  to  college,  a  portfolio. outlining  a  bropd 
range  of  an  individuars  accomplishments.  They  provided  considerably  more  infor- 
mation than  we  see.  today  and  what  was  presented  had  a  potential  for  use  that 
current  admission's  data  la^k:"  /  .  . 

What  would  students  present  to  a  college  if  they  wished  to  demonstrate  their 
fullest  capabilities?  *^  It  might  be  useful  to  examine  the  inlplications  of  such  a 
questbn.  The  College  Board  might  enter  into  some  experimentation  with  &  number 
of  selected  schools,  seeking  descriptive  formats  for  use  within  member  institutions 
rather  than  the  SAT  or  various  acnievement  test  batteries.  We  might  in  the  process 
learn  a  good  deal  more  than  we^now  know  about  our  entering  students  and  thereby 
provide  more  appropriate  advisement  and  placement."  Secondary  schools  might  also 
begin  to  initiate  alternative  ways  to  present  the  strength  of  their  students,  using  in 
the  process  a  broad  view  of  talent.  By  bringing  much  more*experimentation  to  this 
system,  we  are  certainly  not  going  to  increase  the  problems  which  higher  education 
already  experiences  and  we  may  find  more  appropriate  mechanisms  for  doing  what 
colleges  and  universities  need  to  do  better. 

Being  particularly  conscious  of  time  and  recognizing  that  I  have  not  addressed  all 
of  the  concerns  which  were  to  make  up  this  session,  I  will  now  con^ment  on  several 
other  issues,  if  only  to  raise  a  number  of  questions. 

We* are  witnessing  in  our  colleges  arid  universities  a  resurgence  of  interest  among 
the  21-40.  year  old  population.  This  interest  manifests  itself  in  terms  of  particular 
courses  as  well  as  degree  programs.  Are  our  typical  testing  formats  appropriate  for 
this  population?  Should  these  students  be  required  to  submit  a  score?  To. what  end? 
Is  their  interest  and  motivation  for  the  course  or  prograni  sufficient?  Do  we  have 
sufficient  vehicles  for  them  io  demonstrate  tfie  quality  of  their  experiential  learn- 
ing? CLEP— ^nd  the  American  Council  on  Education  has  just  entered  into  a.proc'ess 


•  .  ''Wing  and  Wallach  give  particular  credence  to  what  they  call  accomplishment  ^haracteris- 
tics— political  leadership,  athletic  leadership,  work  experience,  acting,  yvriting,  paintilig— beha- 
yiors  which  are  ends  in  and  of  themselves.  They  conclude,  as  have  others,  that  sy^ifactors  act 
quite  independentl^r  from  grades  and  test  scores,  ^e  also  David  McClelland, Westing  for 
Competence  Rather  than  Intelligence,"  American  Psychiatrist^  Jan.  1973  and  Michael  Ny.qllach, 
"Tests  Tell  Us  Little  About  Talent,*'  American  Scientist,  Jan/Feb  1976.     ■  ^     _  . 

Political  leadership,  athletic  leadership,  successful  work  experience,- paitftmg^  acting,  per- 
forming on  a  musical  instrument,  singing,  etc.  '  .  *  . 

»*  WiTfprd  Aiken  summerizes  the  effort  in  Th^  Story  of  the  Eight  Year  Study,  TilcGraw-HjH: 
N.Y.,  J942. 

•*  I  am  aware  that  many  schools  have  lar^e  numbers  of  applicants  and  because  of  limited 
admissions  st^ff  tend  to  desire  simple  quantification  over  descriptive  portfolios.  I  understand 
this  but  don't  accept  it  as  responsible  practice. 
*  ^*  1  had  that  experience  in  ration  to  a  selectivo^experimental  college.  It  was  not  a  lar|^e 
enterprise  but  She  that  provided  applicants,  and  their  sponsors,  room  to  elaborate,  explain, 
present  the  broadest  poBsiole'  perspective.  It  was  a  process  that  proved  particularly  useful  to  the 
faculty  and  was  vieWedit  a  constructive  experience  for  the  stucfents. 

•'College  advising,  espeijially  at  the  freshmen  y^r,  tends  now,  in  most'settin^s,  to  be  quite 
undifferentiated.  In  part  this  occurs  because  colleges  do  not  devote  enough  of  their  resources  to 
personql  advisement.  But  anot^her  factor  is  that  advisors  have  very  little  MnforielM^ion  luxih 
which  to  differentiate.  While  some  persist  in  believing  that  a  high  or  low  math  score  on  the  SAT 
suggests  a  particukr  math  sequence  for  a  student,  SMch  a  belief  may  not  contribute,  to  the  most 
appropriate  advisement  or  placement. 


of  validation  for  other  similar  programs— is  certainly  a  useful  direction,  one  that, 
has  been  used  successfully  by  tnousands  of  individuals,  young  and  old.  But  is  the 
format  responsive  to  the  learning  of  older  perspnq  who  have  been  removed  from 
^ucational  Settings  for  five  or  more  year!?  I  personally  don't  believe  so.'» 

Would  we  have  more  commitment  to  broaaer  definitions  of  talent— to  alternative 
means  of  presenting  competences  and  accomplishments— if  tests  such  as  the  SAT 
and  ACT  were  more  accessible,  published  along  with  their  correct  answer  form  80 
days  after  administrations  as  a  recent.  California  Senate  Bill  proposed?*'  Would 
stiidentd  and  counselors  alike  benefit  from  an  item  by  item  review?.  Again,  I  believe 
so.  The  single  score  which  now  comes  back  doesn't  reveal  very  m%th  about  how  a 
student  de^t  witl^  the  test.  Is  it  possible  that  the  student  completed  one-third  of  the 
testing  and  of  that  one-third  ,  responded  ''correctly**  most  of  the  tiiilie?  Isrit  possible 
that  a  student  scoring  600  and  a  student  seeing  bOO  did  similarly  on  all  but  a  very 
small  section  of  the  test?  Is  it  possible  that  a  student  provided  insight  into  many  of 
the  questions  that  needs  to  b«  reviewed?  *® 

If  the  tests  were  open,  testing  mi^t  become  less  mystical, .  less  powerful  in 
'selection  and  possibly  more  useful  fur  purposes  of  placement  advising,  would  such 
an  effort  influence  high  school  curriculum  to  an  even  higher  degree  thaii  is  now^the 
case?  That  is  a  possibility  if  colleges  and  schools  continue  their  lack  of  significant 
dialogue  ^nd  lack  of  intensity  in  seeking  more  appropriate  articulation. 

Enough^'for  now.  As  Uie  typical  college  age  pjopulation  declines  and  as  our  econo- 
my changes,  we  need  to  address  more  freshly  issues  renting  to  college  admissions, 
placement  ^nd  adva]:iced  credit.  It  is  a  time  to  establish  a  range  of  alternative 
directions,  for  finding  an  even  better  balance  between  egalitarianism  and  merito^ 
cracy,  for  assuring  access  to  the  best  resources^  of  higher,  education  for  all  who 
deserve  and  can  benefit  from  such  resources.^'  I  am  aware  that  I.  have  highlighted 
the  cohiblexities  and  the  more  negative  possibilities  growing  out  of  the  tests.  I  did;  so 
purposetuily  lest  we  forget  where  we  have  been  and  how  far  we  need  to  go.  Having 
said  that,  I  can  aliBo  share  with  you  my  optimism  fgr  the  future.  I  am  convinced  that 
there  will  be  more  modesty  in  the  ve^rs  ahead  about  what  can  be  measured  and 
that  testing  as  we  know  it  will  moderate  as  a  significant  influence  in  our  society. 

Chairman  i^ERKAs.  I  thank  you  very  much  for  your  testimony/ 
\  We  will  now  hear  from  Dr.  Frank  Snyder,  representing  the  Asso- 
ciation of  American  Publishers. 

STATEMENT  OF  FRANK  SNYDER,  McGRAW-HILL,  REPRESENT- 
ING ASSOCIATION  OF  AMERICAN  PUBLISHERS/  ACCOMPA- 
NIED BY  ROY  H.  MILLENSON,  AAP,  WASHINGTON  OFFICE 

♦       -  .  . 

Dr.  Snyder.  Thank  you,  Mr.  Chairman. 
My  hame  is  Frank'Snyder.  « 
I  am  the  publisher  of  CTB/McGraw-Hill  off  Monterey,  Galif.,  a 
commercial  tirip  which  develops  and  distributes  a  vafiety  of  testing 
instruments,  and  I  am  testifying  here  today  on  behalf  of  the  Associ- 
ation of  American  Publishers,  f 

*  '"The  College  Board  might  wish  to  give  attention  to  the "efTorts  being  made  by  institutions  - 
such  a£  Thon&B  Edison  in  New  Jersey,  Empire  State  in  New  York  and  Metropolitan  State, in^ 
Minnesota  whicliuare  seeking  a  variety  of  means  to  certify  for  college  credit  adult  learning. 

^*The  new  SATiStudent  Booklet  unlike  previous  versions,  m;intaan  entire  facsimile  of  a  SAT. 
This  is  a  stejf)  forward  but  it  is  still  not  the  test  and  it  cannot  be  use<rby  the  participants  in  a 
.manner  suggested  bythe  ^California  Bill. 

**For  a  period/ suggested  that  these  tests,  biaihg  aptitude  tests,  were  not  particularly 
amenable- to  signjricant  sc<>re  shifts  from  preparation  programs.  Btit  a  large  industry  has.  grown 
up  around  the  belief  that  '20-80  hours  of  instruction  can  mak^  a  fiignincant  difference;  that 
scores  can  be  improved^  100  poihts  so.  These  schools  have  become. ^over  the  past  two  years, ^ 
the  subject^of  a  major  FTG^view  in  r^Qlation  to  "truth  in  advertising.!  While  I  do  not  yet  know 
the  content  of  the  repbrt,  I  suspect  tt^at  the  revjew  will  uphold  the  proprietary  school's  general 
claim.  The  College  B()arjd  itselT  has. recently  pi^blished  a  report  which  supports  th^t  the  CQn- 
cepta,  priiiciples,  6tc.,  ^nich  tU&lte  up  tf^e  math  section  of  the  SAT  can  bmaught  and  students, 
who  participated  in  a  21  hour  coflirse  d^igi\ed  for  th^^t  purpose  signiflcantly  improved  their 
scores  from  pre-tep  to  poet-teat.    *     w      \  * 

**Many  in  our  country  believe  that  accw  to  higher  education  is  now  opea#t^#Jl  Who  can^ 
benefit.  Humphrey  Doerftian's,  Toward  Equal  Access  (BushJ'oundation.cihd  College  Board,  1978) 
suggests  otherwise.  Doernuin  notes  tliat  sotfle  200,000  qualifled  students  per  vear  are  not  in  boet. 
high  school  schoillng  because  financial  ^Tstance  is  not  sufficiently  avaifbtrie.  While  we  nave 
n^a^lO^')^  strideis  in^kiancial  prbgrameWr  youoff  people  who  wjsh  further  education,  we  have 
no^yel  reached  a  level  that  is  equal  to  oupcopaclw.  .  %  ' 

/  y 


I  am  accompanied  by  Roy  H.  Millenson  of  the  AAP  Washington 
office.  • 

AAP,  which  is  the  general  association  of  publishers  in  the  United 
States,  includes  among  its  members  companies  wHich  comprise  the 
commercial  testing  community.  Harcourt  Brace,  Jovanovich,  which 
testified  her^  last  month,  and  Science  Research  Associations,  how- 
ever, companies  which  Repretsentative  Weiss  mentioned  in  his 
opening  statement,  are  not  members  of  our  association. 
*  Our  members  are  the  source  of  tests  which  are  hot  only  used  in 
elementary  and  secondary  e'diujation,  but  also  by  private  enterprise 
for  hiring  and  promotion.  At  tnis  time 'our  members  do  not  provide 
tests  for  college  admittance,  although  We  would  not  preclude  the 
possibility  of  entry  into  that  field  at  some  future  time. 

While  only  H.R.  35^^pplies  specifically  to  tests  produced  by 
AAP  constituent  ^oi^]j|i^llh^ur  concerns  must  necessarily  encom- 
pass H.R.  4949  iriasiMchlSs^me  of  its  provisions  might  well  be 
incorf>orated  in  any  ^j^yicsi^ation  applying  to  job  entry  testing. 
Our  testimony  thereiFo^'VpM^^     eadl  o^  these  measures  in  some 

Notwithstanding  -fSur  agreement  with  the  purposes  which  we 
infei-  to  be  implicit  in  the  drafting  of  the  proposed  legislation,  we 
doubt  that  there  is  a'' demonstrated  need  for  the  proposed  legisla- 
tion that  is  not  currently  fulfilled  .in  principle  and  recommehded 
practice  in  the  fdrm  oif  standards  for  educational  and  psychological 
tests  produced  by  professional  organizations  such  as  the  American 
Pi^ychological  Association,  the  American  Educational  Research  As- 
sociation, and  the  National  Council  on  Measurement  in  Education, 
as  well  as  in  currently  availSble  information  provided  by  testing 
.agencies,  as  an  ongoing  attempt  to  provide  information  to  examin- 
:  ees:  .  / 

\  GIBBONS  BILL  (H.R.  3564)    ^     ['  ^  ■ 

\  Now,  we  have  prepared  a  rather  detailed  list  of  analyses  of  the 
'pi\\  section  by  section.  I  would  like  to  provide  some  summary 

comments,  first  on  the  Gibbons  bill. 
There  are  three  main  things  that  concern  us  about  the  Gibbons 

bill. 

<>/  The  first  one  is  the  broadness  of  the  bill.  Section  2(3)  includes 
oral  examinations  within  the  definition  of  "teat."  This  could  pre- 
sent difficulties  both  in  enforcement  and  definition.  For  example,  is 
a  person  interviewed  by  a  personnel  director  or  a  college  ^admis- 
.  sions  officer  being  subjected  to  a  ttest"? 

Our  contention  under  the  proposal  cQ|^tained  within  the  bill  that 
this  would  lead  to  a  very  complicated  situation. 

In  addition  to  the  broadness  of  the  definition      test  contained 
within  the  bill,  the  bills  are  also  designed  to  apply  tb^  very  broad 
variety  of  testing  progi^ms;  namely,  admissions  progrtmis,  occupa 
;  tioiial  testing  programs,  and  proprietary  testing  programs  conduct 
'  ed  by  individual  companies  due  to  their  participation  ip  interstate 
commerce.  ,         -  .  ^ 

<  We  see  that  thq  need  ha^  jiot  been  demonstrated  for  regulation 
in  these  areaajjOf  testing,  and  we  are  very  concerned  abqut  the 
•   pibssible  unanticipated  consequences  of  such  legislation  applied  to 
such^rograms.       .  *  '  :. 


Aso  we.  woj^Jd  point  out  to  the  committee  that  'tfie  coitipliance 
pr4^dsion9bf  tl^e  bill  are  not^leai^.  A  f 
Admissions  prJcedunes  to  institutrons  of  higher  learning  and  to 
V  occ||9ations  ^e  lepresented,  in.  practice,  by  a  variety? of  arrange- 
ments between  af^ncies  which  produce  tests  in  institutions^  organi- 
.  [  z^tipns,  and  comnijprcial  <;oncems  which  use  these  tests. 
'  ^  In  the  ai*ea  of  occupational  admissions,  the' teist  producer  usually 
is  nojt  directly  or  indirectly  involved  in  the  actual  administration  of  ' 
.  i  the  examinatioii,  and  tluis  would  not  be  in  a  position  to  coitiply 
^J^.  with  £dl  the  disclosure  provisions  in  this  section.  , 
M  M    We  would  also  like  to  point  out  to  the  committee,  that  if  ^  our 
0  .  f  interpretation  of  the  bill  is  correct,  in  section  2(5)  we  would  raise  i 
the  question  of  whether  or  not  society  includes  labor  unions,  and 
does  this  bill  intend  to  govern. le$ts  for  admittance  into  labor 
:  unions^  when  such  admittance  controls  entrance  into  an  occujpa* 
^  tion.  .  . 

Our  second  concern  is  a  presentation  of  results.  \*  ' 

The  bill  has  several  stipulations  in  it  which  we  coiitendi^are  not 
in  agreement  with  currently  accepted  practice  within  the  profes- 
sional community;  or  that  would  lead  to  unanticipated  conse- 
quences that  would  make  interpretjsttion  more  ratner  than  less 
difficult. 

^For  instance,  ranking  of  students  in  relation  to  total  test  score 
may  not  fit  in  with  the  loeiC  upon  which  that  particular  test  Was 
constructed  and  would  tend  to  be  in  conflict  with  currently  pccept- 
ed  procedures  of  considering  test  ifeores  as  elements  in  an  overall 
.  profile  characterizing  an  examinee  rather  than  a  single  determi- 
nance  for  admittance.  '  , 

Section  6(bX3)  requires  that  tlie  testing  agency  specify  cutoff 
scores;  for  admission  to  institutions  of  higher  education  or  occupa- 
tions. This  is  unreasonable  both  from  a  technical  viewpoint  and  in ' 
terms  of  a  testing  agency's  capability  to  fulfill  the  requirement.  | 
S\ich  cutoffs  are  generally  unknown  to  the  testing  dgency  in  both 
academic  admissions  and  occupational  testing  progr^ms^ 
/       'Decisions  on  cutoff  scores  are  Under  the  control  of  the  admitting 
L     or  hiring  institution  and  would  logically  change  with  chan^ng 
f     levels  of  achievement  or  aptitude,  si^  of  the  examinee  population^ 
f      and  available  jobs  or  space.  -  % 

The  use  of  single  cutoff  scores  is  discouraged  by  the  testing 
-  ^  agencies  based  on  their  potential  misuse  as  a  m*echanistic  way  of 
^  using  test  information.'  « 

The  ufiM^  of  cutoff  Scores  Would  also  tend  to  minimize  the  use  of 
oth^r  crrteria  and  would  be  detrimental  to  considerations  placed  oil 
criteria  other  than  test  results  contained  in  the  totality  of  a  poten- 
tial entrant's  abilities.  |^ 
/■  When  applied  ii|the  occupational  testing  are^  the  use  of  cutoff 
scores  would  also  Jbnd  t6  le^d  to  a  situation  in  which  no  differen- 
^  tial  decisioni^»  basea  pn  test  peiformance,  could  be  made^  above  the 
cutoff  score.  In  ^he  lonj^  run  this  situation  could  eventuate  in  , 
random  .hiring  of  miniiflilly  qua! jiied/ individuals  rather  than  the 
hiring  of  thoge  deemed  besfqualifiM 

I  would  like  to  add  one  mo^  thiM  to  that.  Thete  is  also  a 
stipulation  in  the  bill  thiat'aifplies  A  dinerential  treatment  of  scores 
fbrability  tests  ana  fdr  achievement  tests.  '  * 
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'  i  "  '  "    •  '  ' 

Basically  the  stipulation  is  thatrricf  results  from  achievement 
tests  can  be  scored  in  such  a  feiann^pr  that  the  distribution  of/the 
respondent's  performance  is  used.         ^  / 

This  differential  treatn\ent  implies  a  distinction  m^theory  be- 
tween the  way  'the  two  types  of  tests  are  treated  thai,  is  not  in 
agreement  with  current  professional  thinkkig  in  testing  mCThodolo- 
gy.  ^ 

The  requirement  that  no  tes{  which  measures  knowjed^^gr 
achievement  shall  be  griaded  on  the  basis  of  the  distribution  of 
scores  of  other  test  isubjects  also  assumes  a  static  level  of  ability  in 
our  population  over  time,  and/or  a  static  capacity  across  institu- 
tions to  accept  admissions  or  hire  applicants.  Both  assumptions  are 
neither  desirable  nor  supportable. 

;  Further,  if  such  a  requirement  were  promulgated  in  occupational 
testing,  it  would  assume  the  existence  of  a  definitive  list  of  mini* 
mum  skills  necessary  for  job  entry.  ^ 

Such  definitive  lists  do  not  currently  exist  and  their  absence^ 
would,  we  believe,  lead  to  pressures  at  the  Federal  level  to  man- 
date :what  such  a  list  would  include;  or,  in  effect,  a  Federal  specifi- 
cation of  minimum  jot)  entry  skills.  This  would  clearly  be  a  viola- 
tion of  both  institutional  and  State  prerogatives  and  should  be  - 
avoided. 

If  this  bill  is  passed  into  law  we  recommen^d- that  the  earlier  date 
be  no  earlier  than  12  months  after  enactment  to  provide  adequate 
time  for  the  promulgation  of  the  final  regulations  and  subsequent 
alteration  of  test  materials  in  order  to  comply  with  the  law.  v 

In  conclusion,  we  feel  enactment  of  H.R.  3564,  would  result  in 
myriad  foreseen  and  unforeseen  consiiquences  and  would  present 
dilerimas  of  enforcement  and,  compliance^ 


WEISS  BILL  (H.R.  49^9) 


Our  comments  on  H.R,  4949  necessarily  relate  only  to  those 
.  provisions  that  might  apply  to  occupational  admission  testing, 
should  the  committee  decide  to  combine  p.R.  4949  and  H.R.  3564  as 
has  been  suggested. 

Specifically,  the  bill  mandated  that  a1^  least  three  different  types 
of  information  not  commonly  available  now  be  provided,  They  first 
require  in  section  3(aX2)  that  the  correlation  between  a  test  score 
and  success  in  a  career  be  provided  to  examinees. 

Beyond  the  realization  that  the  presentation  of  correlations  to 
test  subjects  is  unlikely  to  communicate  information  thai  the^^test 
subject  can  understand,  the  committee  should  liote  that  meaning* 
ful  correlations  between  test  scores  and  career  success  are  almost 
never  available  due  to  the  dimciilty  ^f  defining'  what  is  meant  by 
career  success.  '  . 

The  only  way*  I  could  envision  an  adequate  implementation  of 
this  provision  is  if  .  profession^  people  w^re  tested  year  after  year 
.and  those  results  correlated  back  tb  the  entry  level  test.  While  this 
might  be  a  reasonable  thing:  it  would  certainly  be  beyond  what  has 
curriBntly  been  achievable  in  practice.  *    f  . 

^    Section  3(aX4XB)  of  the  bill  also  Requires  the  comparison  of  test  , 
scores  by  income  group.  Information  necessary  for  this  analysis,  if 
not  routinely  availably,  would  require  much  more  papenvoifk, 


would  potentially  belrieWed  as  an  inyasion  of  privacy,  and  would 
probably  generate  more  ipiaunderstaiidings  about  ^le  tests* 

It  is  in  fact  true  that  t6st  scores  do  tend  to  correlate  with  income 
grpups.  Given  the  way  our  society  is  structured  that  kind  of  conclu- 
sion should  not  be  a  surprise  to  anybody.  ; 
"Section  3raX4XC)  tequires  the  expression  as  a  percentage  of  the 
improvement  in  test  scores  as  a  result  of  a  test  preparation  course. 
The  information  to  form  such  a  statistic  is  not  likely  to  Be  availa- 
ble to  the  test  producer  sufficient  tor  any  meaningful'^  interp^ta- 
tion  to  be  made  arid  would  depend  almost  entirely  on  the  contents 
of  a  specific  test  preparation  course  when  compared  to  a  specific 
test.  ' '  *  , 

In  ^a  sense  the  statistic  itself  would  be  almost  meaningless;  since 
it  would  depend  almost  entirely  on  the  contents  of  a  specific 
course,  a  specific  test  and«a  particular  institution  within  which  the 
correlation  was  genei^ated. 

Section  3(jaX9)  reifers  to  handicapped  test  subjects,  a /term  which 
lis  hot  defined.  The  committee  will  recall  the  difficulties  that  en- 
sued because  of  the  lacleof  a  cleat  definition  of  ^'handicai^ped''  in 
sectioni  504  of  the  Vocational  Rehabilitation  Act  of  1973— Public 
Law  93-122.  That  43-word  section  eventually  resulted  in  some  26 
,  pages  of  regulations.  ^ 

A  '  second  Concern  is  the  release  that  is  being  demandedi  of  what  a 
proprietary  testing  company  such  as  my  own  must  consider  to  be 
competitive  data. 

Section  4(a)(lXB)  indicates  that  we  have  to  release  the  terms  of 
our  contracts  of  customers.  We  can  only  consider  this  an  invasion 
of  privacy— it  is  violative'  of  the  spirit,  if  not  the  letter,  of  the 
Privacy' Act  of  1974,  Public  Law  93-579— and  one  that  would  place 
•  any  company  complying  with  this  provision  at  a  distinct  competi- 
tive disadvantage. 

This  provision  is  not  in!i||;he  "New  York  Stfite  statute  or  in  ^jyiy  of 
the  testing  bills  proposed  in  the  States,  and  does  not  belong  in  any 
Federal-Statute.'  ' 

Section  7(2XF)  would  oblige  testing  agencies  to  reveal  their  reve- 
nue from  each  testing  program.  This  is  proprietary  information 
which  would  only  serve  th^  purpose  of  informing  competitive  com- 
panies and  would  place  the  reporting  company  at  a  competitive 
^disadvantage.  This  provision  is  not  in  the  New  York  statute  or  in 
aiiSTof  the^  bills^progosed  in  the  States  and  mso  does  not  belong  in 
any  Federal  law.  ~r —  .  ,   '  * 

Af  final  topic  that  I  woi^d  like  to  commeitt'tMMSJthe  discloiaure  of 
test  questions.  We  s^  two  problems.  1  am  not  commeiT' 
coUe^  admiftions  t6Stin4  First,^the  security  of  the  lest  for  the 
purcHMing  ]|)^^any's  purpose  would  be  breached. '  ^  m 

Proprietary  testing  in  the  United  States  is  a  somewhat^iffereht" 
animal  than  admissions  testing  to  institutions  oi  hi^er  education. 
I%ie  tests  are  frequently  used  by  individual  companies  to  determine 
eligibility  for  employment  by  the  company  itself.  They  are  acfminis- 
tered  frequently,  usually,  many  limes  aiyear  and  usually  to  a  |froup 
of  ho  more  than  several  dozen  applicants.      *  ^ 

As  a  matter  of  fact/ those  tests  sold  by  my  compiany  within  ttiis 
category  rately  exceed  a  quantity  of  1,500 .copies  to  an \ individual^ 
purcn€tsef  for  use  over  a  period  of  tfme; 
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The  security  of  the  test  if  the  items  arfe  required  to  be  released 
for  the  purchasing  company's  purposes  would  be  breached.  It  would 
be  Infeasible  and  uneconomical  and  considering  the  quantities,  a 
great  bother  to  our  customer  to  substitute  a  new  test  to  begin 
Within  a  month  or  so  and  to  repeat  that  procedure  again  and  again 
throughout  the  year. 

Beyond  financial  and  administrative  consideration^  it  is  also 
highly  probable  that  no  replacement  tests  would  be  available  be- 
cause of  the  costs,  The  data  base  which  we  mtist  as  a  professional 
community  provide  information  on  would  increase  to  the  point 
where  it  would  not  be^finajicially  viable  to  continue  the  publication 
of  occupational  data. 

Second,  the  tests  in  question  are  copyrighted.  The  entire  issue  of 
test  copyrights  should  be  explored  by  the  committee.  We  strongly 
oppose  any  application  of  section  5  to  proprietary  occupational 
entry  tests.      ^  , 

In  Section  7(2)  with  respect  to  paragraphs  (A),  (B),  (C),  and  (D), 
this  information  is  not  routinely  available  to  proprietary  testing 
agencies.  These  provisions  are  not  in  the  New  Yqrk  statute. 

One  further  point,  if  H>R.  4949  is  enacted,  the  effective  date 
should  be  no  earlier  than  12  months  afte^  enactment  to  provide  for 
promulgation  of  the  final  regulations  and  subsequent  alteration  of 
test  materials  to  comply  with  the  law.  / 

Since  H.H.  4949  contains  major  provisions  which  are  not  in  the 
New  York  statute,  it  cannot  be  argued  that  as  a  result  of  comply- 
ing with  the  New  Yotk  law  testing  agencies  will  have  no  need  for 
additional  time  to  prepare  for  compliance  with  a  Federal  statute. 

FEDERAL  DOUBLE  STANDARD  ^ 

I  would  like  to  comment  now  on  the  Federal  role  in  testing  . 
which  we  see  3^  the  imposition  of  a  double  standard.  The  commit- 
tee should'*consider  the  relationship  between  the  legislation  under 
discussion  and  current  practices  of  the  Federal  Government  with 
respect  to  testing.  According  to  the  Office  of  Personnel  Manage-  < 
ment,  in  fiscal  year  1978,  1,616,178  persons  tobk  Federal  civil  serv- 
ice tests.  The  pending  ligislation  requires  that*  job  entry  examina- 
tions meet  certain  prescribed  requirements.  J 

It  seems  strange  that  the  Congress  should  impose  these  requir- 
ments  upon  the  private  sector — r€%iirements  which  themselves 
have  not  undergone  trial — without  first  imposing  them  upon  tests 
given  by  the  Federal  Government  itself. 

If  the  testing  practices  to  be  imposed  by  the  pending  legislation 
ai^,  in  fact,  important  to  the  righte  of  individuals  and  the  national 
interests,  it  seems  only  prpper  that  the  first  step  should  be  taken 
by  tfie  Federal  Government  itself  in  the  interests  of  the  more  than 
1.6  million  individuals  taking  civil  service  examinations  each  year. 

Beyond  civil  service  examinations,  it  should  also  be  noted  that 
the  armed  services  have  extensive  examination -^proc^dyres  both  at 
the^  point  of  entry  and  for  subsequent  promotion  decisions. 

That  FederaKoccupatipnal  entry  examinations  have  their  short-* 
comings  is  pointed  up  by  the  May  15,  1979,  report  to  the  Congress 
by  the  Comptroller  General.     '  »  '-'^ 


^  Also^  we  would  like  to  ijlvite  the  committee's  attention  to  section 
3  of  the  Privacy  Act  of  19f4  (Public  Law  93-579)  which  added  a  new 
sectipn  522a  to  title  V  of  the  U.S.  Code.  Subsection  (k)— "Specific 
Exemptions'' — of  that  secticm  permits  an  agency  head  to  "exempt 
any  system  of  records  withm  that  agency"  from  certain  disclosure 
and  access  requirements  9F  the  statute.  The  law.  includes  am6ng 
these  exemptions  the  follQvd^  ' 

(6)  testing  or  examination  mateilalB  used  solely  to  determine  individual  qualifica- 
tions fdr  appointment  or  promotion  in  the.  Federal  service,  the  disclosure  of  which 
would  compromise  the  objectivity  or  fairness  of  the  testing  or  exjamination  process; 

This  provision^  to  put  it  plainly,  points  up  the  fact  that  the 
proposed  legisl^tion  would  require  the  private  sector  to  do  some- 
thing which  Federal  agencies  are.  not  required  to  do  under  similar 
circumstances.  .  ' 

RECOMMENDATIONS 

The  enactment  at  this  time  of  H.R.  3564  and  the  application  of 
H.R.  4949  to  occupational  entiy  testing  is  premature.  It  is  closer 
that  the  ^entire  issue  needs  furtner  study.  For  example,  such  a  key 
issue  as  the  cqpyright  of  test  questions  has  little  been  explored  by 
the  committee. 

In  addition^  since  the  New  York  statute  goes  bevond  the  Califor- 
nia law  and  the  proposed  F^eijal  statute,  goes  beyond  the  New 
York  law  and  proposals  pending  iir  the  States,  it  would  be  wise  to 
garner  some  ^experience  with  the  *tate  laws  before  pi;oceeding  at 
the  Federal  level.  ^  V. 

There  is  also  a  'study  underway  by  the  National  Academy  of 
Sciences  on  ability  testing  which  reports  should'  be  out  withm  a 
year.  It  would  seem  prudent  to  examine  that  committee's  findings 
before  any  legislation  is  enacted  governing  testing. 

The  second  recommendation:  The  requirements  for  testing^ agen- 
cies contemplated  by  the  pending  legislation  should  ofir^t  be  man- 
>dated  for  the  standardized  tests  administered  by  the  U.S.  OfHce  o^ 
Personnel  ^Management,  formerly  thie  Civil  Service  Cdmmission, 
thet  armed  services,  and  other  Federal  agencies. 

If  it  is  a  matted  of  public  interest  to  apply  certain  testing  stand- 
ards to  the  private  sector,  it  is  even  more  in  the  public  mterest 
thap  the  Fraeral  Government. should  adhere  to  those  standards. 

^e  should  like  to  reiterate  one  legislative  recommendation  in 
the  area  of  testing  which  we  made  in  testimony  submitted  to  the 
Posts^condary  Edlication  Committee  of  the  tiouse  Committee  of) 
Education  and  Labor.  We  urge  that  Section  532(aX2X3)  of  th6  High^ 
er  Education  Act  be  amendeid  by  adding  "testing''  after  "develop^^ 
*ment''.  ' 

•  This  ainendment  would  authorize  teacher  centers  to  provide 
training  to  familiarize  teachers  with  developments  in  testing  as 
well  as  in  curriculum  development  and  educational  research.  It  is 
complementary  to  part  B»  educational  proficiency  stanaards  of 
ESEA  title  I  A,  as  amended  by  the  recently  enacted  Educational 
Amendments  of  1978,  and  sljould  further  the  understanding  of  t\te 
development  and  appropriate  use  of  tests.  f  [P*^ 

We  ask  that  our  brief  testimony  Submitted  to  the  Potsecondaiy 
Education  Subcommittee  be  included  in  the  record  part  of  this 
statement.  '  . 

^1  ..  ,  ■ 
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Our  final  recommendation:  Section  922  of  the  Elementary  and 
Secondary  Educafton  Act,  as  amended  by  the  Education  i^end- 
ments  of  1978  (Public  Law. 95-561),  provides  for  ^'training  fcf  and. 
assistance  to  administrators,  teachers,  and  other  instructional  per- 
sonnel in' the  use  of*  tests  and  test  results"  in  the  case  of  certain 
tests  in  the  basic  skills  in  elementary  and  secondary  schools.  , 

We  recommend  that  consideration  be  given  to  providing  assist- 
ance in  the  use  of"  standardized  tests  and  tests  results  at  the  post- 
secondary  level  and  with  respect  to  occupational  entry  examination 
used  outside  of  schools. 

CONCLUSION 

The  pending  legislation  is  not,  as  a  number  of  witnesses  have 
implied,  ari  extension  to  the  Natioh.of  the'New  York  State  statute. 
The  New  York  statute  doeanot  cover  .occupational  admissions 
tests,  as  does  H.R.  8564.  In  n.R.'  4949  there  are  bqth  major  and 
minor  provisions  which  are  not  a  part  of,  or  which  .are  significantly 
different  from,  the  New  York  statute,  including  the  following:  (1) 
The  findings  in  section  2,  H.R.  4949;  (2)  Section  4(a)(lKB);  (3)  Sec- 
tion 4(b);  (4)  Section  7  on  testing  costs  and  fees  to  students;  (5) 
Section  8(b),  the' penalty  provisions. 

As  for  those  who  wish  to  abolish  all  standardized  testing  and 
might  wish  to  expand  the  pending  legislation  to  achieve  that  end, 
we  are  reminded  that  Irwin  Polishook,  vice  president  of  the  Ameri- 
can Federation  of  Teachers,  asserted  that  while  the  testing  process 
has  some  flaws,  abolishing  standardized  testing  would  be  an  emo- 
•tional  and  damaging  strategy  that  would  deprive  us  of  a  valuable 
education  tool,  to  which  there  is  no  alternative. 

We  are  also,  impressed  with  the  arguments  questioning  the  con-  , 
stitutionality  of  the  pending  legislation  and  believe  that  this  merits 
further  exploration  in  sufficient  detail.  ' 

Finally,  it  is  evident  from  the  testimony  preisented  at  these  hear- 
ings that  there  is  deep  concet-h  about  the  adequacy  of  examinations 
required  for.  entrance  to  institutions  o^  higher ;  learning  an^  the 
nonprofit  organizations  that  produce  thelt^. 

Regardless  6f  the  committee's  findings  in  such  areas,  we  are 
concerned  that  inappropriate  actions  Will  be  taken  against  the 
proprietary  testing  community  whose  operations  are  of  a  much 
lesser  magnitude,  involve  a  totajly  different  constituency, '  and 
whose  trade  practices  are  by  nature  markedly  different. 

[The  prepared  testimony  of  Frank  Snyder  followsi] 


TESTrMoNY  OF  Dr.  Frank  Snyder,*  Aibsociation  ok  American  Publishers 

^    My  name  is  Frank  Snyder.  I  am  the  Publisher  of  CTB/McGraw-Hill  of  Monterey, 
California,  a  commercial  firm  which  develops  and  distributes  a  variety  of  testing 
V      insJruniGntA  and  am  testifying  here  today  on  behalf  of  the  Association  of  American  • 
tiers.  1^AP,  which  is  the  general  association  of  publishers  in  the  United 
\  Statesr^includ^s  among  its  memberscompariies  which  comprise  the  commercial 
^  testing  coHiWunity.  Harcourt^^Bf^ce,T^^  (which  testified  here  last  month) . 
and  Science  Research  JVi?oe<fates.  howevfeXcompanies  which  Rep.  Weiss  mentioned^ 
in  his  opening  statement,  ^e  not  members  V  our  association.  '  m 
Our  members  are  th^  source  of  tests  wh/ch  are  not  only  frsed  in  elementary  and 
^      secondary 'Schools, -i^iit  also  by  private  enterprise  for  hiring  and  promotion.  At  this 
time  our  members  do  not  provide  tests  for  college  admittance,  although  we^ would 
not  preclude  the  possibility  of  entry  into  that  field  at  some  future  time. 
  ..        *   ^        /■  ■ 


'  Accompanied  by  I^y  H.  MiJlenson  of  the  AAP^ashington  office.  ♦  f 
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While  only  H.R.  8564  applies  specifically  to  tests  produced  by  AAP  constituent 
companies,  oUr  concern  must  necessarily  enconipass  H.R;  4949  inasmuch  as.  some  of 
its  proipions  might  well  be  incorporated  in  any  final  legislation  applying  to  job 
entry  testing;  Our  testimony  therefore  deals  with  each  of  these  measures  m  sjome 

detail!       t  •    u  • 

Notwithstandihg  our  agreement  with  the  purposes  which  we  infer  to  be  imphcit 
in  the  drafting  ofjthe  proposed  legislation,  we  doubt  that  there  is  a, demonstrated 
need  for  the  proposed  legislation  that  ii)  not  currently  fulfilled  in  principle  and 
recommejided  practice  in  the  form  of  StandardiB  for  Educational  and  Psycbological  „ 
Tests  by  professional  organizations  such  as  the  American  Psychological  Association, 
the  American  Educational  Research  A$s(XJiation,  and  the  National  (^uncil  on  M 
urement  in  Education,  as  well  as  in  the  form  of  currently  available  information 
provided  by  testing  agencies,  as  an  ongoing  attempt  to  provide  information  to 
examinees.  r  ,  u  n 

First,  We  should  like  to  comment  on  specific  provisions  of.  the  pending  bills,  as 

follows:  i 

H.R.  3564  (GiBBbNS  BILL)  .     ^  * 

1.  Sec,  2(3)  includes  oral  examinations  within  the  definition  of  "test".  This  could 
•present  difficulties  both  in  enforcement  and  definition.  For  example,  is  a  person 
interviewed  by  a  personnel  director  or  a  college  admissions  officer  being  subjected  to 
a  "test"?  ' 

2.  Sec.  ^f4/defines  "test  score"  as  a  numerical  value.  Besides  thfe  obvious  complica- 
tions with  respect  to  oral  examinations,  is  it  the  intent  of  this  legislation  to  man- 
date that  all  procedures  be  reduced  to  numerical  values?  This  would  seem  to 
preclude  a  simple  "pass-fail"  or  other  non-numerical  score.  On  the  face  of  it,  this 
prov^ion  would  seem  to  be  unwarranted  given  the  current  statements  of  need,  and 
to  have  the  potential  for  unanticipat^  consequences  at  variance  with  the  central 
purpose  of  providing  information  and  insuring  equitable  treatment. 

3.  Sec  2(5)  iriclu&s  in  the  definition  of  "persons"  the  term  "societies  .  Does  this 
\.    include  labor  unions?  Does  this  bill  govern  tests  for  admittance  into  labor  unions, 

especially  when  such  admittance  controls  entrance  into  an  occupation? 
•4.  Sec  6  raises  questions  as  to  who  specifically  shall  be  required  to  furnish  the 
information  required  in  subsections  (b)  and  (c).  Admissions  procedures  to  institu- 
tions of  higher  learning  and  to  occupations  are  represented,  in  practice,  by  a  variety 
of  arrangements  between  agencies  which  produce  tests  and  the  institutions,  organi- 
zations and  commercial  conceits  who  use  these  tests.  In  the  area  of  occupational 
admissions,  the  test  producer  usually  is  not  directly  or  indirectly  involved  in  the 
.  actual  administration  of  an  examination,  and  thus  would  not  be  in  a  position  to 
comply  with  all  the  disclosure  provisions  of  this  section.  ,„  ^      .  . 

5.  Sec.  6(tiXl)  and  . (2).  It  is 'not  clear  what  is  meant  by  a  '^detailed  description. 

6.  Sec.  6(aX3):The  term  "reliability"  has  not  been  defined.  Given  the  number  ot 
interpretations  of  this  concept'as  it  currently  applies  to  tests,  it  should  be  more 
thoroughly  examined.  Further,  the  Committee  should  note  that  when  an  examina- 
tion is  prepared  for  a  particular  purpose,  reliability  information  may  not  be  availa- 
ble prior  to  the  administration  of  the  examination^  ,„  .      .   .  i 

7.  Sec.  6(bX2).  The  requirement  that  individuals  be  "ranked"  in  relation  to  other 
.individuals  is  inconsistent  with. Section  6{c)  which  prohibits  grading  of  tests  of- 

knowledge  or  aclftevement  on  the  basis  of  the  score  distribution  of  examinees. 
Ranking  individuals  by  total  t^t  performance  may  also  be  contrary  to  the  logic  on 

Jrhicb  the  test  was  constructed  and  in  conflict  with  currently  accepted  procedures  of  ^  ' 
onsidering  test  scores  as  elements  in  the  overall  profile  characterizing  an  examin- 

^%uSec,  6(bXS)  requires  that4.he  testing  agency  specify  cutK)ff  scores  for  admission 
to  institutions  of  higher  education  or  occupations.  This  is  unreasonable  both  from  a 
technical  viewpoint  and  in  terms  of  a  testing  agency's  capability  to  fulfill  the 
requirement.  Such  cutK)ffs  are  generally  unknot  to  the  testing  agency  in  both 
academic  admissions  find  occupational  testinflj  programs.  Decisions  on  ou^off  scores 
are  under  the  control  of  the  admitting  A  hiring  institution  and  would  logically 
change  with  changing  levels  of  Achievement  or  aptitude,  size  of  the  examinee 
population,  and  available  jobs  or  space.  The  use  of  single  cutK)ff  scores  is  discour- 
aged by  the  testhig  agencies  bqsed  on  their  potential  misuse  as  a  mechanistic  way  of 
using  test  information.  The  use  ot cutK)ff  scores  would  also  tend  to  minimize  the  use 
of  otner  criteria  and  would^  deu'imental  to  considerations  placed  on  criteria  other 
than  test  results  contained  in  the  totality  of  a  potential  entrant's  aibilities.  ^ 
/  When  applied  in  the  occupational  testing  area,  Jhe  use  of  cut-off  scores  muld  also 
:  4  tend  to  lead  to  a  situation  in  which  no  differential  decisions,  based  on  test  perform-  , 
ance,  could  be  made  abov^  the  <5utK)ff  score.  In  the  long  rup  thi$, situation  could. 
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eventuate  in  random  hiring  of  minimally  qualified  individuals  rather  than  the 
hiring  of  those  deemed  best  qualified. 

9.  Sec.  6Va^.^^ shopld  be  deleted  because  the  term  "further  information-*  is  unclear. 

10.  Sec.  6(cl  In  addition  t9  the  conflict  between  this  section  and  Section  6(bK2), 
this  section  also  calls  for  the  differential  treatment  of  the  scores  obtained  from 
achievement  tests  and  aptitude  tests.  Such  differential  treatment  implies  a  distinc- 
tion in  theory  between  the  way  the  two  types  of  test  dre  treated  that  is  not  in 

^  agreement  with  current  professional  thinking  in  testing  methodology.  The  require^ 
men t  that  no  test  which  measures  knowledge  or  achievement  8}).all  be  graded  on  the 
basis  of  the  distribution  of  scores  of  other  test  subjects  also  assifmes  a  static  level  of 
ability  in  our  population  ^over  time,  and/or  a  static  capacity  across  institutions  to 
accept  admissions  or  hire  applicants.  Both. assumptions  are  neither  desirable  nor 
supportable.  Further,  if  such  a  requirement  were  promulgated  in  occupation  a  latest-. 
ing»  it  would  assume  the  existence  of  a  definitive  list  of  minimum  skills  necessarv 
for  job  entry.  Such  definitive  lists  do  not  currently  exist  and  their  absence  would, 
we  Believe,  lead  to  pressures  at  the  federal  level  to  mandate  what  such  a  list  would 
include;  or,  in  effect,  d  federal  specification  of  minimum  job  entry  skills^  This  would 

^  clearly  be  a  violation  of  both  institutional  and  state  perogatives  and  should  be. 
avoided. 

11.  If  this  bill  is  passed,  in  its  present  form  or  in  an  altered  form,  the  effective 
.  date  of  the  act  should  be  no  earlier  than  twelve  months  after  enactment  to  provide 

adequate  time  (a)  for  the  promulgation  of  the  final  regulations  and  (b)  subsequent 
alteration  of  test  materials  in  order  to  comply  with  the  Taw. 

In  conclusion,  we  feel  enactment  of  HR  3564  would  result  in  a  myriad  of  foreseen 
and  unforeseen  consequences  and  would  present  dilemmas,  of  enforcement  and 
compliance. 

.H,H.  4949 (WEISS  BILk) 

Our  comments  on  HR  4949  necessarily  relate  only  to  those  provisions  that  might 
apply  to  occupational  admission  testing,  should  the  Committee  decide  to  combine 
HR  4949  and       3564  as  has  been  suggested.  Our  specific  comments  follow: 

1.  Sec.  JlaHJ)  calls  for  providing  the  test  subject  with  the  correlations  between  test 
^scores  and  "success"  in  a  career.  Beyond  the  realization  that  the  presentation  of 

i^brrelations  to  test  subjects  is  unlikely  to  communicate  information  that  the  test 
subject  can  understand,  the  Conrimittee  should  note  that  meaningful  correlations  . 
between  test  scores  and  career  success  are  almost  nev€;r  available  due  to  the 
difficulty  of  defining  what  is  meant  by  "career  success."  This  provision,  if  imple- 
mented for  occupational  testing,  would  mandate  determining  "success'*  in  ia  carrer^ 
for.  which  admittance  is.  sought.  Would  this  require  that  each  ^ofession  or  occupa-. 
'  tion  be  tested  or  reviewed  over  the  years  throughout  the  career  span  in  some 
.measurable  from  so  a  correlation  would  be  generated  between  that  score  and  3n 
individuals  test  score?  This  provision  is  unclear  and  unenforceable  in  the  present 
context  of  occupational  adnlissions  testing. 

2.  Sec.  J(aKJ!f){B)  requires  the  comarison  of  test  scores  by  income  group.  Inforqia- 
tion  necessary  for  this  analysis  if  not  routinely  available  would  require  much  more 
paper  work,  would  potentially  be  viewed  as  an  invasion  of  privacy,  and  would 
probably  generate  more  misunderstandings  about  the  tests. 

8.  Sec.  J(a)(4^0  requires  the  expression  as  a  percentage  of  the  improvement  in 
test  scores  as  a  result  of  a  test  preparation  course.  The  information  to  form  >uch  a 
statistic  is  not  likely  to  .be  available  to  the  test  projiucer  sufficient  for  any  mdaning^ 
ful  interpretation  to  be  made  and  would  depend  almost  entirely  on  the  contents  of  a 
specific  test  preparation  course  when  compared  to  a  specific  test. 

4..  Sec.  *^(aH9)  refers  to  "handicapped  test  subjects' ,  a,- term  which  is  not  defined. 
The  Committee  will  recall  the  difficulties  that  ensuedibeqause  of  the  lack  of  a  clear 
, definition  of  "handicapped**  in  Sec.  504  of  the  voc^itional  Rehabilitation  Act  of  1973- 
(PL  93-122).  That  43-word  section  eventually  resulted  in  some  26  pages  of  regula- 
tions.  >         ■         '   ,  ' 

5.  Sec.  4(aHlHB).  We  can  see  no  reason  why  any  proprietary  testing  company 
should  be  obligated  to  reveal  to  its  competitors  the  terms  of  contracts  with  its 
customers.  This  is  an  invasion  of  privacy'  and  one  that  would  place  any  company 
complying  with  this  provision  at  a  distinct, competitive  disadvantage.  This  provision 
is  not  in  the  New  York  State  statute  or  in  any  of  the  testing  bills  proposed  in  the 
states,  and  does  not  belong  in  any  Federal  statute. 

5.  Sec.  5  presents  particular  problems  for  proprietary  test  publishers.  These  tests, 
when,  used  for  admittance  into  an  occupation,  arfe  frequently  administered  by  indi- 
vidual companies  to  determine  eligibility  for  employment'  by  the 'company  iteelf. 
 .   ■  '  .  ♦ 

»It  is  violative  of  the  spirit,  if  not.  the  letter,  of  the  Rrivacy  Act  of  1974  (Public  Law  93-5*79). 
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They  are  administered  freqiientlv^  usually  many  times  during  a  year,  and  usually  to 
a  group  of  no  more  thij^  several  dozeh  applicants.  As  a  matter  of  tact,  these  tests 
lare  by  my  company  in  quantities  that  rarely  exceed  1,500  CQpies  U>  an  individual  * 
purchaser  for  use  over  a  period  of  time.  ^. 

We  see  two  problems,  if  disclosure  of  test  questions  andf  answers  are  mandated  in  ^ 
the  occupational  testing  area.  First,  the  security  of  tjfe  test,  for  the  purchasing 
company  s  purposes,  would  be  breached.  It  wQuId  be  unfl^asible  and  uneconomicdl- 
and,  considering  the  qumitities,  a  Kreat  bother  to  our  ^customers-^to  substituted 
new  test  to  be  given  within  a  montn  or  so  and  to  repeat  that  procedure  again  mi 
again'  throughout  the<^;^ar.  Beyond  flnahcial  and  administrative  considerations,  ix  is  h 
also  highly  probably  that  no  such  repalceitient  tests  would  be  available  because  th& 
cost  of  test  development  and  data  gathering  to  support  reliabilitv  and  validity  would, 
increase  to  the  point  where  it  would  not  be  nnancially  viable  to  continue,  the 
publication  of  occupational  admission  tests.  Secondly,  the  tests  ih  question -  are 
copyrighted.  HR  4949,  if  applied  to  occupational  entry  testing,  would  force  the  test 
publisher  to,  in  effect,  give  away  his  copyrighted  material  substantially  before  the 
.  expiration  of  its  useful  life.  The  entire  issue  of  test  copyright  should  be  thoroughly 
explored  by  the  Committee.  . 

we  strongly  oppose  any  applications  of  Section  5  to  proprietary 'occut}ational 
entry  tests.  .  ^ 

7.  Sec.  7(2).  With  respect  to  paragraph  (A),  (B),  (C),  and  (D),  this  information  is  not 
available  to  propri^taiy  testing  agencies.  It  should  also,  be  noted  that  these  manda- 
tory provisohs  are  hot  m  the  New  York  State  law. 

8.  Sec.  7(2XF)  vtonM  oblige  testing  agencies  to  reveal  th^ir  revenue  from  each 
testing  program.' Tliis  is  proprietary  information  which  would  only  serve  the  pur- 
pose of  mforming  competitive  companies  and  would  place  the  reporting  company  at 
a  competitive  disiadvantage.'  This  provision  is  not  in  the  New  York  statute  or  in  any 
of  the  bills  propose  in  the  stat^  and  also  does  not  belong  in  any  Federal  law. 

9;  Sec,  7(2XG)  also  mandates  the  release  of  proprietcM^  information  which  would 
only  be  to  the  advantage  of  the  competitors  of  the  company  providing  it  and  which 
would  place  it  at  a  competitive  disadvantage.  This  provision  is  nbt  in  the  New  York 
statute  or  iii.ainy  of  the  Dills  introduced  in  the  states  and  also  does  not  belong  irr  tmy 
Federal  law. 

10.  Sfic.  8(a)  is  inconsistent  with  Section  431  Of  the  General  Education  Provisions 
Act.  Section  431  provides  that  within  sixty  days  after  the  enactment  of  legislation, 
the  Commissioner  of  ^ucation  must  submit  to  Congress  a  schedule  showing  when 
it  is  planned  to  promulgate  final  regulations.  These  final  regulations  must  be  issued 
within  180  days  after  the  submission  of  the  schedule.  It  should  be  noted  that  the 
Office  of  ^ucation  has  difficulty  complying  with  this  provision.  Final  regulations 
have  yet  to  be  issued  for  parts  of  the  Education  Amendments  of  1979  (Ptib.  L.  95- 
561)  signed  into  law  on  November  1, 1978. 

.  11.  If  H.R.  4949  is  enacted,  the  effective  date  should  be  no  earlier  than  twelve 
months  after  enactment  to  provide  for  promulgation  of  the  final  regulations  and 
subsequent  alteration  of  test  materials  to  coniply  with  the  law.^Since  H.Hl  4949 
contains  m£gor  provisions  which  are  not  in  the  New  Yprk  istatute,  it' cannot  be 
argued  that  as  a  result  of  coknplying  with  th^  Ne^V  York  law  testing  agencies  will 
have.no  need  for  additional  time  to  prepaffe  for  compliance  with  a  Federal  statute. 

THE  FEDERAL  kOLE  IN  JESTING— A  DOUBLE  STANDARD 

The  Committee  should  consider  the  regulationship  between  the  legislation  under 
discussion  and  current  practices  of  the  Federal^Gfovemment  with  respect  to  testing. 
According  to  the  Office  of  Personnel  Management,  in  fiscal  year  1978  1,616,178 
persons  rook  Federal  civil  service  tests.  The  pending  legislation  requires  that  J6b 
entry  examinations  meet  certain  prescribed  requirements.  It  seems  strange  that  the 
Congress  ;#hould  impose  these  requirements  upon  the  private  sector-^reqi^^^ments 
which  theAiselves  have  not  Undergone  tk'ial  without  first  iny)osing  them  upon  tests 
given  by  the  Federal  government  ttselfvl^ttie  testing  practices  to  De  imposed  by  the 
pen4jybg  legislation  are,  in  fact,  important  to  "the  rightis  of  indiyiduitls  ana  the 
national  interests",  it  seems  only  proper  that  t}u»  first  step  should  be  t^ken  by  the. 
Federal^ovemment  itself  in  the  interests  of  tihe  more  than  1.6  million  individuals 
taking  ifvU  service  exiAninations  each  yeajr.  jBeyond  civil  service  examinations,  it 
should  als6  be  noted  that  the  armed  services  nave  exte;isive  examination  procedures 
both  at  the  point  of  entry  and  for  subsequent  promotion  decisions. 

That  Federal  occupational  entry  examinations  have  their  sTiortcomings  is  pointed 
up  by  the  May  16, 1979  report  to  the  Congress  by  the  Comptroller  General,  "Federal 

.    Mt  is  yiolative  of  the  spirit,  if  not  the  letter,  of  the  Privacy  Act  of  1974  (Public  Law  93-579). 


Employment  Ebcaminations:  Do  They  Achieve  Equal  Opportunity  and  Merit  Prihci- 
ple  CJoals?"  (FPCP-79-46). 

Al^,  we  would  like  to  invite  the  Committee's  attention  to  Section  3  of  the  Privacy  < 
Aot  of  1974  (Piib^L.  %579)  whi<?ti  addjjfa  a  new  Section  522a  to  Title  V  of  th«  U.S. 
Code.  Subjection  (k)— "Specific  Exemptions'— of  .that  section  permits  ah  agency 
head  to  *'exempt  'any  system  of  records  within  that  agency"  from  certain  disclosure 
and  access  requirements  of  the  statiite.  The  law  includes  among  these  exemptions 
the  following:   /  ;  .  <  ;*  ! 

:  J  (6)  ot^^ing.  Or  .examination  tnaj^rilds  used^ely  to  determine  individual  qualUica- 
tions  for  appomtmi^nt  or  promQtio;u  in  the  Federal  8ervi6e, 'the  dLBclosUj^  of  which 
W([)uld  cpmt>ronnse  the  objectivity  or  fairness  of  the  (J^ting^^  or  examination  process; 
:  This  provision,  to 'piit  it  plainly,  i>oint6  up  the  fact  that  the  propose^  legwlatibn  ^  ' 
would  require  the  private  dector,  to  do;  something  wH^ch'^Eederal -^agenqlja.il^ 
required^ta do  Under  Bimilair  circumstances.  «        '    "  *  '        ^^^^  t 

;    1,  The  enaqtnient  at  this  tinie  of  H;B.  35Q4.And  the  apj>lieation  of*^R 
occupational  ^entry  testing  is  premature.  It'  i8^^<3feflir  ttiat  the  entire  is^ii&'tite^ 
further  study.  For  examp^,  such  a^k^y  i80\ie  as  the,  copyright  "ofte^t  questfpHiA^has: ' 
little  been  ei^plored  by  t|ie  Committee.  In  addition,  since  tfte  NeK  Yofk  statute  goes 
l^yond  the  California  Iiptw  aiid  the  proposed  Federal  statute  goes 
York  lav/'  and  proposals  pending  ih^he  stk^,  it  would 'be  w^  ito  gariier^rii]^ 
experience' with  the  state  laws  befoiid  proCeeduig  at^  the  Feqetal  level.'"    l','-  • 

2.  Hxb  requirements  for  testing  agenciee  ebptemplated  by  tlbe  i^di^g  lej^li^ioh; 
should  Hrst  be  mlmdated  for  the' standardized  t^p?  adnihiist^r^ 

of  Persoiy^el  Management  (formerW  thy^  Civil  S^mc^B.^Gprnmid^ 
ices,  and  other  Federal  agencies.  If  it  is  ^  inatter  of  ptiMic  intei^t  to  apply- certain  ' 
testing  standards  to  the  private  sector,  it  is  eveft  iQore  inithe-  nubUc  Jnteippet  that  % 
the  Federial  Qpvemment  should  adKere^to  those  Btandards/ln  iddiUpn,^B^ 
imtried  legislatid|i,  going  considerably  beyond  burfent  ^te  statutee,  ap  to 

^the  Federal  ei^blisnment  would  serve  a^"  a  proving  ^ou^d  before  appllcatioii  :^s 
extended..^ ^  - ..  .    T'-  V   ■  ■  '  ■  ^  '    '  .      ;-" .  ■«  v^- 

„^  3.  We.  should  like  jtp  reinterate  one  legislative  recommendation"  in 'the^area  of 
testiitig^  which  we;  ma4e  in  testimony  submitted  .tp  the  Postetecondaty  ^ucatiOh* 

.Committee  oT  the  House  Oomi^iitte|(0n  laudation  and  Labor JiVe  urse^hat  Section 

^532(aX2XB)  4)f  the.  Higher :  Bd^catioa  Actr  be  aoiehded  by  addbjg  •  testiriiff^^  M^t, 
"d<^velopment^\'t)ii8  ani^  atithoBze  teacher  centeris  to  providi^  ^raiiL- ' 

ing  tb  uUniUarizei  in  te^^ng,as  well  a&  m  currioubup^ 

development  a^d  MuQatibbal  i^^ch^  ii  compleinriSi^t^  tO  li'art  B  (Educational 
fe^ofidiepcy  Stondnrds)  of  iSEA^Title  D^;  as  amended  by-  thfe>re<»|itly  -enacted 

,  Ekiucatiorgtt  Ameiidnieii&  w  l^m  a|jd  -shpuld  jBirtfier  .the  Dmderstajudinrrof  the 

^>dev)^l!dj^9ie^t  imd  appropriate  u^^f  t^^      ;a8k*  that  our  bri?f  t<^rmbny  subtnit^'^ 
ted  toc^the  P(At»?f^  Sub^WtrtHt^  W  included  in  the  j^ord  api^part " 

„of  thtrfltatement. "     e":-  -.  ""^        r  "«V/;  V  " 

a:  Sectioh  QiZ  6f  the  Ele^enitaid^  imA  Sfptiaaxy-'Educatioh  Aoft  as  amended  by 
;$he  Ec|ufi^tion  AnieJtdm^qtjB  of  lw8:(Pub;.%-9^  jbtovides  foy**jtraihin^  of  .  and 
adsiistj^nc^  to^adminj^trat^,;  teacherd^  an(}^^Ot]|§r  i^(&!UQ^^  iide . 

of  test$  and%st9esuits;'^Viri  t^  basic  ^IMn  qJeoH^tjary 

imd  seCoihdiBFy'j^  re^omkahd  'ih^it:  ;pdnaideration  be  g^v^p"  ta..pjrbviding.^^ 

asdistance  in  the,  u^     etimdai^li^  tests  antrt§$t^i^it^  :at  the^f^^^^^ 

'Kevel  and  '^^;^re8jpRei^^,J^  «c<^i|patioiidl^entiry  ;^^^  uiEfeittOui^ide  o^ 

The  pending  legislation  is  nqt,  a£r  a  ^umber  of  witn^^  have  impiiedf  ih  e)(ten-; 
.si9n  to  the  nation  l^f  the  New  Y^rJl;State  statute.  The  New  York^stcKtut^  doflB?^0|t\ 
cover  occupational  adihissions  tests^  as  d<^^^]fij^  3564^  ther^  ar#%Qth^  ^ 

*  major  and  minor  provisions  wliich  agre  not  ^^^^^ 

different  from  the  New  Y^OrJt  statuie,  including  th^  ^  ^ 

I    l.Thefmdinmin  Sed;Ior2^-HR4949;  .  ^  ^      '  ^ 

I    2.  Section  4(a5(l)(B),  reference  ta w]iich*is  made  in  this  testimony; 

3.  Section  4(b),  reference  to  which  IS  made  in  this  testimony; 
-  4.  Section  7,  (Testing  Costs  and  Fees  to  Students);  and 

5.  Section  8(b),  the  penalty  provision. 

It  should  also^  be  noted  that  the  provisions  bitcid  above  are  not,  for  the  most  part, 
in  any  of  the  parallel  bUls  which  have  been  introduced  in  the  states. 

■'■  •  '  ■  <  \       .  '  ' 
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As  for  those  who  wish  to  abolish  all  standardized  testiiig^  and  might  wish  to 
^  expand  the  pending  legislation  to  achieve  that  end,  we  are  reminded  that  Irwin 
'  Polishook,  vice  President,  of  the  American  Fideratioh  of  Teachers,  asserted  that 
whUe  the  testing  process  ha^  some  flaws,  abofshing  standardized  testing  would  be 
''an  emotional  ana  damaging  strategy''  that  would  deprive     of  a  valuable  educa- 
tion tool,  to  which  there  is  no  alternative/'         .  ,  . 
.  We  are  also  impressed  >yith  the  arguments  questioning  the  constitutionality  of  the 
pending  legislation  and  believe  that  this  merits,  further'  exploration  in  sufficient 
detail.  > 

Finally,  it  islevident  from  the  testimony  presented  at  thes^  hearings  that  there  is 
'deep  concern  about  th^  adequacy  of  examinations  required  for  entrance  to  institu- 
tioAs  of;iugher  learning'  and  the  nonprofit  organizations  that  produoe  them.  Regard- 
V  jiess  of  the  Committ^^s  finain^  in  suph  az^,  we  are  concerned  that  inappropriate 
^actions  wtil  tJie  taiki^  agmniit  the  proprietary  testing  community  whose  ppei^ations 
are  of  «  mUoh  lfiQ^r  ma^itud^/ involve  a  totally  diflerent  constituency,  and  whose 
trade  j^£tctice0  are  by.  nat^^^ 


t^e  ^^ibciii^iipinjbf  A^  (AAP)  iid  :ttie' general  associatipnjof  book  , 

Bubliaher^  In  tlK  XJ[^^  the  General  Publishing  division,^ 

Ifrect  MArketing/Book  C  and  Medical  Divii5ioA>^ 

international  0ivi^dn,?  QoUege^Divi8idh,-:M^  Pwerb^H  Bivisioh,  and  School  Divi- 
sion. Our  380l  membeir  pt^Usning  houses  jproduoe  the  Vast  •mmpr^    of  general  trade,  . 
/  educajtional;  merence, 'pk>fessio|ial  atid religidus l)ooks  published  in  this  country. 
\  AAP  m^^rs  publish  80  percent  of  the  ihdtr^ctiqnaT  material^  Used  ui  the  nation  s 

V  '  We^  laTge^'t^  Education  Act      amended  by 

adding ^vtesting»''  altei****lteyelopment'*,  ATtemyseur,  showlrig  how  this  amendment 
vW(^(ralW  escistih^ 

;  '^"'Tbis  amendteent<WQuld  aftnorize  j^cherw^^^         pr^de  training  to  familiar- 
:'t29e  teaphers  "With  developments  in  testih^^'as  well     ia  curricu)ii£ni  davelbpment^d . 
*  educational  research. 'It  is  cdmplenxentanr    pArt  B  (Educational  Proficiency  Stand- 
..ajdfl)  of  title  DC  of  the  ^recfently-^inacted  Mucafflpn  Am 

^^'THe  /j^ct  th^t  an-inci«asing.  number  of  Stat^-4d6  at.^la8t  QpUnt--^re(iui^  mihiiAum^  / 

<.  Experience  and  tne  recent  legislative^mandates"  bxi  school  assmmdht  indicate^thatd 
^testing  is  cpntinuiisg  to  increase  and  is  likely  to  increase  e>Mn  further  iii  the  i^ext 
decade.  Despite  thjp  criticisms  and  expresillons  of  conceni,     is  appai^t  ther^  are 
,^  foro^  ill  eduCatiotliaQd  society  that.are  r^pphding^tp  prds8UT#  for  better  a^punt* 
'  ability-  ai\d  perfonbancjB  i|i  the  schpola  by  r^uiring:  rest.  dmL  ffo  determine^/ the 
-  <mU^n^e  of  Mucatloiiu  pr^Dg^^  *^  "        1  .  ,  ^  ^ 

■'^  -  TM^  M^  repo]fi,lBSuedl)y  the  Educatidn  Commi^afa  f)t  the  Stat^  shows  that 
thirty^iae  States  haVe  legistaM  the  sorpalled  mijbimum  coinjt^tep(9'  })X%rahm  int^ 


A  rTolate  to  1 


rcd^djmhration.that  the  leVel  of  uttdersl^d^g  arid  cpinpetenoe!.^^ 
many  test  users;  j;i^hd0ilr  counselors^  adminijiltr^tors,  leaves  hiuch  tp  p^ 

'with^e 


l^desiriofl.  peftainly  pi'l^«£fi;yice  trai^     in  tests  affii  measurements  iss^rioosly 
eqimte  cbnrmaimwit^  ago.  Test  publiBhere'  eflTortsIBb  deal' wit 

/;^rid|^^  Conferences,  pamphlets  and  similar  m^biods  touch  . 

Qt^a  fra^to^  of  those  ^cftt^  ■  \.  r  ;id'>v^J^^- ^ ^  . 

.  .  Tolpbkfor a^momentaOheJw^^  '\ 
^JSIiV^^  minimum  <KmpOTWcy^ 

iiQn^mnding  of  the  basic  conceptSvOr  te||t  conisttO^ion  in  pelation  t&  ttlle  km    of  .  f 
assessmp^t  outcomes  desired  is  essentii^.  if  teachmi  are  going  %o4)e  expeqfed  tp  use   .  ^> 
the  test  i^ults  to  identify,  teach,  and  coiinsel  students  so  they  may  acnievV district-  t> 
praiAibed  standards,  then^  seems  otily  reasonable  that  the  miore  knowledge  teach- 


^.National  Education 
atibn  stronglv  encourages  tl 
achievement  tests.*^ 


ition  Resolution  77-67  states^  '^e  National  Education  AsiBoci- 
elimination  of  grout>  standardized  ii;iteUigence,  aptitude,  aod 
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ers  have  about  the  testing  plrocess  and  the  test  results,  the  more  meaningful  will  be 
the  interface  with  their  students. 

Some  States  are  providing  that  proficiency  assessments  relate  directly  to  locally- 
established  standards  and  indicate  that  locally-developed  criterion-referenced  tests 
are  the  best  way  to  insu(;e  that  tests  covei^those  skills  and  standards  identified. 
When  teachers  are  involved  in  the  development  of  such  tests,  a  good  basic  under- 
standing of  test  construction  is  essential.  Too  often  we  find  teachers  thrust  into  such 
situations  without  sufficient  training  andHhen  blamed  for  inadequate  tests  laced 
with  ambiguous  items,  poor  distractors,  and  personal  bias. 

Moving  away  from  minimum  competency  testing,  teachers,  through  the  use  of 
standardized  test  batteries,  can  determine  ai^as  wherein  learning  has  been  the  most 
or  legist  efficient.  The  .analysts  of  learning  rateSvind  levels  of  accomplishment  of 
students  permits  teachers  to  priescribe  appropriate  Instructional  programs. 

By  obtaining  knowledge  in  statistics,  even  if  just  an  overview,  teachers  will  'be 
able  to  summarize,  describe  or  compare  the  results  of  measurement.  This  informa- 
tion provides  more  opportunities  for  accurate  analysis  of  test  results  than  simply- 
assessing  a  single  student  *s  grade. 

In  the  classroom  one  of  the  tasks  of  teachers  is  the  quiz  or  teacher-made  test.  For 
a  reliable  and  valid  classroom  test  teachers  ne^d  t^.know  the  basic  concepts  in  order 
/to  properly  construct  and  assess  the  adequacy  of  a  given  test. 

Teachers  can  give  a  more  informed  voice  to  their  school's  administration  if  they 
have  some  knowledge  of  tests,  and  measurements  and  cao  evaluate  them^  as  to 
whether  the  results  will  be  as  useful  as  predicted,  in  addition,  teachers  can  more 
knowledgeable  examine  and  recommend  mipasures  to  be  used  throughout^the  school. 

When  teachers  review  student  records,  or  those  of  transferees,  knowledge  of  those 
tests  for  which  scores  are  reported  will  lead  to  a  better  understanding  of  the  student 
and  his  level  of  accomplishment. 

When  serving  on  a  test  selection  committee,  teachers  with  a  good  background* 
knowledge  of  the  wide  variety  of  tests  available,  their  application  and  how  to  b^st 
assess  their  usefulness  make  a  valuable  contribution  to  the  school  district  and  to  the 
community. 

In  conclusion,  for  the  above  reasons  and  in  the  interest  of  improved  understand- 
ing of  educational  measuement,  we  urge  that  Section  532(aK2)(B)  be  amended  to 
include  testing. 

TEACHER  CENTfeRS 

Sec.  532.  (aXl)  The  Commissioner  is  authprized  to  make  grants  to  local  education- 


al agencies  in  accordance  with  the  provii 


planning,  establishing,  and  operating  tachc  r  centers. 
(2)  For  the  purpose  of  this  section,  th^  term""  "teacher  center*'  means*  dny  site 


operated  by  a  local  educational  agency  (o 


ons  of  this  section  to,  assist  agencies  in 


a  combination  of  such  agencies)  which 


serve  teachers,  from  public  an3  nbnjiuhUc  schools  of  a  State,  or  an  area  or  commu- 
nity with  a  State,  in  which  teachrfsT with  any  assistahce,  of  si^ch  consultants  and 
experts  as  may  be  necessary,  maV^  *  * 

(A)  develop  and  produce  curricula  designed  to  meet  the  educational  needs  of  thg^ 
persons  in  the  communite^area,  or  State  being  served,  including  thfe^use  of  educa- 
tional research  finding^r  new  or  improved  methods,  practices,  and  techniques  in 
the  development  of  suci  curricula;  and 

(B)  provide  training  to  improve  the  skills  of  teachers  to  enable  such  teachers  to 
meet  better  the  special  eductional  needs  of.  persons 'such  teachers  serve,  and.  to 
familiarize  such  teachers  with  developments  in  curriculum*  development,  testing,, 
and  educational. cesearch,  including  the  manner  in  which  the  research  cag  be  used, 
to  improve  thfeir  teaching  skills.  * 

Chairman  Perkins.  Thank  yoii  very  much. 

We  will  nW  hear  from  Dr.  Paul  Pottinger,  executive  director  of 
the  National  Center  for  the  Study  of  J^rofes^ions.  ^ 
Go  ahead,  Doctor; 

STATEMENT  OF  PAUL  S.  POTTINGER,  EXECUTIVE  DIRECTOR, 
'  NATIONAL  CENTER  FOR  THE'  STUDY  OF  PROFESSIOlNS 

Dr.  PoTTiNGERrThank  yoi;,  Mr.  Chairman,  and  membars  oFthe 
subpommittee.  .    '  * 
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to  have  been^  invited  to  give  my  testimony  today, 
jl^e  is  Paul  S.  Pottingeri  I  am  the  executive  director  of  the 
I^Uodal  Center  fdr.  the  Study  of  Professions  here  in  Washington.  I 
I^tt^i^  before  you  today  in  my  official  capacity  as  the  cen- 
1|t|ryiitre^  and  spokespprsoh  fo^  Truth  in  Toting. 
^^^^^  center  was  established  nearly  2  y^ars  ago  as  a  private  not- 
})^^;Ojpii,  oi«anizatiOn       were  started  with  a^ant  from  the  M. 
i^lRi^^  Currently,  our  funda  come  pri- 

mi^rily         the  NatipnisJ  Institute  df  Mental  Health  for  testing 
i^d  manpower  research  in  the  mental  health  profession. 
^  Our.  misijion  is  partly  to  raise  the  level  of  awareness  of  the  public 
about  issues  of  mcuipower  regulation  within  the  professions.  We 
ij^dv  certification  and  licensing  practices  among  other  regulatory 
Queobanisms.     /    ,  - 
V/  W^'  view  tests  as  a  mcgor  qegulatory  device  in  the  professions^ 
anci'we  are  concerned  about  the  effect^  tests  have  on  the  freedpm 
of  compj^tent  citis^ns  to  pursue  work  of^their  choosing. 
.  Part  of  the  center's  mission  is  also  to  help  examine  alternatives 
to  eurrentk^  usi^  testing- techniques.  My  research  background  is 
rel^tcNi  to  tliis.  I  have,  a  doctorjate  in  psychology  from  the  Universi- 
i^t)r  of  North  Carolina  in  Chapel  Hill  and  a  bachelor  of  science 
IjMpreefr^ 

1  was  Senior  Research  Associate  in  the  Office  of  Research  at  tihe' 
National  Institute  of  Edjication  (DHEW)  from  1973-74.  For  8  years 
t^rior  to  establishing  the  National  Center  for  the  Study  of  Profes- 
.  didns  j  was  the  directoi?  of  assessment  systems  at  McBer  &  Co.,  a 
Boston  social  science  research  and  development  consulting  firm. 

.1  recently  edited  a  book  titled  ^'Defuiln»  and  Measuring  Conipe- 
tence^'-sJossey-Basd',  1979.  This  book,  in^uding  a  chapter  that  I 
fwrote,  articulates  some  of  the  problems  of  current  testing  practices 
"and  the  need  for  more  and  better  information  about  tests. 

So  I  come  here  today  as  both  an  advocate  of  proper  test  develop- 
^  ment  and  usage  and  as  an  exjpert.  |I  am  confident  that  better 
altemativea  to  ounpurrent  testing  p^ctices  Will  become  possible  if 
We  can  learn  mot^bout  the  tests  at  |ssue  in  these  bills.  .  . 

I  have  written  testimony  that  in  part,  as  I  listened  to  my  col- 
)eagues>  I  feel  is  redundant.  I  will  try  to  reduce  my  comments  to 
nAflKe  points  that  have  not  already  been  made,  if  possible.  . 
;  i  jvould  like  to  make  the  argument  that  testing  is  an  eissential,  a 
jmm^X  gatekeeping  mechanism  in  allocating  opportunij^es  for4edu- 
%it4on  jand  Vojrk,  and  because  it  is  so  critical  we  JHeed  1;he  best 
mforpation  possible  about  what  these  teste  measure,  how  valid 
they  are>  what 'effects  they  are  having  on  the  public,  who  are 
affected  by  taking  them.  ^  ' 
1  think  ,the  evidence  is  fairly  convincing  that  the  test  companieei 


Ijbiy  do  not'cWail  this  information  known  because  the  knowledge 
of  these  tc«lts  atnl  their  failings  I  think  ii^  threatening  to  their 
diedibilibf  as  well  as  the  revenue  that  they  depend  on  for  selling. 

I  would  like  to  make  some  comments  about  multiple  choice  tests 
in  fl^erfd,      •  • 

Wk'  ix^  miti$  a  very  poorljr  understood  aHppatipn  mechapism, 
fed  j;he  dtandardlzed  multiple-choice  aptitude  test.  We  need 
Itgi^  information^  which  is  currentlvMifficult  to  obtain, 

r  In  j^fdeV  to  understand  these  tests— because^  they  function  as  the 


gatekeeping  device  to  opporturiraes  for  making  a  decent  living  and 
contributing  to  society ♦  . 

This  present  system  of  all6catjffl|: ^opportunities  \s  not  benign.  It 
is  harmful.  Every  year  thousands  of  students^are  unfair-  : 

ly  denied  opportunities  to  further  ttmr  education,  work  ^nd  life 
skills.  These  falsely  rejepted  in4ividu£^|\8uffer  as  dp  the  erioormous 
numbers  of  potential  clients  of  their  seirvfees  and  skills. >    v>  ' 

The  problem  of  allocating  education  fti^l^ork  oppdrtiltaiti^^ith 
severely  limited  and  secretive  devices  ufgemly  nee^  to  be  c^j^t^d 
;^  to  public  scrutiny.  > 

Test  developers^  and  users  have  been  witffltoldi  abpht  ' 

poor  test  constructibri;  yalidation^^nd  meani^^^ithn^    sKteud  of 
innocence — and  for  far  longer  than  most  comm'e^kil  ihstitt;^!^^  in  ^ 
our  society  have  been  allowed  to  do  without  bdr^broaght^an 
^opien  accounting.       ^  ^  '  ^  A,    .  *  ^ 

In  business  or  industry,  tests  came  under  carefUl  sCTjiitiny  m  the 
1960's  after  the  Supreme  Court  ruling  on  Griggs  v.  ^^ke  Power 
Company,  Since  then,  industry  has  been  made  to  demoristrate  the 
validity,  value,  and  reasonableness  of  its  methods  of  sele5ti^n4-or 
w,ork  allocation — strategies.  '  \  • 

We  should  not  be  tolerant  of  excessive  secretness  dn  testingiUndi- 
yiduals  and  making  life  ^decisions  for  them.  The  strength  of  trttt^ 
in-testing  legislation  is  th^t  it  opens  the  testing  process  scrutin^^ 
understanding,  pi^blic  infonpation  and  intimately  sfccountability  by\ 
making  known  both  the^strengths  and  weaknesses  of  standardized  \ 
testing.  Tests  would      subject  to  outside  scrutiny  and  evaluation  ' 
for  tlie  first  time. 

'/  Truth-in-testing  legislation  should  be  only  the  first  step  in  the;  ' 
demiand  for  accountability.  It  should  not  become  merely  a  placebo 
as  Di^;  Kenneth  Clark  recently  warned  in  a  letter  to  the  New  York 
Times. 

In  the  next  section  i  haVe  written  about  some  of  the  practical 
issues  of  the  bill.  I  thirik  Efi-.  Perrone  and  others  have  covered 
many  of  these  points.  The  costs  are  not  significant,  they  are  exag- 
gerated, I  think  to  deflect  attention  from  the  real  issue^  of  openness 
and  accountability.  *  .  . 

»    iThe  validity  would  probably  not  be  affected  with  respect  to  pre- 
dicting real  life  outcomes  beyond  academia,  that  is  work  outcomes.  ^ 
There  is  no  evidence  that  thi^  tests  are  valid  predictors  Si  anything 
Qf  consequence  beyond  academia.  r  *-^ 

I  want  to  focus  some  comments  on\he  problem  of  npt  getting 
iriforihation  and  nol;  knowledgeable  to  analvze  the  tests  because  of 
the  testing  industry's  resistance  to  being  held  accountable. 

The  testing  companies,  ^concerned  about  the  financial  impact  of 
selling  their  products  to  people  who  would  be  no  loriger  in  the  dark 
about  the  value  of  these  tests,  will  argue  against  this  law.  They 
want  ta  discourage  £uiy  sun  from  shining  on  test  development^ 
utilization  and  interpretaiion  processes. 

They  present  themselves,  as  public  servants^  who ^do  not  compete 
in  business,  in  fact,  calf  themselves  testing  agencies  rather  than 
companies  as  a  way  of  disguising  their  revenue  seelung  motives. 

Yet,  ETS  reported  $1  million  in  excess  revenue  after  expendi- 
tures in  1978— out  of  a  total  of  $80  million  in  revenues.  '      •  , 


I  see  nothing  wrong  with  their  seeking  reveiiUe,  but  if  they 
caiinot  be  open  and  above  board  about  something  so  obvious  as 
their  desire  to  make  money,  how  cain  we  trust  jtheir  statements 
about  less  obvioiJis  matters?  Their  statements  breed  mistrust  and 
lead  many  of  us  not  to  beheve  them  even  when  tHey  are  not  lying 
.'to  us.; 

We  must  look  beneath  their  publiiC  relationfs  policies  an4  actions 
to  understand  their  real  positions*  Retfeiitlv,  E.^Belvin  Williams, 
vice- president  of  the  Educational  Testing  Service,  in  a  discussion 
about  New  York^s  truth-in-testing  legislation,  v  stated  publicly  oh 
the  television  show  "Today",  ^nd  I  quote,  "I  think  that  the  law  in 
New  York  State  is  a^^6od  one,  although  it  created  cer;tain  kinds  of 
problems.  Student?  should  see  their  tests/' 

This  was  said  ,  publicly  when  in  fact  they  launched  and  bank- 
rolled an  elaborate  and  eifctensive  lobbying  effort  to  defeat  the  NeW 
York  bill.  They  are  now  working  with  equal  vigor  to  rescind  this 
bill  which  they  publioly  praise.  ^  ' 

The  point  is  test  companies  will  tell  you  tlTat  many  people  have  ^ 
access  to  their  tests.  But  in  »  case  I  ^as  closely  associated  with,  it  . 
took  court  action  tb  be  allowed  te  see  a  test  that  was  disputed,  and 
even  then  the  courte  agreed  to  a  test  cciinpanyje  stipulation  that  we  . 
oiUy  be  allowed  to  view  the  'tests  for  a  limited  amount  of  time. 

The  courts  held  up  our  abilitv  to  examine  just  fundamental, 
basic  information  about  the  teste  for  over  a  year.  \ 

The  truth  is  that  eve^  aspect  of /this  law  is  doable,  practical, 
necessary,  and  overdue.  But  these  clever  and  professidtial  market- 
ing experte  will  try  to  confuse  and  impress  you  with  accoynto  of 
tests  development  costo,  complications,  and  technicalities.  These  > 
ploys  are  aimed  at  persuading  you^that  disaster  for  their  cliente 
will  occur  if  they  are  foroed  to  be^accounteble. 

The  red  herrings  of  highier  coste,  demise  of  yalidity,  enforcement 
problems,  or^  others  put  before,  you  by  the  iaw's  'detractq^i  are. 
smoke  screens  for  the  real  issues  of  openness  and  accountebilitv,  . 

What  about  multiple-choice  teste?  How  good  are  they? .It  is  ironic  v^^ 
that  the  very  instrument  of  promise  for  fdir  (or  e^uHable)  and 
competence-based  location  of  opportunities  for  education  shottldi^^'Y 
now  come  under  atteck^.but  the  trutK  is  that  we  social  scientis^i  T> 
blew  it.  We  reduced  personal  competence  to  trivial  test-tekin^  Jl 
skills  because  that  was  the  only  practical  technology  we  had  ayailA- 
ble  to  us.  '  '  ^%  '  *  W 

More '  valid  and  less  discriminatory  technology>  is  available;  It 
imply  is  not  being  used.  The  testing  companies  are  liocked  into 
heir  old  techniques.  Rathifer  than  inform  the  public  ab^ut  new 
technolo^  and  persuade  the  public  <^  make^use  of  it,  they  contin- 
ue to  se]J  cheap  teste  that*  assess  few  variables  of  consequence,  and 
^hey  want  us  to  believe  that  this  is  all,  or  .th^  best,  that  is  available 
and  that  it  is  sufficient.  Neither  is  true.     '  / 
'  Multiple-choice  a  teste  are  unfair  because  they  fail  to 

assess  the  more  critical  aspecte  of  competence  that  determine  how 
ef&e^l^  could  be  as  workers  and  productive  citizens.  'This 

meaas  that  we  are  not  selecting  p^ple  into  education  and  work 
based,  on  individuals'  potentisil  tor  competence  on  the  job.  Rather,  ' 
we  Allocate  education,  work  and  hfe  opportunities  solely  on  the. 
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basis  of  some  stripped^iown  version  of  intelligence — such  a  mem- 
pry  for -fact?  or  tests-taking  ability,  not  even  academic  competency. 

The  ability  to  perforip  for  a  matter  of  minutes  limited  intellectu-  • 
al  skills  of  recognition,  recall,  or  esoteric  analysis  is  an  absurd  way 
of  allocating  opportunities  of  lifelong  importance.  It  is  neither  sci- 
entifically nor  n^^orally  defensible  to^generaliz'e  from  cme  single  ^and 
simplistic  test  procedure  to  complex  learning,  working,  and  living 
experiences. 

Decisions  can  be  based  on  more  than  these  limited  measures  of 
people's  overall  competence  in  life.  But  thfey  won't  be  so  long  as  we. 
continue  th  believe  in  the  myth  of  multiple-clioice  aptitude  tests, 
and  we  will  continue  to  believe  in  these  myths  as  long  as  we  are 
not  provided  more  information  about  them.  ' 

Test  companies  advise  admissions  officers  not  to  rely  exclusively  ^ 
on  test  scores,  but  they  also  promote  test  score  validity.  Admissions 
officers  often  do  not  seriously  question  test  validity.  Or  they  use 
tests  as  convenient  decisionmaking  devices  regardless  of  the  valid- 
ity, that  is,  they  accept  the  utility  of  the  tests  without  understand- 
ing them.  . 

Accurate  data  and  information  about  the  meaning  of  these  test 
scores  is  so  hard  toobtdin  that  practically  speaking,  learning  aSout 
the*  true  value  "^of  tests  is  not  wprth  the  effort  for  most  test  users. 

In  short,  our  society's  covenants  With  its  citizens  with  respect  to 
opportunities  for  education  and  work  are  determined  unfairly  antl 
^without  merit  on  the  basis  of  a  feSv  limited  and  irrelevant  abilities 
^to  solve  trivial  problems.  These  abilities  bqar  little  relationship  to 
the  more  enduring  qualities  or  characteristics  of  productive  and 
good  citizens,  ^       .         '  ' 

We  miist  learn  if  tests  are  contributing  to  the  loss  of  our  ability 
to  think,  analyze,  understand,  and  write  because  educiation  stoops 
to  cheap  but  convenient  disguises  for  knowledge  and  cornpetence. 
We  must  know  if  \ye  are  decreasing  the  intellectul  nourishment  of 
our  youjth  by  seducing  them  into  memorizing  facts  or  using  phony 
analytical  SKills  on  trivial  multiple-choice  problems  so  they  qualify 
for  education: and  work  opportunities.  * 

Testing  processes  need  to  be  opene^,  to  public  scrutiny,  under- 
standing and  evalution.  Truth-in-testing  legislation  is  urgently 
needsd.  Its  requirements  are  doable.  Its  results^  will  be  enlighten- 
ment, more  equity  and  attention  to  competence  in  allocating  educia- 
tioh  and  work  opportunities^  and  yes,  even  better  tests. 

[The  prepared  statement  of  Dr.  Pottinger  follows:] 
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Prepared  Statement  or  Paul  S:  Pottinoer/Ph.  iA,  Director,  National 
"Center  for  the  Study  of  PRorfosioNs,  WashinoTon,  D  C. 

X.  INTJIODUCTION  '  V  ^ 

•    .  •  ■*       '     .  ■   '  . 

My  name  i«  Paul  S.  j?otting«r.    I  am  the  exdcutiv»  • 
director  of  the  NationSal  Centdr  for  the  Study  of  Profea^ionB 
here  la  Washington.    I  am  testifying  before  you  today  iii 
my  official  capacity  as  the  Center's  dirjeotoJ .  and  spokesperson  ~ 
for  Truth  in  Testing.         I  ' 

The  Center  was  established' neatly  two  years  ago  as  a 
private  not-fior-proflt  organization.    We  were  sjbarted  with 
a  grant  form  the  M.A.  Rooney  Poundatioli  in  Illinois.  ,  Currently,  . 
our  funds  come ''primai;ily  frcyn  the  National  Institute  of  Mental 
Health  for  testing  and  manpower  research  in  the  mental  health  V 
profession.  *  ^  • 

.  our  mission  is  partly  to  raise  the  levQl  of  awareness  of 

.  .  •  ■  ... 
the  public  «b6ut  issues  of  manpower  regulation  wiUUn  the 

professions.    We  study  certification  and  licensing  practices 

2unong  other  regulatory,  mefbhanisms.     '  j  . 

ft,  ■  ; 

We  view  tests  as  a  major  regulatory  device  in  the  professions; 
and  we  are  concerned  about  the  effects  tests  have  on  tt^  freedom 

oi  competent  citizens  tb  purine  work  of  their  choosing. 

'  •  *  .      ■  ■  ■ .  "» 

Part  of  the^Center's  mission  is  also  to  help  jsxamine 
.alternatives  to  ourfeptly  u^ed  testing  technique?.    My  research 
background  is  related  to  this.    X  h^ve  a  doctoi^te  ln  psychology^ 
from  the  University  of  North  Carolina  in^ Chapel  Hill  and  a 
Bachelor  of  Science  degree  from  Denison  Univeipsity  in  Ohio.  .t 
I  was  Senior  Research  Asscwciate  in  the  office ^of  Research      ^  * 
at  the  National  Institute  of  Education  (DH£W)  frpm  1973-74. 
For  three  years  prior  to  establishing  the  National  Center  for  . 
th^  Study  of  .Professions^  I  was  the  DirectoF^f  Assessment*  ^  * 
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Systems  &t  HcBer  and  Company,  a  B9'fiton  socr^al  science  research 

and  development  consulting  firm. 

■  • .      ■     >  ■  •  . 

'  ■  '    '     V   '      '^-i  ■  ■    ;  ■. 

.1  recenlty  edited  a  book  titled^  Defining  .and  Measuring 
dompeten'ce  (Jossey-Bass,  1979).  »  This  book/  including  a 
chapter  that  I  \ao^e,  articulate^  s^me  of  the  problems  of 
'.current  testing  jpractices  and  thq 'A^ed  for  more -and  better 
informiftion  about  testa*  .'!'.*  g 

.     .  -v'     .  f 

So.  I  come  here  tod^y  as  both  ap;  adyocate  of  proper  test 
development  and.  usage  and^a^s  aii  ex]b|)e^Y    I  am  confident  that 
■'better  aljl&rnajiives  to  our  9urrent  t^s^ing-  praptices  will 
become  possible       we  can  learn  more  about*  the  tests  at. issue v 
in  these  bills.         '  •        .  ;  ,  '  * 

•'.  ■■■       .  ■    ...  w 

'  ^  I  am  here  today  to  vsupport  Truth-In-Testing  legislation^^ 
*I  tlj^k  it  is  urgently  needed  because 

e    t^Bt:s  aret.a  permanent  part.  oTB  pur  decision-making  • 
^  about  who  is  ^iven  the  opportunity  to  learn  and  ^ 
•to  work^  ,  '      .  !  '  ■ 

•  test  valiclity,  use  and^  meaning  are  poorly -understood 
•by  the  public,  whose  lives  Vaije  affected,  and 

•  there  are.  few  if  any  incentives  for  making  information 
aboiith  testd    publicly  available  and  better  understood. 

■   *        '  i 

Accountability,  control  over  our  liv^s.  and  baisic  human  righ^ 
are  at  stalls.    Therefore,  t  want  to  addjcess  four  important 
issues:  ^    '  '  > 

•  The  rationale  for  and  urgency  ! of  passing  Truth- in  -  * 
Testintf  legislation. 

The  practicaliity  of  this  legislation,  in  terms  of' 
costs,  validity  and  enforcement;  * 

.       e    The  testing  industry resistahc^  to  making  information 
availzUslev  or  to  being  held  accountable.'  \  ^ 

•  The  value  of  multiple-choice  aE^tiitude  testing  in 
terros  of  fai^rness  and  relevancei  to  individual  ^ 
competenc^e.  .  . 


t     I  .  * 

*I  tiUt  to  truth-ln-testlng  bb  b  genetili  cBncBpt »    I  bell^v««  In  fact 
that  tha  Educational  Taatlng  Act*  of  1979  (H.R.  1b  the  atmgar  and  mora 

praf erabXa  of  ^ha  two  .bills  under  con8lde|atloh:  -  . 


XI.     RATIONALE  AMD  UltGENCY  OF  PASSING  TRUTH- IK-TESTING  LEGISLATION 


'   Wt  allocttt  uttiTc9  edueation  and  work  oppDrtuaitits 
with  «ptitud«  tttt«.    F«w  p«0|(flt  uaderstand  thM« 
testa.    Tttt  devtlopert  and  uttr»  do  not  provldt. 
-    '       InfoTaktion  n«tded  for  us  to  under  stand.    Yet  ve 
dp  aot  hold  thie  iodustry  sccountable  for  their 
'    eecretive^^^blng  of  our  Binds.    Current  teeting  - 
.         practices  ere  henaful  to  this  cotmcty's  goals  of 
r  equity  and  a  competent' work  force. 

\   ■         -  X 

l^e  problem  we  face  today  iii  claesifylng  our  youth  and 
other  citizens  to  allocate  education  <and  work  opportunities 
is  a  crisis  qf  proportions  uxdmagined  fifteen  years  ago,  or 
eveii  more  recently.    Today  our  country '  s  work  force  re^qulres 
more  education  th«m  ever  before;  and  jobs  are-'Sfcarce.  Our 
ways  of  allocating  scarce  education  and  work  opportunities 
have  become  more  and  moire  critical « 

A 

we  are  using.a  very  pooi^ly  un^lerstood.  allocation  mechanism,, 
called  the  standardized  multiple -choice  aptitlide  test.  He 
need  more  and  better  information,  which  is  currently  difficult 
to  obtain,  in  order  to  understand  thefte  tests  —  because  they 
function  as  the  gatekeeping  devdoe  to  opportunities  for  making 
a  decent  living  and  contributing  t6'*>^ciQty. 

♦ 

This  pr^sentAsystem  of  allocating  oppprtunities  is  no.t 
benign.    It  is  hnmful*    Every  year  thousands  of  competent 
students  are  unfaizrly  denied  opportnhities  to  fuirther  their 
education,  work  and  life  skills.    These  falsely  rejected 
individuals  suffer  as  do  the  enormous  numbers  of  potential  . 
clients  of  their  services  and  skills. ^        .  * 


.  ■    .  2 

Educatipn  itself  suffers  as  it  is  forced  to  mold  its 
curriculum  to  me^t  the  demands  ofafew  test  developers.  Inijovation 
suffers  becauite  any  school  that  strays  from  the/ commercial  tester' 
blueprints  for  learning  will  certainly  pay  a  penalty  for  Jjawer 
test,  performances  in  loss  of  support  by  almpni,  the  press  and 
the  public.    All  of  these  people,  for  lack  of  jjood  inform^jtion, 
believe  in  multiple*- choice  test  fcores  as  a  matter  of  faith  and 
ignofance.    They  equate  test  scores  with  Individual;! "and  program 
'competence. 


•.  The  problem  of  allocating  education  and  work  opportunitiefl 
with  sevt^rly  limited  and  secretive  devices  urgently  needs  to 
be  openeA  "to  public  scrutiny.    Test  developers  and  users  have 
been  withholding  facts  about  poor  test  construction,  validation, 
and  meaning  within  a  shroud  of  innocence       and  for  far  longer 
than  roost  commlrcial  institutions  in  bur  society  ha v.e  been 
allowed  to  do  without  being  Jbrought  to  an  open  accounting. 

In^business  of  industry,  tests  came  under  careful  scrutiny 
in  the  1960s  after  the_5upj?eme  Court  ruling  on  Griggs  v.*  Duke 
^ower  Co..   Since  %en,  industry  has  been  made  to  demonstrate 
the  validity,  value ^nd  reasonableness  of  its  methods  of  ' 
selection  (or  work  allocation)  strategies. 


opportiy^i 


Nothing  comparable  exists 'in  our  system  of  allocating 
titles  for  the  learning  tftat  is  incre^sin'gly  required 
for  many  jobs.    So  to^ay,  the  problem  oft  allocating  scarce 
education  and  work  opportuinties  is  a  problem  of  enormous 
proportion.    It  centers  around  the  'use  of  a  simplistic  mechanism 
mechanism  that  needs  ^ore  exposure,  analysis  and  understanding 
by  the  piiblic.  .  " 

•  ■ 

.  *  ■ 

We  should  rj^ot  be  tolerant  ot  excessive  secretness  in 

testing  individuals  and  making  life  decisions  for  them.  The 

strength  of  Truth-in-Testihg  legislation  is  that  it  opens  the 

testing  process  to  scrutiny,  understanding, public  infprmation 

and  ultimately  accountability  by  making  known  both  the  strengiijis 

and  we^rknessei^s  of  standardized  testing.    Tests  would  be  subject 

to  outside  scrutiny  and  evaluation  for 'the  first  time. 

*  ■  .■*■■' 

Truth-in-Testin^r  leglrslation  should  be  only  the  first 
step  ijk  the  demand  for  accountability*    It  should  not  become 
merely  a  placebo  as  Dr.  Kenj\eth  Clark  recently  warned  in  a 
letter  to  the  New  York  Times  (August  18,  1979) •  .  , 


J 


III.  *  THE  PRACTICALITY  OF  TRUTH-IN-TESTIAg.IiEGISLATION 


Tht  cote  of  dtvttloplng  nw  tMts  would  be 
insl^lflcAnt,    Tht  validity  of  the  tests,. 
•    espscielly  in  prtdictiog  iaportsnt  ItlU  out- 
^      co«es»  would  reaain.  unaf fectsd.    The  raguUtion 
'of  education  or  of  .test  developers  and  users 


should  not  be. confused  with  enforcement,  this 
*  '  •  law  is  to  Mke  tast  publishers  and  users  open  and 

A  potential  problem  is  cost.    More  test  questions  will 
have  to  be  written  if .  each  test  .is  released.    The  cost  of 
developing  and  using 'tests  is  not  Insignificant,  but  the 
cost  incurred  by  writing  mor>s  test/ questions  is  insignif ioant. 
In  faot,  a  small  peroent  of  t^sintg  fees  are  spent  on  the 
wciibing  of  tests.  Host  of  the  cos't  of  admissiops  testing  is 
in  the  labor-intensive  administrative  aspects  of  tesiing  — 
not  in  deyelpproejit. 

There  are  at  least  a  dozen  major. technical  steps  in 
developing^  roulitple-choice  tests    and  one  of  the  cheapest  p 
steps  is  item  geneifation*    The  editing,  and  testing  of  items 
is  not  expensive  either*    The  latter,  step,  for  example,  is 
often  done  by  including  neW  items  in  tests  that  are  -already 
paj.d  for  and  in  use.    Th^  lidded  Cost  of  ^iting  new  tests  could 
be  insignif  ioant  especially  whe(^  spread  ^^oss  hundreds  oi^ 
Ifhousanas  of. tests*  «  . 

•  / 

yshe  exaggerated  concern  about  extra  dollars  required  to 
enafcUle  istudents,  researchers,  teachers,  college  personnel  or 
others  to  know  o/)  what  basis  life  decisions  are  being  made 
has  l^ecome  a  tactic  often  used  by  test  developers  themselves 
to  deflect  attention  from  the  real  issues  of  openness  and. 
accountability. 
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The  iftsue  of  validity  is  another  concern.    Will  tests 

which  might  u^e  items  that  have  been  made  public  still  be 

valid?    The  answer  is  yes:  Tests  will  be  at  least  as  valid 
as  they  have  been.  ^ 

The  potential  number  of  items  for  any  of  the  tests  that 
would  be  affected  by  this  law  is  so  great. that  no  one  could', 
possibly  memorize  the  answers  to  all  the  thousands' of  items 
in  the  ilftera  bank. J And  if  they  did,  they  might  know  more  than 
man/ who  knew  little  but  guessed  W6d.l  on  the  teat.) 

I        ■  ■       .  .   .  . 

What  is  more  important,  these  tests  currently  have  no 
validity  with  respect  to.woi^k  and  life  skills  required  out- 
side of  academia. %  They  are  sometimes  poor  predictors  of  i 
academic  competence,  but^^ey  *are  always  poor  predictors  of 
cbmpetence  in  the  real  world. 

Thus,  many  students  are  inappropriately  screened  out  of. 
opi^o'rtuir^ites  to  enrich  their  existing  work  and  life-relevant  . 
'  competencies  because  they  lack  some  esoteric  knowledge  or 
skill  valu4d  only  in  {icademia. 

For  example,  hoW  would  you  feel  about  your  son  or  daughter 
losing,  an  educational  opportunity  because  he  or  she  could  not 
*  answer  the  following  types  of  questions  to  the  satisfaction 
of  the  testei^s?  ^ 


IMl^R^GNABLE  :  AGGRESSION  t: 

(A)  imperfect  t  revision 

(B)  invincible  :  defense 

(C)  inequitable  t  criticism 

'  (D)  indivisible  :  separation . 
(E)  iiUQutable  :  preservation. 


These  items  are  from  th^  S.A.T.,  from  Wheeler,  Thomas  C., 
"The  American  Way  of  Testing",  The  New  York  Times  Magazine,  ' 
September  2,  1979.  • 


SHILL  :  SWXNC  tt 
(A) "roe  J  fish  . 
•(B)  Coop  poultry 
.   (C)  mouton  t  sheep 
(0)  ^estidide  t  ve 
(is)  fodder  cattle 


After  reading  a  short  passage  about  the  ways  of.  the 
.jungle  and  the  daliert,;  you  are  asked  questions  in  the 
following  fbrmats' 


Which  of  t 
.  way  of  the 


.1. 

U, 
-III. 


,  foUowirig  is  tare)  true  of  both  the 
ungy  an4  thfe  way  of  the  desert? 

They  a^e  characterized  primarily  by  the  struggle 
pf  creature' against  creature^  '       >  y 

They,  afre  reactions  tOv  hostile  environments,. 

Th^  /result  in  population  control , 

i« 


(A)  /  II  only  \ 

(B)  m  only  , 

(C)  I  and  II  onlV 


(D)  II  and  III  'only 

(E)  'I,  II  and  IIX 


Furthermore,  what  -does  the  ability  to  answer  thdse  questions 
have  ta  do  with  being  competent  at  work  and  in  life  for 
which  educatilin  presumably  is  preparing  Gne?    New  law  would  ' 
make  the  lack  of'  validity  ot  these  tests  public  information  ^ 
so  that  co\leg4sA  stii^nts  and;Others  couj^d  know  vjhen  and  when 
noj|^  to  rely  on  tests.  '  .  * 

Another  ^ncrern  is  whether  the  fed,8  will  regulate  educators 
or  test  developers  and* users.  'Regulation  ^s  neither  the  intent, 
nor  do  I  believe  it  wUll  b€^  the  outcome  of -this  bill. 

' .  * 

Some  meohanism  luoh  as  civil  procedures  for  preventive 
relief  or  adininistrativa  proceduires  muist  be-  regulredVbo  enforce  • 
this  law.    But  enforcing  dpenness  About  testingr  activities  is 
not  th^  sans  as  regulating  the  activities  themselves,     (if  the  \ 
specter  of  r^^ulation  is  enhanc^ei  by  the  request  for  the  Coirniissionw 
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of  Education  to  report  on  testing,  the  requireipent  could  be 
dropped  *  ^ 

IV*     THE  TESTING  INDUSTRY 'S  RBSiSTANCE  TO  BEING  HELD  ACCOUNTABLE 

•   .      '  \  •  .  . 

^    .J  Testing  coapanles  have  a  large  financial  a|:ake 

In  aelling  multlple-^cholce  testa.    An  Informed;;. 
^public  Is  threatening  to  their  credibility.  S'oirt 
are  slick  market^s  and  defenders  of  their  tests. 
4-         They  have  laany  rationalizations  for  not  being 

held  accountabj.e.' '  The  law  Is  a  sbiind  one  and  / 
overdue. . 

■  I '  .    ■     ,  '  ' 

Testing  companies,  concerned  about  the  financial  impa'ct 

of  selling  their  products  to  people  who  would  be  no  longer 

In  the  darJc  about  the  value  of  these  te^ts,  will  argue  ^gainst- 

thi8^iaw«    They  want  to  discourage  any  sun  from  shining  on 

test  development^' u4:ili:iation  and  interpretation  processes. 

The  testing  companies  should  fear  loss  of  credibility  and 
revenue  if  the  truth  gets  out  about  tests.-  This  is  a  legitimate 
fear  based  on  their  own  knowledge  that  the  tests  we  are  talking 
al>out  fail   Jbo  be  fair  or  cqmpetence-based,  ,  ' 

■    ,         ■t>  ■ 

Fear  of  accountability  has  already  led  to  widespread 

■  ■  .  « 

hypocricy  and  deceit  by  some  testing  companies*    For  example, 
.to  persuade  us  that  they  are  public  servants  rather  than  sales- 
people,  some 'of  them  claim  that  they  do  not  market  their  products 
or  compete  with  one^  another  for  business.    They  even  call  them- 
selves tjl^ting  agencies  raBfTer  than  companies  ,  to  disguise  their 
revenue-seeking  motives.  Yet,  ETS  reported  one  million  dollat'& 
in  excess  revenue  i^^r  expenditures  in  1978  —  out  of  a  total 
of  $80  million,  in  revenues.' 


I  . see  nothing  wrong  Withitfteir  seeding  revenue,  but  if 
they  cAn  not  be  open  and  4ibove'*tfeiard  about  something  so  obvious 


as  thtir  deaire  to  make  money r^ow  can  we  trust  their  statements 
.*;  about  less^  obvious  matteift    Their'^atatements  breed  mistrust 
'^«nd  lead  -many  Vf  us  not  to  believe  them  even  when  they  are 
;  not  lying  tg  us,  \  f         .  ^ 

r  '  ^  . 

ywamust  look  beneath  .their  pUbliiff  r^latidna  policies  and 
\  actions  to'ui^rstand  theit:  real. positions.    Recerttly,  E.  Belvin 
*  ■♦iliiliiins^  vice  president  of  the  Educational  Testing  Service 
iti  a  diacusaion  about  Njw  Yprk's  Trdfbh-inrTesting  legislation,  . 

seated  publicly  on  the  television  show  •*Ti(^day",  (and.  I  Cpjote)^^  

think  th«^t  4:he  law  in  Nen  York  ^tate  is  a  good  phe.,  although 
jLt  crsAted  certiah  Vitids  of  problems.    Students  should  see. 

heir  tests.**.  This  wa|i/sald  publicly  when  in  fact  the/O.auncbed 
ind*banlfrolled  art  eai9^ate.  and  extensive  lobbying  effd^to 
^defeat- J:he  New ^IfoJ^k  bill.    They  are  now  working  With^ual  * 
.  vigbif'  to  recin^dl  *this  bill  which  they,  piablicly.  praise. 


;  .  Ifesi  coi&panies  will  tell  yt>iiv^$MlmanY  people  have  aceas  ' 

^  •      .  •  •      •  •        .  .  t**'  \  ^  ■  i  ■ 

^^t^|;c  t^ats.  'But  in  j\ Vase. I  WaV  closely  associated  wi^>  /" 
JLt  ^(^  court.  tpv&e  allowed  to  see  a  test  that:  was 

: disputed;  \and  even  theon-the.  coturt^agreed  tOK^a  test  company's 
yiijiulaUon  that.  H^*' only  be  allowed  to  ^^i«w  ^  l:ests  for  ' '  -  *  • 
.iSL.litmiied  amount' of  time.'   No  notea  c6uld  be  taken.  * 


"ft. 


^4. 


tihat  wore^p^eiitiy  *faistf.^^  painted  out  to  the  test i^  . 

cpWpany  that  th^ir ,  numbers  could  not  hsve  been  right,  because      *  . 
^7  of . arithmetic  errors  thioy  cUimed  the  problem  Was  juii.  a  matte|^ 
;  of  "typos**  and  immedi>tely  retracted  the  dhth  of fered  as  evidence 
for  their  dase«  .  .1...  ♦  *  > 

The  truth  Is  that  eivery  aspect  of  this  law  is  doable^  practical 
^necessary  and  overdue.    But  these  clever. and  professional 
inarketing' experts  will  try  to.  confuse  and' impress  you  with 
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AcOiihts  of  test* development  costs,  complications  and  technlcalitled. 

These  ploys  are  aimed  a*t  presuading.  you  that  disaster  for  their 

clients  will  occur    if.  they  are  forced  to  be  accountable.  The* 

^  ■  .  ..        .  >» 

red  herrings  of  higher  costis,  demise  of  validity,  enforcemiant 

problems,  or  others^put  before  you  by  the  law's  detractors, 

•are  smoke  screens  for  the  peal  issues  of  openness  and  accountability. 

, .  •■■-,v  • 

V.     THE  VAlDe  op  multiple-choice  testing  ^  ^ 

•  i        ■        '  ;  . 

Admissions  aptitude  tests  are  unfair  because      '       .  , 
they  reduce  personal  covpetence  to  memory  for 
*facts»  esoteric  aaalysis  or  test-taking  skills. 
■  ,     \  Other  coqpet^ncies  critical  to  work  and  life  .ate 

*.     not  assessed.    These  tests  are  unfair  because  they 
contain  measurement  error  and  beteu^e    this  very 
* ^      fact; id  frequently^ of  no  consequence  to  test 

use^.    These  teats  ai^e  social  sorting  methanl^s, 
'  unworthy,  tff  .  current  social  i^cience  and  social 

■         ■  valu'es..  .      *  '      '  * . 

What  about  mulipl©jtf;hoice  tests?    How  good  are  they?  It 
is  ironic  that  the  veryT-nstrument  of  promise  for  fair  (or  ,  . 
equitable)  and  competince-based  allocation  of  opportunilfieB 
for  education  should  now  ,cofae  under  attack,  but  the  truth  Is 
that  we  social  scientists  blew  it*    We  -reduced  personal  compe- 
tence to  trivial  test- taking  ^11 Is  because  that  was  the  only 
practical  technology  we  had  available  to  us. 

As  a  result  few  if  any  of  standardized  testing's  promises 
have  been  achieved*    Rather  we  have  created  a  multimillion 
dollar  industry. that  must  perpetuate  the  technology  of  multiple- 
choice  te^ts," 

More  valid  arid  less  discriminatory  technology  is  available. 
■  It  simply  is  not  being  used.    The  .  testing  conJpanies  are  locked 
*into  their  old  techniques.    Rather  than  inform  the  public  about . 
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7niW  tiM^^olo^.and  p*r0uad#  the  pabllo  to  mak^  use  of  iti  . 
thiiy  continue  to  aelX  cheap  teeti  tihat  assesa  few  variables 
ol  con««quenc««  and  they         ^want:  us  to  believe  that  this  is 
%ll  (or  th*  best)  that  is  availably  ^nd  that  it  is  .sufficient* 
Mfithw  ie  true.  .  . 

•* 

V    .  Hultiple^choice  tests  are  not  fi^lr  because  they  contain 
lar^e  inea^urententjerror  (as  much  as  60  points  on  some  tests) 
Thus  numerous  people  are  excluded  from 'opportunities  by 
melsurement  error #  often  in  their  one  sh^t  ^t  opportunity. 

Multiple'-choioe  aptitu<|6  tests  are  unfair  because  they  * 
fail  to  asseps  the  more  critical  aspects  of  competence  that 
dttermine  how  ^ffiective  s tridents  could;  be  as  workers  and 
productive  citizens*    This  means  that  we  are  not  selecting 
p#o|^le  into  education  and  work  based  on  individuals^  potential 
iojp  competence  on* the  job*    Rather  we  allocate  education^  work 
and  lif e  oppor.tunitieil  solely  on  the  basis  of  some  stripped^ 
down  version  of  lnt«illignece  —  such  as  memory  for  facts  or 
test-^taking  ability.  .  ^ 

>.     » .    •  .  ■  •»  ■  ■  •  ■ 

.  ^  ■    ■  . 

The  ability  to  perform  for  a  mattier  of  minutes  limited  .  .  . 

intellectual  skills  of  recognition,,  recall  or  esoteric  analysis 
ijpan  absurd  way  of  .allocating  opportunities  of  life-long  importance* 
*It  is  neither /scientificaly  nor  morally  defensible -to^ generalize 
froi»  one  single  and  simpllstie  test  procedure  to  CQmpl  ex /learnings 
Working  and  l^ing  experiences. 

.  Decisions  can  belbased  on  more  than  these  limited  measures 
o£*p*ople?s  overall  competence  in  life*    But  they^woh*t 
bSpSo  long  as  We  continue  to  believe  in  the  myth  of  multiple-* 
choice  apti^tude.  tests /  and  we  will  continue  to  believe  in  ^ 
them  as  long  as  we  are  not  provided  more  informa^tion  about 
th*m.  .    ■  .N- 

'    *  . 

^  .    ■  •    r-ll-     ■  ■  ■  .  ■ 

■r      .  •      .        ■         ■  ■  ■  ■ 


488       .    ^    .  * 

*    '  '  ;\.  ■ 

The  tests  are  unfair  because  thej  ane  sometlihea  /. 

'  invalid  for  predicting     academic  competence.    One  test 
expert  from  a  major  .«iptitude  Resting  compafty  recently 
told  me  that  he  wanted  tduf^^^^^ome  schools  about  the  '. 
validity  (for  them)  of  a  college'  aptitude  test..  The 
validity  was^  so  low  for  some  schools  that  it  was  essentially, 
meaningless.  ,  But  he  feared  for  his  job  if  he.  told,  the 
truth;    his  company  might  lose  the  school's  business.  This 
anecdote  reveals  the"  motivation  of  the  testing  companies 
to  sell  their  products  regairdless  of  their  real  value;  it 
also  reveals  the  lack  of  information  available  to  the  schools 

■  to  make  their  pwn  determination  of  the  value  of  the  tests  for 
themselves*  „ 

Test  companieis  advise  admissions  officers 'not  to 
rely  exclusively  on  test  scores',  but  theyolso  promote 
test  score  vaiidity,  Admissions  officers  often  do  not  * 
seriously  question  test  validity.    Or  they  use  tests  as 
convenient  decision-making  devices  regardless  of  tjie  validity, 
i.e.,  they  accept  the  utility  of  the  tests  without  under- 
standing t^em.    Accurate  data  and  information  about  the  mean- 
ing of  these-test  scores  is  so  hard  to  obtain  €hat  practically 
speaking  learning  abdut.  the  true  value  pf  testa  is  not 
warthi  the  effort  for  most  test  users.. 

We.ar^  enchanted  with  thede  aptitude  measures  and  the 
mystery  surrounding  them  as  we  were  some  years  ago  by 
IQ  tests.    Indeed  we  can  trace  the  origins  of  our  widely 
iembraced  use  of  multiple-choice  aptitude  tests  to  coriditipns 
surrounding  the  advent  qf  IQ  tests, 

*  ■  ■ 

IQ  tests  became  popular  because  .l^hey  served  a  need  to 
classify  people  not  because  theV  were  scientifically  sound.  ' 
The  inappropriateness  —  even  the  immorAlity  —  of  using  /./ 
IQ  tests  to  track  and  sort  children  is  now  widely  recog-  ,.■)/ 
liized  and  accepted..  •  ^/.^ 

■'    '  '     ■  ■       -12-    ■  .  '  ■ 
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|So  why  are. W«' 10  enameled  with  aptitude  testa?  Because 
theykoo  are  convenient  sorting  tools.    But  the  teftt 
develbpert  must  fight  againit  our  realizing  the  similarities 
between  aptitude  tests  and  otKer 'measures  which  many 
educators  and  businesspebp^  have  Alrea^  discarded  as 
uselells  or  harmful.  * 

C|ily  recej^ly  hap  there  been  widespread  attention  to 
the  inherent  discrinflnatory  effects  of  these  tests,  which 
reflect' and  perpetuate  the  social  philosophies  of  the 
dominant  social  groups  that  design  them.  ^ 

CiJrreht  testing  practices  muslJ  be'^valaated  in  light 
of  bo th| practical  classif icifcion  needs  and  our  philosophical 
belief sllabout  ^ocial  contracts  ari^J  human  digjj^ty.  Our 
social  |alues  have  changed,    Status  in  our  society  is  ' 
.changind|  from. b^ing  based  on  intelligence  tests  or  academic 
achievenfcnt  tt  being  based  on  demonstrated  competence. 
Our  testji  simply  do  npt  measure  up  to  this  change  in  our 
values  a 
tests  in 


d  perspectives.-  We  have  jgut  the  old  wine  of  IQ 
o  new  bottled  and  found  it  erringly  more  tasteful. 


VJ.  SUM 

.In 
With  res 
determin 
few  iimi 
problems, 
more  end ur 
good  citizi  Qs 


hort^  our  society's  covenants  with  its  citizens 
lecf  to  opportunities  tot  education  and  work  are 

unfairly  «nd  without  merit  6n  the  basis  of  a 
|d  and  irrelevant  abilities  to  solve  trj<vial. 
Thestf  abilities  bear  little  relationship  to  the 
ng  qualities  or  characteristice  of  productive  and 


We  mui  t  learn  if  teste  •are  contributiing  to  the  loss 
of  ou^  ability  to  think,  analyze,  understand^  and  write 
because  edt  cation  stoops  to  cheap  but  convenient  disguises  . 
for  luiowle^Qje  and  competence.  We  must,  know  ilf"  we  are^  deojefeasing 
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the  intellectual  nourishment  of  our  youth  by  eecivoing  them  > 
Into  memorizing- facts  or  uBin^  phony  *nalytioal  skills  on  , 
trivial  multiple-choice  pj^oblems  so  t^ey.  can  ^qualify  for  , 
^education  and  work  opportunities.*^ 
•  .  f 

■  N         •    Tesing  processes,  need  to  Sk  opened' to  public  scrutiny, 
■       understanding  and  evaluation.    Trutb-in^Tfesting  legislation  .  ^ 

is  urgently  ^«leded.    Its  requirementa  are  doable.  Its 
cesulfis  will  be  enlightenment,  more'iequity  and  attention  to  . 
competence  in  allocating  education  .ind  wbrk  opportgnities; 
and  .(yes)  even  better  tests.  '  /   •  ' 

.  ^^we  should  not  allow  ETS  and  dtber  members  of  education's 

■  mafia  to  control  our  access  to  needfed  Information.  We  need  « 
sunshine  and  openness  in  testing,  k  sincerely  hope- a  strong 
testing  bill  will  be  passed  by  confess.       ,  ' 

•  ■  ■  ■'■    ■■■    ^.  -^ 

Chairman  PERKms.  Tliank  ypu  for  excellent  tiMtiipony. 

are  going  to  revert  to  the  -first  witness.  It^ would  be  my  hope 
that  the  members  would  take  dibout  7  or  8  n^nutiM  and  pej^iaps 
that  will  give  you  time  to  ask  ifeach  witness  a  {Question,  whfen  we 
come  back  to  the  second  go-ardiiiid  you  can  run  15  or  20  minutes. 
None  of  the  mmtibers  will  be  cu^  9hort. 

Mrs,  Sparling,  how  would  you  ^uiswer  the  criticism  of  the  Weiss 
bill  that  it  w^d  lead  to  an  undue  burden  oh  the  testing  industry 
and  increase  tosts  to  students  since  p|  test  could  only  be  used  once 
before  it  was  made  public?  ! 

Mrs.  Sparung.  Mr.  Chairman,  wp  haye  discussed  this  morning 
the  number  of  questions  in  the  test  ^nk  so  wie  would  have  to  have 
more  information  as  to  how  the' bill  is  related  to  public  disclosure. 
We  would  need  information  tp  determine  that  (question.  We  are 
primarily  interested  in /how  Jthese  tests  are  goiy  to  affect  our 
young  people.    /  i    .  ^    f  . 

Chairman  PfeRKiNS.  Now,  Dr.  Rever,  how  do  you  answer  the 
criticism  that  the  testing  iijdustry,  which  is  so  important  to  the 
future  job  prospects  of  8tt^6nt8,  is  "baslcetlly  an  Unregulated  indus- 
try not  accountable  to  the  public?  '  ^ 
'  Dr.  Rbvbr.  Mr.  Chairmln,  /the  test  industry^  as  you  have  wit- 
nessed here  before  you  Mve  iiwo'  segments  in  general.  They  have 
the  foM)rofit  "segment  ir&ul^ited  by  existing  law  both  State  and 
loc^d.  The  nonprofit  seqt^  wmich  I  represent,  which  is  represented 
by  thfr  Educational  .Testmg  j3emce,  is  to  some  degree-regulated  by 
the  Code  of  the  Ititernalf  Revenue  Service.       -  ,  •  „»  .  , 

But  with  regard?  to  s^  as  reflected  in  Mr.  Weiss  ' 

bill,  we  flnd  that  the Jdhds^^of  issues  thrft  are  being  Addressed  in 
this  bill  are  addressed  b|^  the  colleges  and  the  universities  that 
provide  elected  representatives  for  our  governance.  In  fact,*  we  are 
accountable  t<^  elective  rtiprefieht&tives  of  the  higher  education  and 
the  secondary  education  ^'ft^to  in  this  d6untry.  They  are  the  ones 
that  make  BU)^  ^at  we  can  *tate  tovyou  ISpjBciflcally  that  we  see  no 
need  for  this  kind  of  loddlation.  ,     ,  V 

Chairman  PKHipw.  Dr.  Perrone,  how  would  you  answer  the  criti- 
cism    the  Weiss  bill  rals^  by  the  Medii^al  and  ppntalTAssoci- 
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•  •  •  ■     .      *  .  >    '  * 

'  ations  that  there  is  not  an  adequate  pool  of  questions  for  ^  them  to 
formulate  a  new  t^t  every  year  or  several  times  9  year  since  they 
would  have  to  make  public  any  test  after  it  is  given?  V 

Dr.  Perronb.  I  think  I  tried  to  argue  already,  Mr.  Chairman, 
'  that  the  4tem  pool  is  very,  very  large.  There^  is  absolutely  no 
'  evidence  that  I  am  aware  of,  that  the  MCAT  or  the  examinations 
used  for  that  process  deal  with  a  limited  base  of  information.  In 
fact,  the  MCAT  has  a  very  l^ge  section  that  talks  about  problem- 
solving  skills  and  the  lik^  It  is  almost  infinite  in  the  terms  of  the, 
numbers  of  questions  th^  could  \f(d  devised  to  respond  to  that, 

I  think  it  might  also  be  interesting^  for  the  committee  to  note| 
that  in  regard  to  the  MCAT  what  little  mt  of  research  there  has 
been  and  correlations  between  the  l^CA'Tand  success  in  medical 
school  and  success  later,  the  Weitigard-Williams  research  that  cov- 
ers a  period  of  about  10  years  indicates*  that  the  MQAT  does  not 
correlate  effectively  at  all  with  college  grades  and  medical  pchool, 
success  in  ^medical  school  or  in  clinical  study  or  with  succera  as  a 
practitioner.  } 

Chairman  Perkins.  Let  me  ask  Dr..  Snydqr  a  question. 

Doietor,  r^arding  occupational  testing,  do  you  believe  adequate 
.  safeguards  now  exjust  to  assure  that  test;takers  are  fairW>  treated? 
Congressman  Gibbons  &om  Florida  does  not  believ^uch  safe- 
guards now  exist. 

What  is  your  answer?       ,      ~     *  ^ 

Dr.  Snyder.  Yes,  I  do.  I  believe  that  prior  legislation,  especially 
around  the  Equal  Opportimity  Act,  adequately  set  a  standard  and 
a  stage  for  demanding  that  validity  evidence  be  available  for  any 
anticipated  tests  use.  I  beUeve  that  is  adequate  and  built  into  the 
disclosure  provisions  and  the  necessity  W  preserving  the  privacy  of 
individuals- being  tested  is  also  adequately  covered  by  the  other 
Privacy  Act.  •  . 

,      y  ^   .  CONTROU  OF  TESTING  INDUSTRY 

■  ■  ■ 

Mi^  Millenson.  May  I  comment  on  a  previous  question? 
Chairman  IPerkins.  Yes.         "  ' '   ^  '  ■ 
Mr.  Millenson.  I  woul<j[  like  to  comment  on  the  question  posed  , 
with  respect  to  control  of  the  testing  industry.  Except  for  collegfi^: 
entiy  testing,  tl^e  greatest  pjari^  of  the  industry's  tests  are  sold  to 
local  and  State  educational  agencies  and  bodies.  Therefore,  we  are 
dealing  with  local  arid  State  governmients.  If  there  is  to  be  any 
control  over  the  testing  industry^  then  it  wotild  have  to  be  at  the 
~   Federal  level  with  respoct  to  purchases  which  are  mbde  by  local 
and  State  governments  >yhich  I  thiiiik  ;:raises  some  very  serious 
questions  with  respect  to  the  Federal  controls  of  education,  let 
^    alone  with  respect  to  the  adequacy  of  the  U.S.  Office  of  Education  * 
controlling  such  an  item. 
Chairman  Perkins.  'HiaAk  you  verV  nuich.  .  / 

Now,  Dr.  ^Pottihger,  if  1  unders^;oi()d  you  correfctly,  vou  stated  you 
were  an  expert.  Since  your  center  stucues  all  the^professions,  let  me'* 
y  ask  you  about  a  criticism,  of  both  bills.  ^  *     ' ' 

'   Do  you  believe  thc^t  tH^d  problems  asserted  about  tfljj^ing  are 
\  grave  enough  to  have  the  Federal  Oovern}Aent  cpme  in^d  pre-, 
^mpt  the  States  in  this  area?  '  \ 

^  .    ■     •       *  ■  ' .  ■ "      •  ' 


.  Dr.  PoTTiNGER.  Yes,  Mr.  Chairman,  I  do.  I  think  in  fact  in 
response*  to  a  remark  just  made  by  Dr.  Snyder,  that  EEOC  is 
adequate  protection  for  the  occupations,  we  find  in  fact  that  the 
testers  argue  that  EEOC  does  not  apply  to  certification  and  licens- 
ing tests.  In  fact,  it  has  not  byeen  t^ted  in  the  courts.  The  testing 
companies  t^U  us  th^  will  proceed  without  abiding  by  EEOC 
guidelines  until  there  is  a  test  case  m  the  courts  and  I  believe  that 
thart  attitude  by  the  testing  companies  that  they  will  do  the  mini- 
miim  neicessary  until  forced  by  the  courts  to  do  more,  reflects'in 
my  opinion  the  need  to  adequately  oblige  them  with  the  kind  of 
enforcement  procedure  re'Quired  to  make  tests  accountable. 

Chairman  Perkins.  Mr.  G'oodling. 

Mr.  Goodling!  Thank  yoiu  Mr,  Chairman.  '  ■  ' 

I  have  several  objections  out  perhaps  most  of  my  questions  will 
wait  for  the  second  round. 

First  of  all,  my  rn^or  concern  about  tRis  whole  legi^lat^ioh  puts 
me  in  an  awkward  position.  As  a  counselor,  principal,  superintend- 
ent, and  supervisory  teachdr  for  23  .^eSrsf  I  was  always  very  con- 
cerned about  the  relationship  of  how  much  standardized  testing  w^ 
did  and  what  the  results  were  used  for. 

I  want  to  make  very^  sure  we  don't  go  off  half  qocked.  I  think 
when  there  is  an  emergency  and  wq  pass  some  legislatijon^  and 
between  the  legislation  and  th^  regulations  we  don't  help  the  peo- 
ple that  we  were  trying  to  help,  perhaps  we  can  be  forgiven. 

When  there  is  no  emergency,  as  is  true  in  this  case,  then  we 
leertaihly  could  not  be  forgiven  if  in  fact  we  just  end  up  doing 
opposite  of  what  we  thought  we  were  going  to  b^  doing  in  the  first 
place.  .        ,^  '  V, 

For  instance,  when  we  had  the.  sponsors  of  the  legislation  testify 
before  the  subcommittee,  the  response  that  I  got  I  think  from  the* 
one  gentleman  sponsoring  one  of  the,  bills  was  its  purpose  was 
.pretty  much  centered  around  whether  somebne  did  or  did  not  get 
into  a  law  school. 

In  the  second  piece  of  legislation  it  appeared  that  the  msgor 
concern  dealt  with— and  I  am  not  sure  this  is  corrfect— helping 
young  people  who  are  disadvantaged.  Because  they  are  disadvan-' 
taged,  they  don't  have  the  money  for  tutoring*,  et  cetera. 

It  certainly  seems  to  me,  if  we  are  ever  going  to  liurt  those 
^disadvantaged  individuals,  we  will  hurt  them  with  this  legislation. 
We'll  create  the  kind  of  opportunity  for  private  groups  to  get  in  the 
business  of  titling  more  than  they  are  todav  unless  there  is  a 
companion  bil^hvhich  will  ptovide  Federal  funds  to  make  sure  that 
all  have  an  equal  opportunity  to  be  tutored^  in  order  to  take  the 
tests. 

So  I  Have  sqme  real  concerts' about  that/ 1  don't  know  if  you  saw 
the  editorial  this  morning  in  the  Post,  but  I  thought  Mr.  William 
Raspberry,  who  is  certainly  a  noted  columnist  for  the  Post,  makes 
several  good  objections*.  ^  , 

I  will  just  mei)tion  three  quotes*  . 

One  biUi  introdtkced  by  Rep.  SjGUY>  Gibbons  (D.-Fla.)  is  legifllative  cotton  Candy,  it 
looks  good^ardd  tastes  good,  but  ft  is 'mostly  air.  Its  provisions  *fell  ipto  two  main 
categorlea*  the  unnecessary  and  the  impossible.. 

A  second  quote:  y 


if  tbe  Gibbons  bULik  cotton  candy,  the  other  propo6al--introduoed  Reps.  Ted 
Wei88  a).-N.Y.),  Shirley  Chisholm  (D.-N.Y.)  and  George.Miller  (D.-Calif.)-^i8  legislar 
tive  horehound:  strong;  bitter  stuff  that  ctoesn't  cuYe  anything.  ^, 

Getting  to  a  point  in  part  of  theUestimony,  and  I  quote: 

.  But  since  publication  of  any  particqlai  tests  would  lead  to  its  immediate  retire- 
ment! the  corrected  exams  would  be  helpfd  only  in  the  same  generalized  way  as  the! 
test  study  guides  airead^^  available.  ' 

» Indeed,  as  Diane  Ravitch  of  Teachers  Coll^e^  Columbia  University^  has  pointed  . 
out,  the  mejor  benefit  of  test-answer  publication  would  accrue  not  to  those  who  fail 
the  tests  but  to  those  who  sell  test-taking  assistance.  'It  will  create  a dbonanza  for. 
private  tutoring  services,  which  wo^ld  have  actual  tests  as  teaching  tobls,  not  just 
their  own  inventions,"  she  sdd.  ''This.will  increase  the  advantage  orthose  who  can 
afford  to  pay  for  coaching."  '  , 

So  I  want  to  make  sure  as  we  go  through  i;hi8  that^e  don^t  jtimp 
off  the  deep  end  rapidly  and  end  up  hurtit^  the  very  people  we  are 
trying  to  help.  It  seems  to  me  in  the  last  couple  years  every  time 
we  take  a  potshot  at  education'^  refu^^to  consider  some  of  the 
feal  problems.  iVe  refuse  to  consider  the  deterioration,  of  ifamily 
life/  €he  inirability  at  home»  the  competition  for  students'  time.  I 
iust  watcheo^twO  teenagers  grow  up.  They  would  have  needed  48 
^ours  to  do  all  of 4he  things  that  are  expected  of  them  to  dcr'in 
school  and  home  and  in  the  commuitity  andiK^  forth.  We  refuse  to 
accept  the  fact  th^t  in  the  last  15  years  we  haye  educated  ail 
students  which  is  totally  different  than  what  it  had  been  prior  to 
that.  i  • 

First  of  {dl,  if  I  have  a  fcp  minutes  left,  1  think  I  noticedJn  your 
testimony,  Mrs.  Sparlvig,  you  had  a  real  concern  about  teachers 
teaching  for  the  tests.  Do  you  not  feel  that  publishing  these  testis 
and  the  results  and  answers  isn^t  going  to  make  that  more  likely 
than  it  precienUv  is,  and  Lord  knows  it  is  being  done  now?  Teachers 
feel  insecure.  They  want  to  make' sure  when  you  stick  a  standard- 
ized.test  in  front  of  them  their  youngsters  do  well< 

Mrs.  Sparukq.  With  this  particular  bill  there  will  be  more  infor- 
mation of  the^  purposes  and  uses  of  the  ftest  so  thdt  the  results  of 
tbe  tests  were  known  to  the  students  and  parents  then^it  could  be 
Used  in  a  diagnostic  manner  so  that  the  education  of  that  particu- 
lar student  would  be  enhanced  by  this  kind  of  knWledg 

Then  it  would  also  give  the  teacher  the  opportunity  to  take  an 
overall  look  at  the  needs  of  that  student,  so  that  a  better  curricu- 
lum could  be  devised.  -  /  \ 
/  Mr.  GooDLiNQ.  Do  you  not  find  a  trend  in  this  coumnr  that  these 
standardized  tests  are  being  used  more  diagtiosticallv  than  ahyting 
else  at  the  present  time  otiier  than  in  some  select  schools— perhaps 
the  top  10  or  12?  ^  ^  / 
:  V  Mrs.  Sparung.  This  particular  bill  will  b^  oneythat  will  give  us 
this  kind  of  information  and  then  they  certainly  ycan  be  used  to  b(B 
miore  diaghoetic.             :     '        ^  / 

Mr.  GooDUNG.  Do  they  not  already  have  that  Opportunity? 

'Mrs.  Sparung.  But  the  parentis  and  the  students  do  not  have  the 
opportunity  to  see  the  result(»other  thamthe  raw  scores. 

Mr.  OooDUNG.  \  8ee.,1iiiB  l^islation  icr|^oing  to  pu^  the  family 
unit  back  togetfier  and  make  parents  become  more  mvolved  in  the 
education  of  their  children.  0  ^  . 

Mrs.  Sparung.  Parent9  are  very  interested  in  being  involved  in 
the.  decisions  that  affect  the  lives  of  their  children  and  certainly 
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where  education  is  concerned  they  are  very  concerned  with  the 
issue  of  testing.         .  * 

Chairman  Perkins.  Mr.  Weiss. 

Mr.  Weiss.  Thank  you  veryjrfauch. 

Jtist  so  that  there  is  some  balance  of  newspaper  reporting— and 
this  is  not  by  way  of  editorializing— some  questions  have  been 
raised  as  to  the  coaching  schools,  and  the  New  York  Times,  in 
testing  an  education  wnter,  had.  a  feature  story.  Let  me  just  read 
rie  aspect  of  it.  The  Nation's  largest  test  preparation  school  has 
ranchesnn  88  cities.  Then  it  goes  on  to  quote  about  other  schools. 
They  were  not  talking  about  just  a  random  situation  of  the  testiijg 
phenomenon  being  used  by  profitmaking  ventures  to  ihe  value  of 
those  who  could  afford  the  schools  and  to  the  disadvai^ge  of  tWase. 
who  can't.  ^.  -  1L 

Dr.  Perrone,  .first  let  me  reemphasize  ^the  disclaimel|you  make 
that  vour  statement  is  not  to' be  viewed  as  an  officiar  position  of 
the  University  of  North  Dakota,  the  North  Dakota  Study  Group  or 
the  National  Consortium  on  Testing.  I  appreciate  and  recognize 
that. 

I  do  want  to  ask:  You  are  the  president  of  the  National'  Consor- 
tium of  Testing;  is  that  correct? 
Dr.  Perrone.  That  is  correct.    #  - 

Mr!  Weiss.  We  haye  some  inoication  as  to  tlie*validity  and  stand- 
ing of  that  group.  I  will  ask  permission  to  have  entered  into  the 
record  a  list  of  members  of  the  National  Consortium  of  Testing  as 
of  \June  1  of  1979. 

Giairman  Perkins.  Without  objection. . 

[The  inforfnation  referred  to  above  follows:] 

National  Consortium  on  Testing— List  of  Members 
'  '  ^  %  ,  June  1,  1979 

1.  American  Association  of  Physics  Teachers,  Graduate  Physics  Building,  SUNY  at 
Stony  Brook,  NY  11794,  (516)  246-6840.  Designated  RepresentaUve:  Edwiii  F. 
Taylor,  86  Oxford  Road,  Newton^  Center,  MA  02159. 

'2.  American  Association  of  School  Administrators,  1801  North  Moore  Street,  Arling- 
ton, VA  22209,  (703)  528-0700.  Desimated  JElepresentative:  William  G.  Spady. 

2,  American  College  Testing  Program,  P.O.  Box  168,  Iowa  City,  Iowa  52240,  (319) 
356-3845.  Designated  Representative:  Philip  R.  Rev^r,  ACT  Washington  Office, 

,    One  Dupont  Uircle,  N.W.,  Suite  340,  Washington,  D.C.  20036,  (202)  223-2318. . 
4.  American  Educational  Research  Assdciation,  1230  17th  Street,  N.W.,  Washington, 
D.C.  20036,  (202)  223^9485.  Designated  Representative:  Peter  W.  Airasian,  School 
of  Education,  600  McGuinn,  Bostcm  College,  Chestnut  Hill,  MA  02167,  (617)  969- 
0100. 

,5.  American  Federation  of  Teacher8,Ml  DUpbnt  Circle,  N.W.,  Washington,  D.C; 
20036,  (202)  797-4400.  Designated  Representative:  Eugenia  Kemble. 

6.  American  Psycholckdcal  Association,  Office  of  Scientific  Affairs,  1200  17th  Street, 
N.W.,  Washington,  D.C.  20036,  (202)  883-7600.  Designated  Representative:  Richai'd 
EvSnow,  School  of  Education,  Stanford  UniversitVrStanford,  CA  94305. 

7.  American  School  Counsellor  Asisoclatidn»  1412  North  18th  Street,  Boise,  Idaho 
83702,  (208)  345-6722.  Designated  Repreeentative:  Helen  R.  Washburn. 

8.  Association  of  American  Medical  Colleges.  Division  of  Educational  %feasurement 
and  Research,  One  Dupont  Circle,  N.W.,  Suite  200,  Washington,  D.C.  20036,  (202) 
466-6100.  Designated  Representative:  Robert  L.  Reran. 

9.  Association  for  Childhood  Education  International,'  3616  Wisconsin  Avenue, 
N.W.,  Washington,. D.C.  20016,  .(202)  363-6963.  Designated  Representative:  ElVie 
LouLuetge.  A  - 

■   #  .      ■ ,         ■ '  ■         ■  •    '     ■  ■ 

*  Designates  members  of  the  Board  of  Directors.  ^ 


10.  Association  for  Measurement  and  Evaluation  in  Guidance,  Department  of  Meas- 
.  lirement  and  Statistics,  Collie  of  Education,  University  of  Maryland,  College 

Park,  MD  20742.  Designated  Representative:  William  D.  ScHafer. 

11.  Association  for  Non*White  Concerns  in  Personnel  and  Guidance,  c/o  William  E. 
Gardner,  President,  Chairman,  Dept.  of  Education,  Lincoln  l/niyerslty,  Lincoln 
University.  PA  19362,  (215)  932-8800.  Dteigiiat^  Representative:  Mildred  R. 
Back,  10315  CotbeU,  Apt.  A,  St.  Louis,  MO  68141.  *  .  ^ 

12.  Association  for  Supervision  and  Curriculum  Development,  225  No.  Washington 
St.  Alexandria,  Va.  22814,  (703)  549-9110.  Designated  Representative:  Ruth  Long. 

13.  Center  for  Applied -Linguistics,  1611  North  Kent  Street,  Arlington,  VA  22209, 
(703)  5i28-4312.  Designated  Representative;  Roger  Shuy. 

14.  Chicanp  Education  Project,  1444  Stuart  Street,  Denver,  CO  80204,  (303)  825-7864. 
Designated  Representative:  Bill  RoBser. 

15.  Child  Welfare  League  of  America,  Inc.,  1846  Connecticut  Avenue,  N.W.,  No.  310, 
Washington,  D.Cy  20036,  (202)  83B-28&0.  Designated  Representative:  William  L. 
Pierce.  \ 

16.  The  College  Board,  888  Seventh  Avenue,  New  York,  NY  10019,  (21^  582-6210. 
Designated  Representative:  Stephen  H.  Iven9.  ' 

17.  Community  Resources  Institute,  670  West  End  Avenue,  No.  12F,  New  York,  NY 
10025,  (212)  596-0295.  Designated  Representative:  Ann  Cook. 

18.  Council  for  American  Private^Education,  1626  IBye  Street,  N.W.,  Washington, 
D.C.  20006,  (202)  659-3286.  Designated  Representative:  Robert  Lambom. 

19.  Council  for  Educational  Diagnostic  Services,  c/o  Louise  Appell,  National  Com- 
mittee, Arts  for  the  flandicapped^  1701  K  Street,  N.W.,  Suite  801,  Washington, 
D.C.  20006,  (202)  2^-8007.  ^  ] 

20.  Council  for  Exceptional  Children/  1920  Association^ Drive,  Reston,  VA  22091, 
(70^620-8660.  Desiignated  Representative:*       N.  Nbzzaro. 

21.  Division  for  Study  and  Research  in  Education,  Massachusetts  Institute  of  Tech- 
nology (MTD,  Cambridge,  MA  02139,  (617)  258-2050:  Designated  Representative: 
Judah  L.  Schwartz.     *  4  ' 

22.  Education  Conunission  of  the  States,'  1860  LhiccHn  Street,  Suite  300,  Denver,  CO 
80295,  (303)  861-4917.  Designated  Representative:  Homer  Ekero^d. 

23.  Education  Development  Center,'  55  Chapel  Street  Newton,  MA  02160,  (617)  696- 
7100.  Designated  Repreisentative:  Jerrpld  R.  Zachams. 

24.  Educational  Records  Bureau,  2  Sun  Life  Execittive  Park,  100  Worcester  St., 
Wellesley  Hills,  MA  02181,  (617)  236-8920.  Designated  Representative:  R.  Bruce 
McOUL      '  ^ 

25.  Educational  Testing  Service,  Princeton,  NJ  088^0,  (609)  921-900(f.  Designated 
Representative;  Alice  iJ.  Irby,  ETS,  11  Dupont  Circle,  N.W.,  Washington,  D.C. 
20086,(202)4^5110.  *  /  , 

26.  International  Reading  Association,  8000  Barksdale  Road,  Newark,  ,DE  19711, 
(802)  781-1600.  Designated  Representative:  Roger  Farr,  Indiatta  University,  Educa- 
tion Building,  Room  227,  Btooiqinffton,  IN  47401,  (812)  837-1440. 

27.  National  Association  for  the  Advancement  of  Colored  People,'  1790  Broadway, 
New  York,  NY  10019,  (212)^  245-2100.  Designated  Representative:  Althea  J.  L. 
Simmons.   . 

28.  National  Association  for  the  Education  of  Young  Children,  1884  Connecticut 
Avenue,  N.W.,  Washmgton,  D.C.  20009,  (202)  282-8777.  Designated  Representative: 
Marilyn  M;  Smith: 

29.  National  Association  of  Elementary  School  PrUicipals,>  1801  Nbrth  Moore  Street, 
Arlingt9n,  VA  22209,  (708)  328-6000.  Designated  Representative:  Paul  L.  Honts. 

30.  Ndtiona)  Association  of  Independent  Schools,  4  Liberty  Square,  Boston,  MA 
02109,  (617)  642-1988.  Designated  Representatives  Wellington  V.  Grimes. 

31.  National  Association  ro£  School  Psychologists,  c/o 'Ann  Engin,  President,  8781 
CriiiweU  Drive,  Columbus,  OH  48220,  (614)  422-8787  (office  telephone).  I 

82.  National  Center  for  the  Study  of  ProfeMions^l527  New  Hampshire  Avenue  ^ 
N.W.,  Washington,  D.C.  .20036,  (202)  282-2204.  Designated  Representative:  Pai)l  S 
Pottinger.  *  li 
33.  National  (Congress  of  Parents  and  Teachers,  700  N.  Rulh  Street,  Chi( 
606U,  (812)  787-0977.  Designated  Representative:  Ann  Kain,  9202  Ponce 
^    Fairfax,  VA  22080.  (708)  591-4689. 

84.  National  Council  of  Teachers  of  English,  1111  Kenyon 

(217)  828-8870.  Designated  Representatiye:  John  C.  Maxwj^^^ 
36.  NationM  Cpuncil  on  Meeiurement  in  Education,  108  Iniycott  Street,  Fayette- 
"       J!l|yi3066  (home),  (816)  423-8024  (office).  Designated  Representative:  Eric  F. 
Infer.    .  :  ■  '    .  I   *  .  • 
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36.  National  Education  Association,  1201  Sixteenth  Street,  N.W.,  Washington,  D.C. 
20036,  (202)  833-4000;  Designated  Representative:  Frances  S/Quinto. 

37.  National  Employment  Counselors  Association,  r/o  Derortment  of  Commerce, 
llmployment  Security  Division,  303  Caldwell  BuildVlg,  Tallahassee,  Florida  32304, 
(904)  488-6005.  Designated  Representative:  Richard  O^Mara. 

38.  National  School  Boards  Association,'  1055  Thomas  Jefferson  Street,  N.W.,  Wash- 
ington, D.C.  20007,  (202)  337-7666.  Designated  Representative:  Jannes  A.  Mecklen- 

4t  .  burger. 

39.  National  Science  Teachers  Association,  1742  Connecticut  Avenue,  N.W.,  Wash- 
ington, D.C.  20009,  (202)  265-4150.  Designated  Representative:  Phyllis  Marcuccio. 

40.  National  Vocational  Guidance  AssocratHon,  c/o  Daniel  Sipick,  griftident.  Profes- 
sor of  Eduqation,  Rehabilitation  Council  Education  Program,  George  Washington 
University,  Wa8hi9H|  D.C.  20052,  (202)  676-6376.  Designated  Repre^sjitative: 
Juliet  V.  Miller,  SlHRrneth  Drive,  Milan,  Michigan  48160. 

41.  New  York  Public  Interest  Research  Group,  5  Beekman  Street,  New  York,  NY 
-  9484/'   ~  "  -     .     ^  - 


10038,  (212)  349^4^0.  Designated  Representative:  Stephen  Solomon. 

42.  North  Dakota  Study  Group  on  Evaluation,'  Center  for  Teaching  and  Learning, 
University  of  NSrth  Dakota,  Box  8158,  Grand  Forks,  ND  58201,  (70U  777-2674. 
Designated  Representative:  Vito  Perrone.  •  ■  . 

43.  Public  Education  Association,  20  West  40th  Street,  New  York,  NY  y018,  (212) 
254-6100.  Designated  Representative:  David  Seeley.'  ^  W  ■ 

44.  Social  Policy  Institute,  33  Westr.42nd  Strfeet,  Room  1212.  New  York,  NY  10036,  

(212)  840-1258.  Designated  Repre^ntative:  Frank  Riessman. 

45.  Southeastern  Public  Education  Program,  American  Friends  Service  GpiDmjttee, 
401  Columbia  Building,  Columbia.  SC  29201,  (8Q3)  .252-0975.  Designated  Repr^ 
sentative:  M.  Hayes  Mizell.  .  j 

46.  Speech  Communication  Association,  State  University  College  at  Brockport, 
SUNY,  Brockport,'  New  York  14420.  Designiated  Representaflve:  Fred  E.  Jandt. 

47.  Teachers  of  English  to  Speakers  of  Othe^ 'Languages,  455  Nevils  Building,  •» 
Georgetown  University,  Washington,  D.C.  20057,  (202)  337^^7264.  Designated  Rep-  ^ 

.  resentative:  James  E.  Alatis.  •  . 

4^ Workshop  Center  for  Open  Education,'  Shephard  Hall,  Room  6,  City  Collegd> 
Advisory  Service,  Convent  Avenue  and  140th  Street,  New  York,  NY  10031,  (212)  ^ 
368-16.19.  Designated  Representative:  Lillian  Weber..  ,      ■  ^ 

■  ^  .      .  f 

.  CONSULTANT  TO  THE  BOARD 

Professor  Bariesh  Hoffman,  43-17  169th  Street/ Flushing,  NY  11358,  (212)  358-  • 
6231. 

Mr.  Weiss.  Again  Recognizing  that  not'  all  of  the  organizations 
that  are  members  gf  the  National  Consortium,  would  agree  with 
either  your  statement  or  with  the  proposed  legislation  which  I 
sponsor,  let  me  just  indicate  agkin  for  credibility  purposes  only  as 
to  your  credentials  and  thiat  of  tke  National  Consortium  itdelf,  that 
it  includes,  among  others,  the  American  Federation  of  Teachers, 
the  American  Psychological  Association,  the  Ahierican  College 
Testing  Program,  the  American  School  Counsellors  Associations, 
the  Ai^ociation  of  American  Medical  Colleges,  the  College  Board, 
the  Educational  Testing  Service  and  so  on. 

So  that  this  National  Consortium  of  Testing  is  a  v^y  highl|/ 
regarded  organization  in  its  field,  I  assume.  Is  that  correct? 

Dr.  PsRRONE.  It  is  made      of  a  large  number  of  orgarvizations 
interested  in  a  lot  of  tseues  that  this  legislation  dddressea. 

Mr.  Weiss*  Would  you  again  very  briefll^|Summarize  what  is  the 
work  of  the  National  Consortium?  1, 

Dr.  Perrone.  Tha  National  Consortium  on  Testing  has  as  its 
primary  purpose  to' increase '^public  understanding  of  testing  and 
tests  use  in  this  country,  to  bring  about  greater  understandmg  qf 
strengths  and  W^knesses  of  tests  as  they  exist  and  is  committed  tO  : 
assist  in  improving  the  quality  of  assessment  practices  that  go  ion 
in  our  society  in  schools  and  outside  of  schools. 

«  ■  :. 
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Mr.  Wriss.  Again  to  reemphasize^  your  position,  as  is  the  position 
of  the  sponsors  of  H.R.  4949,  is  not  tp  eliminate  tests  but  to  provi4e 
more-Hsupposing  you  state  what  your  position  is. 

Dr.  Perrone.  The  National  Consortium  obviously  would  not  be ' 
supportive  of  eliminating  the  use  of  tests  in  our  society.  Clearly  the 
aim  of  the  group  is  to  improve  the  quality  of  a^essment  practices 
that  exist  with  and  ^^toward  greater  fairness  and  equity  across  all 
segments  of  the  society." 

^  In  my  own  case,  I  am  personally  concerned  that  our  present 
testing  practices  do  not  give  support  to  a  broad  enough  range  of 
areas.  I  am  concerned  that  alternatives  to  the  current  technology  - 
have  not  yet  been  explored  fiilly  because  the  current  technology  * 
has  not  been  fully  exposed  to*  the  sunshine,  as  Paul  Pottinger, 
describes  it.  A  ^ 

I  am  certainly  not.  op]y)sed  ^to  standardized  testing  if  applied 
fairly.  "      /  ♦ 

Mr.  Weiss.  We  have  had  in  the  course  of  the  hearings  that  the 
subcomittee  has  held  some  indjication  as  to  how  available  informa- 
tion about  tests  is  gurren^Iy  and  that  this  l^^lation  really  is  not 
needed  because  anybody  who  wants  the  information,  particularly 
experts  in  the  fields  would  have  no  difficulty  in  getting^  all  the 
available  information.  y 

\  What  has  been  your  Qxperienee  as  to  the  c^ailability  of  informa- 
tion about  the  tests  from  the  various  testing  services? 

D^Perronb.  There  is  clearly  a  limitation;  not  only  a  limitation 
for  qi^ified  scholars  but  I  think  a  limitation  more  directly  for 
those  Who  must  take  those  tests  and  those  whose  lives  are  governed 
by  them.  \^  ^  ' 

I  tmnk  what  you  mi^ht  want' to  do  is  to  enter  into  the4*ecord 
\  also  Oscar  Buros'  valedictory  address  at  the  University  of  Iowa  in 
1972.  Oscar  Buros,  who  has  been  the  noted  chronicler  around, 
evaluator  tests  in  this  coimtiy  over  a  40-year  period,  who  has 
been  the  pmine  producer  of  the  Mental  Measurement  Handbpokj  in 
that  valedictory  statement  made  clear^  that  not  only  were  tHb  tests 
venr  bad  ii^  the  192p^s;  he  suggested  to  his  great  .sorrow  they  were 
no  better  in  thei  19'w^s. 

He  went  oa.  furtRer  to  say  even  though  there  is  that  claim  that 
information  is  available  to  those  who  must  u^  it  for  evaluation 
.  purposes,  he  stated  quite  explicitly  that  the  materials  w%re  just 
never  available  to  do  the  kind  of  assessment  that  was  necessary  if 
in  effect  the  mo^  Critical  questionq^  about  equity  were  to  be  re- 
sponded to.  , 

I  tmnkfthat  statement  would  also,  be  a  very  good  entry  into  the 
^     record  of  this  committee.  ' 

Mr.  Wbiss.  Do  you  have  that  statement  aVailable? 
Dr.*  Pbrrone.  Yes,  I  can  make       available  to  vou. 
'  Mr.  Weiss.  If  you  do,  1  tRink  that  would  be  well  to  h|^vWl>in  the 
record.  ^  ^  s 

In  Dr.  Reveres  t^timony  he  stated,  and  I  quote  on  pag^  8: 

The  probuble  lack  of  recognition  that  different  typei  of  teeto  are  constructed  to^ 
;  serve  oiverei  purmbte  will— this  to  me  is  the  signiflcant  point-^Ukely  result  ih 
invalid  interpretatfons  and  critiques  of  the  items  bV  individuals,  unschooled  in 
testthg  methodology  and  uninformed  about  the  intended  uies  of  the  tests. 
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Would  you,  Dr.  Perrone,  feel  that  may  in  fact  in  some  variation* 
^  siimnjarize  the  concern  that  th|  testing  services  have  not  necessar- 
ily tHat  there  would  be  invand  criticism  but  tHat  coming  from 
recognized  experts  in  th6  field  therfejnay  be  valid  criticisms  which 
'  may  tend  to  suggest  changes  that  sHould  be  built  into  the  tests  in 
order  to  make  them  fair. 

Dr.  Perrone.  sense  is  that  any  time  yoii  expose  the  test 
items,  one,  you  are  going  to  improve  the  opportunities  for  those  ^ 
tests  to  be  made  better  and  at  the  .  same  time  you  are  going  to 
improve  the  opportunities  for  a  lot  of  people  to  scrutinize  them  in 
ways  that  test  publishers  might  not  like  and  in  fact  experts  in 
testing  might  find  absurd. 

But  in  the  public  exposure,  the  benefits  to  be  gained  are  far 
greater  than. the  deficits.  Mr.«^Rever  is  essentially  arguing  that  t 
deficits  are  ^oing  to  be  highlighted. ^  My  position  tends  to  be  th^ 
the  opportunities  for  prokiucAve  change  are  going  to  be  highlighted.  ^ 

Mr.  Weiss.  There  has  also  been  some  suggestions  that  if  you 
make  tests  available— and  I  would  like  both  you  and  Dr;  Pottinger 
to  respond  to  this— to  the  students  who  took  them  and,  %f  course, 
then  to  the  public  at  large,  there  will  be  such  a  requirement  for 
additional  tests  'that  it  will  be  impossible,  really,  to  supply  the 
number  of  tests  that  are  needed  or  that  the  costs  wilf  be  so  burden- 
some that  the  students  will  be  the  opes  to  suffer. 

T>r.  Perrone.  The  information  that  I  have  seen' would  suggest 
there  is  absolutely  no  validity  to  any|of  those  claims.  Now  I  must 
say  there  may  be  data,  somewhere  hidden  that  is  not  available  for 
the  public  record  that  I  don't/khow  about  or  that  others  in  this 
ro6ni  don't  no^v  about.  But  everything  that  I  have  seen  would 
suggest  that  that  claim  has  virtually  no  yalidity.  . 

Mr.  Weiss.  Dr.  t?ottingen  ^ 

Ur.  PoTTiNGER.  I  would  Only  add  thatThere  are  numerous  steps 
in  the  development  of  tests  and  the  generation  of  new  test  ques- 
tions, i  thinki  as  Dr.  Perrone  has  already  made  known,  is  a  very 
small  aspect  of  this  p^ess.  The  fact  is  that  inany  times  items  are 
developed  by  people  in  academia  or  by  volunteers.  The  actual 
physical  generation  of  test  itetria  i^.  irtsignificant.  The  items  then 
become  edited  and  statistical  procedures  take  place  usually  as  the 
tests  are  being  used  by  people  who  pay  for  therti  anyway,  to  exam- 
ine their  relationship  to  the  tests  characteristics  and  so  forth. 

All  I  can  say  is  that  both  logically,  procedurally  and  in  fact  the 
evidence  that  we»have  gathered  from  ETQ  is  this  is  not  a  si^ifi- 
caht  cost  factor. 

Chairman  Perkins.  Mr.  Erdahl. 

Mr.  Erdahl.  Thank  you,  Mr.  Chairman. 

A  couple  of  observations  and  a  question  to  any  membeir  of  the 
panel  who  might  Wish  to  respond.  . 

'  Ideallv,  for  .one  in  schoot  the  perfect  school  would  be  one  in 
which  there  were  no  tests!  Life  is  full  of  tests,  and  schools  lare  full 
of  tests,  $nd  we  are  tinkering  about,  reducing  the  use  aW  effective* 
ness  of  testing,  so  I  haye  sohie  reservations  about  the  bill.  ^ 

Are  we  looking  for- $  serial  number  of  standardized  tests?  It 
se^ms  to  me  obviously  ieus  the  teat,  results  are  made  availc^ble  to  the 
student  who  took  the  test,  they^are  aho  available  to  otl^er  people 

.  who  would  be  taking  the  t^sjtd.  It  seems  to  me  we  have  a  consensus 


h^re  that  the  present  testing  system  needs  to  be  improved  and 
modified  tp  nmke  it  more  fair,  to  make  it  coincide  better  with  the 
student's  actual  aptitude  and  abilities. 
But  1  am  mot  so  sure  that  this  will  resdly  get  it  done. 
By  making  this  information  available,  will  it  iii  fact  m|tke  the 
testing  process  better?  ;      V  > 

Are  we  assured  unden  a  n^w  system  that  we  wouldn^t  also  see 
multiple  choice  questions  being         which  have  been  used  by  ^ 
teachers  before  we  had  the  ^stcmdardized  tests,  so  th^a^  are  some 
questions  we  have  not  had  andwered  yet.  ^ 

Certainly,  as  Member^  of  Congress,  we  use  test  scores  for  th^ 
appointments  that  we  might  recommend  to  tHe  Military  Jlcadeiny.  i 
Are  we  hop^g  fdi*  a:  situation  that  no  longer  exists  fpfhayinjg  a  V 
morQ  personalized  way  of  evaluating  people?  \i 
1^1^^;  I  hope  that  we  could  do  that^  but  It  seems  to  me,  as  Mr. 
^rl^^ntioned,  we  in  fact  qpuld  end  up  hurting  the  very 
>^s^idi  Cdnc^rnc^  aboiit  trying  to  help,  those  that  might  be 

:'^:^^Xi^  %e  ijli^i^ytjie  p^        greater  for  tutoring  situations,  that 
^;ptildn't  be  aii^llable  to  the  poor  students?  These  are  questions 
that  certain^/jittHld  have  to  be  answered  before  I  would  support 
this  bill.  i  ^  . 

Lat^  on  I  will  have  slmie  more  specific  questions. 
\pjlt  assurances  do     nave  that  this  disclosure  Will  really  make 
thwtesting  process  betler?  Are  we  assured  that  under  a  new  testing 
process  we  wouldn't  have  a  repetitive  new  standardized  test,  that 
we  would  have  to  be  turning  over  miich  quicker? 

What  assurance  would  we  have  that  people  would  be  accepted  to 
a  univeraty,  to  a  law  or  medical  school,  or  some  job  opportuoitj^  by. 
the  fact  Hiat  a  person  who  took  the  test  before  knoMp  the/Ahswelrs 
'  therefore  makes  it  available  to  anybody  who  fakes  the  test? 

TESTING  rrBM  POOLS 

Dr.  Snyder.  Basically,  one  very  common  thing  that  underlies 
your  concerns  whethei'  or  not  the  item  pools  will  be  large  enough 
to  generate  the  needed  security  in  an  mclividual  ach^inistration, 
while  still  being  able1;o  release  each  and  all  of  the  itenk  after  they 
have  been  used  at  once." 

;  I  suspect  that  given  the  range  of  alternatives  which  ^are  available 
with  current  technology,  which  is  essennally  to  write  more  items 
or  dp  a  relatively  speculative  algorithm  that  will  generate  classes 
t  of  items  which  will  tei^d  to  mak6  %p  contents  of  the  test  less 
unsuitoble  rather  than  moi^  u^suiteble. 

Any  time  you  are^  in  a  situation  where  you  must  generate  art 
enormous  range /of  ,<;Ontents  and  limit  what  you  are  measuring, 
that  the  spe^uic  questions  ufed  will  get  more  trivial  rather  than 
less  trivial. 

.  gMir.  QooDUNG.  I  would  like  to  comtiient  on  B^it^^j^m^Bt  you 
said,  perhaps.  ,  ♦  ' 

You  talked  about  tek^         for  admittanct mto  m 
academies  an4  judgmema  that  Membets  of  Congg^^ 

As#e  kno^,  a  goodly  number  of  Members  oTt^ngr  utilize 
such  teste  tnemselvi^;  and  these  are  stendardiW  tests,  and  the 
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question,  should  be  posed  how  many  Members,  even  of  this  commit- 
tee, utilize  these  standardized  tests,  and  how  many  members  of  this 
committee  would  be  willing  to  have  these  very  tests  utilized  in  the 
method  suggested  by  the  pending  bills?  That  is,  give  tRe  answers. 

•How  many  of  them  are  doing  that  now?  They  ar§  worried  about 
all  of  those  other  tests. 

I  would  ask  also  the  question,  and  I  don't  have  the  informsttion 
as  to  the  tests  given  in  the  House  of  Representatives  for  potential 
employees. 

They  give  tests.  I  know  they  give  typing  tests  and  stenographic 
tests,  but  whether  they  give  any  other  tests,  beci^use.  as  we  try  to 
point  out  iti  olir  testimony,  there  is  a  double  standard  where  we 
are^^king  the  private  sector,  hbth  profit  arid  nonprofit,  to  do 
certain  things  which  not  only  the  Government  does  not  do,  but;  as 
you  see  to  point  out,  even  the  members  of  this  co^imittee,  the 
House  of  Representatives  of  the  United  States,  doesn't  have  one. 

Mr.  Erdahl.  If  I  could  make  another  point  I  think  most  of  us 
/saw  the  article  in  the  AV^^i^K^'^  Fost  Another  article,  in  other 
papers  throughout  the  dountry,  dealing  with  the  SAT  scores,  was 
brought  to  my  bttention  this  morning.  Someone  mentioned,  evi- 
deiitally  we  see  a  ^decline  iri  reading  and  writing  skills,  and  yet 
maybe  .the  problem  is  not  with  the  testing  but  with  the  teachmg 
procedure.  * 

The  tests,  whether  we  like  them  or  not,  are  .  fairly  accurate,  in 
that  they  show  a  decreased  stability  in  these  areas,  and  we 
shouldn't  really  blame  the  test  for  that.  It's  the  procedures.  . 

It's  kind  of  like  shooting  the  messenger  of  bad  news.  I  am  not 
sure  ,  the  tests  are  the  fault  of  the  decline  in  some  of  these  skills. 
^  Chairman  Perkins.  Mr.  Miller?  <  , 

Mr'.  Miller..  Thank  vou,  Mr.  Chairman. 

Dr.  Rever,  on  page  6  of  your  testimony,  on  item  2  you  talk  about 
the  release  of  the  securities  items,  and  down  at  the  bottom  you  say 
the  tests  will  be  inappropriately  leading  the  curricula.  A  related 
effect  would  be  to  encourage  the  proliferation  of  coaching  schools, 
many  of  which  will  fail  to  engage  in  sound  educational  practices. 

Since  *  if  s  not  established  that  the  efforts  of  coaching  schools 
produce  results  of  equal  benefit  to  all  and  may  vary  tor  many 
students,  and  this  would  also  be  An  anathema  to  the  public  inter- 
est. 

I  don^t  quite  follow  you  there.  You  are  suggestirij^  if  ypu  release 
all  these  items,  that  then  the  public  school  system  will  engage  in 
teaching  just  to  pass  the  test? 

Dr.  Rever.  The  first  point  to  be  made  in  responding^  to  your 
question  is  this:  The  college  admissions  test  is  for  a  purpose  unre- . 
lated  to  the  evaluation  of  the  student's  total  experience  in  the  high 
school,  so  consequentb^' while  Mr*  Erdahl——  . 

Mr.  Miller^  what  do  you  mean?  '  . 

Dr^  Rever.  Mr.  Erdabl  references  a  scholastic  aptitude  tesit  and 
decline  ini  test  scores  over  time.  We  experience  the  jame  thing  on 
£be  assessments,  but  we  never  stated  that  that  was  an  indictment 
against  the  secondary  school  system  in  this  country,  because  the 
content  of  the  examination  does  not  represent  the  entire  wealth  of 
the  curriculum  in  the  high  school' 

Mr.  Millie;r.  What  does  it  represent  then? 

■     ■{    ' ' 

5{)s  ' 

*   .  -    ,  .  ^=  -      ^  :  ,  y  -   :    


.  ■  •     ■      *         *  * 

Kkvbr,  It  repeatnto  what  We  befieved  what  our  users  or 
en  I  saiy  UserS)  tnoi6  are  the  secondaiy  schools  and  the jpwtsec- 
dar^  institutions  in  this  country,  aire  the  necessary  abilities 'to 
rvivl^  in  institutions  of  higher  education  in  an  academic  sdnse. 

yjfe  are  in  fact  indeed  

rrMitiLER.  Wfdra  minute;  what  is  High  school  about? 
RbVer.  High r^qhooli  the  curricula  of  the  high  Bchool  are  used 
as  th0  ba$is<for  therkinds  of  questions  that  we  ask,  but  we  do  not 
^Int^nd  to  sample  oi*  draw  questions  Ifrom  all  the  range  of  the  high 

school  c'urricuia  in  this  country. 
^  *  Mr,  Mit4iBR4  The  test  will  then  provide,  separate  from  your  total 
Hil^h  jM^hool  experiences  whether  or  not  you  have  the  skills  to 
survive  in  an  institution /of  higher  Wucation.  y '  ■  ' 

,    Dr.  RivER.  Our  intent  in  developing  the  ACT  assessment  is  to 
/provide  an  instrument  to  predict  studentsVperfdrmances  in  their 
wmt  y^  in  College,.yed»  indeed. 
|ilr.  MiiXBR.  I  thought  that  is  what  gradttation  from  grades  in 

Dr»  Rbvbr»  No^X^n^^  l^li^ve  so,  as  a  matter  of  fact,  one  of  the 
difficulties. 

r  Mr.  Miller.  Why  do  we  consider  themi  the  grades,  why  do  col- 
'  l^ges,  consider  the  grades  and  the  scores? 

'*   Dr:  ;RBVtBR.  For  two  reasons;  one  is  the  grades  among  high 
jfchoolfi.  and  according  to  the  size  of  the  high  school  and  its  curricu- 
Ii|illmd''the  like/ varies  enormously  in  terms  of  their  reliabmty  in 
pfeiiUeting  first  Vear  in  college  performance  in  grades. 

Ttie  t^t  really 'ii3  a  third  party  external  approach  to  providing 
[Sfbm0  kind  of  opportunities  for  students  to  demonstrate  the  kinds  of 
skillB  and  abilities  they  have  to  an  institu^ion^f  hig||^er  education, 
independent  of  whatever,  the  high  school  itsel9has  tried  to  impart 
for  the  student  .  *  \  ^ 

Mr.  MiLLEIt.  thate  to  say  this,  but  I  am  still  a  little  lost.  '  *  . 
I  thoue^ht  if  y&n  wl^ht  to  high  school  and  were  a  B  student- and 
you  did  B  work  iii  mathematics  and  algebra  and  trigonometnr, 
vour  chances  of  doing  fairly  well  in  mathematics  in  cdllege  would 
oe  ffood.         •  ' 

'  If  you  did  reasonably  well  jin  history  in  high  school,  you  would  do 
reasonablyfWell  in' history  in  college^  and  the  same  as  to  literature 
And  writing)  and  so  forth.  Now  you  tell  me  that  is  not  so,  that  tbat 
18  m<>t  a  good  ju^^ent  but  rather  it^s  the  test; 
Dr«  RbvbR*  ipi  t  didn't  say  it  was  not.  I  said  it  may  not  be. 
If  .  The  diflPerehce  in  a  n  in  the  high  schools  I  graduated  frOm  in  a 
i  southern  little  town  in  North  Cairolina  and  a  B_in  the  Baltimore 
Polytechnic  High  .School  is  substantially  different  in  terms  of  how 

What  is  it  vi^h  In  predicting  how  one  will  perform  fit  Harvard, 
ibr  example?  The  faculty  at  Harvard  will  say  if  you  graduated  from 
^lialtimpre  Poly  that     is  worth  considerably  more  J;han  if  you 
jiraduated  ftom  some  smiedl  high  school  in  North  Garolma. 
W^Hv^  ^aaMn^^  if  you  lived  in  North  Carolina,  you 

%Uldn^t  go  to  Baltimore  Poly. 

-  t>]t.  BjiivsR.  fnat  is  tfiUei  but  I  still  wanted  to  go  to  Harvard,  and 
jpplied  to  demonstrate  that  it  did  not  disadvantage  me  in  what  I 
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:  .  learned,  that  I  could  compete  successfully  academically  with  those 
students  who  had  been  at  Baltimore  College. 
Mr,  MiLW)R.  The  proh}dm  is  Harvard  s  i^rception  of  your  B. 
Dr.  Rever.  Indeed,  the  test  sponsors  and  agencies  are  offering  an 
independent  third  party  opportunity  for  graduates  of  all  of  our 
.    Nation's  high  schools  to  demonstrate  what  kinds  of  skills  they  have 
acquired,  so  if  there  is  some  selection  that  needs  to  be  done  it  can 
be  done  fairly.  ' 
^  Even  if  flection  is  not  to  be  done,  they  can  make  a  judgment 

based  on  my  high  school  records  as  well  as  my  test  performance  to 
see  what  kinds  of  accommodations  their  curricula  has  to  make  to 
accommodate  my  particular  development  because  of  the  high  ^ 
school  I  went  to  or  whatever,  the  resources  that  were  available  to 
me  to  learn. 

Mr.  Miller.  What  about  the  test  being  overruled  by  Harvard, 
and  you  got  into  Harvard? 

yfnai  about  in  the  case  where  the  tester  told  Harvard  you 
shouldn't  get  in  because  you  are  from  a  little  high  school  in  North 
Carolina?     .  *  * 

Dr.  Perrone  and  others  would  suggest  that  there  is  not  enqugh'  - 
information  to  determine  whether  either  determination  ,  is  valid  or 
not.    '  '  • 

Dr.  Rever.  The  amount  of  information  that  is  available  to  deter- 
mine whether  the  examination  is  valid?  , 

Mr.  Miller.  To  do  an  analysis  of  vour  operation's  d^^on  that 
this  student,  considering  the  high  school,  should  be  convHred  for 
Harvard  or  this  student  be  considered  for  Harvard.  , 

What  about  jcritics  of  the  test  who  say  that  we  don't  know 
enouKh  about  how  te^ts  are  evaluated,  ,how  the  questions  are  put 
together,  the  rationale  for  the  use  ol^  the  questions,  to  know  if  that 
\     is  a  legitimate  determination?  ^ 
f  Dr.  Kbver.  You  have  two  parts  to  your  question,  if  I  may  inter- 

pret that.  V 

The  one  has  to  do  with  the  release  of  test  contents,  and  £hat  is  tf 
say  that  the  proponents  of  the  bill  have  suggested  that  looking  at 
the  contents  of  the  tests,  one  can  then  make  judgments  aboiit 
whether  or  not  it's,  valid,  good,  and  does  what  it  intends  to  do. 

We  submit  to  you  that  is  an  impirical  question.  If  the  intent  of 
the  examination  is  to  predict  first  year  performance  in  college  for 
the  purpiose  of  selection,  guidance,  placement,  whatever,  we  subhiit 
that  these  data  are  not  hidden  in  fact.  Ck)nsequently,  we  ask  the 
question  what  do  you  miean  by  people  don't  know  whether  the 
examinations  have  any  value?  « 

We  have  substantial  informaition,  and  we  would  be  happy  to 

J provide  the  committee^  which  is  inundated,  with  research  reports 
rom  everv  publisher,  that  in  fact  the  tests  do  predict  in  a  reason- 
able way  now  students  will  jperform  in  college. 

One  has  to  make  a  selection  decision  who  goes  and  who  does  not, 
and  wants  to  provide  the  dkiisionmaker  with  the  best  possible 
information  that  is  available^  and  that  nieans  both  high  school 
grades,  college  fiprades,  reconpiendations  «f  teachers,  of  iriends, 
guidance  counsellors,  principals,  and  tlje  Ime^  so  that  tl^t  judg- 
ment can  4}e  made  with  the  test  and  available  oossible  in|[ormation. 
Mr.  AfiLLER.  Dr.  Perrone,  do  you  agre^with  that?     #  *    '  ^ 


Dr.  Pbrronb.  It's  my  s^nse  if  the  tests  were  actually  exposed  and 
people  could  actually  see  precisely  what  it  is  that,  they  are  making 
judgments  about  in  relation  to  students,  that  there  would  be  a  lot 
more  doubts  than  there  are  at  the  momen1|;,  and  I  think|there  are 
considerable  doubts  already.        \  '  ^     ■  ' 

In  terms  of  predicting,  I  think  it's  clear  that  ACT  and  ETS, 
Colliese  Board,  will,  claim  that  their  tests  have  some  predictive 
correlation  to  the  firstyear  in  collie.  v 

^submit  that  that  cprrelation  is  not  very  high.  It's  Relatively  low. 
It  is  not  as  high  as  grades;  grades  are  higher.  /  .  . 

The  argument  then  is  that  if  you  put  both  together,  you  are  in 
better  shape  than  if  ]^ou  have  one  or  the  other  ,  separately,  and 
there  has  oeen  some  independent  research  that  I  do  cite  in  the 
appended  paper  that  I  haVe  ^ven  you,  and  I  guess  then  you  have^ 
to  ask  the  Question  about  equity* 

Michael  Wallach  at  Duke  has  done  a  good  deal  of  research  on 
what  would  happen  if  you  used  primarily  the  test  score  for  pur- 
poses of  admission,  if  you  used  the  whole  pool  at  Duke  University, 
and  if  you  used  test  scores  exclusively,  you  end  up  with  a  popula- 
tion that  even  Duke  at  this  point  in  time  that  would  not  support 
equity  in  any  ^pect. 

If  you  take  grades,  as  Michael  Wallach  has  done,  grades  and  test 
scores,  you  get  a  configuration  thM  is  a  little  more  diversie.  ^  you 
take  grades  only  you  get  a  radically  more  diverse  population,  and 
then  if  you  take  what  Michael  Wallach  c&Us  achievement  activi- 
ties, what  ACT  and  some  of  their  research  as  talked  about  as  non- 
intellective  factdrs,  you  get  a  more  diverse  population. 

Do  the  testa  say  very  much  about  the  kinds  of  predictions  that 
qne  can  make  about  a  4-year  program  or  success  in  one's  chosen 
career?  ACT  and  ETS  will  not  stand  behind  th^r  tests  in  terms  of 
anything  beyond  first  year  prediction,  and  there  is  a  good  jjieal  to 
suggest  the  whole  prediction  breaks  down  when  you  go  all  the  way 
to  the  baccalaureate  level,  and  it  suggests  there  is  .  a  good  deal  to 
suggest  it  breaks  down  When  you  try  to  do  any  cprrelation  to. 
success  in  any  given  field.  ^ 

We  need  a  much  better  defuiitiph  of  talent  than  comes  througn 
these  particular  t€N9t9.  - 

A  think  we  need  much  more  equity  than  now  exists. 
'-^■^Chairman  Pbrkins.  The  gentleman  from  North  Carolina. 
Go  ahead. 

Mr.  AndrswSv  It  seems  to  me  the  institutions  being  referred  to 
have  done  a  thorough  job>  so  far  as  I  know,  and  far  better  than  this 
committee  isf\oing  to  be  able  to  do  in  the  several  hours  that  We 
might  devote  to  these  aerious  questbns. 

Ithink  these  institutions  have  mthin  them,  certainly  Duke  Uni- 
versity, which  happens  to  be  In  my  district,  and  the  others  have 
people  there  far  more  qualified  thftn  we  to  determine  which  crite- 
ria should  be  considered  in  term?  of  the  admissibility  of  the  appli- 
cant. 

Imperfect  though  it  may  be,  I  simply  question  the  capacity  of  we 
who  are  on  thii  committee  or  we  viho  are  in  th#  Congress  to  in  the 
short  time  available  if  us  devise,  a  better  way  of  determining  who 
should  ai$  sh6uld  not  be  admitted  than  the  institutions  in  ques- 
tion,    .       r      '.  \ 


,  Second,  I  wonder  if  making  avaikble  publicly  the  test,  if  that  * 
has,  OT/as  I  am  told^nd  inclined  to  believe  as  its  effect  the  relative 
do^triiction  of  that  as  one  of  the  tools  available;  that  is  to  say,  that 
w0  win  destroy  the  standardized  testing  as  at  least  one  criteria  of 
the  qualifications  of  the  applicant,  what  are  the  alternatives  that 
are  available  that  are  any  better^  and  it  seems  to  me  the  answer  is 
rkther  obviously  none.  * 

As^in,  as  imperfect  as      standardized  testing  may  be,  if  we  in 
effect  destroy  it  as  one  of  th|^riteria,  we  resort  to  the  other 
;ialtfernatives  that  have  been  allowed  to  or  the  only^onefi  I  know, 
that  is,  the  achievement  in  the  prior  school  or  prior  vehicle  of 
^  Education  that  the  applicant  might  have  been  subjected  to,  and  I 
'  guess  in  ^ost  cases  we  are  saying  high  school,  or  the  liters  (j/t 
recommendation  froni  the  various  people,  academic  or  otherwise,  in 
behalf  of  the  applicant  and  all  of  these  are  far  more  subject  to 
:  rational  criticism  than  is»the  standardized  testing.  / 

I  guess  my  point  is  I  am  inclined 'to  thihk  that  the  standardized 
testing  serves  a  valuable  purpose  which  we  should  not  inhibit  by 
Rational  legislation,  and  the  exteffit  to  which  it  should  be  used  as 
*one  of  the  methods  of  determining  the  ability  of  the  applicant  to 
achieve  what  he  %*  she  seeks  to  achieve  can  best  be  determined  by 
those  who  represent  the  entity  to  which  the  applicant  applies. 
I  am  not  in  favor  of  approving  either  of  the  bills  that  are  before 
<  the  committee. 

Chairman;  Perkins.  Thank  you  very  much,  Mr.  Andriews. 
Mr.  Kogovsek? 

Mr.  KoGOVSBK.  Thank  you,  Chairman. 
,The  strong  interest  1  have  in  the  passage  of  H.R.  4949  is  the 
insight  that  we  can  get,  I  think,  as  to  what  we  are  doing  wrong  in 
this  country  and  in  school  distribution  asuifar  as  low  income  and 
,  minority  schools  are  concerned. 

I  would  ask  Dr.  Rever  and  \)r,  Snyder,  specifically,  first  of  all,' 
^  while  neither  one  of  you  actually  came  right  out  and  said  it^  I  seem . 
to  hear  you'  imply,  or  got  the  impression  that  purveyors  of  tests 
have  no  responsibility  to  low-income  or  minority  test  takers. 

If  any  group  can  attain  the  confidence  that  they  need  as  far  as 
test  taking  is  concerned,  I  think  it's  these  groups. 
^  r  think  that  taking  a  test  is  a  traumatic  experience  for  anybody, 
but  it^Q  so  much  more  for  a  minority  student  who  has  been  educat- 
ed in  a  system  that  really  has  not  brought  him  along  as  fast  as  he 
would  have  liked  to  have  been  brought  along. 

The  openness  that  is  involved  in  H.R.  4949  can  give  these  stu- 
.  dents  the  confidence  that  they  need,  I  think,  in  the  future. 
:  Let  me  ask  you  specifically  if  you  do  not  think  that  it's  the 
responsibility  of  purveyors  of  tests  who  take  into  consideration  low 
income  groups,  I  assume,  you  feel  it's  the  responsibility  of  Congress 
&nd  the  educational  people  in  this  country,  and  I  concur  with  that, 
hyxi  what  is  the  responsibility  of  these  people  who  put  together 
tests  that  have  to  be  taken  by  minority  students  when  they  are  not 
prepared  actually  tQ  take  therm? 

In  other  words;  what  is  th^  responsibility  of  a  purveyor  of  a  test 
and,  second  of  all,  is  theretany  kind  of  a  cpTmmunication  between 
those  people  who  ar^  makillg  the  tests  right  now  and  the  school 
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dietribwtibn  that  have  a  llrge  pppulation  of  low  income  6r  minority 
groups?  ^  ■ 

Dr*  Rbvbr.  Indeed,  testing  agencies  and  test  sponsors  have  been  . 
sensitive  to  the  needs  and  the  educational  development  of  our 
minority  and  other  Iwr  inconie  groups  in  our  society. 

In  fact,  it's  ironic  that  the  one  single  index  that  points  to  their 
needs  a6  a'' ijarticulat  object  of  this  Cx^ngress  comes *fromi^he  serv-. 
ices  we  provide.      "  ^  . 

We  do  not  intend,  for  exatriple,  to,  given  thelcind  of  information 
and  validity  that  the  laminations  have,  we  do  riot  intend,  it  | 
serves  no  purpose  whatever  to  withdraw  the  examinations  from  the^ 
useful  purposes  for  which  they  are  put  in  helping  minority  young* 
sters  magnose  what  their  educational  status  is  and  plan  for  the' 
appr9priate  steps  to  be  taken  ta  be  develbii^  further. 

We  have  been  seniAtive  to  tha^needs  of  minorities,  both  religious 
and  racial  and  low  income  people,  because  our  examinations  indeed 
are  reviewed  by  representatives  of  those  people  before  they  are 
even  administered. 

To  suggest,  for  example,  as  Mr.t'Perrone  has,  that  there  is  some^ 
thing  easy  about  the  linguistics  of  an  ex^ination,  that  makes  it 
inherently  biased  is  sheer  folly  land  superficial.  ^ 

Mr.  KooovSKK*  You  are  saying  there  is  communication  going  on 
now  between  school  districts,  once  a  test  is  taken  and  results  are 
sent  back  and  some  kind  of  communication  that  says  your  average  . 
students  or  whatevek*  are  performing  thus  and  so,  arid  we  think 
this  is  why  the  minority  groups  arid  low  income  students  are  not 
doirig  well  on  the  test. 

Dr.  Rbver.  We  have  a  statement  iri  her^.  regarding  that/ particu- 
lar aspect.  ;    ^    .  . 

We,  as  an  agency,  do  not  see  ourselves  In  an  evaluation  position 
with  regard  to  this  fie^jondary  school  system  in  this  counti^.  What 
we  do  is  sample  from  the  high  school  curriculum  arid  try  to  make 
predictions  about  their^ucaoility  at  the  postsecondary  level.. 

On  the  basis  of  thiat^  we  trust  the  schotol  system,  the  secondary 
schciol  system,  to  make  judgment  of  how  important  is  that  to  them. 
If  they  juctee  that  it  is  important,  if  they  do  in  fact  have  a  valid 
judgment  about  their  students,  they  should  take  appropriate  action 
andinvestigate  why  that  seems  to  be  the  case.  v 

Mr.  KoGOVSBK.  Dr.  Snyder,  you  had  indicated  if  JI.R.  4949  does 
become  law,  you  would  like  to  see  a  year  delay. 

TiEST  Laudation  t 

Dr.  Snyder.  So  there  would  be  adequate  time  for  the  promulga* 
tions,  et  cetera.  Could  I  also  respond  to  your  first  question? 

The  most  direct  way  I  can.  respond  to  ii  this  is  not  iri  the  area  of 
college  entrance  testmg,  but  when  we  construct  all  of  our  mcgor 
standardized  cichievement  series,  the  ones  that  are  used  in  elemen- 
tary and«secondanr  education,  we  routinely  review  iall  item*  with 
fippropriate  minority  groups,  but  in  addition  to  thatj  our  particular 
company  spends  a  rather  considerable  ^oiint  of  nfoney  conduct- 
ing simultiii|»ous  tryoiits  in  variourgroups. 

Ih'Mditicl  to  that,  you  raise  tHi  issue  of  uniform  variety  with 
the  test,  ana  to  solve  that  problem,  we  have  begun  the  practice 


many  years  ago  of  producing  practice  exercises  for  the  examina- 
tions that  would  be  administered  to  the  students  before  they  actu- 
ally took  the  achievement  tests. 

We  also  provide-essentially  as  a  conipany  service  both  prp-  «nd 
'^postworkshops  with  teachers  to  counsel  them  in  how  test  results 
can  h^most  adquately  used,  specifically  these  days,  in  the  class 
room.  H       .  » 

The  trend  we  are  seeing  is  more  standardized  tests  to  be  used  m 
more  diagnostic  fashion  than  they  were  in  the  past. 
'  Just  onte  more  thing:  We  have  also  intnoduced  recently,  several 
companies  have  the  notion  of  a  functional  level  testing  procedure 
tlvat  can  allow  the  adoption  of  a  series  |f  achievement  tests  to  the 
actual  level  that  th©  chiy  is  functioning  at,  so  you  get  the  most 
accurate  measurement  and"  can,  therefore,  use  it  in  the  most  direct 
manner  possible  in  the  instructional  stage.  ^ 

Mr.  KoGOVSBSc.  Are  you  far  enough  along  to  be  able  to  tell  those 
States  who  have  bihngual  bicultural  progranis,  is  it  still  too  early 
tcTtell  if  these  programs  are  working  as  far  as  your  test  results  are 
concerned? 

Dr.  Snyder.  We  published  ondthe  bilingual  evaluations  an  instru- 
ment that  parallels  one  of  our  achievement  series  only  about  1 
year  and  2  months  ago.  It's  a  bit  early  to'tell.  There  may  be  some 
results  coming  out  shortly,  but  I  cannot  say  at  this  point  in  time. 

Mr.  KoGOVSEK.  Thank  you. 

Dr.  Perrone.  May  I  respond?  " 

Mr.  Andrews.  Yes. 

Dr.  Perrone.  If  you  were  to  examine  the  power  of  testing  in  our 
society,  I  think  one  of  ^he  things  you 'will  find  is  that  its  power  is 
relat^  to  the  measure  it  controls  and  has  access  to  all  the  informa- 
tion and  holds  it.  As  bng  as  testing  and  clients  cpntroLthe  infor- 
matibn  an\l  it  is  not  a'ccessible  for  public  scrutiny,  testirig  is  going 
to  maintain  a,  power  that  1  think  many  people  in  our  society  are 
chdleiigiM  without  access  to  the  necessary  tools. 

Comm«t  was  made  it  is  very  gross  to  talk  about  cultural  and 
linguistiqfbias.  I  don't  think  it  is.  The  fact  is  "we  don't  have  access 
to  the  tools.  One  csin  argqe  that  minority  groups  quite  regularly 
review  items.  But  at  ttie  same  time  why  is  it  that  almost  every 

.  major  minority  association  in  the  United  States  has  called  in  to 
-question  the  whole  testing  enterprise  and  in  fact  gives  support  to 
bills  like  that  in  New.  York  and  I  will  puspect  give  support  to  the 
WeisQ  bill,  et  cetera,  and  to  this  particular  C!ongress. 
^^ne  of  the  questions  they  askr  if  you  read  the  resolutions  passed 
'by  NAACP,  they  don't  absolutely  asljert  that  there  is  cultural  and 

^  linguistic  bias,  they  assert  without  more  information  we  won't  even 
know  the  extent  to  which*  it  does;  exist  I  think  those  are  important 

*  issues.  .    '  ■./■'.  \  ■  ■    ■  •  . 

Is  there  a  problem?  Take  a  look  at  the  Parcfnt-Teachers  Associ- . 
ation.  I  hope  that  this  /ommittee  is  sensitive  to  where  the  PTA  hiaS 
come  from.  If  you  v^re  to  have  looked  kt  the  PTA  20  years  ago,  I 
think^they  would  h^e  been  out  in  front  of  the  testing  enterprise 
without  question  and  they  were. 

As  it  has  gone  through  its  own  atteinpt  to  probe,  as  it  has 
attempted  to  score  from  the  testing  industry  what  little  bits  of 
information  it  has  been  able  to  gather,  as  i1^  has  been  reviewing  the 
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iPew  items  tlm^it  can  get  hold  6f,  it  has  come  to  the  coticlusion  that 
this  is' in  fact  tb«  man  without  dothing.  that  there  is  something 
wrong,  and  no  longer,  is  the  PTA  the  sup^rtive  body  it  was  a  few 
years  ago.  \ 

My  sense  is  if  more  people  had  an  opportunity  to  review  what  is 
accessible,  they  in  fact  would  see.  the  power  of  that  enterprise 
decline  and  come  more  into  line  with  what  is  reasontible  in  our 
society  as  opposed  to  unreasonable  in  our  society. 

In  terms  of  information^  I  misht  only  add^  I  hate  to  use/analogies 
like  nuclear  energy,  but  for  how  jong  did  we  believe  that  th6 
nuclear  energy  industry  had  under  control  the  safety  issues  relat- 
ing to  its  employees  and  the  public  at  large? 

How  long  did  it  take  to  find  out  what  impact  there^as  in  Utah 
from  the  1950's  testing?  Would  sunshine  have  been  Aiseful  all 
along?  I  would  suggest  that  sunshine  would  have  been  useful,  and 
we  might  hav^.Jtaipn  even  nuclear  energy  with  ajittle  more  cau- 
tionl  '  ,  ,  .  ^ 

I  think  this  particular  body  needs  to  do  the  same  thmg.  The 
legislation  does  ca}l  for  a  marked  change  in  a  relationship  of  the 
Congress  and  the  National  Government  to  a  private  enterprise  and 
to  nonprofit  institutions  or  agencies. 

On  the  other  hand,  if  you  go  to  that  fundamental  issue  that 
individuals  who  are  to  be  judged  by  test  results  are  entitled  to 
.  know  the  basis  of  those  judgments,  it  seems  to  me  all  the  bjiher 
concerns  evaporate  and  ought  to  evaporate. 

Mf.  ANDRSW8..Very  good.  The  time  of  the  gentleman  from  Colo- 
rado, I  am  told,  1mu3  ejtpired,  aiid  the  Chair  will  now  recognize  "the 
gentleman  from  Pennfiylvania.  ,  . 

Mr.  GooDUNG.  Thank  you,  Mr.  Chairman. 

I  forgot  to  ask  that  the  entire  editorial  be  printed  in  our  minutes 
of  today's  meetine.  A" 

Mr.  Andrews.  Without  objection. 

[The  editorial  referred  to  above  follows:] 
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SooRi^o*  THi  Admissions  Tesi^b 


At  first  glance,  it's  a  teltribly  appealing  idea.  A  House  subcprnmlt^e  is  now 
briskly  proceeding  with  a  bill  giving  students  a  legal  right  to  see  their  college 
entraaoe  examinations,  with  the  questions  and  the  corrected  answers.  For  ^ood 
measure,  the  bill  would  also  establish  broad  federal  iiupervision  ov^r  all  admissions 
testing.  On  a  second  and  closer  lookr  this  legislation  becomes  less  appealing. 
,  8om9  of  the  support  for  it  comes  from  people  who  simply  thmk  that  students 
ought  to  be  able  to  review  their  exams  and  see  whete^they  fell  short.  But  some 
comes  from  people  who  want  to  change  the  nature  6f  the  ijffiL  and  the  whole 
admiseions  process,  on  groutids  that  these  are  tilted  against  the  poor  and  the 
.minorities..Kep.  Ted  Weiss  (D^N.Y.),  the  author  of  the  principal  bill  under  consider- 
ation, says  thaflib  doesn't  want  to  regulate  the  tests.  But  his  bill  dearly  lays  the 
foundation  for  a  regulatory  system.  ^    ^  .  .  . 

Young  Americans  take  these  tests  by  the  millions  every  year  for  admission  to 
college  or  professional  schoiol.  The  most  widely  U8ed»  the  College  Board's  Scholastic 
Aptitude  Test,  is  given  more  than  20  times  a  year  throughout  the  counti^  and 
abi^d.  Each  new  edition  picks  up  a  good  many  questions  from  the  previous  one,  to 
ensure  that  the  scores  on  a  test  given  on  one  date  will  be  comparable  to  those  of 
anothep 

'  But  Mr.  Weiss'  bill  would  require  the  College  Board,  after  each  test  is  seor^,  to 
:ive  Jjfte  student  both  the  questions  and  the  answers.  Sitice  the  questions  would 
JBiately  be  paMed  around  to  other  students.  tK«y  6ould  hardly  be  used  affain. 
icost  of  the  tests  would  go  up,  and  the  reliali^ility  or  tl)e  scores  would  protybly  go 
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down.  If  you  think  that  competitive  admi^ions  test  are  wrong  in  principle,  fine.; 
Certamly  test  scores  aren't  the  only  criterion  for  admissions.  But  to  diminish  their, 
usefulness  would  force  colleges  to  depend  on  the  other  and  hiore  subjective  meas-  * 
ures— not  necessarily  an  advantage  to  the  youngster  who  doesn't  fit  the  usual 

pattern.  .        .      ,  r     i  . 

Mr.  Weiss  wants  the  scores  reported  to  Congress  by  students  family  income,  race, 
sex  and  ethnic  origin.  What,  precisely,  do  you  suppose  he  ho^  in  mind?  Its  obvious 
that  the  children  of  educated  middle-cliass  parents  tertd  to  make  higher  scores  than 
the  children  of  poor  and  uneducated^parents.  But  the  increasing  use  of  these  tests 
has  demonstrably  bkn  accompanied,  even  at  the  most  rigorously  selective  colleges, 
by  increased  enrollments  of  children  from  disadvantaged  families.  ^ 

But  not  everbbdy  likes  the  idea  of  an  independent  testing  board  run  by  the 
colleges  that  use  it.  The  National  Education  Association,  the  country  s  largest 
teachers*  organization,  warmly  supports  the  Weiss  bill.  Under  it,  the  oversight  of 
testing  would  reside  in  the  new  Department  of  Education,  if  Congress  is  unwise 
•  enough  to  create  one.The  strongest  political  influence  within  that  new  department 
would  be  the  NEA.  That's  another  reason  for  concluding, that  the  Weisg  bill  has 
dangerous  implications  that  go  far  beyond  its  author's  stated  intentions. 

Mr.  GrOODUNG.  1  think  some  people  talked  about  excess  profits  on 
big  campuses  and  I  don't  think  this  bill  deals  with  that.  If^IRS  is 
not  certifying  prpperly,  that  should  be  handled  in  court  or  by  other 
legislation.  ^         .  . 

I  don't  know  )iow  familiar  you  people  are  or  how  much  expertise 
you  have  in  the  business  of  looking  over  lesson  plans,  which  of- 
bourse,  include  teacher-made  tests.  I  can  only  say  in  about  18  years 
of  experience  many  of  those  tests  frightened  me.  Of  course,  there  is 
a  quick  way  to  do  these  things  so  you  don't  get  too  much  paper- 
work involved.  You  Can  write  essays  and  then  the  opinion  of  the 
teacher  is  the  important  thing,  not  the  opinion  of  the  student 
responding  to  the  essay.  .  .. 

Wduld  you  suggest  that  somehow  we  proceed  With  legislation  in 
relationship  to  teacher-made  tests  wliich  are  probably  much  more 
damaging  thanc^the  tests  Wft  are  now  discussing.  I  believe  we  have 
pros  and  cons  out  there  as  I  listened  to  the 'testimony. 

\.  ■  " 

TEACHER  TRAINING  IN  TESTING  , 

o 

Dr.  Snyder.  We  recommended  in  other  testin^pny  that  testing  be 
added  after  development  in  the  Higher  Education  Act  of  specific 
sections  that  are  given  in  the  testimony.  The  purpose  of  that  rec- 
'  ommendation  Avas  to  authorize  teacher  centers  to  provide  training 
to,  familiarize  teachers  with  development  in  testing  as  well  as 
curriculum  testing  and  educational  research. 

Mr.  GooDUNG.  InVother  words,  you  are  saying  all  those  courses 
we  had  to  take  thr&gh  college  and  gradute  school  really  weren  t 
very  helpfuli'         i  ,  ,  ,  ^  , 

'Dr.  Snyder.  I  am  hot  sure  whether  the  courses  weren  t  helpful  Or 
whether  they  disappeared  from  a  lot  of  the  teaching  curricula. 

Mr.  GooDLiNG.  Anyone  els^  want  to  respond  to  that? 

Dr.  PoTTiNGER.  I  wouIq  Say,  Congressman,  that  if  tests  a  teacher 
made  up  as  the  gatekeeping  device  was  the  one-shot  decision  that 
affected  whether  that  enild  had  an  opportunity  for  higher  educa- 
tion or  work  opportuniw,  they  should  be  scrutinized. 

The  fact  is  that  Jjeacher-mfade  tests  that  are  used  routinely  are 
not  that  influentialfr  don't  ttave  the  impact.      !      .  ^ 

Mr.  GoODLiNG.  Wait  a  minute.  T  heard  a  lot  ^  discussion  aboutf 
getting  aw£^  from  any  l^nd  of  standardized  testing.  Wouldn  t 
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'  grades  be  the  sole  thing  and  thait  would  be  extremely  important  in 
relationship  to  somepUe's  admission  into  college  if  you  go  that 
route?  '  ^ 

Dr.  PcxitiNOKR.  I  don't  think  that  the  issue  is  that  we  should 
h&ve  tests.  I  think  the  issue  is  which  tests  should  be  scrutinized, 
evaluated,  find  understood. 

Mr.  GooDLiNO.  Then,  of  course,  it  is  very  important  who  does  the 
scrutinizing,  who  has  which  axe  to  grind. 

Second  question:  At  the  present  time  we  will  have  legislation 
somewhat  similar  to  this  in  operation  in  New  York.  We  have  some 
kind  of  legislation  in  operation  in  California.  We  have;  the  National 
Science  Academy  presently  studying  this  whole  issue. 

Shouldn't  we  wait  to  evaluate  their  results,  and  use  what  they 
fhid^out  from  their  experiened  before  we  as  a  Federal  Government 
i^ip  on  this  bandvraigon?  <  ' 

Again,  I  think  you  are  divided  in  camps  down  there. 
Pr.  Snydbr!  My  responsa  is  that  the  isdues  are  complicated 
enough  and  since  there  has  not  been  a  demonstration  of  any  sort  of 
.emergency  condition,  it  would  be  best  to  wait  until  all  the  evifence 
is  in.  The  bills  themselves  kalk  about  apalyzing  data,  seeing  how  ■ 
:    Efomethihg  goes  with  respect  to  State  mtutes,  seeing  how  a  review 
i   goes.  The  National  Academy  of  Sciences  would  certainly  be  data 
1  that  would  be  helpful  in  the  decision  process. 
V     Ih*.  Rever.  Indeed,  the  experience  we  have  in-New^York  and 
1  perhaps  California,  although  the  legislation,  as  we  pointed  out  in 
1  pur  testimony,  is  quite  different  from,  what  has  been  introduced 
I  here,  would  be  appropriate.  '  '  , 

1    We  have  in  fact  Hstened  over  the.  previous  2  days  of  testimony 

given  today  in  which  Me  beneficial  claims  for  this  Kind  of  legisla- . 
*  tlon  are  mglily  speculative.  In  fact,  the  proponents  of  the  legisla- 
tion say  to  us  test  agencite  who  are  opposed  to  the'  legislation,  I 
dpp't  believe  you  either.  You  htJve  ho  data  on  whicH  to  bas^  your 
■  claims.  We  fbcus  on  such  trivial  matters  as  10  or  15  cents  mpre  per 
j  Igs^  ■ '    '  t 

We  don't  know  in  fact  what  the  effects  of  the  legislation  are 
going  to  be  on  the  disadvantaged  student,  for  example.  I  could 
afgue  I  think  in  a  fairly  convincing  way  to  most  reasonaWe  people 
that  our  educational -system  is  not  fair  ,  to  all  students.  We  make 
that  point  in  our  prepared  testimonyl 

The  ones  who  are  hurt  the  most,  as  an  index  of  high  school 
grades  show,  are  related  to  socioeconomic  status  apd  I  have  a  tabl(^ 
in  my'testimohy  that  relates  to  lhat 
Why  would  we  assume  that  by  making  the  examination  public 
I  we  will  automatically  hdp  and  be  of  great  benefit  to  the  disadvari- 
/   tagied  in  this  country?  'jjm  legislation  that  this  subcommittee  h&s 
/    led  the  Congress  through  to  help  the  disadvantagefl  in  this  Nation 
is  often  disappplnting  in  the  evaluation  of  it.  Even  for  those  Feder- 
al prograhifl  that  are  designed  to  help  the  (disadvantaged,  we  can't 
always  demonstrate 'a  positive  response,  so  why  would  we  assume 
that  $11  of  a^udden  by  making  air  manner  .of  data  available, 

EafticiUarly  test  contents,  the  disadvantaged  indeed  are  going  to  be 
elped,  particularly  |the  students? 
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,  The  proponents  will  argue,  of  course,  that  revealing  the  contents 
of  the  examination  will  throw  open  the  tests  to  all  kinds  of  re- 
search for  imm^ate  improvement  and  that  will  not  bci  a  problem. 
We  are  not  sure  that  is  the  case. 

Mre.  Sparung.  I  would  like  to  respond  thdt  there  is  legislation 
in^some  States.  As  a  parent  and; expressing  the  concern  x)f  parents 
,  .  in  the  other  States,  we  would  like  to  have  this  particular  bill 
.  because  we  can  have  the  information  that  allpws  ^us  to  ma)ce  the 
kinds  of  decisions  about  our  ^dren's  education  that  we  need  to  be 
making.  / 

Mr..  GooDUNG.  Would  ymx  not  rather  have  the  kind  of  informa- 
tion that  has  been  proven  rather'  than  the  kii>d  of  information  that 
may  be  totally  incorrept?  Let  me  give  you  an  illustration.  We  did 
away  with  the  teaching  of  phoniqs,  for  instance.  That  was  strictly 
motivated  by  the  Federal  Government  because  of  the  money  it 
'  provided  for  thiat  kind  of  experimentation. 

It  would  have  been  better  done  as  a  test  kind  of  thing,  I  suppose, 
on  a  few  rather  than  spread  all  over  the  Nation.  That  is  one  of  the 
concerns  I  have  here.  Do  you  not  want  legislation  that  you  can  be 
sure  of? 

'  Mrs.  Sparung.  In  this  particularvbill  it  would  give  us  the  oppor- 
tunity to  haye  the  kind  of  iiiibrmation  that  would  indeed  help  us  to 
make  thesp  decisions  in  H.Rr494ft, 

STATE  AND  FEDJBRAL  EXPfiRIENTCE  .. 

Mr.  MiLLENSON.  With  rdspect  to  your  question^  aa  we  pointed  oiit 
in  our  testimony  the  legislation  before  this  committee,  both  bills  go 
far  b^^d  this  New  York  State  law  so  that  even  the  experience  in 
the  NPT  Yorfc  State  law  should  be  relied  on.  . 

No.  2,  if  this  le^lation  is  desirable,  then  also  in  addition  ro^ the 
State  experience  1  would  think  you  would  want  experience 
the  Federal  Government.  The  Federal  Grovemment  gives  tests 
are  skipping  the  Federal  Government  and  going  right  on  to  im 
ing  this  elsewhere  on  States  and  localities. 

I  might  add,  noLfinly  the  Federal  Govemmeht  but  as  was  point- 
{m  ed  out  here  beforei^fliembers  of  this  committee  who  rely  upon  tests 
^  themlelves  for  appointments  to  the  military  academies,  why  don't 
theyapply  this  first,  s^e  how  it  works  with  them  ajid  #aybe  we 
can  go  on?.  : 

Mr.  GooDUNO.  I  won't  have  time  for  a  response  to  what  you  were 
just  talking  about  but  one  question  that  came  up  dtiring  the  discus- 
sioh,  concerns  this  business  of  eliminating  stanaardizeoT  tests.  If  we 
get  to  the  point  where  they  aire  no  longer  a  part  of  admissions-^ 
and  I  certainly  don't  think  they  should  be  the  only  criterion—but  if 
*     we  go  away  from  that,  will  not  those  schoolijiuch  as  Duke  Univer- 
^    sity,  for  example,  have  a  tendency  to.be  very  selective  from  which 
schools  they  choose  their  applicants?  Thei»  are  many  ways  to 
handle  this  matteir.  As  I  saidjl  will  not  have  a  chance  to  get  your 
response.  You  may  want  to  respond  in  writing. 
Ilie  second  tbin|f  w^  just  touched  on.  I  have  written  to  the 
•   chairman  just  re^tly  and  said: 

It  seeniB  that  before  this  committee  considers  marking  up  any  leglslatibn  designed 
to  regulate  standardixed  testing  which 'will  impinge  solely  on  the  privatt^tor»  it 
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ought  to  consider  the  impact  of  standardized  tests  administered  by  the  U.S.  Office  of 
Personnel  Management,  the  Armed  Services,  and  other  Federal  ^encies. 

If,  as  the  sponsors  of  the  testing  legislation  contend,  it  is  |i  matter  of  public 
interest  to  tpply  certain  testing  standards  to  the  private  sector,  it  is  even  more 
important  that  uus  Cbmmittee  investigate  the  ramincations  of  applying  such  stand- 
arai  to  the  Federal  Government.  * 

I  would  say.  againi  you  will  have  to  respond  in  writing.  I  am 
running  out  or  time.  I  am  wondering  whether  that  shouldn't  be  our 
main  ie^enue  because,  we.  surely  do  affect  an  awful  lot  of  lives  with 
the  kind  of  testing  that  takes  place  in  the  private  and  piiblic 
seo^rs.  Maybe  we  should  start  at  home.  I  am  not  sure  aboul;  that. 

Just  one  ottier  thing.  Again^  you  oan.respond  in  writing.  I  have  a 
cbncerngflJ^ut  ebmbining^th^  two  pieces  of  legislation.  In  your 
readings  these  .  bills/ some  people,  would  suggest  that  unions  then 
would  have  to  submit  such  information  as  copies  of  contracts, 
revenues  from  testing  programSi  and  testing  overhead  si)endin^r 

I  can  see  if  this  becomes  an  issue  of  that  nature,  knowing  this 
committee  and  the  makeup  of  the  Congress,  we  are  going  to  have  a 
real. problem  if  there  is^some  impact  on  the  unions. 

Dr.  Pbrrone.  It  seems  to  me  the  legislation  before  us  is  fairly 
limited.  It  doesn^t  deal  with  high  school  tests  given  by  teachers, 
doesn't  deal  with  State  competency  standards  or  .  tests  for  promo* 
tion  from  one  grade  to  another. 

Mr.  GooQUNG.  But  there  is  a  lot  of  talk  about  combining  two 
bills.  .  . 

Dr.  Perrons.  Let's  take  both  of  them.  Both  of  them  are  fairly 
limited  in  that  sense,  lliey  are  not  addressing  all  the  standardized 
tests  dyen  to  elementary  and  secondary  schoolchildren  in  the  Na- 
tion, ^e  bfll  is  fairly  focused  on  poetsecondary  testing  where  at 
least  large  numberiil  of  people  perceive  a  serious  ^problem  to  exist. 

One  can  take  on  that , question  without  at  the  same  time  thinking 
that  you  must  first  tak^  on  the  entire  world.  It  is  prescribed.  It  is 
prescribed,  I  think,  for  a  number  of  legitimate  reasons. 

Mr.  Andrews.  Thank  you  both. 

Your  time,  as  you  have  indicated,  has  expired. 

The  Chair  will  recognize  the  gentleman  from  New  York. 

Mr.  Weiss.  Thank  you  vem  much,  Mr.  Chairman. 

Just  to  reemphasize  the  point  tha^  Dr.  Perrone  had  made,  this 
legislation'  in  no  way  appli^  to  occupational  areas.  It  is  simply 
limited  to  adnussidii  to^tsedDndary  mstitutions.  Indeed,  Dr.  Snv- 
der,  in  your  testimony  Ithink  upu  acknowledge  the  fact  that  while 
only  H.R.  8564  applies  to  speciffc  tests  proceed  that  your  concern 
as  to  H.R.  4949  is  that  som^  of  its  provisions  might  well  be  incorpo- 
rated into  fined  legislation,  i 

You  have  no  concern  about  H.R.  4949  applying  to  any  occupa- 
tional tests,  do  you?  *  ) 

Dr.  Snyder.  My  concern  is  if  l^R.  4949  provisions  are  included  in 
any  bill  for  occupational  testing^  then , my  comments  would  apply. 

Mr.  Weiss.  You  do  agree  right  now  it  ^oe^not  address  occupa- 
tional testing 

Dr.  Snyder.  That  is  correct  : 

Mr.  Weiss.  Ab  far  as  Mn  Goodling's  statement^  I  just  warit  to 
reassure  hin^  suid  everyone  else  I  have  not  heard  of  any  intention 
of  joining  the  two  pieces  onlegislation,  so  regardless  of  wha);  may  or 
may  not  oe  in  somebody  elie's  mind,  it  certmnly  is  not  in  my  mind. 


Dr.  Rever,  let  me  ask  you  a  question.  Can  you  tell  us  roughly 
how  many  examinations  fox  admission  to  postsecondary  institu- 
tioAs  are  given  on  an  annual  basis? 

Dr.  Revsr.  Mr.  Weiss,  that  is  difficult  to  estimate  for  several 
reasons.  One,  we  know  that  the  college  entrance  examination 
board,  I  believe  in  their  annual  reports,  said  for  admissions  pur- 
poses it  was  something  like  a  million  and  a  half.  For  the  assess- 
ment it  is  about  900,000  each  year.  In  addition  to  that,  you  have 
the  intrastate  college  iidhiissions  teftting  programs  which  I  refer- 
enced in  my  eftrlier  remarks  which  must  offer  services  maybe  to 
Several  hunderds  of  thousands  of  stiidetats;  but  I  have  no  figures. 
.  Mr.  Weiss.  It  runs  into  th6  milUoni^  I  would  assume. 
Dr,  Perroi^.  Yes.  I  don't  have  A  precise  figure  for  you. 
Mr.  Weiss.  I  think  Dr.  Rever  had  indicated  there  was  a  concern 
al)out'the  constitutional  issue  in  tjie  situation  because,  after  all, 
what  we  would  be  doing  would  be  addressing  strictly  intrastate 
situations  between  institutions  and  the  students  within  a  partfou- 
lar  State,.  Ls  that  your  position? 

Dr.  Rever.  No.  We  say  there  are  essentially  two  parts  to  that. 
One  hau8  to  do  with  the  fact  that  it  is  simply  a  State's  right  political"^ 
issiiB* 

Mr.  Weiss.  What  do  you  do  with  the  situation  where»  for  exam- 
ple, in  New  York  right  now  the  mediral  people  have  taken  the 
position  that  because  of  the  exist^ce  of  increasing  New  York 
applications  they  will  not  give  tests  in  New  York  upon  applying  to 
medical  schools.  V  | 

Would  Federal  legislation  be  helpful  in  that  instance? 

Dr.  Rever.  Not  likely.  I  cannot  speak  Tor  the  Association  of 
Kledical  Schools. 

'Mr.  Weiss.  If  in  fact  the  Federal  law  re<|(Uire8  disclosure,  no 
mattei*  where  that  testing  organization  gave  the  test,  would -  there 
then  be  any  advantage  to  MCAT  saying  we  will,  move*  to  New 
Jersey  and  give  our  tests  there?  ^ 

Dr.  Rever.  I  don't  believe  AAMC  has  made  that  statement.  What 
they  said  was  if  your  bill  were  to  be  passed  they  w^uld  indeed  have 
to  change  the  nature  of  their  examination  as  it  is  now  offered  to  be 
able  to  sustidiL-aKvice. 

Mr.  W«(«m  MCAT  people  testifying  before  us.  Dr.  Cooper, 
Specifical^tated  th*t  if  in  fact  the  le^la^ion  passed  in  New  York; 
were  to  go  into  effect  and  b^  implemented  and  not  repealed,  they 
would  in  fact  move  out— they  woulcj;  not  give  those  tests  in  New 
York.  '    /  ■ 

Dr.  Rever.  Oh,  yes,  that  is  true,  but  you  have  asked  me  what 
would  be  the  effect  of  Federal  legislation  on  AAMC.  What  I  am 
saying  to  you  is  Dr.  dboper  hasi  responded  to  that  question  and  he 
has  indicated  theft;  the  nature  of  their  examination,  their"  new 
MCAT  would  have  to  change  to  be  responsive  to  this  legislation. 
They  object  to  that  becausie  th|y  feel  thev  are  not  cdnftdent  in  the 
nature  of  \that  examination.  They  would  have  to  revert  to  the 
former  type  of  examination. 

Mr.  WEISS.  How  long  has  the  new  MCAT  examination  been  in 
effect? 

Dr.  Rever.  Two  years. 


.  '  618.  ■  .    .-^z:  • 

Mr.  Mf^ss*  On' the  basis  of  that  y6u  are  cK>le  to  say  it  is  a  better 


examination.  .  » 

Dr.  Rbv£R.  I  have  not  done  ail  evaluati^  of  that.  That  is 
AAMC's  responsibility  aitd  I  cannot  'comment  on  that.  -j'  / 

.         ,TiTJET)HEI^  LEGIStATION  ON  TESTliNG 

Mr.  MiLLENSON.  Mr.  Weiss,  I  would  Uke  to  respond  further  to  the 
question  yoU  posed 'to  Dr.  Snyder  and  perhaps  we  can  get  some 
clarificajtion  of  our  concern  that  your  bill  dould  possibly  be  applied 
to  mor&than  just,  cq^l^  entry.  '    •  ' 

f\  In  your  opening  statement  at  the  beginning  of  this  series  of 
hearings,  you  said,  ^.^The  testing  industry/'  which  comprises  the 
compaliies  we  represent,  ^^despite  its  influence  over  a  vital  aspect 
of  individual  lives,  operates  in  a  most  unaccountable  fashion.  Like 
utilities,  testing  corporations  perform  a  public  function  and  they 
js^yyo]^  exempt  rroiE^KUblic  scrutiny,"  / 
:  Then  on  page  3. of  your  opening  statement  you  refer  to  the  fact 
that  50  miUion  youbg  Americans  will  take  up  to  three  standardized 
tMs  during  their  academic  careeris.  That  refers  not  only  to  college 
c^jtry  tests  but  the  elementary  and  secondary  schi3ol  tests  that  our 
Colbpanies  provide.  '  ■ 

Then  you  talk  about  at  least  $200  million  in  annual  revenues. 

Mr.  WiBiSS.  To  allay  your  ccmcern,  on  page  18  of  the  bill^  at  Une^L 
.  the  term  ^Standardized  tesVW  "test"  means:  (1)  Any  test  t^€^t  is 
used,  or  is  required,  for  the  i)rocesi^  of  selection  for  admission  to 
postsecpndary  educational  inqtituticJhs  or  their  programs;  (2)  any 
test  used  for  preliminary  preparation  for  any  t^t  ^at  is  u&ed,  or  is 
required^  for  the  process  of  selection  for  admission  to  postsecondary 
educational  institutions  Or  their  programs.  ^ 

Mr.  MiLLENSON.  I  am  aware  of  that  but  also  on  page  3  of  your 
statement 'you  refer  to  companies  which  are  npt  members  of  Our 
association  which  give  tests  which  are  not  college  admittance  tests. 
.   So  the  fact  you  reffll  speciflcally  to  them  raises  a  very  natural) 
question  in  our  minds  that  perhaj[is  there  might  be  SolduHj^  if 
not  how  and  speciflcallv  in  your  bill,  which  I  have  read  ili^M|l,  at 
some  later  tifne  to  apply  theseVestrictions  not  only  to  collegPentry 
4    tests  but  together  standardized  tests,  especially  as  we  see  some  of 
these  statements  that  have  been  made,  for  example,  in  the  New 
York  Times*.  August  15.  "A  passage  of  the  law  is  a  triumph  for 
I   Italph'^^  Nader  and  his  associate^  wh9 .  have  been  campaigning 

'  agamst  sl^dardized  tjests  in  genera^.-'   ■  *  % 
« J-    Mr.  Weiss.  You  areisatisfied  now  that  as  jrar  as  the  information 
before  you,  H.R.  4949  applies  only  to  admissions.  *  . 

Mr.  Mi&ENSON.  I  ami  absolutely  satisfled  of  thai  I  am  not  satis- 
fied as  to  What  further  intent  might  be  with  respect  to  this  legisla- 
tion or  how  it  might  foe  expanded  or  what  the  x^asis  might  be  for 
future  action,         '  f 

Mr.  WlussKiwIiat  you  are  doing  is  sounding  eat  earjy  alarm. 

Mr.  MtixE^soN.  I  aifi  indeed  doing  that,  sir.. r  y 

Mr.  )7^Eiss.  Dr.  Jlever,  can  you  tell  me  what  percentage  of  ahy 
.     particular  tbst  your  organization  gives  is  new?  : 

^^rJtEV|pft.  In  our  p^icjolar  test  th^re  isT-^me  explain  how  we 

.  .  .    *  /  J 


In  our  method  of  equating  examinations,  Nvhich  is  what  I  think" 
you  are  asking-^  '  i 

Mr.  Weiss.  No;  l  am  asking  really  for  those  questions  which  are 
used  in  developing  the  raw  score  on  the  basis  of  wluch  the  scores 
are  given  to  the  ^tudlnts  as  to  hpw  they  did  on  the  test.  Not  new 
questions.  There  are  equated  c(Uestions,  there  are  experimental 
questions!  I  am  not  cpncerned^about  tnose.  I  want  to  know  those 
questions  that  are  used  on  me  test  which  in  fact  are  new  in  any 
particular  test  that  are  used  with  a  score  given  to  the  student. 
Dr.  flEVER.i^aysI  contin^ie  on? 

Mr,  Weiss.  Suic^  we  arp  limited,  in  time,  try  to  give  me  a  percent- 
age if  youjjm  '  '■   1-  

Dr.  Rever.  a  hun(^?6d  percent  for  four  or  five  test  dates. 

Mr.  Weiss.  A  huhderd  percent  of  the  test  questions  are  new.  . 

Dr.  Rever.  Forjfour  of  the  five  test  dates.  ^ 

Mr;  Weiss.  In  any  particular  year? 

Dr.  Rever.  Yes.  That  is  why  I  wanted^  to  explain.  The  way  in 
which-^ — 

Mr.  Weiss.  So  even  without  the  disclosure  in  four  out  of  five 
instances  you  provide  100  percent  new  questions  in  each  test. 
Dr.  Rever.  Virtually.  V 
Mr.  Wjjiss.  There  would  be^^ — 

Mr.  Andrews.  He  says  he  wants  to  explain  that  you  are  misin- 

t^rpretingiiis  answer. 

Mr.  Weiss.  Iliope  I  am  not.  " .   

Dr.  Rbvbr.  The  question  is  related  to  the  manner  in  which  we 

equate  forms.  We  do  equate  all  of  our  forms  at  a  cfertain  test  date 

during  the  course  of  a  year. 

•  The  ev^uation  occurs  well  before  the  examination  is  entered^  so 
roughly  there  would  be  some  equivalent  to  cross  the  examination 
in  tiie  duplicative  items,  but  the  percentage  is  relatively  small. 

Under  revisions  that  would  be  required  under  your  law,  we 
would  estimate  ^hat  approximately  20Npercent  of  the  items  would 
be  repeated  items  for  that  purpose  and  80  percent  would  be  new. 

Mr.  Weiss.  Right;  so  that  it  would  be  80  percent  whether  we  had 
this  disclosure  requirement  Or  we  didn't,  have  it.  ^ 

Let  me  put  it  by  way  of  question.  On  that  basicilbhow  much  does 
it  cost  additionally  to  develop  that  20  percent  ^f  new  questions? 

Dr.  ReVer.  Our  position  is  that  the  additional  cost  is  marginally 
spread  over  the  millions  of  students  iVe  are  talking  about,  but  we 
did  make  a  point  that  one  must  be  careful  in  looking  at  the  law 
about  the  impact  it  has  oni  small  value  tests,  for  example,  braille 
tests.  ^  i 

The  cost  from  our  perspectii^e  is  not  the  central  issue  of  the 
legislation;  and  this  legislation,  its  desirability  or  xindesirability, 
should  not  be  based  on  the  cost  of  developing  different  forms  of  the 
examination.  That  is*a  misdirected  argument. 

Mr.  WEise.  You  are  aware  of  thfi  fact  that  H.R.  4949  provides  an 
exception  to  those  tests  which  are  given  to  5,000  fewer  parties? 

thr.  Revbr.  We  do  have  more  than  that  in  terms  of  special 
^administration,  but  different  versions,  for  example,  a  braille  vef* 
sipn)  and  so  on,  and  examinations  are  administered  essentially  865 
'days  a  year  on  the  shifts  and  the  like,  and  the  numbers  and 


int^ii^jretiktions  of  th9  intent  of  your  law  does  cause  us  a  cons| 
able  amount  of  concern^  because  it^g  all  called  the  sa^^e  test . 
M^Wuss.  One  final  area  of  questioning.  V 
Do  you  haye  any  information  to  give  us  as  to  the  margin  of  error 
that  is  buUt  into  any  of  these  academic  admission  tests? 

I)r.  Pbrronk*  llie  mar^n  of  error  tends  to  be  fairly  large  for 
most  tests  that  I  am  familiar  with/ 

For  example,  most  of  the  standardized^  tests  that  exist,  the  argu- 
ment is  that  in  two^thirds  of  the  cases  you  can  judge  that  the 
standard  of  error  will  fall  on  either  side  of  the  main  by  cmywhere 
from  8  to  4  raw  score  items.  ^ 
,       On  th^^SAT  I  suspect  that  it  would  range,  a  score  of  460  would 
|:.      probably  be  very  miK^h  like  a  score  of  56a 

That  IS  the  range  in  which  the  standard  of  error  would  accrue.  It 
tends  to  be  fairly  largie. 

I  think  that  it  has  been  a  mistake  for  Jtest  companies  to  give  a 
siru^le  scor«.  I  think  that  has  been  part  of  the  misleading  aspect  of 
the  scoring  syirtem.  <  ^ 

Mr.  Weiss,  oo  that  if  a  school  which  uses  one  of  these  tes|B 
decides  hypothieticallv  that  it  will  consider  for  admission  those 
§  students  that  score  600  or  above,  and  a  student  comes,  in  with  520, 
that  that  student  may  in  fact  be  excluded  oh  the  basis  of  the 
margin  of  irror  whioh  exists  in  the  test  itself  and  not  the  perform* 
ance  of  the  student?/ 

J)t.  Pbrrokb.  That  is  correct.  That  student  may  very  well  be 
excluded  by  some  institutions  for  that  reason. 
Mr.i  Wbi9S.  Dr.  Pottinger,  do  you  care  to  comment  on  that? 
Dr.  PomNORR.  We  once  asked  some.membeito  of  the  Educational 
Testing  Service  why  they  didn't  present  scores  to  clients,  to  teach- 
erS)  usmg  an  interval  score;  that  is,  saying  that  the  probability  is 
some  hi^  percent  that  a  student's  Iscore  vfalls  within  a  certain 
I'ange  to  try  to  break  down  this,  the  auriM  that  somehow  a  475  is 
oetter  than  a  450/and  in  fact  it  may  not  be. 
.  Yet  schools  may  make  decisions  on  the  basis  of  that  tliflerence. 
*  1  think  that  is  a  critical  probletn  in  the  test.  The  response  by  the 
Educational  Testing.  Service  was  that  they  provided  scores  and 
sbme  of  their  tests  in  interval  ranges^and  the  cljBnt  said,  ''We  don't 
^,ff:'  understand  this.  It^s  unclear.  Give  us  a  single  score;"  so  the  testing 
cbmpani^.are  not  4n  the  business  of  providing  information,  teach- 
iiiooople  better  ways  to  use^ the  tests. 
Tnw  ate  in  the  busihess  of  providing  a  product  that,  the  client 

Siks  K>r,  but  the  fact  that  the  client  asks  for  ^mething  simplistic 
^  that  they  ^  can  inake  decisions  that  in  fact  may  not  be  right)> 
sipms  to^be  of  no  responsibility  to  the  test  company,  so  there  is  no 
ificentive  jfbr  them  to  provide  that  information,  even  though  they 
reco^i^e  thai«tnat  would  be  a  preferable  way  of  presenting  the 
'Scor^* 

Mr.  WjMte.  Br.  Hever?  \ 
Dr.  BsviR.  If  I  can  respond  to  that? 
,  In  4eii»iu9e  of  either  Mr.  Millenson  or  Dr.  FergusonAl  don't  kijow. 
WhMk,  this  is.  Mr.  Millenson,  and  this  is  Dr.  ^rgu^on  [indicating]. 
Mr.  WwnJ  My  apologies    either  or  both  of  you. 
Dr.  tttwHj  The  issue  is  related 

think,  Mr. 


  issue 

^  iepoM't  ^tjfi,  in  faU;  I 


to  what  kinds  of  scores  em 
Weiss,  if  you  willL  look  .at  the 


kilids  of  scores  to  which  Dr.  Pottinger  was  referring,  those  that 
may  be  used  for  guidance  or  selection  in  postsecondaiy  institutions, 
ample  information  is  pi^ovided^  and  the  a9ta  are  reported  in  terms 
of  intervals. 

In  fact,  we  repoiikthe  data  typically  in  much  better  terminoloKyi 
and  that  has  to  do  with  probabilities  of  success  which  are  a  lot 
more  meaningful  to  most  students  and  admissions  officers  in  terms 
of  how  one  deals  with  those  (lata. 

Mr.  Weiss.  What  does  th6  student  receive  back  after  he  takes  the 
test?. 

Dr.  Revbr.  I  will  be  glad  to  provide  you  mtoy  copies.  \ 

Mr.  Weiss.  As  far  as  the  pcore?  ! 

Dr.  Revbr.  An  eiltimate  for  up  to  six  sch^ls  that  he  ciem  choose 
of  his  choice,  what  his  chances  of  success  aie  in  terms  of  acaHemic 
grades,  what  the  local  norms  are  for  the  examination,  how  do  his 
nijgh  school  e[rades  and  scores  compare  to  his  future  competitors 
within  that  institutions,  his  sc(](f*es  and  the  national  percentile 
ranges  for  his  school,  how  do  they  compare  to  the  entire,  population 
of  studento  who  have  taken  the  examination  for  the  previous  3 
years.  I   •  v 

In  addition  to  that,  there  is  something  like  probably  190  differ* 
eiit,  separate,  distinct  pieces  of  information  that  are  reported  to  the 
student  includii^  everything  from  whc^t  the  9peiiing  date  oC  the 
schoQl  is  to  what  it  costs  to  attend.  ' 

Mr.  Weiss.  Either  on  your  test  or  on  the  SAT,  does  the  Student 
receive  back  the  numerical  score? 

Dr.  Revbr.  Indeed,  they  do  get  numerical  scores  for  each  of  the 
subtests  that  are  reported  in  an  average. 

Mr.  Weiss.  By  number,  475,  525? 

The  student  id  not  adv^^  that  in  fact  this  is  the  range? 

Dr.  Bbvbr.  Indeed  they  are  in  the  handbook  for  students,  and  I 
will  be  glad  to  provide  you  one.       /  i"  ' 

Mr.  Weiss.  Before  or  after?         '  , 

Dr,  R;bvbr.  As  th^y  receive  their  test  scores  they  are  provided  ]^ 
intm)retative  data.  .  \ 

Mr.  Weiss.  liim  sorry.  Mr.  Millensol,  we  have  just  had  occasion 
to  check  with  me  Naval  Acadehiy  in  Tesponse  to  a  comment,  and 
you  will  be  pleased  to  know  the  SAT  ianq  the  ACT,  and  the  othdr 
academies  do  as  well  and,  therefore,  the  likelihood  would  be  that 

■  they-  /  ■ 

/  Mr.  MiiXENSQN.  I  am  referring  also,  J^f  course,  to  Member^  of 
C^iunresSi  the  ^  , 

Mr.  wieiss.  Those  are  occupational  tesu. 

Mr.  Millbnson.  This  bill  would  cover  the  service  academies?. 
Mr,  Weiss.  SATs.  , 

\Mr.  Andrews.  Are  Qiere  o^her  members  of  the  committee  who 
haV  questions?  ^ 

Mkv  Erdahl.  One  questiouj.  and  maybe  I  can  address  this  to  a 
specifi^member  of  the  panel.  i  g 

Dr.  Fqttingc^r,  majnbe  I  know  the  answ0r,  and  I  |uq  not  a  lawyer, 
but  I  Imow  latii^ers  ask  questions  like  this.  . 

lib  instMtiOjid  have  w  use  these  tests?  Couldn't  they  use  the 
grades,  their  oi^  entrance  examinations?  Do  any  institution^^  have 
to  use  th^  st^dardized  tests?       ^   .  ^  ^ 
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r*  PoTTiNQER.  Well/when  you  say  do  they  have  to,  I  assume  you 
saying  isn't  it  a  voluntary  process.  Some  institutions  cl^oose  not 


toluse  ^em. 

Dr.  Wever.  If  there  is  a  better  system,  they  are  entitled  to  use 
that 

Dr.  PoTTiNGER.  If  tMly  have  the  information  about  better  systems 
and  if  a  better  system  exists,  if  yoii  can  develop  them,  if  the 
information  is  clear,  of  course,  they  would  be  free  to  do  that. 

The  problem  is  that  information  i^  not  available.  We  don't  know 
enough  about  the  tests^^and  in  any  specific  example,  the  fact  is,  to 
get  the  information,  you  need  to  make  reasoned  decisions  about  the 
test  which  often  pieans  you  have  to  go  to  court  and  spend  years  in 
Court  to  eet  the  data  you  need. 

The  critical  issue,  you  raised  the  question  earlier  that  relates  to 
this,  and  that  is  important.  Who  is  getting  hurt  and  who  is  not  by 
the  tests? 

That  is  probably  our  major  concern.  " 

To  use  a  couple  of  concrete  examples,  it  might  l^elp. 

The  Foreign  Service,  I  realize  this  is  an  occupational  exam,  but 
the  example  gives  us  a  multi|)le  choice  test,  and  for  a  number  of 
years  the  Foreign  Service  because  of  that  test  yielded  a  highly 
white  middle  class,  often  iyy  league  cptps  of  people  which  was 
acceptable/ but  in  the  sixties  that  nption  came  under  question. 

Ipey  waived  the  requirement  of  the  Foreign  Service  test,  because 
minorities  and  others  who  did  not  do  well  on  the  test  needed  to  be 
given  access  to  those  jobs. 

They  discovered  some  years  later  that  those  people  who  did  not 
tfifke  the  tests,  some  of  them  became  their  star  Foreign  Service 
officers. 

They  came  to  us  in  another  firm  I  worked  for  at  that  time  and 
said:  ^'Why  is  this  happening?  Why  do  we  have  people  who  do 
badly  on  the  test  doing  well  on  the  job,  and  are  we  in  fact  discrimi- 
nating?" ^ 

The  study  that  we  did  for.  the  Foreign  Service  said  that  the 
problem  is  the  test  items  compare  and  contrast  with  a  Mozart  and 
Shubert  scenario  and  simply  did  not  relate  to  the  job  of  doing 
Foreign  Service  work.  ' 

You  don't  know  what  those  items  are  about,  and  what  the  char- 
actefiftics  and  how  it  relates  to  outcomes,  if  you  don't  have  infor- 
mation. ^ 

Second,*  I  think  that  the  people,  the  point  I  am  really  trying  to 
make  is  those  that  are  being  protected  often  are  the  people  who 
haivf  learned  to  take  tests  or  learned  to  do  well  on  specific  kinds  of 
nts  that  have  littlef  relationship  to  the  more  important  conse- 
ces  of  education,  work  and  living,  and  I  think^  the  notion  that 
s  are  SESnorient^^/  correlated  with  socioeconomic  status  is 
ly  true  of  multipl^hoice  teeis.  ^ 
u  read  David  McClelland's  article  in  1972  called  "Testing  for 
Competence  Rather  than  Intelligence."  There  are  other  examples 
in  th^  human  services,' particularly  mental  health  where  people 
use  inner-personal  skills  effectively,  but  we  test  them  for  esoteric 
knowledge  analogous^or  sort  of  irrelevant  kinds  of  esoteric  kinds  of 
inforn^tiofi.     •  s  \-  '  ■  .  & 
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Mr.  l2llu>AHL«  What  are  thej  alternatives  to  a  standardized  test 
that  are  workable?  Somebody  brought  up  the  essay-type  tests.  Any- 
body who  claims  that  the  standardized  tests  are  the  only  thing  you 
yi^ant  to  lopk  at,  would  be  in  error  if  they  limit  .their  consideration 
^  this. 

It  should  be  grades,  personal  contact  or  Jntelyiewj  but  what  are 
youfluggesting? 

Dt>PoTnNGER,  I  would  ask  the  universities  and  colleges  who 
don't  use  the  test  what  their  mechanisms  are.  Tcan  tell  you  from 
our  own  research,  the  preferable  alternatives  ar#ffieasures  where 
people  have  to  demonstrate  the  very  skills  that  they  are  being 
asked  to  use  in  their  work  and  life  responsiblities. 

It's  interesting,  I^hink,  that  the  reason  multiple-choice  tests  

Mr.  Erdahl.  I  hbi^you  don't  carry  that  analysis  tq  a  brain 
surgeon,  where  you  have  to  demonstrate  1«^^  get  into  medi> 
cal  school. 

Dr:  PoTTiNGER.  I  would  argue  the  other  way  recognizing  correct 
items  on  a  multiple-choice  test  which  is  the  way  we  now  certify 
brain  surgeons  is  probably  even  less  adequate. 

The  reason  multiple-choice  tests  do  correlate  with  the  first  year 
of  school  is  because  the  very  way  we  operate  in  education,  especial- 
ly in  the  early  years  is  multiple-choice  tests. 

Once  we  get  into  the  real  world,  we  are  not  confronted  with 
information  in  a  multiple-choice  format  wnere  we  have  to  recog- 
nize the  correct  alternatives.  We  are  confronted  with  a  number  of 
domains  of  behavioral  and  affective  qualities  that  cannot  be  meas- 
ured by  multiple-choice  teste. 

,  We  are  saying  we  will  allow  people  the  opportunity  for  work  as 
proifesdionals  or  whatever  the  schools  are  admitting  them  to,  if  they 
can  demonstrate'  that  they  can  get  through  that  first  year  of 
school.  Forget  about  the  rest  of  their  qualities  that  will  be  required 
of  them  in  their  later  years  of  school  and  on  the  job. 

Mr.  Erdahl.  We  are  getting  into  a  brandnew  concept  here  that 
everybody  then  should  be  entitled  ito  enter  a  college  or  university. 
You^are  saying  that  in  a  sense  if  you  don't  make  it  the  first  year 
you  dpn't  mcJce  it,  but  at  least  you  have  that  chance  to  go  for  1 
.  year.  .  '  ^ 

That  adds  a  new  dimension  costwise. 

Dr.  POttinger.  I  am  only  focusing  on  the  inadequacy  of  thi& 
particular  method  for  gatekeeping.  There  are  beginning  to  ^emerge 
work  samples,  what  we  call  operant  measures  rather  than  respond: 
ent  measures  whejpe  we  ask  people  to  demonstrate  something. 
^  One  reason  these  methodologies  are  not  being  utilized  is  because 
the  inadequacies  of  the  current  system  aye  not  being  exposed. 

Mr/ Erdahl.  I  would  hope  institutions  would  use  a  broad  spec- 
trum of  different  criteria  in  admitting  students.     ^ . 

I  spent  some  time  at  the  Mayo  Clinic  .over  the  August  recessi  and 
they  have  a  rather  exclusive  medical  school  there,  because  they 
have  several  thousand  applicants  for  40  members  ip  the  class. 

There  the  grade-point  jptveuiage  of  th^  people  that  apply  is  prob* 
ably  close  to  4  points.  \ 

I  talked  to  one  of  the  i)eQple  there,  Who  said  they  um  these 
various  tnings,  personal  mjterviews,  and  for  the  out-of-State  stu- 


dents  1;|ley  allow  five  n^w  mem] 
ftpplicantsv  any  one  o£  which  may] 

They  go  by  jtandardized  tests, 
to  broaden  out  a  class  as  far 
bacjcgrounds. 

I  would  hope,  and  I  don^t  th 
York's  intent  at  all,  that  they 
the  standardized  test  a?  one  of 

I  thinx  also,  Mr.  Perrone, 


each  year.  They  haive  1,400 
^  could  make  it. 

:^hool  grad^,  interviews,  and  tiy 
.cUfferent  ethnic  and  geographic 


this  is  the  gentleman  from  New 
n't  exclude  the  possibility  of  using 
e  topis,  % 
Ou  ietre  eager^tdPl^iedce  a  response. 


Dr.  PomNGER.  I  would  agree  |with  that.  The  example  you  have 
given  ib  an  excellent  one,  and/we  would  concur.  We  are  not  saying 


we  should  throw  out'  all  si 
open  them  up  for  analysis  so 
when  tney  are  not. 

I  can  cite  examples  of  la 
said:  ^1  don't  have  time  to 
ation,  if  they  know  we  werl 
would  be  all  i>ver  my  back.'' 


ardized  tests,  but  saying  we  should 
e  can  knW  when  they  are  good  and 

school  deans  of  admissions  who  have 
that,  and  anyway  my  alumni  associ- 
taking  people  who  make  below  650, 


liiat  is  the  other  side  of  t|ie  problem. 
"   Mr.  Andrews,  When  you  way  we  should  open  them  up  so  that  we 
can  know  when  they  are  go<Kl  and  when  they  ure  not,  who  is  ^Ve"? 
Dt.  PotTiNGERf  To  begin  with^  it's  the  students  who  take  them. 
Its  rese{u*chers  want,  to  bB  better  informed  about  the  effect)?,  for 
instance,  the  discriminatoiy  effects  or  the 'relationship  between 
those  measure  and  the  socic  economic  status. 

We  are  put  intoX^oublc  bind,  and  when  are  the  pr^nents  of 
this  bill  ^ing  to  show  somo  data  that  these  tests  are  discriminato- 
ry. How  can  we  show  the  data  when  we  can't  have  access  to  it? 
•  We:  don't  want  to  be  frujitrated  by  the  need  to  go  to  the  courts 
and  pay  lots  of  money.  Most' of  us  can't  afford  the  thousands  of 
dollars  that  is  required  to  go  (o  the  courts  to.get  this  information. 
Dr.  Revtbr.  May  I  r^pond'jto  that,  sir? 

Dr.  Pottinger  knows  full  y^rell  that  the  issue  clf  hiding  daV  relat- 
ing to  bias  and  the  like  ii^  certainly  not  the  case  with  luting 
agencies  that  I  deal  with.  1 

We  have  never,  ever  tum^  dowrt  a  responsible  researcher  frpm 
taking  a  look  at  the  contents  of  our  examination  or  any  of  the  ddt^i 
that  we  have  in  our  files. 

In  fact,  we  provided,  upon  request,  people  with  significant  data 
sources  which  they  can  make  judgments  about  all  kmds  of^thingsX 
to  which  testing  is  related,  j^jprie  of  which  has  to  do  with  learnings  ' 
by  the  ^ay,  but  that  |b  part  of  it. 

The  data  that  we  ^de  is  hard  for  us  to  understand,  you  see, 
because  when  you  talk  about  the  issue  of  is  the  exanupation  biased 
against  pertain  classes  of  peoble  in  our  society,  in  fact  the  t^t 
agencies  have  been  the  ones  wqo  have  been  the  leaders  in  analyz- 
ing the  effects  of  their  examina1|;ions  and  the  use  of  th^ir  examina- 
tions on  those  very  peosle.  '  ' 

What  we  do  in  fact  find  is  that  the  examinations,Si4i^n  used  for 
selection,  soften  work  in  ihe  favbi^^  of  Jthe  disadvantaged  rather  than 
vice  versa!  i^^d  i^cyp  claim  that  there  is  untold  and  unkftown  kinds 
of  disastrous  efi(^B  on^society  throttgh  the  use  of  examinations  is 
indeed  well  reseai^ed.  \ 
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What  the  proponents  really  want  to  talk  about  is  the  contents  of* 
the  examinatipn.  it 

I  .cannot  tell  \mether  the  examination  is  inherently  biased . 
against  certain  parts  of  our  society  unless  I  see  the  contents  of  the 
examinatipn. 

Well,  we  have  faculty  members  every  year  by  the  scores  who 
look  at  the  examinations,  and^  admissions  officers  look  at  the  ex- 
aminations as  a  part  of  choosing  which  examinations  are  they 
going  to  require  fpr  their  students. 

To  assume  that  they  do  not  know  the  contents;  and  it  has  not 
been  studied  by  acadlemic, committees  who  are  in  charge  of  admis- 
sions, is  really^mifising  the  point. 

Mr.  Andrews.  Js  there  anything  contractual  or  otherwisei  be- 
tween the  testing,  for  a  lack  of  better  terminology,  company,  who- 
ever makes  the  test  and  the  schools,  say,  a  subscribing  school? 

We  will  take  Rochester,  whoever  it  is.  Is  there  anjrthing  that 
precludes  the  pjBople  at  Rochester,  the  members  of  the  admissions 
committee,  the  des^n' of  admissions,  or  whatever,  doing  with  t^at 
test  whatever  he  or  she  wishes?  ^  : 

If  they  want  to  go  to  AP  or  UPI  or  something,  and  ^ve  copies  of 
the  test  to  anyone  who  might  ask  them,  is  there  anyl!hirig  that 
precludes  them  from  doing  that?      *  \ 
What  are  the  exponent  of  secrecy  here? 

Dr.  Rever.  In  general  there  are  copyright  laws;  they  could  not 
reproduce  the  examination  which  falls  under  copyright  law.  In 
most  of  the  documei^ts,  all  of  the  examinatipns  are  in  fact  cdp^r 
■  righted  by  a  test  sponsor.  f 
Mr.  Andrews.  Whsit  does  that  mean  exactly?  That  means  they 
couldn't  reproduce  it  and  sell  it? 

Dr.  Rever.  I  believe  lit'also  means  distribution  of  any  kind.  They 
could  not  reproduce  it  and  distribute  it  at  any  time. 

Mr.  Andrews.  Where!  the  student  wh^  feels  he  or  she  might  have 
been  discriminated  against,  could  that  student  go  to  the  appropri- 
ate office  of  the  school  and  say:  "I  want  to  see  a  copy  of  the  tesH 
took  and  on  which  I  received  a  low  grade.  L  know  I  saw  the  day  I 
took  iJt,  but  I  brought  my  parents  with  me  and  we  want  to  see  the 
test  again."  ,  \  * 

Is  there  anything  that  would  preclude  the  appropriate  .pfficial  at 
that  institution  to  say:  "Here  is  a  copy  of  the  test." 

Dr.  Rever.  Often  he  has  an  equivalent  form  that  he  could  share 
with  the  student.  There  is  nothing  that  precludes  them*from  dojng 
that  in  our  policies.  In  fact,  students  upon  request  cannot  see  ^ 
copy  of  the  Examination  unsupervised  and  the  like,  .but  we  have 
had  attorneys  and  students  who  show  up -for  ^particular  examina- 
tiohs  and  we  sit  down  with  them  bibth  And  go  through  the  examina- 
tion. ^  .  J 

Mr.  Andrews.  It  iseems  that  the  bill  would  cause  the  tdst  to  be 
made  public,  and  I  guess  my  question  is,  are  they  now  public? 

Dr.  Bever.  No,  sir;  they  are  not  to  the  students.  The  publication 
of  the  tests  themselves  are  under  the  control  of  the  test  agencies 
J    and  the  test  sponsors,  and  they  are  not  t)ublic  record  at  alL  • 
(       We  control  who  sees  tHem  and  who  does  not,  the  purpose  df 
which  is  not  to  hide  ^e  examination*  ) 
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T.  ANDftB^.  When  you  say  we,  you  are  talking  of  the  testing 
yw«*panv?   ^  , 

I^dont  thinly- thd  studen|)^;probably,  orJ;he  applicant  who  is  not 
now  a  student 'and  is  disgr^tled  by  reason  of  the  fact  he  or  she 
wasn't  admitted  to  be  a  student^  that  is  the  person  we^ate  trying  to 
assist;  is  that  right?  .r 
Dr.  Rever.^  Right/    .  a 

Mr.  Andrews.  Yousay  that  appliamt  does^ot  have  access  to  the 
test  or  may  or  may  not  have  from  the  company  that  prepared  the 
tedt;ibut  the  student,  as  1  understand  itnrhas  no  relationship'  with 
the  company  preparing  the  test? 

.  The  applicant  has  some  sort  of  ki^lationship  to  the  institution  to 
which  he  or  she  applied,  and  that  institution,  not  the  tesiing  com- 
pany, which  has  denied  the  applicant , admission,  is-^iiat  right? 
Dr;  Rever.  TjhaWs  correct. 

Mr.  Andrews.  Is  ^here  anything*  to  prevent  the  applicant  going 
to  the  institution  and  getting  such  information  he  or  she  might 
want  as  to  why  that  institution  failed  to  admit  him? 
Dr.  IIever.  Indeed  they  may,  , 
Mr.  Andrews.  Would  that  not  relate  toJihe  iristitution'is  right? 
The  institution  is  not  precluded  from  givingjthat  Wormation  to 
the  student? 

Dr.  Rever.  That  is  correct,  as  far  tis  I  know.  f 

Dr;  Perrone.  I  have*a  sense  that  Mr.  Andrews  has  really  moved 
very  <?lose  to  the  fundamental  issue  in  the  bill. 

Ought  the  person  who  takes  the  test  have  an  opportunity  to  see 
what  it  is  that  he  or  she  is  being  judged  by? 

The  precluding  of  that  individual  from  seeing  the  examination, 
seeing  the  answers,  seeing  their  own  answers  in  relation  to  it  is  the 
frmdan^ental  issue  in  this  bill.  ^ 

Mr;  Andrews.  I  don't. know' this,  and  I  no  doubt  should,  is  this 
bill  directed  at  the  testing  company  requiring  the  testing  company 
to  make  the  test  public,  or  is  it  directed  to  the  institution,  fpr 
instance,  Duke  University,  who  denied  adniissioh  to  the  applicant? 

Dr.  Perrone.  In  the  case,  for  example,  the  law  sqhool  acUnissions 
I  council  is  technically  responsible  for  the  administration  of  this  law 
school  aptitude  test.  That  is  prepared  on  their  behalf  by  the  educa- 
tional testing  service. 

I  might  say  they  do  have  a  process  for  review.  The  process  is  long 
and  complicated. 

A  student  who  might  want  ^cess  to  the  LSAT  would  be  in  a 
proces%  for  months  and  months,  and,  then  might  see  the  exam 
,  Under  conditions  hardly  conducive  to  a  serious  review  and  long 
past  the  point  of  it  doing  that  student  a  lot  of  good.  . 

Mr.  .Andrews. ''tlk)e8  this  bill  require  the  testin|  company  to 
make  public  the  test,  or  does  it  require  iSie^appropriate  offricifids  at 
Duke  University  to  make  public  the  test? 

Dr.  Perrone.  .The  offioials.  at  Duke  University  do  nqt  have  the 
test.  ^ 

Mr.  ANDREWS.^ell,  let's  pick  an  Insti^ion  that  dpes  tiot. 

J)j.  Perrone.  ACT  has  the  test;  ATS  has  the  test,  the  law  school 
adimssions  council  may  ha\ft  the  test,  the  American  Medical  Col- 
legemay  have  the  test.        ;  ^ 
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Mr.  Andrews.  Well,  my  question  is  to  whom  is  the  directive  in 
this  bill  directed? 

Mr.  Weiss.*^  The  test  agency,  and  the  test  agency  may  indeed  be 
the  testing  company  as  in  the  instance  of  ACT  or  ETS.  It  could  be 
the  law  school  admissions  council,  the  agency,  bujt  it's  not*  the 
institution,^  and  Dr.  Rever  may  have  misunderstood  perhaps  some 
of  the  questions,  because  1  think  in  the  course  of  the  dialog,  gave 
responses  Ivhich  may  be  ambiguous,  and  perhaps  he  can  try  to 
clarify  tha ;.  ^  - 

OK,  agmn,  is  it  not  true  that  it's  the  testing  agehcy  which  has 
the^uitim^te  proprietary  right  in  the  examination  which  is  given  to 
the  student?. 

Dr.  Rever!  Yes.  ,  ■  "     ■  r 
Mr.  Weiss.  After  the  studejit  completes  that  examination,  the 
examination  goes  back  to  the  testing  agency  itself.  » 
Dr.  Rever.  Yes. 

Mr.  Weiss.  It's  the  testing  agency  which  then  supplies  what  to 
the  institutions  who  are  the  using  institutions?  ' 

Dr.  Rever.  Score  reports  and  interpretive  manuals. 

Mr.  Weiss.  Right,  but  not  the  individual  applicant's  test  and 
results.      '    ■   '         :  . 

Dr.  Rever.  That  is  correct.  ^ 

Mr.  Weiss.  The  applicant*  can  in  no  way  go  to  the  institution 
because  at  the  tinie  he  takes  ^he  test  he  may  have  indicated  a  half 
do^en  institutiqns  to  which  he  would  like  to  have  the  jtest  scores 
sent.  /  * 

Dr.  Rever.  Yes.  "    •  ' 

Mr.  Weiss.  This  bill  is  in  fact  necessary  if  we  were  in  fact  to  have 
the  kind  of  accessibility  that  Mr.  Andrews  indicated  the  student  or 
'  student's  parents  would  like  to  have  as  to  how  the  student  did  on  a 
particular  examination,  and  what  he  did  in  relation  to  a  particular 
question;  is  that  right?  ■  ^ 

Dr.  Rever.  That  is  correct. 

Dr.  PoTTiNGER.  I  want  to  make  a  simple  elaboration,  because  I 
think,  Mr.  Chairman,  you  have  fingered  the  issue  as  he  says,  and  if 
we  look  at  an  item  on  a  test  we  were  involve^  in  a  case  where  we 
were  finally  allowed  to  ^lee  the  items.  ^ 

An  expert  in  the  industry  that  the  test  was  developed  for  saw  an 
item  on  the  test,  and  I  am  using  one  item  as  an  example  that  could 
represent  many.       ^  \ 

This  item  has  nothing  to  do  with  what  this  outcome  is  to  be 
predicting.  •  : 

In  my  bpinio^  it  just  is  unrelated.  It  happened  to  be  a  case  where 
the  item  related  to  information  that  had  been  Out  of  date  for  25 
years. 

The  point  is  that  so^£^lled  objective  tests  are  at  the  base  viery 
subjective.  Someone  has  io  d^cide  what  are  the  iteAs.  What  are  the 
questions  we  are  going  to  asK? 

Who  are  those  people?  How  are  they  selected,  and  what  do  they 
ask? 

If  you  simply  take  the  test  developer's  word  for  it,  and  you  may 
get  the  pames  and  even  the  addresses  perhaps  of  the  people  who 
made  up  the  items,  but  what  is  it?  What  are  their  values?  ^hat  d(J 
they  believe  is  important/  \ 
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THe  point  I  am  making  i$  that  there  are  times  when  some  of  us 
feel  that  their  suiybcU^  opinions  about  what  goes  into  the  con- 
tenta  of  those  tesii^  inappropriate. 

We  hav0  no  way  to  chs^lenge  it,  unless  we  go  to  court  and  go 
through  the  mechanisms  that  we  ha^e  heftrd  about. 
^  We  simply  cannot  make  a  ^straightforward  challenge  to  the  sub- 
jectivity that  is  inherent  in  thesd  tests. 
What  is  ot^ecftve  .^bout  them  is  not  the  content,  but  tly  way 
iy  are.given.  I 

Mr.  AiNVREWS.  May  I  ask  this  question?  If  the  persdi  or  persons 
itpmade  the  test  that  you  now  perhaps  question,  assuming  that 
}u  or  somebody  comes  to  the  conclusion  that  certain  questions 
irere  not  relevant  or  the  te^t  was  in  some  way  not  fair,  what  do ' 
you  prescribe  be  done^  that  you  designate  who  . make  the  next  set  of 
tests  or  who'is  to  make  the  designation  of  which  subjectivity  the 
applicant  is  going  to  be  subjected  to?  ^ 

Dr.  PomiiQBR.  I  think  there  is  an  intermediate  step.  Before  we/ 
can  answer  the  quiBstion  of  what  is  a  fair  process  of  arriving  at  thf 
decision  of  what  content  should  be  on  the  tedt,  we  have  to  know 
what  the  content  is.  Once  there  is  a  body  of  professionals  or  other 
experts  who  say  we  think^this  is  contrary  tto  the  best  interest^  of 
students  gQing  mto  this  school  or  into  this  profession,  then  we  can 
have  an  open  dd^te  and  the  process  may  in  fact  come  down  in 
fayor  of  the  test  as  it  stands.  . 

That  woidd  be  OK  if  in  fact  the  consensus  or  someidiie  process 
led  to  that  conclusion.  We  simply  don't  have  a  process  that  enables 
to  have  ^at  debate  or  to  cl^enge  the  beople. 
The  tedt  developers  often  an  the  people  responsible  for  picking 
those  who  write  the  item|t  Thelefore  they  in  a  sense  are  responsi- 
ble for  the  content  of  xhe  tes^  indirectly  or  sometimes  directly. 

Again,  there  is  no  wi^  to  challenge  that  process.  It  is  a  tremen- 
dous power  of  an  industry^  If  we  were  buildiing  automobiles  the 
way  we  are  buijiding  teste  and  we  c^ly  allowed  a  certain  few 
.  experts  to  design  the  parte  and  kept  them  secret,  we  would  be  in  a 
.real  mess.  .  , 
,  We  do  not  have  innovation.  We  would  not  have  very  good  prod- 
ucts probably.  Yet  the  industry  and  soi^e  experra  would  say  this  is 
th^best  car  we  can  produce  and  the  exerts  agree  with  it. 

The  fact  is  we  have  to  ope|i  those  decision^  lUp  for  debate  due 
process.  * 

Dr.  Perrone.  The  specter  that  is  before  us  is  after  possibility  and 
after  open  d^ate  these  examinations  get  strengthened,  they  may 
get  strengthened  to  the  i>oint  where  they^are  so  credmle  they  may. 
even  have  more  power  in  the  American, society  than  they  havc^ 
already.  I  can  see  that  potential.  ^ 

There  is  the  other  jpotential  that  the  alternatives  will  be  exam- 
ined more  seriously,  tt  is  very  difficult  for  an  institution,  a  college 
or  university,  especially  th^  that  are  not  in  the  top  10  or  15,  to  go 
it  al6ne  in  alternative  directions  when  the  wave  is  all  somewhere 

doin  could  ed9ily  discard  .the  SAT  as  it  did  by  sayirig  it 
it  relate  to  anytning  that  is  important  to  us.  Hamps^ir^ 
could  discard  the  SAT.  Harvard JJiTiversityfnd  College  caiT 
ah  Whittler  has  said,  we  npllonger  U9e  the  SAT  to  the 
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degree  that  we  did  15  or  20  years  ago.  It  doesn't  meet  our  purposes 
anymore.  _ 

But  there  are  2,000  other  institutions  in  the  Uhited  States  that 
in  fact  through  their  own  accrediting  associations  have  to  show 
some  kind  of  qucdity  mechanism  arid  the||  refer  to  this  process  as 
their  way  of  doing  that. 
I  think  historically  we  have  examples  of  procedures  that  are 
.  different  than  those  that  we  tend  to  be  trapped  into  at  the  mo- 
ment. The  8-year  study  in  the  late  thirties  ancT  early  forties  pro- 
>   vides,  I  think,  a  very  good  example  of  alternative  procedures  for 
*  *  showing  colleges  and  universities  what  people  in  fact  can  do. 

They  were  much  more  operant  in  David  McClelland's  terms  than 
the  tests  we  now  use.  I  am  convinced  that  those  alternatives, 
though  known  about,  are  not  used  to  any  great  extent  today  be- 
[  cause  of  ihe  power  of  that  process  which  is  already  in  place, 
r  *  If  we  are  going  to  have  the  serious  debate  that  I  think  ^ucation- 
ally  and  politically  and  culturally  we  need^bout  these  powerful 
forces  in  people's  livesj  then  we  have  to  rapose  everything  that 
exists.  To  leave  any  of  it  hidden  is  tiot  in  the  best  interests  of  the 
society  in  any  form. 

I  wanted  to  respond  to  Mr  Goodling  and  Mr.  Erdahl  in  part,  a 
question  that  aren't  we  going  to  encourage  a  coaching  industry. 
.1  might  only  suggest  that  Mr.  JCaplan,  who  has  the  largest  of 
.  that  bit  of  industry,  has  not  shown  up  anywhere  that  I  know  pf  to 
argue  in  favor  of  any  of  these  bills.  In  fact,  it  is  fairly  clear  that 
the  bill  that  is  before  you  might  in  fact  do  damage  to  that  kind  of 
enterprise  by  msdting  it  possible  for  the  public  sector  to  carry  out 
1      more  effectively  (what  Mr.  Kaplan  seems  to  have  a  particular  hold 
1     on  at  the  .moment.  # 

j  I  think  in  fact  we  will  see  a  different  process  than  more  of  that 
i     kind  of  industiy .  ^  *'  |/ 

One  last  comment:  The  one  thing  that  has  not  been  said,  and  it 
stays  with  me  because/I  work  with  large  numbers  of  people  who 
have  not  typically  gone  to  graduate  schools  Or  professional, 

^And  one  of  the  things  that  has  been  very  disconcerting  is  trying 
to  encourage  individuals  whose  experience  with  these  kinds  of  tests 
.  have  been  so  negative  that  while  qualified  in  every  Tespect,  they 
won't  take  the  GRE,  they  won't  take  the  LSAT,  they  won't  take 
the  MQAT,  because  they  absolutely  don't  want  to  go  through  what 
they  perceive  to  be  a  humiliating  process  that  the^  have  not  had 
any  kind  of  success  with  in  the  past?  y  \ 

Yet  their,  qualities  would  make  fine  attonrieys  and^firie  doctors 
and  yet  they  have  not  even  made  the  step/^  \ 

Mr.  Andrews.  On  what  dd*  you  base Jmat  judgment— yOu  say  they 
are  well  qualified— by  your  subjectiy6  standards?  \ 

Dr.  Perrone.  I  am  going  to  sjiggest  to  you  that  ♦their  qualifica- 
tions don't  in  and  of  themse];vBS|permit  that  entry.  JTherii  are  a 
number  of  schools  that  demahd  trat  test  be  taken  and  there\are  a 
.    number  of  pfeple  whose  ^perieftces  have  been  so  negativeXthat 
they  don't  take  them.    X  \  \ 

1  am  suggesting  th^is  the  power  of  that  particular  piece.  It  a 
power  that  I  think  i^s^far  greats  than  we  ought  to  Ifolerate. 

To  the  degree  tl^at  wl  open^the  process  up  and  suggest  that  there 
tie  alterhatives^4o  the  degree  that  the  strengths  as  well  as  the 
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I  think  that  is  fundamental  to  the  bill..  * 

tklucaUopally  there  in  apsqlutely  nothing  in  the  bill  that  would 
cause  the  tfest  to  be  poorer  than  they  are  now/From  my  perspec- 
•    tive,  everything  in  the  bill  would  caiisd  the  tests  to  be  far  better 
than  they  have,  ever  been  if  that  is  the  direction  that  seems  to 
come  out  of  that  public  debate. 

Mr.  ANDitEWS.  May  I  aak  you  to  comment?  If  I  understand  one  of 
the  argumehts  to  thfe^contrary,  what  good  would  it  do?  In  other 
words,  I  understand  the^  opponents  to  say  that  if  th^  bill  became 
law  so  that  the  applicajats  various  schools,  say,  next  year 

would  not  have  the  benef!tM)f  having  the  questions  that  are  going 
to  be  submitted  to  them  in  advance  of  taking  the  test  so  that  thev 
might  find  the  answers  and  hence  if  their  memory  is  any  good, 
mSce  100  or  1,000,  whatever,  in  orde!'  to  avoid  that,  I  believe  they 
say  it  would  b4  neceffiicuy  at  each  vesting  period  to  come  up  with  a 
.  iiaew  test.  \    .  '     ]  \  ■ 

Do  .yoU'Con(^e  tliat  probably  to  be  the  case? 
Dr.  Perrone.  Y/afu  have  already  heanrfrom  Mr.  Reyer  that  ACT 
has  a  new  test  right  now.  That  does  notNoeem  to  be  an  obstacle. 

Mr.  Andrews.  What  good  would  it  do  td^ake  public  the  test 
given  in  1979  io  there  would  be  this  public  debate  and  examhiiation 
as  to  the  credibility  oj  feasibility  or  value  of  the  1979  test  if  the 
.  1980  test  is  in  fact  going  to  be  an  altogether  different  test? 

Dr.  PcnriNGlfR.  K  wquld  not  help  tnose  who  toofc\the  1979  test, 
but  t)nce  we  unde^tand.  how  the  1979  test  was  constructed,  why 
the  ones  that  are  under  dispute  were  put  in,  we  m'ayNjhange  the 
IdSOtest.  "  .  ^ 

Mr.  Andrews.  But  you  t^e  not  going  to  make  the  1980  test.  The 
same  people  who  made  the  1979vtest  are  going  to  make  the.  1980 
test;  \ 
lit.  PoTTiNGER.  That  i£ft  the  point.  T^ey  are  goin^  to  «nake  the 
'    decisipn  every  year 'without  any  of  us"^  having  sm  mput  into  the 
•  processt 

iMr.  Andrews. -You  cannot  have  an  mput  into  the  process  by 
Bavingtaiade  available  to  you  the  19^9  test?  They  are  going  to 
isiakeiu^  1980  test  and  you  will  not  have  a  copy  until  it  has 
alread/b^n  giverkright?  .  ■  „       ,^  . 

Dr.  POTTINGER.  That  is  right,  you  are  correct.  We  would  not  have 
direct  input  in^  the  item  writing.  They  would  still  produce  those 
tests.  I^think  :we'would  demonstrate  whether  the  tesjs  are  in  fact 
being  effective  of  not  ■  . 

Let's  go  Idfibk  to  alsifnple  example.  There  ftiay  be  items  on  the 
('  test  that  simply  are  not  appropriate  to  what  we  are  trying  to  test. 
We  don't  know  that  ImrithQUt  seeing  the  items.  That  is,  someone 
'  may  think  they  are  Appropriate.  The  testers  may  feel  they  are 
apprc^priate  and  the  peome  whb  wrote  the  items  may  fctel  they  are 
appropriate.  That  is  a  very  limited  number  of  people  who  have 
control  over  the  decisions  that  are  being  made.  )         |  . 

We  are  simply  asking  that  80i|[iehow  the  process  be  so  that 
more  than  these  priviteged  few  p^ple  make  the  decisicms  about 
how  ou^^^oung'people^are  admittef  or  rejected  from  schools.  That 
is  the  basic  piot  of  it.  '  * 

Mir.ANSwfflfrMr.Erdahl? 
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Mr.  Eadahl.  I  believe  the  spread  and  standard  are  in  error,  I 
think  .we  had  the  ijgure  pointed  up  of  100  points^in  the  SAT  test 
and  information  the  staff  has  provided  me,  I  under|tand  it  is  a  80- 
point  spread.  Mayb6  that  is  too  big^  but  it  is  not  as  big  as  100 
points. 

Would  you  waht  to  comment  on  that? "  , 

Dr;  Perrone.  It  depends  on  where  you  are  on  the  scale,  if  you 
are  on  the  upper  or  lower  end  of  the  scale.  # 

Mr.  Erdahl.  I  think  you  made  the  point  it  was  100  jpoints. 
Information  we  haye,  accprding  .to  ETS,  is  that  it  is  a  30-point 
spread.  ^ 

Mr.  Weiss  [presiding].  Tasked  what  is  the  range  of  error.  He 
responded  to -what  the  tangd  of  error  would  be*  and  I  think  that  is 
correct. 

•    Mr.  Erdahl.  Another  point  I  would  like  to  dispose  of  here,. again 
"   with  regard  to  the  article  in  the  Washington  Post,  since  publication 
of  any  particular  test  would  lead  to  its  immediate  retirement,  the 
.*  corrective  examples  would  be  helpful  only  in  the  same  generalized 
way  as  the  test  study  guide  alreaoy  iavailable. 

If  we  are  t  " 
reflect  the  ai 

tion  of  the  tests  is  the  best  way 
times,  is  a  learning  tool  and  hopefully  our  schools  use  them  wisely 
in  that  way,  but  a  test  is  also  a  diagnostic  tool.  It  is  not  the 
treatment. 

We  have  had  a  concern  here  today  that  maybe  people  are  ill- 
equipped  to  survive  in  law  school  or  medical  school.  Again,  that  is 
not  the  fault  of  the  test.  It  is  the  fault  of  something  in  our  educa- 
tional system:  / 

Or  you  might  say  that  law  school  doesn't  have  the  right  require- 
ments or  the  medical  school  has  the  wrOng  requirements.  It  seems 
like  the  toting  doesn't  get  at  that.  '  . 

I  am  n6t  sure  what  one  achieves  by  requiring  that  the  testing 
agency  come  up  with  new  te^ts  all  the  time. . 

Dr.  PorniTOER.  Can  I  answer  that  with  an  analogy? 

I  think  it  is  an  old  saw.  If  we  say  the  automobile,  going  back  to 
my  manufacturing  analogy,  if  we  say  the  automobile  manufacturer 
just  makes  the  car  and  it  is  unsafe  at  ftny  sp6ed,  mftybe  I  should 
ft  add  that  if  the  consumer  buys  the  car  or  the  dealer  sells  the  car^ 
that  maybe  we  should  put  the  pnuijictf  responsibility  on  the  ^>uyer 
'  .  and  the  dealer.  .  '  /  ". 

We  are  talking  abbut  a  systerii,  an  organizatiional  dr  social  Sys- 
tem, that  pperates.  To  say  t^ese  -people  simply  manufacture  the 
tools  that  then  others  rely  *n  appropriately  or  inappropriately 

/gives' them  no  sense  of  responsibility. 
It  is,  I  think,  akin  to  saying,  the  same  response  ^  wduld  get  if 
:  we  sjiid  any  manufacturer  of  any  product  has  no  reroonsibility  fo 
it,  it  Us  only  the  user,  tl^e  (^aler  or  intermediary  people. 
■    Mr.  ErdXhl.  I  am  not  sure  I  follow  your  analogy.  It  seems  to  me 
I  don't  have  to  buy  that  car.  I  pan  take  a  bus  op  train  or  walk.  The 
same  is  true,  I  think,  witl\  Ihejiied^.  If  somebody  comes  up  with  a 
better  one,  I  think  the  real  vpressure  should  be  on  the  educational 
V  ^institutions  in  the  whole  ai^a  of  education.  \     •. ;  v 

If  the  tests  are  not  good,  let's  come'^up  with  some  better  ones. 

ER?c  .  •       r    '^H  . 


Ik.  PtMCTiNGER.  But  we  cannot  come  up  witH  better  tests  untU  we 
understand/As  long  as  the^roople  who  have  control  over  the  devel- 
opment of  the  tests  that  w^laim  wi^hout  pf oper  data  are  not 
good,  Wfe  simply  don't  have  the  leverage  to  cspate  innovations  to 
come  up  with  better  teste^fWe  cannot  do  that  until  we  have  open 
debate  of  what;ifl  now  going  on.  ~ 
.  Mr^  Erdahl.  Then  Mr.  Raver  has  misinformed  us  that  this  mfor- 
miatio|i  is  available  to  ev6ry6tte  who  ever  took  the  test.  If  they  have 
Bom?  memdry  of.  when  ^hey  took  the  JteSt  and  said,  those  are 
inaf>|>ropriate  tesffl  or  they  ar^  not  relevant,  it^ieems- that  informa- 
tion is  avtiUable  now.  "l 

I^.,  PoTTiNGKR.  It  is  ther©  theoretically;  not  practically.  .Every 
student  who  has  the  gumption  or  finances  to  hire  an  attorney  or 
take  abtion,  some  appeal  procedure  or  proper  action,  can  probably 
get  acceite  to  it.  It  is  not  a  theoretical  issue,  but  it  is  a  practical 
issue'of  ac(?ess  to  the  information.  We.got*acces8  to  the  .information  • 
after  2  years  in  the  courts. 

Mr.  Andrews  [presiding].  HaVe  you  seen  the  questions,  all.  of 
them  given  on  the  LSAT  for  the  last  15  years? 
.  Dr.  POTTiNGBiR.  No,  I  have  not. 
Mr.  Andrews.  How  many  of  them  have  you  seen? 
Dr.  Pottinger. 'I  have  seen  what  has  been  published  publicly, 
that  is,  what  the  BTTS  has  released  some  years  ago.  Th^  released  a 
past  test  of  the  SATLfiftepeople  could  understand  some  of  the  items. 
A  few  of  those  itemslire  in  ttly  testimony,  the  comparison-contrpst- 

tyve  items.  !       '       '  » 
Mt.  Andrews.  But  you  have  not  seen  the  items  on  the  SAT  for 

1978?  '  .  ^ 

Dr.  PotnNGER.  No,  and  ETS  has  the  full  authority  to  determine 
whether  I  Can  see  those  items  or  not  and  they  have  the  full 
to  decide  Whether  I  am  a  credible  expert  to  view  those 


)REWS.  You.say  you  have  hot  jeen  them? 
^    riNOtR.  I  haye  hot  seen— I  have  ifeen  past  tests,  the  itemp 
„jare  public  information. 

Mr<  Andrews.  But  you  have  not  seen  all  the  questions  that  y/ei:« 
on  the  SAT  or  any  of  the  SAT  tests  that  were  given  in  1978? 
,  Dr.  Pottinger.  That  is  fjght.    -f    ,  .  / 

Mr.  Andrews.  Dr.  Perroil,  let  ine  ask  you  this  question:  Do/you 
subscribe  to  or  support  or  believe  in,  adhere  to  the  basic  principle 
of  testing?  / 
Dr.  PERftoNBtJ  think  that  testing  has  "some  possible  uses.  / 
Mr.  AnohH.  Do  you  think  an  institution  of  higher  ^ucation 
should  cauMT»  ajpplicants  to  be  submitted  td  some  written  test? 
Dr.  PBRRONEiiNot  necessarily.  / 
Mr.'  AndrewgI  Weill  do  you' think  they  should  have  the  preroga- 
tive of  doing  that  or  hot  doing  that  as  the  institution  mfght  choose? 

Dr.  Pbkronb.  1  think  colleges  and  universities  have  probably  not 
'been  as  responsible  as  they  might  hswe  beeiupver  ttie  years  in 
buying  into  this^af^ular  m^e  of  testing.  / 

ft)  I  think  colleges  and  un^ersities  ought  to  have  some  kmd  of 
anTdmissions  process?  Yes,  I  do.  .  \, 

Mr.  Andrews.  Do  you  think  that  ghoi^^  include  requiring  the 
'  appUcant  to  submit  to  some  written  t^t?^  ' 
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.  \Dr. 'JPerrone.  Again,  I  will  say  not  necessarily.  T  think  colleges 
and  universities  might  make  a  range  of  decisions  about  that  partic-  / 
ular  factor.      ^  ^  Y 

Mr/ Andrews.  Do  you  think  the  institution  should  have  the 
prerogative  to  make  that  determination  and  require  testing  if  they 
choose?  . 

Dr.  Perrone.  I  think  they  should  have  that  opportunity  and  I 
hope  they  wotild  take  advantage  of  that  opportunity  within  ah 
atmosphere^  where  ^therejs  fu^^^^  tests  and 

.what  they  are*  and  what  they  mean  and  within  the  context  that 
students  nave  access  to  the  decisions,  the  judgments  that  are  being 
made  about  them,  and  that  they  will  ask  the  question,  have  stu- 
dents been  treated  fairly  in  this  process  as  well. 

I  Will  only  say  again,  I  think  the  fundamental  issue  in  this  bill 
go6s  all  the  way  back-  In  some  ways  we  have  been  all  the  way 
around  it,  we  haiffe  taken  societal  issues,  but  there  is  a  fundamen- 
tal issue  for  students  who  take  a  test.  Ought  they  not  nave  the 
oppnortunity  to  review  that  test,  the  queistions,,  the  answers,  and 
meir  res^nses.  That,  I  think,  is  very  fundamental  in  this  bill.  I 
thipk  that  is  a  right  that  a  student  ought  to  have  in  this  process. 

I  think  the  whole  testing  enterprise  ^yould  be  far  better  for  being 
.'^pen  to  that  than  to  continuing  dn  argument  that  somehow  that 
will  reduce  validity  or  item  quality  or  that  some  technical  issue 
will  be  comprpmised.^There  is  no  evidence  that  that  is  true. 

Mr  Andrews.  I  see. 

Dr.  REviER.  It  is  hard  to  argue  a^inst  Dr.  Perrone's  basic  tenet, 
that  is,  that  students  ought  to  have  the  right  to  see  their  examina- 
tion arid -its  basic  contents.  That  is  the  kind  of  appealing  issue  that 
I  think  everyprte  would  love  to  endo^e.  '  ^ 

Our  difricuity-  with  thait  is  that  for  one  thing  it  is  for  no  Observ- 
able purpose  whatever.  Whatever  learning  will  take  place  fot  the 
student,  aa  you  oap  see,  as  you  pointed  out  in  your  line  of  question- 
ing, is  relatively  femalL  The  examinations  really  are  a  sample,  of 
bell  avior,  learning.  Which  items  one  misses  has  nd  implication  in 
general  for:whetber  or  not  they  have  mastered  something  very 
different  from  that,  not  even  related  to  the  question. 
•  So,  consequently,  when  yoii  are  tailung  about  student  rights,  you 
are  talking  abodt  protecting  them  from  some  kind  of  -conwrate 
power  which  is  unwarranted.  We  suggest  to  you,  in  fact,  DnsPer- 
rone's  very  own  statement  of  a  while  qgo  argues  against  the  pas- 
sage of  these  bills  on  the  basis  of  whether  institutions  over  the  past , 
twc^decades  have  been  stud3ring  and  evaluating  examination  pro- 
grams as  they  try  to  move  to  comply  with  the  laWs  for  equal 
opportunities  in  this  Nation. 

Bowdoin  and  Harvard  and  others  have  chosen  not  to  employ  the 
examination  in  ^heir  admissions  programs.*That  is  a  very  powerful 
argument  that  indeed  dur  programs  are  responsive  to  the  needs  of 
those  institutions  and  they  are  attending  to  their  soeial>^esponsibil-' 
ities  in  evaluiating  the  kinds  of  iservices  have. 

So  we  look  at^  the  benefit^.  Are  tliere  really  truly  benefits?  In- 
deed, researchers  do  look  at  bar  examinations  and  try  to  improve 
;  them  for^  us.  We  hire  people  for  that  very  purpose  tb  represent . 
disciplines  across  the  specti^um  of  American  education  and  the , 
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iecon^ary  school  Bysteths.  So  ri^ally  of  what  benefit  is  it  to  the 
^student?  i 

We  submit  there  has  been  no  clear  n^  for  that  land  of  right  to 
be  extended  by  our  Grbvernment  to  th^  studerit  at  the  moment. 
Mr.  Andrews.  Do  you  have, a  condudine  statement? 
Mr.  Weiss.  J^at  a  couple  of  queistibns,  Mr.  Ghurman.  Just  a  little 
bit  ago  Mr*  Erdahli  in  responding  to  Di*.  Pottinger's  automobile 
.  analogy,  said  that  he  sboUld  have  the  option  of  hot  using  it,  not 
buying  the  ittltomobile  at  all,  or  using  the  bus  or  train  or  whatever 
else.  '■ 

I  think  the  problem  is  that  the  student  may  in  fact  hc^ve  no 
Choice.  For  examplei  let  me  put  the  question,  the  student  who 
wa^nts  to  apply  to  law  schooli  what  percentsige  of  the  ]aw  schools 
§odfty  ^11  accept  a  student  «who  does  not  take  the  LSAT?""-^^ 

Dr.  I^RRONE.  I  don't  know  any. 

Dr.  PorrmbsR.  I  ddn't  know  the  percentage. 

Mr.  Weiss.  Inhere  are  somei  but  probdbly  miniscule  as  far  as 
percentage  is  concerned,  as  feu:  as  the  pnercentage  of  law  schools 
tjiat  dbn^  require  the  SAT.  I  don't  know  if  any  of  you  are  familiar 
.with  the  species.  .  ^  . 

\  In  the  firsi  day  of  testimony  that*  we  have  here,  somebody  rer 
ferred  to  the  fact  that  somehow  within  the  last  few  years  apparent- 
ly there » was  ah  LSAT  examination  given  and  the  professors  of 
Georgetown  Law  School  then  examined  the  answers  an^  questions 
and  concluded  that  their  answers  in  25  i)ercent  of  the  Jnstsinces 
would  be  different  than  that  wl\ich  the  LSAI^^had  in  fact  designat- 
ed as  being  the  correct  answer. 

Now  it  seems  to  me,  that  if  that  kind  of  testing  and  testing  floor 
were  open  to  public  scrutiny  and  public  critique,  that  in  allprob- 
ability  the  LSAT  people  and  the  testing  services  generally  would  be 
much  more,  concerned  and  careful  about  the  kind  of  tests  which 
they  would  be  putting  forward  for  the  students  of  next  year's 

LsArs. .  .  ' . 

](^n^t^that  really  the  concept  behind  wl^at  the  benefit  is  to  the 
student  and  to  the  sdciety,  Dr.  Perrone?  '  \ 

Dr.  Perrone.  I  think  that  is  the  argument  I  have  been  posing 
throughout  my  testimony.  I  think  Dr.  Pottinger  has  posed  the  same 
issue,  that  the  item  quality  will  undoubtedly  improye. 

Mr.  Weiss., In  conclusion,  I  waiit  to  express  my"  appreciation  to 
all  the  witnesses  on  bbtn  sides  of  the  issue  for  their  participation.  I 
think  they  have  helped  to  further  define^  and  your  questions  cer- 
tainly havOi  whiat  the  issues  are  here.  ' .    ■  - . 

In  summaiy,  I  want  to  say  that  I  do  hot  ilor  does  H.R.  4949 
^tend  to  eliminate  standardize^  testing.  What  II  fwant  to  dp  is 
make  sure  it  is  an  open  process,  mat  people  understand  what  is  in 
it  an^  th^t  in  fact  we  ,can  have  a  better  syl^tem  that  everybody  can 
be  happier  with,  i  /i    «  ^ 

I  thank  you  very  much*  (  v 

Mr.  Andrews.  I,  too,  on^  behalf  of  Chairman  Perkins,  would  like 
to  tha3qk  all  of  you  for  your  very  valuable  contribution.  Unless 
there  is  an  objection,  we  will  now  acjijourh\to  reconvene  on  Sep^m- 
ber  ^4,  2  weel^  from  today,  at  which  time  we  will  consider  these 
same  bills.  ,  <  ' 

Thank  you.  ; 

[Whereupon,  at  1:25  p.m.  the  stibcominittee  adjoi^i^ned.] 

■■■■/  '  .5*37 V" 
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MONDAY,  SEPTEMBER  24,  1979 

HpusE  OF  Representatives, 
?  Subcommittee  ON  EgEMENTARY,  Secondary, 

ANt)  Vocational  Education,  ^ 
Committee  ON  Education  AND  Labor, 

Washington,  D,C 

The  subcommitiee  met,  ptirsuant  to  notice^  at  9:30  a.m.,  in  room 
2175,  Rayburn  House  Office  Building,  Hon.  Ted  Wefss  presiding. 

Members  present:  Representatives  Weiss,  Kildee,  Buchanan,  and 
Erdahl. 

Staff  present:  John  F.  Jennings,  mcgority  counsel;  Jeffrey  W. 
Brennan,  staff  intern;  and  Martin  LaVor,  minority  senior  legisla- 
tive associatie.      i  * 

Mr.  Erdahl  [presiding].  Good  morning.  We  will  get  our  hearihg 
underway. 

I  was  asked  to  st^rt  thb  hearing  this  morning.  Chairman  Perkins 
is  on  his  Way  in.  I  see  Mr.  Weiss  is  here.  I  will  begin  the  hearing 
^  because  we  do  have  several  witnesses  to  appear  today. 
'  This  is  the  fourth  day  of  hearings.  Two  more  days  are  scheduled 
onH.R.^64ahdH.R.  4949.  • 

We  have  an  interesting  and  distinguished  panel  this  morning.  If 
they  would  take  their  places  around  the  witness  table  this  morn- 
ing, we  qpuld  get  the  hediring  underway. 

Even  though  some  of  our  colleagues  are  not  here  yet,  this  will  go 
into  the  record  and  we  will  establish  the  record  this  morning. 

The  i^ople  on  the  panel  this  morning  ^re:  Dr.  Urbain  J. 
De Winter,  director  oMdmissions,  College  of  Arts,  Cornell  Universi- 
ty; Dt.  Richard  Bergnozen,  president,  American  Universityi  repre- 
senting the  American  Council  oo  Education;  Dr.' Jahies  W-  Loewen, 
director  of  research.  Center  for  National  Policy  Review,  Catholic 
I^&iiversity  School  of  Law;  Ms.  Ailhea  Simmons,  director,  Washing- 
ton OE^^,  NAACP;  Dr.  Lionel  Newsojtn,  member,  board  of  direc- 
tors, National  Association  for  Equal  Opportumty  in  Higher  Educa- 
tion, pjp^deht.  Central  State  Universitv;  ^r.  Sheldon  R.  Gold^tine, 
Clevelano,  Ohip;  and  Dr,  I.  Leon  Smith/ djrector.  Professional  Ex- 
.  amination  Service.  1  j      .  " 

/First  I  will  call  on  Dr.  De  Winter,  a^fl  now  I  will  relinquish  the 
Chair  to  Representative  Weiss.  { 

Mr.  WBis»Jpresiding].  Let  me  apologize.  It  used  to  be  that  only 
deat^  an^  taixes  were  certain.  I  now  have  a  thjird  part  of  that.  That  :^ 
is.  that  the  Eastern  shuttle  will  be  late  going  or  coming  from  New 
York.  I  Apologize  for  myself,  That  is  the  reason  I  amrlate. 
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Thank  you  very  much. 
Dr.  De Winter,  if  you  woulftproce^. 

STATEMENT  OF  URbKi^  J.  DfeWINTER,  DIRECTOR  OF 
ADMI^ION^,  COLLEGE  OF  ARTS,  CORNELL  UNIVERSITY 

■  Dr.  pEWmTER.  Gogd  i^iing.  My  nanae  is  IJrbain  J.  DeWinter, 
.  associcrt^  dean  and  direciorjof  aurts  and  sciences  admissions* 

lj$t  me  give  you  personaji  l|)ackgroimd  from  which  I  approach  the 
proposedriegislation.  I  was  a  high  school  teacher  for  3  year^  and 
have  taught  at  the  coUegeJ  level  for  the  last  15  years.  Si|iGe|  I 
obtained  my  Ph.  D.  in  Spanish  literature  from  the  University  of 
yPennsylvania  in  1972   "  •  ' 

Mr.  Weiss.  Dr.  DeWinter,  excuse  me.  That  microphone  is  not  as 
sensitive  ,  as  it  ought  to  be.  Maybe  you  could  pull  it  closer  and 
down.  1  ^  '        ^         -  i 

1  Dr.  DEWiNtEfe:  Thank  you..  V  ^ 

I  have  taught  at  Cornell  University  whejre  1  have  served  both  as 
a  faMlty  member  and  an  administrator.  lam  currently  associate 
dean  and  director  of  undergraduate  admissions  for  the  College  of 
Arts  and  Sciences/  \ 
'  lln  tMs  capacity  it  has  bepn  my  responsibility  since  1975  to  direct 
the  admissions  program^^bf  the  college  and  more  specifically  to 
direct  the  selection  process  for  the  approximately  8,000  students 
who  apply  for  admission  to  this  college.  \ 

I  want  to  point  out  to  the  committee  that  I  do  refer  specificaUv 
to  the  College  of  Arts  and  Sciences  because  at  C!ornelI  we  hafe 
seven  different  undergraduate  colleges  (not  to  mention  the  several 
graduate  divisions),  each  one  varying  somewhat  in  its  policies  and 
procedures.  ... 

My  coUe^gui^  who  serve  as  directors  of  admission  in  these  col- 
leges have  for  {he  most  part  academic  backgrounds  in  such  fields 
as  the  history  ,5f  science,  botany,  architecture,  or  agricultural  eco- 
nomics.       /  '  . 

I  mention  tiiese  facts  because  there  is  no  unanimous  opinidtLo^ 
this  question  at  Cornell,  and  the  university  as  an  institution  has 
'  not  taken  an^fiicial  stand  on  the  proposed  legislation, 

L  would  atto  like  to  mention  a  little  later  an  associate  of  ours. 
Prof.  E.  Wood  Kelley  from  the  Cornell  Department  of  Govefmnent, 
will  be  available  for  additional  testimony,  when  he  arnma  later 
this  morning,  especially  on  the  legislatipn  in  bill  3564;/He  is  a 
member  of  the  admissiliris  committee.  / 

As  a  member^of  the  admissions  committee.  Professor  Kelley  w|is 
overall  project  consultant  for  the  evaluation  of  the  Elementary  and 
SeCotiiaary  Education  Act  for  the  House  Education  Committee  prior 
to  its  recent  reauthorization,  and  has  consulted  for  /the  House' 
Education  Committee,  the  NIE,  the  National  Opinio^  Research 
Center  in  testing,  the  Federal  Judiciary  Center  of  the  Supreme 
Court,  and  other  organizations.  /. 
. .  I  accepted  the  inWtation  to  testify  on^  the  proposed  bills  bec^iuse  I 
believe  that  the  palsage  of  this  legislation  wiA  reinfi^rce  aur  own 
j^lection  policies  and  procedures  which  I  think  are  air  and  com- 
preRftisive.  and  it  will  ultimately^  Increase  our  understanding  of 
the  tests,  thereby  placing  them  in  their  proper  pe^^sp^ctive,  without  . 
destroying  th^r  validity. 
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I  belftve  this  legislation  is  in  the  interest  of  faimesa  to  students, 
pafenta,  teachers  and  in  the  overall  TOterest^f  education. , 

There  may  be  some  ineonvejuenceTthat  arise  as  a  reEfult  of  this 
legislation,  but  these  should  be  resolved  in  due  time  and  are 
ou^eighed«4y  the  overaU  advantage  to  a  fairer  educational  sys- 
tem/. 

In  order  to  put  the  quiestion^of  te^  in  the  proper  perspective,  I 
want  to  say  something  about  the  philosophy  of  acbnissions  as  ar- 
tfculated  by  the  faculty  of  the  College  of  Arts  and  Sciences  and 
how  this  philosophy  is  implemented.  ^ 

It  is  our  belief  that  faculty  and  students  benefit  both  academical- 
ly and  persomdly  from  a  diverse  student  body.  The  College  oJT  Artis 
and  Sciences  admits  men  and  women  who  have  diverse  socijal, 
economic  and  cjkltural  backgrounds^  racial  and  national  idenj)ities, 
andt^ents.     i  .  ^ 

All  studtots  entering  the  college  must  be  prepared  to  contribute 
to  and  beneut  from  the  environment  of  Cornell.  Therefore,  admiis- 
sion  selection  is  an  evaluative  process  that  considers  each  individ- 
ual's achievements  and  poi^ntid  for  success  at  the  university; 

The  most  important  criteria  ro]^4dm^  are  intellectual  poten- 
tial and  conmutment— a  complex  combination  of  abilijby,  achieve-' 
ment,  motivation,  diligence  tod  educational  opportuility.  Nonaca^ 
demic  qualifications  are  also  important.  ^ 

The  college  seeks  individuals  with  outstctnding  personal  qualities 
and  a  recora  of  significant  involvement  in  extracurricular  endeav- 
ors. Students  wiw  unusucd  talents  and  achievements  in  mui^ic, 
acting,  creative  writing,  science,  athletics,  politics,  and  other  areas 
^are  given  special  consideration  in  the  admission  process,  i 

A  committee  of  faculty  members  and  admissions  officers^  reviews 
the  materials  submitted  by  the  applicant!  The  folder  indudies  the 
foUowmg  items: 

There  are  four  different  areas  that  are  important. 

One.  llie  application  form  itself  which  contains  a  lot  of  informa- 
tion on  the  student's  background,  and  his  or  her  interests,  accom- 
plishnients/  ai^d  goals;  for  example;  one  of  the  questions,  is  a  300- 
word^&say  that  reads  as  follows:  ;^'De8cribe  a  problem  that^  faces 
your  home,  school,  »city,  region^  or  nation.  How  did  the  problem 
originate,  and.  how  might  it  bei61ved?"  Or  another  question  seeks 
to  find  out  VWhat  education^  objectives,  interests,  experiences, 

S^reer  or  profesfitioncd  goals  or  other  factors  have  influenced  your 
ecision  to  apply  for  the  pr<«rain  you  have  specified?" 
Two,  An  individual  jSdhoor  report  wmch  would  de^9HMistr^te*tKat 
the  student  has  been  prepared  foir  a  challenging  college  curricu^- 
lum.  This  form  contains  the  following  statement:  '  A  fujl  and  can- 
did report  J^om  the  schbbl  is  essential  if  the  applicant  is  to  be  given 
fair  co^ioeratioh.  We  therefore  ask  for  careful  ratings  and  oom- 
mentff  abofit  character  and  ability  by  a  sdhool  official  who  ktiows 
the  studeno  well.^^  The  ratings  and  comments  i^efer  to  class  rank, 
itranscripts,?test  scores,  personcd  characteristics  such  as  academic 
•motivatm  and  selfdiscipihie,  as  well  as  ovei^all  performance  of  the 
^IKndidate  in  extracurricular  activities;  also  this  form  provides  the 
{opportunity  tojrmaltse  additional  comments  pertaining  to  special 
VHrcumstances  that  may  he  relevant  to  the  student's  application. 
'  is  iffiportaiit  mformation  because  due  consideration  is  given  to 
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the  grfiding  system,  the  courses  available  and  taken,  and  cultural 
opportunities. 

Three.  Letters  of  reference  are  welcome  when  they  provide  an 
asseagjpaent  of  the  applicant's  academic  or  personal  qualities  as  are 
'  Mher' subjective  reports  sueh  as  the  comments  of  fkn  interviewer. 

iFour.  Finally,  we  require  the  results  of  the  SAT  or  ACT  exami-x 
nations  and  three  achievement  tests  which  are  evalu^ated  with  the 
rest  of  the  applicant's  materials.  ^.  \ 

I  would  characterize  our  method  of  selection  as  a  holistic  one  in 
which  any  Qne  factor  cannot  easily  be  separated  frbm  tl|e  others. 
The  complete  application  folder  always  greater  than  )the  mere 
sum  of  its  parts. 

Furthermore,  it  is  a  method  that  looks  positively  for  what  the 
student  has  accomplished  i^  the  past  and  is  likely  to  accoQiplish  in 
the  future  rather  th^ui  for  what  he  or  she  has  failed  to  do.  It  is  an 
evaluation  of  each  candidate  in  light  of  the  opportunities  and  ac- 
complishments he  or  she  has  demonstrated.  ^ 

The  role  of  standardized  tests  in  this  review  <has  not  been  quapti- 
fied.  Standardized  ibsts  have  been  reviewed  by  our  committSpefl  as 
one  measure  of  reasoning  sfbilities  in  both  verbal  afid  mathematical  - 
areas.  As  we  understand  tnem,  the  SAT's  and  achievement  tests 
place  the  applicants  from  a  wide  variety  of  schools  on  the  same 
scale  in  order  to  make  some  meaningful  comparisons. 

Clearly;  we  would  not  select  our  students  on  the  basis  of  the  tests 
because  that  would  be  in  direct  contradiction  to  our  philosophy.  To 
equate  admission  with  the  score  on  a  test  would  be  to  equate  all 
applicants  with  the  characteristics  of  the  test  which  would  entirely 
eliminate  our  diversity.  ^ 

Therefore,  in  our  case,  standardized  tests  have  had  a  supplemen- 
tary value  rather  than  an  absolute  valued  and  this  will  continue  to 
be  the  case.  TThis  does  not  mean  that  we  reject  the  notion  of  a 
standardized  test.  For  example,  we  use  the  regents  examinations 
which  are  given  in  New  York  State. 

But  our  coftimittees  have  refrained  from  placing  too  much  pm- 
phasis  on  the  scores.  Instead  th€j|^  use  multiple  criteHa  in  dfeter- 
mining  admission.  Therefore,  when  speaking  about  our  own  meth- 
od 9f  sel Action  I  would  say  that  whether  the  answers  are  disclosed 
or  not,  tne  cmrrent  legislation  is  unlikely  to  have  a  strong  impact 
on  our  procedures. 

Nevertheless,  I  endorse  the  current  proposal  pertaining  to  disclo- 
sure of  facts  because  there  does  exist  the  danger  of  abusing  or 
misusing  tests,  as  appears  to  be  thp  case  in  some  professional 
programs  and  institutions  that  receive  a  large  volume  of  applica- 
tions. Furthermore,  they  are  frequently  misunderstood  or  poorly 
appreciated  by  the  general  public. 

One.  Tests  make  it  extremely  easy  to  administer  Vjpu3t  amounts  of 
paper  and  material  that  can  be  digested  in  a  highly  mechanical 
fashion,  with  great  speed  and  uniformity.  We  have  to  be  careful 
with  the  very  visible  numbers  lest  they  distort  our  vision^nd 
prevent  us  from  taking  the  appropriate  time  to  make  a  thorough 
review  of  each  case.  It  is  important  .to  recogmfze  the  efficiency  of 
dean-cut  numbers  for  what  it  is  worth.     ,  ^ 

TWo.  We  cannot  assume  that  what  is  gefterally  true  about  sociej;y 
is  also  true  about  the'lndividualand  therefore  good  for  him  or  her. 
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Oa  the  basis  cl  statistical  an^^sis,  for  example,  we  might  say  that 
the>'average-size  family  in  the  United  States  consists  of  2.7  chil- 
dim  Does  this  inlply  that  1/ should  have  2  or  3  , children,  or  0.7 
chMren?  i 

We  cait  be  tempted  to  exclude  individuals  or  ^oups  of  individ- 
,  ualb  from  consideration  for  a  program  because  they  do  not  meet 
.th6  average  number^.  If  that  number  becomes  so  significant  that  on 
that  basi^.  I  am  (excluded  from  a  program,  then  I  as  an  individual 
have  a  right  to  see  the'  test  upbn  which  I  have  been  excluded. 

■  Three.  Objectivity  is  frequently  misunderstood.  We  speak  of  ob- 
jective tests  orydecisions,  confusing  one  part  with  the  whole.  To 
make  an  ofaje^ve  decision  does  not  mean  limiting  the  factors  I 
take  into  consideration  to  quantifiable  areas.  Subiective  judgments 
are  part  of  the  objective  decisio0.  We  can  too  easily^fconfuse  quality 
with  an  "objective'*  number;  as  in  describing  an  /individual  or  a 
group  by  means  of  a  dumber.  ^y**  / 

Four.  Disclosing  the  tests  as  proposed  in^H.R.  494gnvould  addjbd 
our  knowledge  of  the  te^and  demysttfy  the  secret  contents  that 
promote  misunderstanding  of  the  tests  among  students,  parents, 
and  ac^issions  officisJs.  / 

It  would  challengi^  all  of  us  to  become  still  more  knowledgeable 
about  ^e  test,  and  to  enable  us  to  give  a  student  or  parent  an 
explanation  of  just  what  a  high  or  low  test  score  represents,  how  it 
is  interpreted  by  both  the  testing  agency  and  tti6  admissions  office. 
,  Disclosure  would  lead  to  a  more  realistic  f  appraisal  of  the 
strengths  as  well  as  the  limitations  of  a  test.  Ultimately  it  will  , 
strengthen  the  credibility  of  tests,  for  they  will  be  e?camiried  by  a 
wide  variety  of  educators  who  are  interested  in  maintaining  their 
,h^h  quality.  Undoubtedly  intelligent  people  will  express  disagree- 
ment over  both  the  questions Jftnd  the  answers  of  the  tests. 
•   The  .most  important  obj^ipns  that  havfe  been  raised  lo  the 
disclonire  of  tests  involve  cost  and  equating.  Ample  testimony  has 
beeiyg{ven  in  New*york  and  Washington  showing  that  the  cost  of 
test/developmentlrepresento  but  a  relatively  small  fraction  of  the 
toUDi  cost  of  test  Administration.  m 

Equating  is  offlbn  confused  with  validity.  Equating  simply  means 
that  we  rank  the  students  in  some  Common  order  across  test  ad- 
ministrajtions.  However,  equating  is  a  complicated  t>6ychometric 
.procedure  that  should  not  be  confused  with  the  validity  of  the  test 
-  which  deals  with  the  predictive  value  of  the  test.  It  is  validity  and 
noiebuating  which  is  our  ihain  concetn.         '  ■ 
As  \  understaiid  the  bill,  it  was  drafted  inlcopnderation  of  the  ' 
:  testing  industry's  contem  to  exempt  from  disclosure  quespons  used 
for  equating  and  pretesting  pun^^ 

In  sum,  I  believe  this  legislation  will  providre  us  with  mor^  tisefUl 
ihformation^  about  standirolzed  i^sts,  an  opportunity  to  monitor 
« the  appropriate  development,  correction  and  administration  of  'thl^ 
tests/and^  continue  to  encour^e  the  responsible  use  of  tests  in 
schoms  an4  admissions  office.  '  '  k 

Mr.  WkiSs.  Thank  you  very  much.  We  wHl  hold  off  the  q^uestion^ 
ing  until  th$  entire  nanel  has  had  oocasion  to  make  their  state^ 
:  mehts  and  tlien  we  wul  proceed  to  questions.  \#  . 

Now  we  will  proceed  m  the  order  Hi  which  J^e  wtnesses  appear 
^n  th^  llsJsOur  next  withess  is  Dr-  Richard  ^Mm^n. 


STATEMENT  OF  RICHARD  BERtlNDZEN,  PRESIDENT,  AMERICAN  •  . 
UNIVERSITY,  REPRESENTII^G\  THE  AMERICAN  ^OUNCIL  ON 
EDUCATION,  ACCOMPANIED  BY  SHELDON  SEEINBACH  AND  ^ 
DOUGLAS  WHITNEY  OF  THE  AMERICANJCOUNCIL  ON  BDUCA- 
tlON  , 

Dr.  Berendzen.  Mr.  Chairman  and  members  of  the  subcommit- 
tee, my  name  is  Richard  .  Berendzen.  I  am  university  provost  and 
president-elect  of  the  American  University  here  in  Washington,  . 
D.C  V 

I  thank  you  for  this  opportunity  to  offer  testimony  in  behalf  of  * 
the  American  Council  on  Educatdon  and  seven  other  major  educa: 
tion  associations  on  H^R.  351^4  and  H.R.  4949. 

With  me  today  are  Mr.  Sheldon  Steiif>ach  and  Mr.  Douglas 
Whitney,  of  the  American  C!ouncil  on  Education. 

As  you  may  know,  the  membership  of  the  eight  organizations  we 
represent  here  today  includes  nearly  all  the  colleges  and  universi- 
ties in  the  Nation.  And  the  American  Council  on  Education  serves 
as  the  prin^ary  coordinating  agency  for  the  Nation's  higher*  educa- 
tion community. 

Thus,  our  testimony  today  represents  generally  the  concerns  and 
interests  of  the  diverse  postsecondary  institutioHS  that  use  stand- 
ardized tests  in  their  admissions  processes,  as  welTas  the  present 
and  future  students  of  these  educational  iniatitutions. 

We  recognize  that  faculty,  students,  parents,  arid  others  have  a  / 
genuine  and  legitimate  interest  iji.  the  nature  and  use  of  the  stand-  / 
ardized  tests  that  gjay  a  role  in  the  admissions  process  at  many  / 
higher  education  institutions.  j 

During  the  pa^t  four  decades,  such  t^ts  have  proven  to  be  useful 
at  many  institutions  in  assessing  students' potential  for  completing 
undergraduate,  graduate,  and  professional  programs  of  study> 

In  many  instances,  test  results  have  been  especially  helpful  to  / 
students  who  attended  sqhools  and  colleges  hot  well  known  to/ 
admissions  committees  arid  to  those  whose  prior  educational  work 
did  not  reflect  their*  full  potential  for  further  s(udy.  • 

At  the  outset  we  wish  to  stress  that  while  acknowledging  the 
interests  of  students  and  others  in  the  nature  and  use  of  sucb  tests 
and  concurring  with  some  of  the  stated  goals  of  the  proposers,  we 
beHteve  that  Congress  should  not  enact  «uch  legislation  at  this  time. 

Portions  of  each  proposal  now  before  the  Hou8^  are  unnecessary 
infthat  theyipimply  codify  the  current  practices  of  most  testing 
programesjand  make  no  significant  changes  or  improvements. 

Further,  the  jproposers  of  H.R.  4949— which  would  require  the 
disclosure  of  test  questions  and  answers  rffter  each  t^st  administra- 
tion—have not  groven  the  need  for  t^iis  riiajor  change  in  test  pro- 
gram iJlR)cedures  on  the  basis  of  demonstrated  educational  benefits 
to  students,  on  a  definitive,  analysis  of  relative  costs  and  benefits  tO 
students  or  institutions,  or  on  wpU-documented  instances  of  im- 
proper or  harmful  past  practices.  ~ 

Finally,  the  portiohs  of  H.R.  4949  that  i!equire  test  agencies  to 
mak^  public  all  studies  conducted  on  behalf  of  individual  colleges 
and  the  portion  of  H.R.  3564  that  prohibits  the  consideration  of  the . 
test  restilts  of  other  applicants  in  determining  whether  or  not  an 
individual  should  be  admitted  to  an  institution  would  severely 


limit  the  ^illty  ^  colleges  to  develop  admissions  procedures  that 
best  serve  the  nee^  of  both  students  and  institutions. 

HistoricalLy,  Congress  has  shown  an  admirable  reluctance  to  leg- 
islate matters  at  the  heart  of  education  and  curricula..  College 
admissions  procediiws— including  the  evMuation  of  t^  results— 
are  an- outgrowth  ofland  a  reflection  of  the  missicnj'  and  goals  of 
each  institution.  The  Wormation  required  from  each  student  appli- 
oant  properly  reflects^the  curriculum  ,and  requirements  of  the  ^insti- 
tution  and  educational  program  to  which  application  for  admission 
is  made. 

The  sufeject  of  the  proposed  legislation  is  an  educational  matter . 
and  properly  the  pfoyince  of  the  faculty  of  each  institution.  Al- 
though the  proi}Osers  disclaim  any  intent  to  interfere  with  admis-' . 
sions  procemir^s,  it  is  our  view  that  the  evolution  of  subsequent 
regulatory  and  legislative  actions  will  do  precisely  that  by  moving 
from  one  factor  in  the  adihissions.process^standardized  test  infer-  • 
mation— to  others.  ,  . 

I  now  turn  to  a  brief  analysis  of  the  propo6(ed  legislation. 
First  of  all,  Illation  in  areas  of  information  and  priv^py  is 
/unnecessary.  The  enaclment  of  legislation  in  any  area  ndt  previ- 
/.  busl;^  subject  to  legislation  suggests  the  existence  of  an  und^irable 
/  and  intolercd)le  condition  that  can  and  must  be  remedied  oy  law. 
Do  siteh  donditions  exist  in  the  area  of  educational-  admissions 
testing?  We  think  not  land  do  not  believe  the  proponents  of  the  bills 
now  before  you  have-carried  their  burden  bf  demonstrating  a  clear 
need  for  such  legislation.         »  ,      ,  . 

Today,  qualified  students  have  greater  access  to  higher  education 
in  the  United  States  than  ever  before.  More  than  90  percent  of  the 
students  currently  seeking  admission  to  undergraduate  study  are 
admitted  to  the  college  of  their  first  choice. -More  than  95  percent 
are  adihitted  to  some  college.  \  , 

As  the  number  of  18-year-old8  declines,  more  And  more  und6r- 
^aduate  institutions  can  be  expected  to  use  test  results  ' for  inclu-  ; 
slve  ^uvpoeeB  to  help  identify  and  timait  aU  students  able  to  com-  / 
plete  und.ergraduate  programs  of  study  rather  than  to  exclude  / 
those  who  appear  less  likely  to  do  so.  <      ,  ' 

At  the  graduate  and  professional  levels,  most  institutions  na»e  : 
already  recogniajed  the  desirability  of  broadening  their  student  bod^-^i 
iel  and  have  achieved  diversity  through  vigorous  progr«uns  of  af-^  • 
firmative  action,  ipecial  academic  assistance  and  multiple  oritena 
for  Admissions.  ^TmA  hap  occurred  i?i  the  absence  of  legislation 
jtoncerping  the  use  of  admissions  tests,  J 
Both  H.R.  3564  and  H.R.  494»  prescribe  specific  items  of  mforffia- 
tion  about  each  admissions  test  that  must  be  provided  to  students 
wto  they  register  for  the  exahiination.  While  we  support  the 
practice  of  providing  studenta  with  useful  information,  it  is  o^r 
jiidgmejit  that  nearly  aU  the  Required  informiation  is  already  pro- 
vided to  students.     -         /  -  ,  ;  '        ,  . 

The  United  States  Student  Association  conceded  as  much  m 
their  ^^testunony  concerning  H.R.  8564.  The  fact  that  sectipu  3  of 
H.R.  8564       section  6  of  H.R.  4949  essentially  require  testing 
programs  ^  continue  td.provide  students  with  the  information  now  ^ 
avauablci  u  hardly     Argument  that  demmstrates  a  need  for  the  ^ 
legislationi  t  ^ 
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Fina]^,  no  persuasive  evidence  has  been  presented  to  suggest 
that  te^  agencies  are  now  handling  student  testjv  records  improper- 
ly, the  best  of  our  knowledge,  test  results  are  currently  sent  in 
identified  form  only  to  institutions  and  agencies  designated  by  the 
/•stfudent — either  by  a  specific  request  or  by  a  general  permission 
applying  to  scholarship  programs,  special  information  services  and 
the  like.  ^ 
^  Some  persons  have  been  critical  of  the  College  Board  and  Educa- 

tional Testing  Service  for  refusing  to  release  identified  test  results 
to  the  Federal  Trade  Commission  for  use  in  its  study  of  Coaching 
schools.  Section  6  of  H.R.  4949  would  require  them  to  refuse  other 
1^    similar  requests.  * 

Second,  requiring  the  disclosure  of  test  questions  is  unwise.  Sec-  ' 
tion  Q  of  H.R.  4949  requires  the  release  of  test  questions  and 
answers  to  students  and  to  the  public  after  their  first  use.  'Hiis 
would  effect  a  msgor  change  in  the  current  operations  of  all  educa- 
tional aott\issions  testing  programs. 

This  requirem.ent  is  the  mayor  point  of  contention  surrounding 
H.R.  4949.  That  this  would  »rpsult  in  an  abrupt  change  for  testing 
programs  is  not  a  sufficient  reason  for  us  to  oppose  disclosUire.  It  is 
the  anticipated  effects  and  highly,  questionable  benefits  of  this 
I         seemingly  simple  change  that  cause  us  to  oppose  this  section* 
'  It  is  generally  acknowledged  that  the  disclosure  provision  would 

necessitate  the  development  of  more  test  questions  and  more  test 
forms  than  are  currently  needed.  It  would  be  impossible  tk)  reuse 
questions  that  have  been  shown  to  be  useful  and  valid.  ] 

It  would  be  unwise  to  legislate  a  change  of  this  magnitude  Vith- 
out  adequate  assurance  that  the  quality  of  information  gained  from 
admissions  tests  will  not  thereby  be  compromised  without  a  clear 
.indication  of  the 'number  and  identity  of  the  students  wtto  might 
.  benefit  from  such  changes!  and  without  a  comprehensive /estiftiate 
of  the  appelated  costs.  / 

It  is  by  no  means  clear  that  there  will  be  any  significant  educa- 
tional banefit.  for  students  from  the  required  disclosure  of  test 
questions  and  answers.  Experience  suggests  that  the  use  of  a  pre- 
test or  th^  development  of  more  extensive  diagnostic  information 
to  accompany  student  score  reports,  or  both  would  better  accom- 
plish the  educational  purposes  claimed  for  H.R.  4949. 

We  notei  that  the  learning  that  occurs  for  students  whose  ques- 
tions and  ^swers  are  returned  is  a  matter  that  could  be  rather 
,         simply  studied.  This  should  be  done  before  disclosure  is  required  in 
%  order  to  help  us  all  understand  more  fully  the  implications  of  the 
lewslation.  ■  . 

The  possibility  that  the  requirements  in  Section  5  of  H.R.  4943 
'  wouli  result  in  a  decline  in  the  quality  of  information  that  il 

gained  from  these  tests  is  a  major  concern.  Mthough  some  persons 
ave  te^tifie^  that  quality  will  not  be  adversely  affected,  we  believe 
that  moibt  e:^perienced '*test*  experts  would  disagree  or  express 
doubts  that  this  will  be  the  case.   *      «  , 
The  possibility  that,  test  information  will  be  less  usbful  than  it  is 
1      now  is  particplarlv  vexing  in  light  of  the  failure  to  demonstrate 
i      that  students  will  benefit  from  the  passage  of  this  legisl^io^. 
,        The  oiifmbet^r  of  students  who  would  request  copies  ot  their  test 
j      questions  and  Briswers  is  not  kijown.  Without  a  satisfactory  esti-K 


mate  of  the  number  8tud6nlte  who  would  do  so,  it  is  impospible  to  $ 
evaluate  the  societal  beneHtis  that  would  result  from  enacting  H.R. 


.4949. 

If  few  requests  dre  made,  tl 
will  prove  to  bQ  high  and  th 
beyoii4  the  ability  of  jow-incor 
You  should  be  aWare  thai 
complete  standardised  tests  c 
in  nqiatters  of  courife  selectio 
for  example,  theyAmerici 
ma;ke  retired  test  forms  av 
orientatipn  or  preregistrati( 
it  seems  likely  th^t  if  tJle 


\^  marginal  icosts  of  providiifg^  ^ies 
nominal  charged  permitted  wp  be 
e  students  to  pay. 

many  institutions  ask  students  to 
lefly  to  assist  in  proyiding  guidance 
and  planning.  Some  test  agencies- 
college  testing  program— currently 
[ble  to  ins^tj&tions  for  use  jn-^ttidSni 
testing  programs  on  thef  campuses, 
disclosure  requirement  is  enacted. 


secure  testi  forms  will  rio  Ibnger  be  available  for  this  purpose  or 
hat  they  will  be  much  more  expensive  to  use  for  these  purposes. 
It  should  t«  noted  thay /educational  admissions  tests  are  not  all 
,(^ike.  It  se^ms  inevitable/that  the  disclosure  requirement  would  be  ^ 
'"more  difficult  to  effect  fffv  some  tests  than  for  others.  No  evidence 
has  been  presented  thedb^  suggests  that  aiw  admissions  testinga)ro- 
gram  can  be  operated  in  this  manner,  let  alone  all  of  them.    ^  ■ 

This  legislation  is  untimely.  During  the  past^year,  the  role  of 
ability  tests  in  Ameru^m  education  and  society  has  been  under 
study  by  A  broadly  representative  panel  of  educators  and  others. 
This  study  by  the  ^tional  Academy  of  Sciences'  Committee  on 
Ability  Testing  is  «:neduled  to  be  released  in  midyear  1980. 

Although  we  have/ no  knowledge  of  the  conclusions  or  recommen- 
dation^  to  be  included  in  the  report,  it  seems  lately  that  consider- 
able *  aittention  will/  be  given  to  the  use  of  t^ts  in  educational 
 lissions.  Action /on  testing  legislation  before  this  report  is  re- 
eased  would>reji|f.dge  the  evidence  and  preempt  the  conclusions  cif 
i.he  study  p^n^.  /|  , 

No  crisis  exists  m  wairant  hasty  action  on  these  proposals  before 
the  committee's  wport  is  released.  We  expert  the  rewrt  will  con- 
tribute much  to  the  discussion  of  issues  associated  with  this  legisla- 
tion.  ^  , 

And,  finally,  0  3  ch  year  more  than  1,000  studies  of  test  validity 
and  delated  mat  i^rs  are  conducted  by^  on  behalf  of  individufid 
colleges' and  uhii^^rsities.  £acb  ihvolves  students  enrolled  at  a  siii-' 
gle  institution  a|ia  each  examines  the  usefulness  ot  admission  test 
results  in  conjunction  with/other  relevant  information  about  the 
students  as  theylli^late  to  Indicators  of  program  completion  and 
achieveme&t  at  ti^lja^t  institution. 

^ults  of  these  studies  are  available  to  faculty 
icers  at  tha^t  institution  for  their  use  in  develppr 
issions  procedures.  None  is  qf  intere^  beyond  , 
one^ecessarily  h^  relevance  for  stud^n^  at 


ie^€ 


^  Currentlir^^the 
%and  admissions  oi 
in£  appropriate  a 
tlmt  institution.  ! 
otiter  instittitions. , 

Yet,  section  4  of  Hic.  4949  requires  that  all  be  made  public  if 
.they  have  peen  conducted  by  a  test  agency  on  behalf  of  the  institu- 
tion or  if  they  haveiused  date  obtained  frbm  a  test  agency^ 

Individual  ijnstitutions  should  be  encouraged  to  conduct  such 
studies.  The  bublic\filing  reigiuiremenfr  of  section  4  of  HB.  4949, 
how^ver^  i^JIkely  to\  discourage  these  efforts.  The  test  agency  stud- 
iejs  prepared  fbr  an  Institution  consist  largely  of  tabular  material. 


They  lack  the  interpretive  context  that  is  known  to^  admissions 
committees^  but  that  would  be  unknown  and  quite  possibly  misun- 
derstood by  other  readers.  It  would  serve  no  purpose  to*  require  the 
publicati^  of  studies  that  pertain  to  single  institutions, 

I  now  wish  to  comment  on  the  matter  of  improvements  in  educa- 
tional testing;  What  have  been  and  die  alternatives  to  Federal 
legislation  with  ite  attendant  risks? 

As  a  general  principle,  we  believe  fthat  legislation  should  be  used 
s(s  a  remedy  only  whei;i  less  ^astic  alternatives  have  been  exHaUst- 
ed.  Historically,  three  nonlegislative  means  have  proven  useful  in 
identifying  problems  and  effecting  heeded  improvements  in  educa- 

•  tional  testing: 

One.  Evaluations  of  tests,  voluntarily  agreed  to  by  the  test  spon- 
soips,  conducted  by  qualified  persons  with  no  vested  interest  in  the 
outcome,  ^ 

Two.  Standards  for  good  practice  that  clarify  the  procedures  for 
developing  and  rising  tests  and  for  preparing  test  manuals  that  are 
generally  endorsed  by  professional  test  experts,  and 

Three.  Publication  of  analyses  df  issues  and  recommendations 
prepared  by  broadly  representative  ad  hoc  committees  of  educators 
and  others.  ^  :■  '   ^  >    .  * 

I  cdll  your  attention  to  the  examples  of  these  efforts  that  we 

*  have  detailed  in  the^written  testimony  we  have  submitted. 

•  These  examples  olxsignificant  efforts  to  guide  and  improve  the 
use  of  educational  testis^stand  as  evidence  of  the  education  cornmu- 
nity's  inten^  to  keep  its  iiouse  in  order.  These  activities  have  led  to 
changes  and  improvements  in  educational  testing.  They  are  read 
and  understood  by  persol(i3  involved  in  institutional  admissions 
decisions.  ^  •  • 

In  the  course  of  ttiese  hearings,  witnesses  have  raised  a  number 
of  serious  allegations^bout  deficiencies  in  current  admissiohs  test- 
ing programs.  We  believe  that  all  caii  and  should  be  aiddi'essed  in 
one  of  the  above  ways  and  that  thesd  nonlegislative  approaches 
vfill  prqve  more  effective  at  identifying  and  remedying  deficiencies 
than  would  ahy  legislative  solution.     .  . 

I  believe  I  can  say  in  all  candor  that  the  postsecondary  education 
community  welcomes  the  public  debate  and  interest  that  State 
Ifegislation  and  the  two  bills  now  before^  the  Congress  have- 
prompted,  -♦v 

We*  sincerely  believe  that  both  test  producerVand  test  users  have 
policed  their  own  practices  well  and  have  devoted  enormous  re- 
sources and  effort  to  develop  the  art  of  educs^ional  testing:  And, 
>ye  remain  committed  to  continuing  that  course  in  the  future.  In  so 
doing,  wfe  welcome  the  active  interest  and  assistance  of  the  con- 
cerned groups  who  represent  the  interests  of  test  takers. 
^  Specifically,  the  American  Council  on  Education  makes  commit- 
ments to  future  progress  as  outlined  in  the  formal  statement. 

Mr.  Wei^.  Thank  you  very  nftich.  Dr.  Berendzen. 

[The  complete  statement  of  Dr.  Berendzen  follows:] 


PMI^AIIBD  STATfmNT  OF  DlR, UlCHARD  BKIUBNinBN,  UnIVWWITY  PrOVOOT  AND  PR^SI- 

DiNT-iLicT.  The  American  Umversj^,  on  Behalf  of  the  American  Associ- 
ation OF  State  Collboes  and  UNiYiRsmESj  AmbricAn  CdbNCiL  on  Education; 
AssocuTiON  OF  American  Univer9&us;  Association  of.Cathouc  CJollbges  and 
IfNivERflmts;  QouHPiL  or  Gradu|ts  Schools  of  the  UNrrro  States;  National 
^Association  for  Equal  Opportuhtty  m  Higher  Education;  National  Associ- 
ation OF  IndbpbHdent  Collboes  and  Universitiks;  and  National  Association 
OF  State  Universities  AND  LAND<}RANt  ^LL^B^  4 

Mr!  Chairman  and  Members  of  the  SubcOti^ffeittee,  thank  yon  for  the  o*artunity 
to  tostify,  on  behalf  of  the  %  Higher  Education  Associations,  concerning  admissions 
terting  m  higher  educatfon  and  to  disouss  the  proposals  for  ledslation  in  this  area 
(HSr3564  and  H.R.  4949).  As  organizations  whose  members  include  nearly  all  of  the 
colleges  and  universities  in  the  nation,  we  are  troubled  by  these  proposals  and 
concerned  about  the  impact  their  ^enactment  would  ^ve  on  t^e  admissions  procesa 
at  collies  and  universities.  ■  ^  if 

SUMMARY  STAT^ENT  ' 

We  recognize  that  faculty,  students,  parents  and  others  have  a  genuine  and 
legitimate  Interest  ih  the  nature  and  use  of  the  standardized  tests  th^t  i)lay  a  role 
in  the  admissions  process  at  many  higher  education  institutions.  During  the  past 
foyr  decades,  such  tests  have  proven  to  be  useful  at  many  institutions  in  assessing 
students'  potential  for  c6mpleting  undergraduate,  graduate  and  professional  pro- 
grams of  study.  In  many  mstances,  test  results .  have  been  especiall^r  helpful  to 
students  who  attendfd  schools -and  colleges  not  well  known  to  admissions  commits 
tees  and  to  those  wnose  prior  educational  work  did  not  reflect  their  full  potential 
for  fiirther  study.  ^*  ^ 

At  the  oiitset,  we  wish  to  make  it  41ear  that,  while  acknowledging  the  mterests  of 
students  and  others  in  the  nature  tihd  Use  of  such  t0sts  and  concurring  with  some  of 
the  stated  goals  of  the  proposers,  w&  believe  timt  Congress  should  not  enact  any 
legislation  at  this  time.  Rprtions  of  each  proposaHiow  before  the  House  are  unneces-  ' 
sary  in  that  they  simply  codify  the  current  practices  of  most  testing  pj^ains  and 
makjS  ho  significant  changes  or  improvements.  Further,  the  proposers  of  HJR.  4949— 
which  would  require  the  disclosure  of  test  questions  and  answers  afldr  each  test 
administration-^ave  not  demonstrated  the  need  for  this  migor  change  in  test 
prgji^am  pnx^ures  on  the  basis. of  demonstrated  educational  benefits  to  students,, 
oifa  defmitive  ahalysis  of  relative  costs  and  benefits  to  students  or  institutions  or 
on  well-documented  instances  of  improper  or  harmful  past  practices.  Finally,  the 
portions  of  H.BJ049  that  require  test  agencies  to  make  pUblic  all  studies  conducted 
on  behalf  of  individual  colleges  and  the  portion  Of  H.R.  3564  that  prohibits  the 
consideration  *of  the  test  results  of  other  applicants  in  determining  whether  or  not 
an  individual  should  be  admitted  to  an  institution  would  werely  liihit  the  ability  of 
colleges  to  develop  admissions  p|bcedures  that  best  serve  the  needs  of  both  students 
and  mstitutiohs.  ,  >tx 

Historically,  Congress  has  shown  an  admirable  reluctance  to  legislate  matterii  at 
the  heart  of  education  and  curriculum.  College  admissions  procedures  (including  the 

,  evaluatign  of  test  results)  are  an  outgrowth  of  and  a  reflection  of  the  mission  and 
goals  of  each  institution;  the  information  required  from  each  student  applicant 
properly  reflects  the  curriculum  and  requirements  o{  the*  institution  ^d  education- 
al program  to  which  application  for  admission  is  made.  The  subject  of  the  projposed 
legislation  is  an  educational  inatter  and  i>roperly  the  province  of  the  faculty  of  each 
instituticto.  Although  the  proposers  disclaim  any  ihteqt  to  interfere  with  adniissions. 
procedures,  it  is  our  view  that  the  evolution  of  fi^ubsequent  regulatory  and  Illative 

I  actions  will  do  precisely  thft  bv  moving  fit>m  one  factor,  in  the  admissions  process 
(standardized  test  information)  to  others.      \  :  \ 

ANALYSIS  OP  THE  PROFOSED  LEGISLATION  * 

Legislation  in  areas  of  information  and  priViacy  is  unnecessary 

The  enactment  of  legislation  in  any  area  not  previously  8ub|ect  to  legislation 
suggestSfthe  existence  oHan  undesileible  and  intolerable  condition  that  can  and 
must  M  remedied  by  law:  Do  ,such|  6onditions  exist  in  the  area  of  educational 
admissions  testini^  We  think  not  imd  do  not  believe  the  proponents  of  the  bills  now 
.^fore^Olt  have  carried  their -^j^rden  of  demonstrating  a  clear  need  for  such 

^^J^y.  qualifte^udento  hav'e  greater  accesJ  to  higher  education  in  the  United 
States  thao  ever  Before.  More. than  90  percent  of  the  students  currently  seeking 
julmission  to  uhdergraduajp  study  are  aomitted  to  the  collie  of  their  fhst  choice; 


more  than  95  percent  are  admitted  to  some  college.  As  the  number  of  IS-year'olds 
declines,  more  and  more  undergraduate  instituti6ns  can  be  expected  to  use  test 
results  for  inclusive  purposes  to  help  identify  and  admit  all  students  able  to  com- 

Clete  undergraduate  programs  of  study  rather  than  to  exclude  those  Vho  appear. 
^  likely  to  do  so^  At  the  ^aduate  and  pi^^essional  letyels,  most  kistitutions  have 
already  recognized  the  desirability  of  broadening  their  student  Bodies  and  have 
achieved  diversity  through  vigorous  programs  of  affirmative  action,  special  aca- 
^  demic  assistance  and  multft)le  criteria  for.  admissions.  This  has  occurred  in  the 
absence  of  legislation  concerning  the  use  of  admissions  tests. 

Both  H.R.  3564  and  H.R.  4949  prescribe  specific  items  of  information  about  each 
;admi$sions  test  thaf  must  be  provided  to  students  when  they  register  for  th6 
exaipination.  While  we  support  the  practice  of  providing  students  with  useful  infor- 
mation, it  is  our  judgynent  trtat  nearly  all  the  required  information  is  already 
provided  to  students.  TJhe  United  States  Student  Association  conceded  as  much  in 
» their  testimony  concerning  H.R.  3564.  The  fact  that  section  3  of  H.R.  3564  and 
section  6  of  H.R.  4949  essentially  require,  testing  programs  to  continue  to  provide 
students  wblf  jhe  information  now  available  is  hardly  an  argument  that  demon- 
strates a  need  for  the  legislation.  .  « 

Finally,  noJersuasive  evidence  has  been  presented  to  suggest  that  test  agencies 
are  now  handling  student  test  records  improperly.  To  the  iSest  of  our  knowledge, 
test  results  are  currently  sent  in  identified  form  only  to  institutions  and  agencies 
designated  by  the'student— either  by  a  specific  request  or  by  a  general  permission 
applying  to  scholarship  programs,  special  information  services  and  the  like.  Some  , 
persons  have  been  critical  of  the  College  Bolird  and  Educational  Testing  Service  for 
refusing  to  release  identified  test  results  to  the  Federal  Trade  Commission  for  use  in 
its  study  of  coaohing  schools;  section  6  of  H.R.  .4949  would  require' them  to  refuse 
other,  similar  requests. 

Requiring  the  disclosure  of  test  questions  is  unwise  *  t 

Section  6  of  H.R.  494^  requires  the  release  of  test  Questions  and  answers  to 
students  and  to  the  public  after  their  first  use.  This  woula  effect  a  msgor  change  in 
the  current  operations  of  all  educational  admissions  testing  programs.  This  require- 
ment is  the  mpgor  point  of  contention  surrounding  H.R.  4949.  That  this  would  result 
in  an  abrupt  change  for  teiting  projerams  is  not  a  sufficient  reason  for  us  to  oppose 
disclosure;  it  is  the  anticipated  effects  and  highly  questionable  benefits  or  this 
.  seemingly- simple  change  that  cAuse  us  to  oppose  this  section.  ^ 

It  is  generally  acknowledged  that- the  disclosure  provisions  would  necessitate  the 
development  of  more  test  questions  and  more  test  forms  than  are  currently  need^; 
it  would  be  impossible  to  reuse, questions  that  have  been  shown  to  be  useful  and- 
valid.  It  Would  be  unwiise  to  legisfat!^  a  change  of  this  magnitude  without  adequate 
assurance  that  the  quality  of  information  gained  from  adrnissions  tests  will  not 
thereby  be' compromised,  Without  a  clear  indication  of  the  number  and  identity  of 
the  stupdents  who  might  benefit  from  such  changes,  and  without  a  comprehensive 
estimate  of  the  ass<)ciated.  costs.  ^  ^ 

It  is  by  no  means  cleair  that  there  will  be  any  significant  educational  benefit  for 
students  from  the  required  disctosure  of i test  Questions  and  answers.  Experience 
suggests  that  j^fr  usis  of  a  ''pre-test**  or  the  development  of  more  extensive  diagnosr 
tic  information  to  accompany  student  score  reports,  or  both,  would  better  accom- 
plish the  educational  purposes  claimed  for  H.R.  4949.  We  note  that  the  le*"ning 
that  occurs  for  students  whose  queations  and  answers  are  veturned  is  a  matter  that 
CQuld  be  rather  simply  studied.  This  should  be  done,  before  disclosure  is  required,  in 
order  to  help  us  all  understand  more  (uU^  the  implications  of  the  legislation. 

The  possibility  that  the  requirements  in.  Section  5  or  H.ll.  4949  would  result  in  a 
decline  in  the^qiiality  of  information  that  is  gained  fr6m  these  tests  is  a  m£gor 
•  concern.*  Altholigh  some  persons  have  testified  that  quality  will  not  he  adversely 
affected,  we  believe  that  most  experience  test  experts  would  disa^ee  of  express 
doubts  that  this  will  be  the  case.  The  possibility  that  test  information  will  be  less 
useful  that  it  is  now  is  particularly  vexing  in  light  of  the  failure  t^.  demonstrate 
that  studMts  will  benefit  from  the  passage  of  this  legislation. 

The.  Dumber  <of  students  who  would  request  copies  of  their  test  questions  and 
answers  is  not  known.  Without  a  satisfactory  estimate  of  the  number  of  students 
who  would  do  so,  it  is  impossible  to  evaluate  th^  societal  benefits  that  would  result 
from  enacting  H.R.  4949.  If  few  requests  are  made,  the  marginal  costs  of  providing 
copies  will  prove  to  be  h^gh  and  the  "nominal"  charges  permitted  will  be  beyond  the 
ability  of  low-incoftie  students  to  pay. 

You  should  be  aware  that  many  institutions  ask  students  to  complete  standard- 
ize^ tests  chiefly  to  assist  in  providing  guidance  in  matters  of  course  selection  and 
planning.  Some  test  agencies  (e.g.,  the  American  College  Testing  Prpgram)  currently 
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^inake  retired  teet  forms  available  to  institutions  for  use  in  student  orientation  or 

j^re^registration  testing  programs  on  the  campus^.  It  se^ms  likely  that  secure  test 
bhxis  will  no  longer  be  avaiTable  for  this  purposl|or  that  they  will  be  much  moi^ 
expensive  to  use  for  these  purposes  if  the  disclosure  requirement  is  enacted, 
li  should  be  noted  that:  educational  admissions  tests  are  not  all  alike;  it  seems 
•    inevitable  that  the  disclosure  requirement  would  be*  more  difficult  to  effect  for  some « 
t^ts  than  for  others.  No  evidence  has  been  presented  thc^t  suggests  that  any 
'  admissions  testing  program  can  be  operated  in  this  manners-let  alone  ail  of  th^m.- 

jtTTiis  legislation  is  untimely 

Duringthe  past  year,  the  role  of  ability  tests  in  American  education  and  society 
has  be^nSinder  study  by  a  broadly  representative  pa&el  of  educators  and  others. 
This  studyTby  the  National  Academiy  of  Sciences*  Committee  oil  Ability  Testing  is 
scheduld!4o  be  released  in  midyear  1980.  Although  we  have  no  knowledge  of  the 
conclusions  or  recompiendations  to  be  included  in  the  report,  it  seems  likely  that 
.  c6nsi(}erable  attention  Will  be  given  to  the  use  of  tests  in  educational  admissions. 
V^ction  on  testing  legislation  before  this  report  is  released  would  prejudge  the 
evidence  and  preempt  the  conclusions  of  the  study  panel.  No  crisis  exists  to  warrant 
''  hasty  action  on  them,  proposals  before  th^  C^ommittee's  report  is^ released;  we  expect 
the  report  will  contribute  -much  to  the  discussion  of  issues  associated  with  this 
legislation.  . 

It  is  unwise  to  attempt  to  reguhte  the  publicathn  of  research  r^ults 

Results  from  studies  of  test  validity  that  are  of  general  interest  and  applicability 
should  be  published  and  widely  distributed.  Section  4  of  H.E.  4949  seems  an  ineffec- 
tive and  objectionable  W£^  to  accomplish  this  end.  Frankly,  we  find  the  attempt  to 
require  that  resjsarchers  associated  with  admissions  testing  programs  publish  all  of 
their  work  tat  odds  with  the  protections  of  academic' freedom  that  are  universally 
accorded  their  colleagues  associated  with  universities.  Certainly,  d^tinctions  must 
be  made  between  preliminary  and  final  reports;  between  memoranda  and  more 
extensive  treatments  or  analyses;  between  papers  prepared  to  stimulate  discussion 
and  those  that  present  conclusions  resulting  from  the  discussions.  This  is  not  to 
suggest  that  an  altered  version  of  section  4  would  be  acceptiifole;  it  simply  suggests 
that  legislative  solutions  in  the  area  of  research  publications  are  unehiorceable  as 
well  as  unwise. 

Each  year  more  than  1000  studies  of  test  validity  and  related  matter^  are  conduct- 
ed by  or  on.  behalf  of  individual  colleges  and  universities;  each»involves  students 
enrolled  at  a  single  institution  and  each  examines  the  usefulri^  of  admissions  test 
nesults  in  conjunction  with  other  relevant  information  about  the  students  as  they 
relate  to  indicators  of  program  completion  and  achievement  at  that  institutioi^^ 
Currently,  the  results  of  these  studies  are  available  to  faculty  and  admissions 
officers  at  that  institution  for  their  use  in  developing  appropriate  admissions  proce- 
dures. None  is  of  interest  beyond  that  institution;  none  necessarily  has  relevance  for 
students  at  other  institutions.  Yet,  section  4  of  H.R.  4d49  reauires  that  all  be  made 
public  if  they  have  been  conducted  by  a  test  agency  on  behalf  of  the  institution  or  if 
they  have  used  data  obtained  from  irtest  agency.  ■ 

Individual  institutions  should  be  encouraged  to  conduct  such  studies.  The  public 
filing  requirement  of  section  4  of  H.R.  4949,  however,  is  likely  to  discourage  these 
efforts.  Tne  test  agency  studi^  prepai^sd  for  an  institution  consist  largely  of  tabular 
tpaterial.  They  lack  the  interpretive  context  that  is  knowii  to  admissions  commitr 
t6es  biit  that  would  be  unknown,  and  quite  possibly,  misunderstood^  by  other  read- 
ers.^ It  would  serve  no  purpojise  to  require  the  publio^ition  of  studies  that  pertain  to 
single  institutions. 

IMPROVBMEmS  m  BDUCATIONAL  "TES^ 

As  a  general  principle,  we  believe,  that  legislation  should  be  as  a  remedy 
only  when  less  drastic  alternatives  haVe  been  exhausted.  Historically,  three  non- 
legislative  means  have  proven  useful  in  identifying  problems  and  effecting  needed 
improvementa  in  ediicatioual  testing:  V  . 

(1)  Evaluations  of  tests,  voluntarily  agreed  to  by  the  test  sponsors,  conducted 
by  qualified  persons  with  no  vested  interest  in  the  outcome,.  •    '  ^ 

(2)  stSndanis  for  good  practice  that  clarify  the  procedures  for  developing  and 
lisiilg  tests,  and  for  preparing  test  manuals  that  are  generally  endorsed  by 
profiessional  test  experts^  ai^d 

k  (8)  publication  of  lugdyses  of  issues  and  recoinmendatiotis  prepared  by  broad- 

r  ly  representative  ad  boc  committees  of  educatoihs  and  others.  *. 

Examples  of  t^  first  include  the  "Mental  Measuremonto  Yearbooks,"  published 
for  40  years  by  Professor  O.  K:  Buroe.  The  Yearbooks  include  critical  iieviews  and 
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complet^.  research  bibliographies  for  nearly  all  standardized  tests.  In  addition,  brief 
jtest  reviews  appear  regularly  in  thQ  professional  journals  of  twny  education  associ- 
ations. Examples  of  the  second  include  the  Standards  for  Educational  and  Psycho- 
logical Tests  (1974)  prepared  by  the  American  Psychological  Association,  the  Ameri- 
^  can  Educational  Research  Association,  and  the  National  Council  on  Measurement  in 
•Education— national  associations  of  individual  researchers  and  test  experts.  Another 
is  the  statement  on:  Responsibilities  of  Users  of  Standardized  Tests  (1978)  published 
by  the  American  Personnel  and  Guidance  Association — a  national  association  of 
individual  counselors  and  guidance  personnel.  Each  testing  program  issues  explana- 
N  tory  and  advisory  materials  that  describe  the'  tests  and  identify  proper  and  improp- 
er  uses.  Examples  of  the  third  include  the  extensive  report  on  the  recent  decline  in 
scores  on  the  scholastic  aptitude  test  sponsored  by  the  College  Board,  the  compre- 
hensive analysis  of  testing  in  education  and  society  sponsored  by  the  Russell  Sage 
■FDCmdatipn,  and  the  upcoming  report  by  the  National  Academy  of  Sciences  Commit- 
♦   tee  on  Ability  Testing.    *       .  ^ 
These  examples  of  significant  efforts  io  guide  and  improve  the  xlfb  of  educational 
tests  stand  ^s  evidence  of  the  education  community's  intent  ito  Keep  its  house  in 
order.  These  activities  have  led  to  changes  and  improvements  in  educational  testing; 
^  they  aj'e  read  and  understood  by  persons  involved  in  institutional  admissions  deci- 
sions. 

^  In  the  course  of  these  hec^rings,  witnesses  have  raised  a  number  of  serious  allega- 
tions about  deficiencies  in  current  admissions  testing  programs.  We  believe  that  all 
can  and  should  be  addressed  in  one  of  the  above  ways  and  that  these  non-legislative 
approaches  will  prove  more  effective  at  identifying  and  remedying  deficiencies  then 
would  any  legislative  solution. 

FURTHPR  COMMITMENTS  TO  PROGRESS 

Portions  of  both  H.R.  3564  and  H.R.  4949  concern  the  nature  of  the  information 
that  is  available  to  students  when  they  register  to  take  admissions  tests  arid  when 
they  receive  the  report  of  their  results.  It  has  been  Jaid,  during  the  hearings,  that 
the  current  efforts  of  topping  programs  in  this  regard  are  insufficient  and  ineffec- 
tive. We  believe  that  a  thorough  and  comprehensive  analysis  of  current  publications 
and  practices  in  this  area  would  identify  any  serious  shortcomings  in  the  informa- 
tion provided  to  students  and  that  the  suggestions  and  recommendations  that  would 
result  from  such  a  study  would  be  influential  witl\  test  sp>onsors.  To  that  end. 
We  invite  organizations  that  represent  the  interests^of  students,  parents, 
admissions  officials;  counselors,  psvchologists  and.  test  ^experts  to  join  us  in 
conducting  and  publishing  the  results  of  a  review  of  the  current  student  infor- 
mation  booklets  and  te3t  score  reports  prepared  by  educational  admissions 
testing  programs.  .4 
An  en*ective  program  for  self-regulation  requires  both  a  clear  statement  of  intend- 
ed goald  and  a  continuing  mechanism  by  which  activities  can  be  coordinated,  main- 
tained, and  evaluated.  To  these  ends. 

We  will  develop  a  clear  statement  of  acceptable  and  desirable  practices  relat- 
ed td  ^he  development  and  use  of  educational  admissions  tests.  We  invite  other 
interested  organizations  to  join  us  in  this  effort.  We  believe  that  such  a  state- 
.  ment  would,  result  in  anv  needed  improvements  in  both  areas,  and  we  will 
.     convene  a  "Blue  Ribbon    Committee  representing  the  concerns  of  students, 
:  telichers,  parents,  colleges  and  universities,  test  experts,  test  sponsors,  and  the 
public.  We  will  charge  the  committee  to  develop  effective  and  continuing  means 
for  injuring  sounjd  practices  in  the  development  and  use  of  educational  admis- 
sions tests.  This  committee  will  meet  for  the  first  time  shortly  afteV  the  conimit- 
tee  on  ability  testing  report  becomes  available  for  study. 

^  A  SUGGESTION.  TO  TEST  SPONSORS 

In  developing  te^t  questions,  the  threats  qf  ambiguity,  bias,  and  faulty  reasoning 
are  always  present-^whether  the  writer  is  a  teacher,  scholar,  or,  professional  item 
writer  AH  test  agencies  conduct  a  review  of  admissions  test  items  prior  to  their  first 
use  with  students  in  ord6r  to  minimize  the  possibility  that  thede  threats  to  test 
validity  will  obscure  the  actual  abilities  of  the  students.  The  jj^view  conducted  by 
persons  familiar  with  the  test  content  and  skills  is  an  important  step  in  the 
development  of  quality  examihations,  but  many  persons  are  not  familiar  with  the 
procedures  lised  or  with  the  qualifications  of  the  reviewers.  Some  of  the  feelings, 
.e)f pressed  ^t  these  hearings,  that  admissions  testing  t)rograms  are  shrouded  in 
mystery  and  secrecy  would  be  changed,  we  believe^  if  test  sponsors  prepared  and 
distributed  detailed  descriptions  of  the. review  process  used  in  . developing,  their  tests. 


\.    In  addition,  the  poesibility  of  involving  qualified  reviewers  nominated  by  national 
.  i^^^i^sociations.of  teachers  a^cl  faculty  shotila  be  explored. 

Mr.  Weiss.  Next,  Dr.  Lpe^ven.  •       ^       i  ' 

STATEMENT  OF  JAMES  W.  LOEWEN,  DIRECTOR  RESEARCH 
CENTER  FOR  NATIONAL  POLICY  REVIEW,  SCHOOL  OF  LAW, 
.    CATHOUC  UNIVERSITY  OF  AMERI^^  > 

Dr.  LoEWEN.  Thank  Vou.  * 
,  I  am  the  director  of  research  at  the  Center  for  National  Policy 
Review,  Catholic  University  Law  School.  I  have  been  in  that  posi- 
tion for  9  years  and  its  primary  purp^  is  to  critique  the  Federal 
Government  to  ihake  sure  that  the  opportunities  are  maxiniized  for 
minorities  and  for  disadvantaged  American^. 

Prior  to  my  coming  to  the  center,  I  ^p6nt  3  vears  ^  associate 
professior  at  the  tJniversity  of  Vermont.  I  aih  still  on  that  faculty 
.      on  leave.  J  spent  7  years  as  a  faculty  member^at  Toiigaloo  College, 
\    Miss.,  a  predominantly  black  institution.  \ 

'  :  I  h^ve  also  taught  at  Millsaps  and  at  Harvard  University,  where 
\  I  obtained  my'doctorate. 
V   I  say  that  t9  ybu  because  my  testimony,  which  is  not  going  to 
tepeat  my  stkjtements  which  you  have,^  is  based  on  my  personal 
experiences  with  tesfcs  as  well  as  my  students'  experiences,  *as  well, 
as  my  own  fairly  extensive  research  i;r  the  area.  That  experience  is 
.  relevant  because  I  have  taught  rural_stu4ents, , white  and  black, 
and  urban.  Based  on  that  experien^e^  1  want""  to  highlight  three 
points  for  you  this  morning.  ^ 

I  think  there  is  a  bias  built  into  the  aptitudi^  tests  on  which 
admissions  so  largely  de|)end.  |  think  that  bias  is  rural  and  urban. 
I  think  it  is  regional.  I  think  it  is  racial  and  it  is  based  on  social 
class. 

My  second  point— and  I  will  return  to  each  of  these  points  in  a 
minute— ris  that  bias  is  involved  in  the  teste,  hot  just  ineptitude 
t    distributed  by  re^on  or  by  race  or  by  soc||I^  *  , 

lamgoing  togiveyoUan  examateoftWafTbias.  > 

My  third  point  Is  that  it  is  very'  difficult  for  me  as  a  social 
scientist,  as  a  sociologist  in  the  Held  of  educational  sociology,  to  get 
data  to  do  research  in  this  area.  * 

As  you  can  guess,  I  dm  testiiying  on  behalf  of  H.R.  4949. 

Not  only  is  it  verjf  difficult  to  get  items  f|Om  the  tests,  it  is  vet 
difficult  to  obtain^  information  from -the  college  board  of  the  ET 
data  as  to  how  blaclcs  perform,  how  whites  perform,  how  various 
people  i^  various  States  perform  en  massei^  • 
W  Let  me  come  back  to  the  three  points.  The  first  point  is  bias.  I 
assert  fhere  is  a  vast  bias  in  the  test,  tf  you  have  my  additional' 
statement  maaybe  you  Jbuld  turn  to  pages  2'arid  3.  This  is  a  table 
wMch^hows  the  cutofiOT>oint  on  the  preliminary  scholastic  aptitude 
t^,  vmich  is  an  ETSl^xam,  the  cutofT  point  usQd  by  the  National 
Merit 'SbholarsMp  Ck)ip.  which  operates,  as  you  probably  know,  a 

\ massive  national  merit  scholarship  program, 
i  The  merit  prt>^am  wants  its  competition  to  be  natfonal,  and  in^ 
'  oiier  for  it  to  be  national  it  has  to  institute  a  different  cutoff  point 
for  every  State  because,  otherwise,  its  competition  would  be  domi** 
nated  by  people  from  a  f^w  schools  in  Connecticut,  Princeton^  New 
Jersey,  and  a  few  other  places 


So  for/the  last  two  decades,  at  least,  it  has  had  a  different  cutoff 
point  fo/each  State  ahd  typically  Mississippi  has  the  lowest  cutoff, 
and  Con^^ticut  the  highest.  I 

That  is  very  interesting  to  me  as  ^  sociologist  because,  of  course, 
I  know  Ck)nnecticut  is  the  richest  State  in  the  United  Statei^  in 
terms  of  per  capitia  in<;ome,  and  Mississippi  th^poorest 

So  I  did;  a  Bmiple  correlation  of  i  per  capitr  income  and  PSAT 
cutoff  point  as  used  for  the  Natioiial  Merit  Scholarship  Ck)rpora- 
tion.  When  you  look  at  it  you  see  that  Alabama  ranks  49th  in 
income  in  the  SOtStates  plus  the  District|Qf  Columbi^i,  and  it  is  47th 
Mn  the  PSAT  cutoff.  Alaska  is  fourth  in  income  and  ninth,  or  tied 
for  ninth  in  PSAT  cutoff.  That  is  a  Very  close  correlation.  / 

The  feet  that  Alaska  hfW  a  little  l({)wer  performance  on  the  PSAT 
•m^fht  mate  to  its  ruralism  or  the  distance  from^Princetpn  w^ere 
this  test  is  made  up.  /  \ 

Kentucky,  which  I  do  not  pick  at  random,  is  43rd  m  income  and 
45th  in  PSAT  cutoff— almost  identical.  When  you  do  wHat  is  called 
the  Sj^armian  rank  order  correlation  coefficient  on  the  data  as  a 
whole,  you  come  upjyith  the  astonishing  coefiicieht  of  0,83.  They 
can  rank  in  magnitpde  from  zero  to  one.  If  they  are  zero  that 
*  means  there  is  no  relationship  oetween  income  and  PSAT  score.  If 
tl^ev  are  one,  Chat  means  th^  are  a  perfect  relationship,  ; 

If  you  know  income,  you  cSn  perfectly  predict  PSAT  cutoff  score. 

A  correlation  of  0.83  is-i>ne  of  the  highest  correlations  you  wt^ 
likely  to  find.  /  \ 

Therein  a  tremendous  relationship  between  income*' and  apti- 
tifde.  There  is  a  trei^^ndous  relationship  between  region  of 'the 
United  States  and  ^titude.  When  I  first  wpnt  to  Mississippi^  I 
found  out  that  in  jatoth  black  and  white  schools  a  score  of  400  or 
GRE  was  consid^r^;  good  and  qualified  you  for  toUege.  / 
.  At  Harvard  m(bst  students  had  scores  above  700.  Am  I  to  infer 
Missidsii^i  is^^ept?  I  submit  that  is  not  the  case.  There  is  bi^ 
built  inito  the4est6.  .  ^ 

My  Tougaloo  black  students  were  ^drastically  affected  by  this 
bias.  The/previoup  witness  to  me  stalled  that  90  percent  of  all 
studipn^get  into  the  college  of  their  first  choice.  I  submit  to  you 
^hat  ^  a  meaningless  statement.  There  is  a  chilling  effect  on  your 
choice  that  comes  from  your  score.  Miany^&tudents  get  a  score  dn 
the  LS^T  or  later  when  they,  are  going  into  graduate  school  on  the 
ORE,  and  they  know  not  4o  apply  to  the  college  of  their  first 
y  choice.  There  is  a  chilling  effect  going  on  the  score  at  all. 

I  have  known  black  students  who  got  terrible  sqjgres  on  the  LSAT 
and,  therefor^,  gave  up.  They  are  not  getting  a  cai^er  of  their  fi^rst 
choice,  let  aldne  a  college  of  th^r  first  choice. 

First  of  all,  to  toy  original  statement  there  is  an  appendix  "A 
Clearin^ouse  of  Civil  Rights  Research,"  which  is  a  pul^^iciation  I 
edit  at  the  Cen^r  for  National  Policy  Review.  (Retained  in  subcom- 
mittee ^es.)  It  contains  two  articles,  one  on  IQ  testing  and  one 
called  "Tme  Vicious  Circle,''  by  myself,  which  makes  ttiis  argument 
/dear,  I  ,mink.  '  . 

To  Summarize,  Aptitude  tests  are  misnamed.  Aptitude  correlates 
with  soQioeconomic  advantage.  Therefore,  aptitude  testing  com- 
pletes a  vicious  circle.  Spcioeconottdc  advantage  leads  to  socioeco- 
nomic advantage.   .  —  (  » 


V     Let  me  also  ask  you  to  t 
/'statement.  This  js  titled  "The 


page  to  page  5  of  my  additional 
wen  Low  Aptitude  Test."  This  is 
a  device  I  made  up  to  shQW  p6^1e  the  bi^  built  into  aptitude  and 
IQ  tee^ts  as  given  in  this  country.  Number  three  is  an  actual  item 
jis  rem^nibered  and  modified  by  me  from  th|  test  required  by  many 
graduate  Schools.  1  took  it  in  toe  Midwest  and  I  had  no  idea  what  I 
was  doing  on>j;his  item.  I  didn't  know  what  was  going  on,  I  finally 
realized  sake  is;^a  pronoun  when  you  say  for  the  sake  of,  and  a 
pronoun  cannot  be  an  analogy.  ^  \J 

Later,  having  ex^ienced  sake;  and  also  China  tea,  but  I  had  no 
idea  that  word  was  sia^e.  Onc6  you  realize  the  word  is  sake  theipi 
you  realize  the  reasoning  involved  in  an  aptitude  testr  A  Japanese 
sword  play  is  analogous^to  sake  as  opera  is  to  chiantij  That  is 
trivial. 

Buf  it  depends,  uppn  an  urban  upper  class  vocabulary  I  which  I 
didn't  have  and  which  my  students  haven't  had.  j 

Item  two  directly  above  it  ia  my  own  item  jwhich  I  would  be 
happy  to  talk  about.  Itlis  based  oXi  carpentry  terms.  My  question  is 
why  ii3  the  sake  item  included  oh,  the  test  but  not  the  carpentry 
item?  I  think  the  answer  is  clear:  because  the  testmakers  know 
about  sake  and  doi)^t  know  about  carpentry;  therefore,  the!  student 
who  knows  about  ;barpentry  but  doe&tn't  know  about  sake  is  disad- 
vantaged pn  the  test.  ^ 

I  have  some  other  words:  argentum,^us,  baroness,  misai^thrope, 
cuneiform,  Myden,  Riinnymede,  Michelangelo,  and  oi\  and  on. 

There  is  a  serious  bias  built  into  the  tests. 

My  final  point  is  it  is  very  difficult  to  get  data.  Not  only  is  it 
hard  to  get  items  so  that  the  student  can\t  learn  what  he  mi^d;  it 
is  also  hard  to  get  items  that  we  can  check  easily  for  bias.  Wte  can't 
do  tlys  research  on  vaHed  populations  and  the  effect  of  a|)titude 
tests  on  them.  It  is  also  difficult,  and  I  see  W  rWon  for  this,  to  get 
information  on  the  breakdown  scores  as  groups  by  race,  byi  State 
and  by  socM  class.  \ 
f  ETS  a^fd^the  CoJlege  Entrance  Board  hkve  told  me  that  they 
have  a  policy  against  providing  racial  dala  so  they  opera-te  in 
secret.  -AJthough  the  college  letterhead  saysvit  operates'to  expand 
educational  opportunities,  their  t*ts  deny  eqiial  educational  oppor- 
tunities to  blacks  and  other  minorities,  to  working  class  Americans, 
'  to  rural  persons  and  to  some  southerners  and  >yesteftiers. 

In  my  additional  statement  I  submit  to  you  some  specific  sugges- 
'  tions  for  improving  H.R.  4949  but  in  general  T  feel  that  bill  wbuld 
play  a  key  role  in  prompting  openness  and  tmis  inducing  bias  in 
the  tests  and  use  of  tests.  \  1 

I  quote  from  Educational  Testing  Service  in  itis  description  of  the 

■GRErK,  ..  \.  J 

The  aptitude  test,  like  other  standardized  tests,  makes  it  possible  to  conn( 
gtudents  with  each  other  regardless  of  their  individual  backgrounds.  A  ORE  ^or 
BOO,  for  example,  has  the  same  meaning  whether  earned  by  a\  student  from  a  sm]a 
private  liberal  arts  college  or  by  a  studieht  at  a  lat]ger  public  uii^iversity,  \ 

This  is  a  statement  th^y  have  never  subiriitted.  it  incouragejs  the 
misuse  of  tests  by  an  admissions iiiMce.  Unless  erQiKhtened,  as  at 
Cornell,  he  is  likely  to  Say:  The  student  got  only  \385;  we  cannot 
admit  her.  That  happened  to  a  student  of  mine. 
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«  ... 

My  hope  is  that  through  the  application  of  H.R.  4949  the  Ameri- 
can people  as  a  whole  will  come  to  realize  that  statement  is  false, 
and  that  aptitude  tests  have  to  be  taken  in  the  context  of  the 
situation  in  Which  the  test  i$  taken  and  the  background  of  other 
applicants  from  that  area.  ■ 

.Mr,  Weiss,  Thank  you,  Dt,  Loewen.  Yoiir  prepared-  statement 
will  be^  without  objectidn,  ^entered  in  full  in  ^ne  record  and  that 
will  be  the  case  for  all  the  witnesses.  _ 

You  may  feel  free  to  summarize  if  you  so  desire. 

.[The  prepared,  statements  oC  Dr.  James  W,  Loewen  follow:] 

Prbpared  Statsmbnt  of  Dr:  JImes  W.  .  Loewen,  Director  Of  Research,  Center 
FOR  National  Poucy  Review,  School  of  Law,  Cathouc  University  of  America, 
•August  15, 1979 

'  ■  . 

"Truth  in  Testing*'  and  other  issiies  related  to  the  use  qf  standardized  testing  in 
education  and  employment  have  long  concerned  me,  both,  as  a  researcher  in  sociolo- 
gy and  98  a  college  teacher.  My  research  and  teaching  experienced  in  black  and 
white  America,  rural  and  urban,  Have  Jied  me  to  sev|sral  conclusions  which  I  wish  to 
share  with  the  ^bcommittee  and  its^staff  as  you  .  ponder  these  important  l^atters. 
In  this  statement  I  will  first  summarize  my  experience  and  qualifications  in  this 
area,  then  describe  some  insights  I  gleaned  from  my  own  per$onal  encounters  with 
tests  and  from  those  of  my  students,  aiid  finally  describe  some  problems  in  the 
research  literature  and  in  doing  scientific  research  in.  this  area.^  ^ 

Experience  and  qualificiitions  ' 

I  hold  a  Ph.D.  from  Harvard  in  sociolo^  with  specialization  in  race  ^elatioris,; 
sociology  of  education,  and  field  methods  of  research.  These  thriee  areas  are  directly 
reli^vant  to  the  topic  of  testing  and  to  the  research  that  has  been  done^in  this  area, 
particularly  because  field  methods  have  been  the  Achilles  heel  of  the  testing  move- 
ment. (More  0^  that  later.)  I  taOght  for  seven  years  a(  Tougaloo  College  in  Missleeip- 
pi,  an  excellent  predominantly  black  college,  and  am.  now  on  leave  from  the  faculty 
of  the  University  of  Vermont.  At  thosie  institutions  ahd  in  teaching  positions  at 
Millsaps  College  in  Mississippi  and  Harvard  University  I  encountered  diven^  sets  of 
students,  includinR  rural  Mississippians  and  rural  Vermonters,  Bostonis^s  ahd  stu- 
dents from  New  York  and  .Philaaelphia<  suburbs,  children  of  millionaires  and  of 
sharecroppers,  and  of  course  blacks  and  whites.  .  . 

Work  m  the  sociology  of  race  relations  resulted  in  niy  sharing  the  first  annual  ^ 
Spivack  Award  of  the  American  Sodiological  Association  in  1978..  My  recent  work 
specificallv  related  to  testing  includes  three  articles:  '^'Stratification:  Class  Biases  ii^ 
IQ  Tests/  in  Eighty-ohe  Technicjues  for  Teaching  Sociological  Concepts  {Washing- 
ton:. American  Sociological  Association,  1979),  "Breaking  the  Vicious  Circle,''  in  the 
Clearinghouse  for  CivU  Rights  Research  (Vol.  VI  No.  1-2,  1978),  and  "Iniroductorv 
Sociology  for  the  Privileged:  Four  Classroom  Exercises,''  in  Teaching  Sociology  (Vol. 

.  6/No.  3,  197d).  As  Director  of  Research  at  the  Center  fqr  National  Policy  Review,  I 
nave  planned  a  research  project  with  Dr.  William  Sedlacek,  Director  of  Research  at 
the  Counselling  Center  of  yie  University  of  Maryland,  titled  "Possible  Caum  of . 
Lower  Black  Scores  on  Aptitude  Tests."  I  have  also  been  campuswide  Cblloaulum 

/  Sneaker  on  "Aptitude  Tests:  Biased  Against  f  ou?''  this  ^asi  semester  at  Ogletndrpe 
University  in  Atlanta  and  conducted  a  worksnop  on  minimal  competency  testing  for 

:  the  Southeastern  Teachisr  Corps  Network.   l_ 

Personal  experiences  with  tests 

As  a  child  of. urbane  highly-educated  middle-class  parents,  T personally  have 
alwaVs.  done  well  on  testsf  scoring  in  the  99th  percentile  on  tne  PSAT,  SAT, 
MMSQT,  and  GRE.  lliere  fore  I  was  shocked  to  learn.  M^iile  doing  research  in 
Mississippi,  that  Ole  Miss's  requirement  (at  the  time)  or  an  "800"  on  the  GRE  for 
admission  to  its  theatre  pro^ani  meant*  not  a  99th  percentile  score,  but  two  400's 
(morning  and  afternoon  sections  of  the  test)!  I  thus  realized  the  vast  differences  in 
performance  by  region.  Tnese  differences  relate  to  income  and  urbcuiit^;  family 
income  amte  correlates  .83  with  PSAT  scores  on  a  statewide  basis,  as  mov/n  in  my . 
article,  "Breaking  the  Vicious  Circle.'.' 

 ^»-T-  ■    ■      ■  ■   ■/  ' 

■  Enclosed^  Appendix  A. to  this  report  is  the  Autumn- Winter  issue  of  the  "ClearinshoUse  for  ] 
^Civil  Rights  Research/'  which  I  edit  This  issue,  titled  "Testing  and  Citizenship/'  includes  four 
articles  directly  related  to  concerns  of  th%  Subcommittee. 
*  Enclosed  as  Appendix  B  is  my  vita. 


Ti^ching  i^iTougaloo  College  provided  further  insights  into  the  testing  problems 
of  KUB8i88ip]^to8,  this  time  black  Mississippiand.  Tbu^doo-has^'Sr-fltrong /biology 
program.  OSr  graduates  won  ASA  Minority  Fellowshipsjin  each  of  the  first  two 
years  of  that  program,  Ford  National.  Black  Fellowships,  Danforth  Fellowshijps,  and 
other  national  awards  for  graduate  study.  Yet  our  graduating  seniors,  all  of  whom 
were  required  to  take  the  ORE,  scored  bf^tween  200  and  56{i  (the  scale  goes  from  200 
to  800  and  beyond).  We  actually  had  students  scoring  200,  the  minimum;  a  reason- 
ably good!  student  would  receive  perhaps  far  below  tlie  national  median,  then 
500. 

Some  students  with  scores  in  thd  400i  wOuld  nonetheless  be  admitted  .to  difficult 
graduate  programs  (e.g.,  l^nceton  in  international  relations.  Harvard  in  education 
and  social  policy,  Washington  University  in  sociolo^,  (^hicagb  in  social  work), 
Usually  because  some  member  of  the  admissions  committee  kpew  Tougaloo's  reputa- 
tion in  sociology  and  convinced  the  committee  to  disregard  the  GRE  scores.  (We  dlso  . 
learnt  to  help  some  students  develop  reasons  why  they  had  not  taken  the  GRE,  for 
.  SQme  schools  found  it  Wsible  to  waive  the  GRE  requirement  for  a  believable 
excuse,  while  they^  would  not  have  ov^lobked  a  400  score  on  it  if  takeq.)  In  those 
graduate  programs,  our  . students  did  admirably,  oiften  completing  advanced  degrees 
m  short  order  and  with.outst^ding  recommendations. 

So  I  came  to  question  the  tests. 

Now,  let  me  add  something  ihat  might  perhaps  weaken  my  case.  The  GRE  did 
tend  to  put  our  students  in  the  "correct"  rank  order.  That  is,  our  best  mfigors— 
highest  in  grades  and  performance  in  our  clashes— tended  to  get  the  460's  and  530*8. 
Our  worst  students  received  the  200's  and  225*8.  There  would  be  exceptions:  a  rather 
average  white  student  at  Toi^aloo  might  get  a  585,  leading  her  entire  cohort,  while 
her  actual  academic  performahca  was  by  no  means  that  outstanding,  while  a  par- 
ticularly rural  blyk  student  migntnreceive  a  270  while  we  regarded  him  much  more 
highly.  But  in  geMral  the  tests  provided  no  r^l  surprises,  within  our  population  of 
Southern  black  studients.        '      ' ' 

When  I  taught  at  Harvard,  I  recall  encountering  one  .sophomore  who  could  not  do 
.  the  work  required  by  niy  relatively  straightforward  "Sophomore  Seminar  in  Social 
Relationr*.  Other  students  did  not  do  the  work:  still  others  could  do  it  only  with 
difficulty,  but  this  was  the  first  Harvard  student  I  had  seen  who,  no  matter  how 
hard  he  worked,  could  not  handle  ifny  coursie.  So  I  checked  his  file.  (This  was  in  pre-  * 
Buckley  Amendment  days.)  HiH  SAT  verbal  aptitude  was  485.  He  had  graduated 
fjrom  Phillips  Bxeter  Acad^in3^r*ifi  parents  were  highly  educated^  his  father  and 
gfandfather  were  Harvard  alumnOmdJie  lived  in  an  elite  ^Northeastern  suburb. 
Now  I  understood  his  problem.  For  although  his  485  was  identical,  to  the  .485  that 
might  be  scored  by  a  strong  sociology  mcnor  at  Tougaloo,  among  Uls  peer  group  of 
urban  prep-school studentif,  ii  put  him  probably  in  the  lowest  quartile.  He  could  no^ 
do  the  workl  "  i       .  «„v/mi^  ' 

And  yei  Educationcd^Testing  Service  says,  in  its  description  of  the  GREn  Th^ . 
Aptitude  Test,  like  otKbr  standardized  tests,  makes  it  possible  to  compare  suidents  ^ 
with  each  other  regardless  of  their  individual  backgrounds.  A  GRE  score  of  oOOrfor^^ 
example,  has  the  same  meaning  whether  earned  by  a  Studd!it  from  a  small  private 
liberal  arts  college  or  by  a  student  at  a  large  public  university.  (1978-79  GRE 
Information  Bulletin,  p.  16)  > 

This  IS  nor  a  factual  statement,  and  as  the  nexf  sectioh  will  show,  ETS  has 
published  no  research  to  justify  such  a  claim*  It  is  siinply  a  statement  of  arrogance! 

My  experiences  in  Mississippi  allow^-an  additional  generalization.  Because  Mill- 
saps  College,  a  predominantly  wh\te  institution  in  Jackson,  had  no  strong  methodsA 
statistics  course  in  sociology-aathropologyj  I  was  asked  to  develop  ofie.  For  three  , 
semesters,  I  taught  Methods  afid  Statistics  of  Social  Research  simultaneously  at  a 
white  and  a  tdack  institution;  during  two  of  those  semesters  the.  instruction  itself 
V%as  partly  merged,  with  Millsaps  students  coming  to  the  Tbu^aloo  campus  for  about 
a  third  of  their  classes.  Alignments,  texts,  and  tests  w6r§,  identical,  and  I  graded 
examinations  "blind/*  without  knowing  which  students  from  which  collMfe  had 
written  them.  Test  scores  were  almost  the  sattit  at  th^  two  schools,  but  ^  sigmficant 
difference  occurred  in  the  composition  of  thosp  scores-.^pTougaloo  students  did  slightly 
better  than  Millsaps  students  oh  fihe  extended  ebsaya  or  extended  statistical  prob- 
lems, while  Millsape-fltudents  defin^ply  Qu^coiTBd  their  Tougaloo  counterparts  on 
the  "short-anewer'^or ''multi-choice"  sections  of /the  tests.  These  results,  in  addition 
to  some  close  investigation  of  the  performance  i[>f  those  Tougaloo  students  who  Sid 
very  poorlv  on  n^ultij^eK^hoice  duestions,  conyincef  me  that  persons  deficient  iif 
language  skills,  are  particularly  disadvantaged  liy  muItipleKshoice  testing. 

iTiis  conchiBion  mt^  ileem  Odtitrary  to  common  sense.  Indeed,  mahu  of  the  very 
studeats  Afflicted  by  inadequate  reading/ writing  skill?  (flamored  for\mul.ti-phoiqe 
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^  exams,  thinking  it  would  be  easier  for  them  to  marlTX's  than  to  write  paragraphs. 
Nevertheless,  the  process  of  reading  a  paragraph,  holding  it  in  mind  while  r^aaing 
five  sentences  as  ?ilti*rnatives  A  through  E,  testing  each  alternative  against  the 
paragraph,  and  selecting  a  best  answer  amounts  to  a  particularly  *'white"  and 
urban  skill.'  Thus  the  form  of  multipleK;hoice  written  exams  discriminates  against 
persons^deficient  in  that  skill. 

This  discrimination  is  justified  to  the  extent  that  the  skill  involved  is  a  fair 
representation  of  the  abilities  needed  to  do  the  job  to  whichilthe  examination  deters 
entrance.  However,  the  performance  of  black  students  in  graduate  school  (and  not 
•   just  my  own  students,  but  those  studied  nationally,  as  references  in  the  Appendix 
describe)  is  often  excellent,  despite  their  subaVerage  aptitude  scores. 

The  same  conclusion  is  justified  by 'further  analysis  within  my  test  results  from 
Tougaloo  and  Millsaps.  Black  ^t^udents  did  \vorse  on  the  multiplerchoice  part  of  the 
exams.  If  those  scores  measured  something  basic,  if  they  measured  an  important ' 
f  ability  to  deal  with  the  subject  matter  of  the  course, 'then  why  did  the  saipe  black 
students  do  slightly  better  than  their  white  peers  on  essay  parts  of  the  exams? 

The  obvious  overall  conclusioh  from  this  experience,  supported  as  well  by  other 
research}*  is  that  the  form  of  nmltiple-choice  tests  discriminates  against  minorities 
and  non-urbane  peoples,  even  when  they  have  been  exp^ed  to  the  precise  pontent 
on  which  they  are  being  tested.  iBias  in  content  is  another  matter;  I  treat  it  in  the 
.  next  section.)  Other  problems  with  form  include  the  settings  in  which  the  tests  are 
.  typically  given  ("white"  in  styld;  usualiy-white^in  site  and  personnel  as  well)  ai 
the  expectations  of  ^nferior  minority  performance  (laid  on  black  students  with 
special  severity  by  the  society  aii  a  whole,  by  the  educational  system,  and  by  their 
previous  teat  experiences). 
But  if  th|  form  of  ^the  test  is  biased,  that  is  a  sweeping  problem  for  the  test- 
it  cannot^  be  dealt  with  by  half-hearted  measures.  ETS,  for  instance, 
its  test  administrators  to:  Treat  all  candidates  equally.  Knowing  how 
t)rity  candidates  can  le  affected  by  the  phychplogical  atmosphere  of  the 
testing  center,  you  will  want  to  make  certain  that  none  of  your  procedures  makes 
*hem  feel  different  from  other  examinees.  (ETS:  Administering  ETS  Testing  Pro- 
grams, 1978-79:  A  Guide,  1978,  pt  ge  20.) 

Since  the  form  of  the  test  a  id  of  the  testing  does  not  "treat  all  candidates 
equally,'' this  instruction  is  meslninglesp.  ^ 

Nor  are  minorities  the  only  persons  adversely,  affected  by  bias  in  test  form. 
Students  at  the  University  of  Vermont  fall  into  two  basft  categories:  those  from 
rural  Vermont  (perhaps"  excluding  Burlington,  Vermont's  only  sizable  •  city)  and 
those  from  suburbs  of  large  Eastern  cities.  Median  family  income  of  the  latter  group 
is  about  $50,000;  their  SAT  scores  are  about  a  hundred  points  above  the  average'  of 
"native  Vermonters,"  as  the  phi  ase  goes.  Their  freshman  Grade-Point- M&rage 4s 
very  slightly  above  that  of  Vernr  ont  students;  by  the  senior  year  this  small  diffeK 
ehce  has  reversed.  It  is  pOssibh,  of  course,  that  Verniont  students  work  much 
harder  to  earn  those  basically  e<|ual  grades,  but  I  know  of  no  evidence  to  support 
such  a  hypothesis.  Again,  the  vast  test  score  gap  that  exii|lB  across  groups,  in  this 
case  a  rural/urban  gap  and  to  some  extent  an  income  gap,  does  not  denote  any 
commensurate  differential  in  performance. 

Research  on  test-score  differential 

One  reason  I  have  spent  so  mUch  time  on  my  own  experience  with  test-score 
differentials  is  that  previous  research  in  this  area,  at  least  as  related  to  race  and 
class,  has  been  fairly  scarce.  Several  problems  afflict  would-be  researchers  in  this 
field,  First,  it  is  a  sensitive  issue.VThe  College  Board  will  not  even  allow  ETS 
officially  to  release  racial  means,  let  alone  make  detailed  data  by  race  available,  lest 
they  be  misinterpreted  and  misused  By  white  supremacist  writers.*  Ironically,  then, 
precisely  be<»use  of  this  sensitivity  to  t^he  issue,  little  research  has  been  done  ^on  it, 
and  some  that  has  been  performed  seems  more  defensive  than  seeking  in  na'ture.* 
Research  has  also  been  inhibited  by  the  M^tmakers*  claimed  need  to  keep  their  tests 
cdtifldential  and  reusable,  whicM  restrictsXaccess  to  data  and  makes  item-analysis 
almost  impossible,  at  least  by  outsiders.  Researchers  withiii  the  testing  agencies,  on 

*  See  page  29  of  Appendix  A;  cf.  pages  6-11.  "\ 

*  See  the  studies  bv  Abramson,  tcibufg,  Feldman  knd  Sullivan,  Haggard,  SaAler,  ^nd  Whim- 
bey  cited  onjjages  lo-19  of  Appendix  A.  \ 

•George  flt  Hanford,  Senior  Vice  President,  The  College  Board,  letter  to  Loewen,  1 1/10/78. 

*  "Some  Points  of  Confusion  in  Discussing  the  Teswng  of  Black  Students,"  by  ETS  staffer 
Ronald  L.  Flaugher,  begins  with  the  statement,  "Ther*  are  several  confusing  issues  that  have 
delayed  the  progress,  toward  seeing  that  testing  is  nkt  a  source  of  unfairness  for  minority 
students^,*  (Ghapfer  2  of  L.  P.  Miller,  ed..  The  Testing  Of  Black  Students:  A  Symposium 
[EaglewoodClifT&PrenticeHall,  1974],  11.)  ^ 
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the  other  hand,  teiid  to  be  limited  to  data  from  exii^ting  test  items;  this  constricts 
the  range  of  hypotheses  they  can  investigate.  Yeti  another  obstacle  js  created  by 
test-takers'  need  to  focus  on  the  test  itself;  hence  th^y  respond  poorly  to  requests  for 
socioeconomic  dam  and  academic  petfprmance  informati^^^  i 

Within  this  bleiik  picture,  there  are  some  bright  spots.  A  faiidy /large  body  of 
evidence  links  test  performance  with  socioeconomic)  status  and  facial  group  mem- 
berships. (Of  course,  this  evidence  can  itself  be  misus<id  to  "blame^^the  victim''  for 
poor  performance.)  Ad^uat^  documentation  also  inqiciites  that  test  conditions  typi- 
cally favor  mcgority  students.  Test  anxiety,  race  of  ejcaijniner,  formM  tedt,  and  other 
setting-related  factors  Wve  been  shown  to  depress  rjiiiiority  students'  scores  dispro- 

^BiM^iS^t&e  content  of  tests  has  been  claimed.^  However,  an  ETS  study  of  item 
bids,  **Muninating  Differentially  Difficult  Items  as  ab  Approach  to  Test  Bias,"  ETS 
Bulktm  RB-78-4,  found  no  such  effect.  These  researchers  followed  a  strict  empirical 
apipiroach.  They  removed  those  itjerois  from  the 'SAT  on  which  blacks  did  worst,  vis-av^ 
m  whites,  in  effect  builmng  new  SAT  verbal  and  math  scales,  and  then  they  lookeo 
tasee  what  had  haippened  to  scores.  They  found  ^'relatively  little  effect."  Hence  they 
md  not. bother  to  look  at  the  nature  of  the  removed  Items.  But  their  research  Was  . 
flawed  by  the  enormous  problem  that  the  ratio  of  black  success  to  white  success/on 
the  removed  verbal  items  was  58  percent  (43.5  percent  of  the  blacks  ^ot  them  right, 
compared  to  75  percent  of  the  whites),  while  on  the  retained  items  this  ratio  wad  55  . 
percent!  Thus  blacks  did  better  on  the  removed  itemct  than  on  those  items  left  in, 
vis-a-vis  whites.  No  wonder  their  removal  did  not  help  blacks  move  up  compared  to 
the  white  median  sc6rel  Thd  researchers  failed  to  do  what  they  claim  to  have  done. 

Another  paper,  "Word  Associations  of  Students  at  Predominantly  White  and 
Predominantly  Black  Colleges,"  claims  a  different  "null  result."  Joel  T.  Campbell 
and  Leon  H.  belchev  gave  a  word  association  test,  using  words  from  the  GRE,  to 
students  from  black  rnd  white  colleges.  They  indicate  that  the  students  did  not  take 
the  test  seriously,  tod  they  do  not  take  it  seriously  either,  in  that  they  do  not  make 
any  attempt  to  relate  racially  different  word  associations  back  to  test  performance; 
thus  the  words  might  just  as  well  hfve  been  taken  from  any  source  in  the  English 
lanj^age.  Despite  these  methodiological  inadequacies,  black  patterns  vwre  somet 


"ecology,"  while  whilbes  associated  it  to  "air,"  "clean "  "ecology,"  and  "earth.  , 
Neither  usace  is  wrong;  blacks  are  centering  on  the  social  environment  while  whites 
center  on  tne*  natural  environment.  Obviously  any  syllogism,  taitpnjrm,  or  other 
verbal  ability  item  that  used  "envlrohment"  would  nave  to  be  slanted,  purposefullv 
or  accidentally,  agaimt  one  race  or  the  other.  Implications  for  verbal  aptitude  tests 
are  substantial,  especially  where  the  word  is  merely  used  differently,  not  misused: 
items  b£(£ed  on  back  isage  could  lc«ptimately  help  "culture  balance"  other  Items 
I  based  on  vocabulary  less  known  by  blacks.  ' 

The  foregoing  analysis  suggests  that  cbntent  bias  can  be  subtle,  as  when  common 
minority  usage  is  different  from  mi^oritic  meanings,  or  when  Southerners  think  of 
one  context  mr  a  word.  Northerners  ano^Westerners  another.  Much  of  thi  content 
bias  in  the  GRE,  SAT,  Miller  Analogies  Test  (MAT),  LSAT,  and  other  verbal 
aptitude  t^ts  is  more  Hlatent.  Item  after' item  is  rather  simple  in  reasoning  or  word 
relationships  but  is  basM  on  what  can  only  be  termed  "establishnient"  vocabulary.  I . 
have  never  encountered  lain  analogy  based  on  joining  terms,  for  instance,  but  have 
seen  many  based  on  Gi»ek  history  or  classical  music.  Items  based  on  words  like 
Thueydides,  Herodutus,\9hianti»  argentum,  Hera,  ambei^is.  Gather,  cuneiform, 
^^unnymede,  minotaur,  and  Latinate^  test  exposure,  not  aptitude,  ^and  America  a 
residenlal  and  cultural  segregation  limits  the  exposure  of  minorities  and  rural 
childrexi^  this  kind  of  information.  -        .  >, 

This  is  ah  international  problem.  According  to  the  Organization  for  Economic  iCo^ 
oiJ)eration  and  Development,  headqulirtered  in  Paris,  in  a  study  of  testing  and 
certification  in  Western  developed  nations  gendirally:  All  selection  mechaniBms  ^ 
baaed  on  the  usu^l  mdicatora  of  education  perforahanCe  are  invariably  biased  by ' 
factors  related  to  thelitudenttf'  social  and  cultural  t^ackground  and  thus  necessarily 
help  to  ma^itain  the  existing  social  structure  and  its  dominant  v^ues.  (Selection 
anaCertifidfition'in  Education  and  Employment,  1977.) 

Mmy  European  nations,  once  perhaps  more  rigid  than  the  United  States  in  their 
xme  of  testing  for  tracking,  have  moved  toward  reform  in  this  crucial  area.  Can  we 

afford  not  to  following  their  eJiample?  . 

.  t»  *        •    •     .  .      .  ^  *  . 

E.  CoupUnd,  "Aptitude  ^^ts  and  bi8criinination'\  International  Law.  Review,  Vol.  102. 
No.  8, 1970, 241-268.  .  /  ^ 


Conclusion  '     ^  , 

1.  "Standardised  tests"  are  thi  greatest  single  barrier  to^qual  opportunity  for 
disadvantaged  groUps,  at  leat  in  the  sphere  oft  education.  Minorities  who  get  into 
higher  education  generally  do  so  despite  tests,  n^t  because  of  them,  which  is  particu- 
larly ironic  in  light  of  the  ostensible  reason  for  the  development  of  the  tests 
themselves,^  avoid  petty  prejydice  and  capricious  or  arbitrary  rejections. 

2.  Many  ifcembers  of  the  nr\fiyority,  particularly  persons  from  the  working  class  or 
rural  areas,  ai:e  similarly  disadvantaged.  Test  scores  are  drastically  lower  in  some 
parts  of  th^  country  than  in  others. 

3.  Thervast  t^^8Core  differentials  acfoss  groups  and  regions  are  hot  validated  by 
any  commensura*  performance  differentials  and  therefore  indicate  a  failure  of  the 
tests,  not  of  the  minorities  or  the  regions. 

4.  A  **truth  in  testing"  bill  is  needed,  among  other  reasons,  so  that  social  scientists 
outside  the  employ  of  the  jtest  companies  can  undertake  unbiased  research  into  the 

^test-construction  process,  the  effects  of  different  kinds  of  items  on  different  kinds  of 
fl^udents,  and  the  causes'  of  differential  performance  across  groups.  Without  this 
type  of  "sunshine  legislajtion,"  it  has  not  been  easily  possible  to  study  these  topics; 
I  thank  you  for  your /atte;ition  and  urge/your  consideration  lOf  this  legislation. 


Additional  Statement  of  Dr.  James  .W.  Loewen,  Director  of^esearch.  Center 
FOR  National  Policy  Review,  School  of  Law,  Catholic  UNivErisiTY  of  America. 
September  24, 1979  ,  .  ^  •  ^ 

In  order  to  highHght  two  points  about  testing  related  to  H.R.  3564  and  H.R.  4949, 
and  to  add  some  specific  comments  about  each  bill,  I  ask  that  the^  Subcommittee 
allow  me  to  add  this  statement  to  my  statement  of  8/15/79  and  to  its  Vecord  in  these 
hearings.  / 

First,  I  submit  additional  data  to  emphasise  the  most  basic  issue  testmakers  have 
failed  to  address,  therefore,  the  greatest  problem  that  standardized  tests  pose  to 
Amef-ican  society:  tests  may  measure  aptitude  or  achievement. \yithin  populations 
that  share  backgrounds,,  but  th^  do  not  measuj^e  accurately  across  backgrounds. 
Thus  they  discriminate  against  rural  Americans,  Afro-Americans,  working-class 
students,  and  anyone  else  not  from  a  white  urban  middle*  or  upper-class  family.  On 
this  point,  I  enclose  Tabte  I,  Aptitude  and  Per  Capita  Income  by  State.  The  aptitude 
data  come  from  the  PS^T  of  ETS,  which  the  National  Merit  Scholarship  Corpora- 
tion has  used  as  a  part  of  their  selection  process  for  National  Merit  Finalists  and 
Scholars.  NMSC  wants  £q  foster  a  national  competition,  and  in  order  to  avoid  giving 
an  unfair  advantage  to  residents  of  Princeton,  suburban  Connecticut,  et  al.,  it  long 
ago  institued  different  cutoff  points  for  each  state  on  the  Preliminay  Scholastic 
Aptitude  Test/National  Merit  Scholarship  Qualifying  Test,  cutoffs  set  so  that  the 
number  of  NMSC  finalists  is  proportional  to  the  number  of  high-school  seniors. 
Connecticut  has  the  highest  cutoff,  Mississippi  the  lowest,  and  it  is  intriguing  to 
note  that  CqnneCUcut  isjhq^riches^t  _state  in  the Jiaiion,.  Mississippi  the  poorest.  As 
Table!  indicates,  T0%  of  alfvariation  in  PSAT  cutoffsas  associated  with  median 
income  by  sttite!  ■       m  . 

IricidentQlly,  another  variable,  (Proportion  urban  in  th^  population;  plays  a  consid- 
erable role  also.  Its  correlation  witfr  PSAT  cutoffs,  r=.57,  explains  32.5  percent  of 
the  variation  in  PSAT  cutoff  scores. 

\  Table  I  also  shows  by  implication  the  problem  a  researcher  faces  in  trying  to 
learn  about  or  explain  regional,  rural/urban,  racial,  or  other  variations  in  test 
scores:  note  tht  I  had  to  obtain  these  data  from  an  "outside"  source,  NMSC;  ETS 
would  not  release  them  to  me;  the  better  measure,  state  median  score,  therefore 
could  not  be  studied.         \j'      .    .  i 

Second,  I  enclose  the  "Loevimx  Low  Aptitude  Test"  for  your  consideration.  This 
teaching  device  is  designed  to  show  my  Urbane  white  students  some^  the  forms  of 
test  bias  and  to  give  them  the  experience  of  "flunking'*  an  aptitude  test.  Appendix 
C,  a  reprint  of  my  Article,  "Introductory  Sociology:  Four  Classroom  Exercises," 
discusses  the  type  of  bias  each  question  represents  and  provides  (on  page  2i39)  t^he 
correct  answers. 
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nil 


state. 


Conifectiort.. 

Delaware  

Id.C  :  

iFlOfida......... 

iGeofgIa  

Hawaii  

Idaho  

Illinois  

Indiana...:  

Iowa  

Kansas  

Kentucky.. 


Louisiana....  ...^  ,  :  :   3,065 

Maine  ;  ;  :  

;  Manfiand  ;   4^47 


Massachusetts.. 
Michigan .... 
Minnesota... 
Mi$sis$ippi.. 
•Missouri..... 

Montana  

Nebraska.... 


New  Hampshire.. 

New  Jersey  

New  Mexico  

New  York:.,  

North  liiMina.... 


North  Rkota, 

Ohio...;  


OWahoma  :   3.26^^  36 

Oregori  :  ^  

Pennsylvania  

iRhode  Island  

South  Carolina..   jn.  


5; 


Tews  ■  

Utah  ,  ;  

Vermont. .:....:....v  ^  

Virginia.  

Wihkigton..  ;  ...^  

West  Virginia  

Wisconsin  

Wyoming  1  


— 1- — 

nconw 

(1970) 

Rank  \ 

P$AT 

cutoff* 

Rank** 

.  $2^28 

49 

182 

47 

•  4,676 

4 

194 

9.5 

3,542 

30 

190 

21.5 

.  .2,742 

50 

180 

•  48.5 

4,469 

9 

^  193. 

112.5 

3,751  / 

21 

191 

19 

•  4,807 

.  2 

-  200 

1.5 

4,233  ' 

12 

198 

4.5 

5,519 

1. 

•200 

1.5 

'3,584 

29  . 

190 

.  21.5 

3,277 

35 

187 

36.9^ 

.    .  4.530 

7 

193 

12.5 

3,206 

1% 

188 

34 . 

4,516 

8 

19? 

16 

3,773 

20 

189 

27.5 

3,714 

23 

189 

27.5 

3,804 

18 

•  189 

27.5 

3,060 

•  43 

183 

•  45 

3,065  . 

42 

180 

48.5 

3,243 

37 

189 

27.5 

4,247 

11 

198 

4.5 

4,294 

10 

197 

7 

»  4,04? 

13 

188 

34 

3793 

19 

191 

19  . 

?.561 ' 

51 

178 

.51 

3,^59 

26- 

189 

27.5 

3.381 

34 

^89 

27.5 

3700 

24 

189 

27.5 

4.544 

5 

186 

38.5 

3,608  , 
4,539  ' 

27 

191 

19 

6 

f  198 

4.5 

3,044 

45 

188 

•  34  - 

4,797 

3 

198 

4.5 

3,188 

40 

187 

36.5' 

2,937 

46 

183 

45 

3,983 

15 

189 

•  27.5 

3,26^^ 

36 

185 

41 

3,700 

24 

192 

16 

3,893 

17 

193 

12.5 

•  3,920 

16 

194 

9.5 

2,908 

48 

.  183 

45 

3,182 

41 

185 

41 

:  3,051 

44 

185 

41 

3,515 

31 

189 

•  27.5 

.  3,210 

.38  . 

185 

•43 

.  1  .3.491 
.V  3,586 

32 

192 

16 

28 

.  196 

8 

.  '  3,993 

14 

193 

12.5 

2,929 

47 

179 

•50 

3.722 

22. 

189 

27.5 

3,420 

33 

186 
—A- 

38.5 

.    r  (SpeirmM  rank'^rder  corrtlation  coeffidMt) -.83.  r^Vess  •  • 

.>  NMSC  uses  twkx  the  vertkiJ  score  (rartM  20  to  80)  pkis  the  math  score  (same  rante);  the  resultJflg  scores  raoM  from  60^  240. 
>  Ttei  have  bem  assi^tid  the  mispoint  of  tmir  ranking  range.  *  % 

.J^J52^  ^  ^  ^5  mejns  there  hw  rdaUonsMfTapparMA .between  kicome  and  PSAT  scori  r-1.0  meAs  thire. is  a 

perfect  oorrtopondeme.  so  M  knowlr»  mcome  the  sUte  PSAT  cutoff  can  tw  predbted  entirely  without  error.  t^jMinm  there  is  a  perfect 
MtrispMdem.  so^^knoBg  JSfmf  the  state  P$AT  cutoff  can  be  pre«cM  entirely  without  W.  ;-.03  Is  i  if  high  corteiatkm  coeffi3ent 
^  N  means  that  aknoit  70H  (6S.9%)  of  aN  vfhatton  in  state  PSAI  cutoff  ,  can  be  "e)i{(aine(r'  by yRe  variable,  median  Inoome. 

I^nally,  my  fipecific  comments  about  Bach  bill  A|9 1  read  H.R.  8564,  the  "Truth  in 
ting  Act  of  1979,"  it  requifes  nothing  significam  from,  say,  ETS,  that  is  not  no^ 
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being  provided.  Th^refor^  it  seems  paradoxical  to  me.  Why  toact  it?  If  these 
heanAgs  convince  you  there  is  no  proolem  with  standardized  testing  as  now  pr^ 
ticed  in  America,  th^n  I  would  think  you  would  recommend  no  bill;  if  on  the  oth^r 
hand  these  hearings  convince  you  that 'there  are  i)roblems  that  call  for  federal 
regulation,  then  you  would  want  to  recommend  a.  bill  that  addresses  some  of  the 
problems.  H.R.  3564  does  not 

Many  of  the  problems  with  standardized  testing  cited  in  my  previous  statement 
and  in  thi6  statement  are  considerably  amelioriated  by  H.R.  4949,  on  the  other* 
hand.  Its  provisions  regarding  Jeedback  of  test  questions  and  correct  answers  will 
help  individuals  and  entire  scnool  systems  learn  areas  in  which  they  need  improve- 
ment. Its  provisions  reauiring  filing  of  the  relationships  between  test  scores  and 
income,  race,  etc.,  will  help  admissions  officers  understand  that  a  350  from  rural 
Mississippi  is  not  the  same  as  a  350  froxn  Scarsdale.  Thus  accoutitability  and 
fairness  will  be  increased. 


THE  LOKWEN  LOW  APTITUDE  TEST. 


Directions-    Answeg  every  quesllon.  Do  your  best  In  the  time  aflotted,  for 
^ur  ent  l*re  futwn-  Is  at  slake.  Circle  the  U-tt^r  coVrespondinn  to  the  single 
best  aiv.swer  t»)  the  queKtion. 


1.     Nonverbal  Picture  Test 

Hans  and  Rertha.llve  in  i  thatched  hut  hl^h  In  the  Swiss  Alps.  There  Haos. 
herds  hor  noais  while  Herth'a  poads  IMs  hurts.  One  d.ny  .  after  the  sun  came 

up  .  ■.  .  .. 

ClVcle  where  Han^  aad  Bertim  live^  ' 


A. 

2 -  3 .  An  fU  ojj  i  es  Tes  t 

2.       Spl  lift*  is  to  m.ltrn  as 


3. 


a .  lovo.   .  .  .marriage 

b.  straw.   .  .imid 

c.  key.   .  .loi:k 

d.  bmid.    .   .bu  11  . .  ' 
i».  bond.    »  .papi*r 

Is  to  sake  as  opera  is  to 


is  t;o 


^.  Pete's.  .  .many 

b.  hit.   .   . run  • 

c.  swordplay,   .   .Cliianjifi  a  . 
rf.  attend.      .  for^'H"  ■ 

*  o.  her.   .   .star  • 

t\.  "        '        '  -  ■  .  ■  , 

circle  the  letter  which  Indicates,  the  best  answer. 

\  ■  V 

4.  Saturday  AJux  ^ot  an  1,0. 

a.  '^He  had  smoked  too. much  prass 

b.  -  lie  tripped  out  t)n  dru^s 

■  r,  HeH)rtniKht  lier  to  his  apartment 

d.  He  sH^i»\vi»d  i  t  f>f  f  to  his  fo.s  I 
t».  He  be<\pme  "wised  \\\^  (less  dense)    .  f 

5.  Which  of  these  situations  is  least  congruous? 

*  a.  on  Fames  iV)  the  dlplnK  room  .    .  * 
b.  '  a  rh t  ppendal  e  .  1 11  the  dlnlnK  room 

.  c.   an  EnmeH  in  the  living  room 
d.   a  Chlppr'ndaleMn  the.  1 1 y  room 
alt  or  the  above 


■  \ 

Score 

Esy/^k 

P 

1 

200 

2 

'  ,  275 

■3 

'  4 

525 

5 

.7G(>f 

ft  Correct 

■  \ 


Est  Imnteci  sAt 


Efit .  Time 


.  <      .  w.  •  ■ 

I  woull  qiake  two|  minor  suggestions  regarding  H.R.  4949.  First,  to  the  section 
requ|riiig  the  report  ^to  Congress  ^'concerning  the  relationship  between  the  test 
scores  of  test  suojectis  and  income,  race,  sex,  ethnic,  and  handicapped  status,''  I 
would  suggest  you  add  "regional  and  rural/urbah,''  for  these  are  crucial  variables 
inhibitihg  performance  on  the  part  of  those  who  live  in  rural  areas  and  in  the  South 
parts  of  the  West,  Great  Plains^  and  Midwest.  (Sec.  4(b). 

Second,  why  require  provision  to  the  Commissioner  of  "any  study  ♦  *  *  for 
which  [the  tesf  agency]  provides  data'7  (Sec.  4.(aXl)A))  This  is  too  harsh  on  the  test 
agencies,  for  it  saddles  them  with  a  violation  if  they  release  data  to  a  researcher 
over  whom  they  then  have  no  control,  and  who  may  not  eyen  send  back  to  tljem  a 
copy  of  his/her  study.  It  might  also  become  inadvertently  counterproductive  to  the 
purposes  of  the.  bill,  for  it  could  deter  test  agencies  nrom  providing  data  to  social 
scientists,  lest  they  then  unwittingly  violate  tH6  Idw.  The  Hnal  phrase  should  be 
deleted,  in  my  view. 

Otherwise,  I  conclude  from  my  knowledge  of  the  use  of,  standardized  testing  in 
Amei^f^  secondary  and  higher  education,  and  from  my.  attempts  to  do  scientific 
research  in  this  area,  that  H.R.  4949  would  have  a  most  salutary  effi^.  A  national 
industry  is  involved,  and  the  federal  regulations  Iq  this  bill  would*  be  most  helpful 
imelimmating  some  of  the  abuses  now  present  in  t 

Thank  you  for  your  consideration.  t .  . 

]N%.  Weis^.  the  next  witness  is  Ms.  Simmons. 

STATEMENT  OF  ALTHEA  T.  L.  SIMMONS,  DIRECTOR,  WASHING- 
TON BUREAU  OP  THE?  RATIONAL  ASSOCIATION  FOR  THE  AD- 
VANCEMENT OF  COIlORfiD  PEOPLE 

Ms.  Simmons.  Mr.  Chairman  and  itiembers  of  the  subcommittee: 

I  am  Althea  T.  L.  Simmons,  director  of  the  Washinc^n  bureau 
of  thQ  National  Association  for  the  Advancement  of  Colored  People. 
I  am  here  today  in  behalf  of  the  more  than  1,800  branches,  youth 
councus  and  college  ch^ters  of  the  NAACP  which  operate  in  the 
§0  States  and  the  District  of  Columbia. 

I  am  accompanied  by  Dr.  Anderson  J.  Franklin,  who  is  a  member 
of  the  NAACP  National  Advisory  Committee  on  Testiij^. 

Professionally,  Dr. 'Franklin  is  a  profes$or  of  psychology  and 
director  of  the  Center  for  Acadeniic  Sldlls  at  the  City  College  of  the 
City  University  of  New  York. 

I  do  not  profess  to  be  a  psychonietrician,  that  is  why  I  iiave  Dr. 
Franklin  by  my  sidiei  who  will  be  of  assistance  to  meVand  the 
cojmmittee  in  respondting  to  any  teqhnic^U  question  the.  committee 
mtorDropound.  ^  1  . 

We  appreciate  the  (Opportunity  to  appear  before  you  to  share  the 
NAACP  views  on  the  important  issue  of  testing  and  how  it  affects 
blacks  and  other  minoriti^.  I  must  share^  with  tlie  committee  the 
grave  concern  the  NAACP  Jiais  regarding  the  (wholesale  use  and 
misuse  of  standardized  tests  and  the  disproportionate  impact  such  * 
testipg  has  on  our  constituents. 
.  For  4  years  I  was  -the  NAACP's  national  director  for  education 
\  programs  and  had  occasion  to  work  ck)sely  with  all  of  our  units  on 
educa^on  issues,  confer  with  m^y  educaticm  officials  at  all  levels 
and  ofHcials  the  ^mfyor  testingnDompanies  on  the  consequences  of 
ability  groupmg  practicedf  by  whole  ^|icationaI  systems  which  re* 
ipults  hi  racial  isolation,  the  enforcement  of  stereotypes,  the  label- 
ing of  children  tmd  the  reinforcement  of  feelings  of  inferiority 
which  can  lead  and  does  lead  to  a  third-class  education. 

From  the  cradle  to  the  grave,  there  has  been  an  iqy6rea8in|; 
reliance  in  this  country  on  the  use  of  j»n  assortnient  bf^^tsmdard^ 
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ized  testa  to  screen,  select,  iadmit,  reject,  to  classify,,  stratify,  track, 

Ticerise  or  certify.      /  i  .  '  -ui 

Such  subjective  dependence  on  objective  tool  makes  it  possible,  . 
rwid  even  attractive,  in  some  quarters,  to  use  tests  inequalitably  in 
ways  which  preclude  a  segment  of  the  population"  from  reaching 
the  heights  of  its  aspirations  and  realizing  its  potential. 

The  accelerated  wide-scale  use  of  standard  tests  limiting  access-Af 
blacks  and  other  minorities  to  institutions  of  higher  education  IBd 
tff  the  mandate  by  the  NAACP  at  its  65th  Annual  National  Con-  . 
vention  to  its  national  office  to  call  upon  the  Association  of  Black 
Psychologists  and  the  College  Entrance  Examination  Board  to  asr 
serf  leadership  in  addressing  themselves  to  the  issue  of  standard-  - 
izea  testing  and  the  misuse  thereof.  '  / 

In  1972  the  NAACP  adopted  a  convention  resolution  calling  for  a 
moratorium  on  standardised  tests  until  after  other  suitable  and 
nonbiased  criteria 'for  measuring  pupil  progress  and  teaching  ac- 
countability have  been  devised.  ^  ' 
In  Ime  with  the  above  statement  of  NAACP  policy,  I,  in  my  then 
capacity  as  NAACP's  national  education  director,  convened  a  group 
of  experts  from  the  Association  of  Black  Psychologists,  the  College 
Entrance  Examination  Board  and  the  Educational  Testing  Service 
and  the  NAACP  to  begin  dialog  around  this  important  issue. 

Dr.  Sidney  Marland,  president  of  the  College  Board,  and  vice 
.president  Dr*  Stephen  J.  Wright  and  Dr.  Belvin  Williams,  vice 
president  of  the  Educational  "^Testing  Service  were  active  partici- 
pants and  helped  us  to  identify  issues  and  conference  participants.  A 
We  convened  a  conference  wmch  produced  the  NAACP  rep6rt  oh  \ 
minority  testing  which  is  appended  to  this  statement. 

Incite  this  background  to  let  the  committee  know  the  priority  the 
NAACP  gave  to  the  impact  of  the  unregulated  use  of  standardized 
testing  on  blacks  and  other  minorities.  \  ' 

The  present  legislation,  targeted  to  postsecondary  education,  does 
„8t*^«ppear  to  take  into  account' the  usen)f  standardized  tests  in  the 
elementary  and  secondary  schools.  • 

We  ha^fe  spoken  to  legislators  at  the  State  level  and  with  former 
Cdrtgressman  Harrington  who  in  the  95th  session  of  Congress  intro- 
duced  H.K^6776,  a  forerunner  of  the  current  legisl^Ttion. 

AlthougBvthe  Gibbons  and  Weiiss  bills  are  nOt  as  comprehfensive 
as  we  WQulch  like,'  they  are  a  ^tep  in  the  right  direction.  It  is  the 
position  of  liie  NAACP  that  ti^uth-irf^testing  legislation  is  an- idea 
whose  time  ^as  come. '  '■  „  \  \ 
'  NAACP  advocated  such  legislation  in  1976  at  our  67th  Annua^ 
National  Convention  when  &  riesolution  was  adopts  calling  for  an 
Office  of  Consumer  Affairs  in  Testing  and  Student  Evaluation, 
flat  idea  came  from  Dr.  Frah|klin  who  accompanies  me  today.  We 
felt  there  should  be  this^kinrf  of  office  set  up  on  local  and  State 
levels  where  they  would  advocate-adoption  of  a  truth-in-testing  ■ 
law.        ■  V  .'     ;  ^  '    •  . 

The  NAACP  is  ^^^jjj^  accqM  with  the  .purpose  ot  the  act  as  set' 


forth  in  H.R.  4949.  Welbelieve  that  tefl^  publishers  must  be  resppw 
sMe  fo^;  monitoring  the  use  of  their  tests  by  assuming  aii  advocacy 
^  ^ple  when  necessary.  ^  a/  . 

In  our  rejp^^von  minorky  testing,  sufjplied  to  the  committee,  we 
State  that  in  instances  where  tests  are  Ised-^^or  about  to  be'^uped— 
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without,  due  observance  of  this  advocacy  role,  test  publishers 
should  apply  gimctions,  including  the  denial  of  the  use  of  their 
product  by  those  who  misuse  it. 

Moreover,  test  publishers  JiaVe  an  advocacy  responsibility  which 
requires  that  test  objectives  be  clearly  stated,  that  the  process  of. 
administering  the  test  be  fully  described  so  th&t  subjects  and  users 
both  understand  exactly  what  is  expected  to  happen  and  how  it 
will  happen,  in  nonthreatening,  affirmative  terms. 
i    It  is  ouiv^derstanding  that  there  is  little  systematic  information 
leathered  on  the  relationship  between  test  score?  and  future  sue- 
but  indications  are  that  this  is  a  low  cqrrelaltion.  Th^  deiini- 
tmn  of  Tuture  occupational  success  is  ambigubus  as  many  variables 
d^rmine  this  which  challenges  th^  emphasis  of  test  scores  for 

^^NAACP  endorses  tei^t  i)reparatio]J|^Gl^^  long  as.  organi- 
zation and  persons  cap  verify  theij*  uttUty*  ^%ch  organizations 
shoulomlso  b9  regulated  for  their  claims  ^^BSgy  Iik§^e  test 
agenci^  should  be  required  to  acJknowled^eHH^  to  inquirers 
were  C(»ching  is  effective.  ■  * 

We  reoQgnize  that  the  test  agency  and-tiests  are  not  wholly 
responsibly  for  determining  academic  admissions  or  future  per- 
formance; l^ever,  the  test  users  could  pi:ovide  test  agencies  and 
public  the  esfimated  weight  of  perc^tage  carried  by  tests  in  admis- 
sions-consideration. * 

The  NAACP^  aware  that  test  scores  are  being  supplemented,  in 
some  instances>|by  other  criteria,  but  we  also  know  that  college 
board  scores  are^  still  the  deciding  factor  regatding  who  gets  ad- 
mitted to  what  in^itution.       •  j  ^ 

I  could  go  into  a  list  of  horror  stories  on  why  this  is  necessary 
but  time  does  npt  permit. 

The  widespread  use  of  testing  has  already  directed  minorities 
into  opportunities  which  will  not  allow  them  to  perform  well  on 
postsecondary  tests.  The  distinguished  member  of  the  New  York 
Board  of  Regents,  Dr.  Kenneth  Clark,  said  in  his  letter  to  the 
editor  in  the  August  18, 1979,  New  York  Times: 

Admiaiion  ttots  measure,  the  abilities  developed  by  individuals  oyer  a  long  period 
of  tiiAe,  Doth  in  and  but  of  school.  The  value  of  test  results  is  directly  related  to  the 
equaUty  of  opportunity  afforded  to  the  candi^pD^ 

If  tests  used  in  elementary  8cho#|^0ady  begin  to  put  our  chil- 
dren in  a  di^dvantageous  position,lrow  can  we  jt:ea8onably  expect 
them  to  be  competitive  on  postsecondary  education  tests? 

Teachers,  counselors,  and  admissions  officers  are  publi^  impor^ 
tant  to  the  testing  industry  since  they^sit  at  the  entrance  gates 
through  which,  may  test  takers  must  go  if  they  are  to  realize  their 
goals.         ■  .        .  .  ■ 

The  e>ttent  to  which  these  publics  can  correctly  interpret  and 
effectively  use  those  instruments  is  the  e»:tent  to  whicn  decisions 
will  be  made  that  Are  fair  to''  minority  test  takera.  - 

The  testing  industry  is  called  upon  ^to  help  bridge  that  gap  which 
exists  betiyeen  effective  use  and  lack  of  untierstahding,^  b/ conduct- 
ing workshops  and  institutes,  a^d  writing  special  publications  that 
are  aimed  at  interpretatibh  of  testA 

.IMr.  Chairman,  we  haire  a  few  recommendatioiis  to  make  t6  thet 
oommji^tee,  if  we  may.  We  b^li^ve  that  there  is  a  need  for  clarity  in^ 
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the  definition  Regarding  ^o  the  test  agency  is  so  that  the  person 
who  actainisttos  or  ^ 
dated  under  tms  bilL 


who  actainisttos  or  dbyelopft  tests  knows  the  ^responsibility  man- 
''atisd  under  tins  bill  I  ^ 

Section- 4(2Xl|  is  probably!  the  best  section  in  H.R.  .4949  for  it 


comes  closer  to  what  is  neeied  in  the  whole  area  of  testing.  We 
believe  tljere  i^  a  need  for  §  mandate  for  the  Commissjoner  to 
gather  relevant  ^data  over  a  period  of  time  to  see  what  Kind  of 
things  are  goin&  oh.  The  data,  I  am  reliably  informed,  is  available 
%    .      in  the  coJh(iput^     but  there  is  feeling  among  professionals  with  ' 
whom  f*ave  conferred  that  they  do  not  believe  the  testing  compa^ 
nies  will  mlease  such  data  unless  there  is  a  congressional  mandate^ 
\,   If  tHe- Commissioner  has  information  on  what  is  happening 
/  '  through  the  Use  of  these  tests,  the  Commissioner  would  then  be  in 
V  a  i»i»tion  to  report  to^the  Congress  and  it- could  then  make  a 
/^■'"'laete^ili^j^^  ' 

We  believe  that  it  is  necessary  to  establish  a  monitoring  body  for 
/    the  collection  of  data  from  each  testing  agency.  We  believe  the  bill 
should  spell  out  the  type  of  data  to  be  collected. 
Under  ^'Regulations  and  Enforcement,"  we  were  not  certaiti 
/  ^.     whether  the  bill  was  calling  for  a  civil  penalty  not  to  exceed  $2,000 
for  each  individual  violation  (one  person)  ot  group  violation.  In 
other  words,  if  10,000  persons  are  tested  and  there  was  a  violation 
would  the  penalty  be  not  more  than  $2,000  for  the  group  of  10,000 
or  10,000  times'$2,000.  This  section  nieeds  clarification. 

We  believe  that  the  bill  dips  into  psychologioal  jargon-which  will, 
in  turn,  lend  itself  to  a  response  in  the  same  vein.  We  would 
suggest  thai,  wherever  possible,  the  biirs  language  be  simple 
enough  for  a  layman,  like  myself,  to  ^inderstdnd. 

We  believe  there  needs  to  be  massive  data  collected  on  what  has 
happened  to  students  who  have  been  turned  down  because  of  their 
SAT  scores  or  ACT  scores.  ^.v 

As  a  former  college  teacher,  I  know  of  a  number  of  instance^ 
where  students  were  turned  down  by  one  school  because  of  scores 
^on  staniiardiaied  tests  and  wiere  admitted  to  another  institution  and 
performed  creditably. 

It  should  be  noted  that  this  also  pertains  to  preprofessional  and 
postbaccalaureate  such  as  LSAT  and  GRE  tests.  Test  scores  do  not, 
we  believe,  predict  precisely  college  or  job  success  and  they  have  a 
low  Relationship  of  what  students  are  going  to  do  acaderiiieally 
when  they  get  into  school.    ./  \ 

We  want  to  diagi\pse  what  the  students  need  and  design  a  pro- 
gtam  to  meet  those  neseds.  The  intent  of  testing  should  be  to  open 
up  avenues  for  students,  testing  shouM  be  educational  and  not 
simply  evaluative  and  discriminato^  iiwnature. 

ADDITIONAL  RECOMMENDATIONS 

I.  The  >tfest  user:  (a)  Test  agencies  be  responsible  for  the  training 
of  test  u4(prs.  Test  users  should  be  ififormed  o£  the  validity,  i^eliabiU 
ity  and  bias  of  festis.  They  sj^ould  hdve  at  tneir  disposal  reports 
substantiating  these  faptors  as  well  aS  any  o^her  information  which 
clarifies  the  use  affd  limitatioi|s  of  tests.  * 
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•    ■        ■  ■  ■  ' 

>STest  users  or  anylother  contracting  agency  niust  demonstrate 
that' they  have  personnel  trained  in  the  Use  and  Interpretation  of 
tests.  \  •  •■  ^       ^     .•'  i 

Since  misconceptions  x)f  tests  can  lead  to  damaging  uses,  the 
testing  industry  is  oblig£|ted  to  make  full  disclosure  of  the  purposes 
for  which  tests  are  designed,  the  processes  by  which  they^  are  ' 
designed,  the  population  on  which  they  were  stan^dardized,  the 
statistical  characteristics  which  delimit  their  use,  fer  example,, 
standard  error  of  Measurement,  standard  error  of  estimate,  and 
other  "do's  £(ftd  don'ts''  which  will  affect  optimal  .use  and  interpre- 
tation. •  ' 

More  specifically,  it  is  incumbent  upon  the  testing  industry  to 
give  clear  and  precise  interpretation  of  the  scores  their  tests  yield. 

The  public  must  be  informed  not;  only  that  the  test  scorea  are 
fallible  and  that  their  reliability  is  Imperfect,  but  must  be  told  the 
extent  of  that  fallibility  and  imperfection.  The  public  ^ust  be* 
informed  that  test  scores  are  only  a  sample  of  a  student's  perform- 
ance and  are  never  more  than  an  estimate  of  truth. 

•  •  .  ..  ■    ■        .    '         (  • 

CONSTRUCTIVE  USES  TESTS 

Effective  uses  can  be  made  of  tests,  regardless  of  their  type,  only 
if  the.  user,  knows  what  the  test  contains,  what  its  purposes  aye, 
and  what^ite  limitations  are.  We  move  on  the  assumption  that  an 
educational  system,  and  particularly  a  school  within  the  system, 
implicitly  guarantees  that  students  to  whom  achievement  examina- 
tions^teste— kre  administered  have  been  taught  in  ways  such  that 
they  can  reasonably  be  expected  to  have  learned  the  information' 
required  by  the  exathinaltion.  ^  ■ 

Therefore,  we  call  on  ihe  testing  industry  to  assist  school  sjjstems 
and  other  users  in  unldeManding  better  the  content  and.  con- 
straints of  the  examinations,  and  in  helping  them  understand  how 
to  make  optimal  use  of  the  results.  ^  ^ 

Moreover,  we  call  upon  the  educational  community  and  the  pub- 
lic private  sectors  to  insure  that  tests  are  not  used  or  relied  upon 
where  such  guarantees  do  not  exist.  ' 

Mr.  Chairman  and  members  of  the  committee,  the  NAACP 
strongly  supprts  the  bill  H.R.  4049  because  the  key  featuVes  pro- 
vides for  things  never  before,  available.  True  costs  can  be  deter- 
mined; real  predictive  validity  can -be  approached  on  a  job  or  school- 
related  basis  and  more  important^  the  monopoly  would  have  public 
oversigjit.  4. 

,   [The  completer  statement  X)f  Ms.  Simmons  follows:] 


\ 


ft 


i  \  ■     ■     . .  .  •  ■  . 
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\BlKP^RBD  i^ATEMENT  OF  AlTHEA  T.  L.  Slft^ONS,  DIRECTOR,  WASHINGTON  BUREAU  Ot 

N.  THE  National  Association  for  the  Advancement  of  Colored  People,  Accqmpa^ 
NiEfD  BY  Dr.  Anderson  J.  Franklin,  NAACP  Advisory  Committee  on  T#tino 

,AND  'I*3ROPESSOR  OF  PSYCHOLOGY  ANP  JDlRECtOR,  CENTER  FOR  ACADEMIC  SkILI^,  CiTY 
COLfeOE  OF  CUtTY 

Mf. . chairman  and  members  of  the  Subcommittee: 
I  am  Althea  T,.  L.  Simmons,  Director  of  the  Washington  I9urea*u~bf  the 
National  Association  for  the  Advancement  of  Colored' People.  I  am  here 
today  in  jbehalf.of  the  more  than  1800    branches,  youth  councils  and 
college  chapters  of  the  NAACR  which  operate  in  the  50  state  ans  the 
District  of  Columbia.     I  am  accompanied  by  Or  *  Aftdexson  J.  franklin, 
who  is  a  member  of  th#  NAACP  National  Advisory  Committee  on  Testing. 
Professionally,  Dr.  Franklin  is  a  profeesor  of ^Psychoio^y  and  Director  . 
of  th^  Center  For  Academic,  Ski  1 Is ♦ at  the  City  Cqlleqe  of  the  City 
University  ..otf  New  York.     I  do  not  profess  to  be  a  psychometrician, 
th^t  ia  why  I  have  Dr.  Franklin  by  my  &ide  who  will  be  of  assistance 
to  me  and  the  Cori^ittee  in  responding  to  any  technical  question  the. 

m 

committee  may  propound •  >  . 

%  t  :  ■ 

We  appreciate  the  opportunity  to  appear  before  ydu  to  share  the    •  |' 
NAACP  views  on  the^  important  issue  of  testing  and  how  "iTt  affects 
..  ^  blacks  and  other  mirworuities.     I  must  share  with  the  committee  the 
grave  concern  the^NAAC^  has  regarding* the  wholesale  use  and  misuse 
of  standardized  tests  and  the.  disproportionate  impact, such  testing 
has  on  our  constituents. 
■   ^  For  four  years  I  was  the  NAACP' s  H|tional»  Director  for 
•*   Education  Progr'ams  and  had  occasion  to  work  closely  with  all  of 

our  units  on  education ^ifisues,  confer  with  many  education  officials 
at  all  levels  and  officials  of  the  major  testing  companies 


on  the  consequences  of  ability  grouping  practiced  by  whole  educational 
syat ems  which  results  In  racial  isolation,  the*,  enforcement  of  stereo- 
types, the  labeling  of  |>hildrdn  and  the  reinforcement  of  feelings  :Of 

'  *-  ■        .  •  .  ■ .   ■  *       '  * 

inferiority  which  can  lead  to  a  third  class  education. 

From  the  cradle  to  the  grave ,  there  has  been  an  increasing 
reliance  Iq  this  country  On  the  use  of  an  assortment  of  standardized 
tests  to  screen »  select",  admit,  reject,  to  classify,  stratify,  track, 
license  or  certify.    Such  subjective  dependence  on  "objective?  tools 
'^makes  it  possibVe,  and  even  attractive,  in  some  quarters,  to  use 
tests  ineaualitably  in  ways  which  preclude  a  segment  of  the  population 
from  reaching  the  heights  of  its  aspirations  and  realizing  its  potential.. 
The  accelerated  widescale  uise  of  standard  tests  limiting  access  of 
blacks  and  other 'minorities  to  institutions  of  higher  education  led 
to  the  mandate  by  the  NAACP*s  65th  Annual  National  Convention  to  its 
national  office  to  call  upon  tho  Association  of  Black  i^sychologists  / 
and  the  College  Kntrance  Examination  Board  'to-  assert  leadership  / 
in  addressing,  themselves  to  the  issue  of  .standardized  testing,  and  Jbhe/ 
misuse  thereof. 

In-  1972  the  NAACF  adopted  a  convention  resolution  .calling  fozf.  a 

irtoratorium  oh  standardized  -tests  until  after  other  suitable  and  non-bi^aed 

criteria  for  measuring  pupil  progress  and  teaching  accountability  have 

been  devised.  ■     ^  " 

In' 1974  the  following  resolution  on  testing  was  adopted  by  the  NAACP 
«  •  ■       ■  .  . 

convention .  . 

■  WHERfiAS,  a  dispiroportiOnately  large  number  of  black  students  jare 

being  misplaced  in  special  education  classes  a^d  denied  admission  to 

higher  educational  opportqnities.    ■    ».    ^        .     .  a 


WHEREAS,  stJindardized  teste,  e»g.,  Stanforc^-Binet  and  the 
Wechsler  Scale  for  children,  exclude  blacks,  Puerto  Ricans  and  Mexican- 
Americans  from  the  representative  sample,  and,  f 

WHERKAS,  such  testa  label  black  children  aa  uneduc'able,  assign 
them  to  lower  educational  tracks  than  wJWtes;    |leny  black  children 
higher  education  opportunities;    perpetuate  inferior  education;  place 
black  children  in  special  classes  and  destr^  growth  ind  development 
of  black  children,  and,  '  ■ 

WHEREAS,  students  who  fail  to  show  a  high  (rerUal  or  numerical 
ability,    score  low  orj  the  Scholastic  Achievement  l^est  (SAT),  the -Law 
School  Admissions  Test  (LSat) t  the  Graduate  Record  Examination 
(GRE) ,  etc.,  and  are  toutinely  excluded  from  college  and  graduate 
or  professional  educatiori, 

■    BE  IT  RESOLVED,  that  the  NAACP  demands  a  moratorium  on  standardized 
testing  wherever  such  tests  have  not  been  corrected  for  cultural  bias 
and  directs  its  units  to  use  ail  administrative  and  legal  remedies  to 
prevent  the  violation  of  students'  constitutional  rights  through  the 
misuse  of  tests,  and,  '  ' 

BE  IT  FURTHER  RESOLVED,  that  the  NAACP  calls  upon  the  Association 
of  Blaqk  i?sychologists  to  assert  leadership  in  aiding  the  College 
Entrance  Examination  Board  and  EducationJil'Testing  Service  to  develop 
Standardized  tests  which  have  been  corrected  for  cultural  bias  and  . 
which  fairly  measure  the . amount  of  knowledge  retained  by  students 
regardless  of  his  or  her  ind;^vidual  background,  , 

BE  IT  FINALLV  resolved,,  that  ithe  NAACP  directs  its  units  to 
.use  all  administrative  remedies  inl  the  dvent  pf  violation  of  students 
constitutional  rights  though  the  misuse  of  tests. and  directs  National 
lOffice    staff  to  use  its  influeoee  to  bring  the  CEEB,  ET  and  ABP 
together  to  revise  such  tests i  , 


In  line  with ^the  ?ibove  statement  of  NAACP  policy,.  I,  in  my 
then  capacity  as  NAACP* 8  National  Education  Director ,>ponvened  a 
groups  of  experts  f  rcfn  the  Association  of  lilack  Psychologists ,  the 
College  Entrance  Examination  Board  and  the  Educational  Testing  Service 
and  the  NAACP  to  be^in  dialog*  around  this  important  issue«.    Dr.  . 
Sidney  Marland,  President  of  the  College  Board  and  Vice  President 
Dr.  Stephej}_J»  Wright  and  Dr.  Belvin  Williams,  Vice  President  of 
the  Educational  Testing  Service  were  active  participants  an^  helped  ■' 

us 'to^ identicfy  issues  and  conference  part^tcir>z\nt«,.        conyd:ned  a 

conference  which  produced  the  NAACP  Report  on  Minority  Testing  which 

is  appended  to  this  statement.  '\ 

I  cite  this  b&ckground  to  let  the  committee  know  the  priority 
the  NAACP  gave  to,  tl^e  impact  of  the  unregulated  use  of  standardized 
testing  on  blacks  and  other  minorities.  ^ 

The  present  legislation r  targeted  to  postsecondary'  education 
does  not  appear  to  take ^nto  account  the  use  of  standardized  tests. 

r 

in  the  elementary  and  secondary  schools.    We  have  spoken '  to -legislator's 
at' the  stite  level  and  with  formed  Congressman  Harrington  who  in  the 
95th  session  of  Congress  Introduced  H.  R.  6776,  a  'forerunner  of  the 
.current  legislation.     Although  the  Gibbohs  and  Weiss  bills  are  Tiot  as 
cOmpi^ehensive  a^  we.  woul^  like 'they  are  a  step  in  the  right  direction « 
It  is  th&  position'of  the  NAACP  that  truth  in  testing  legislation 
is  an  idea  whose  time  has  come.    NAACP  advocated  such. legislation,  in 
.1976  at  otlr  67th  Anniyil  National  Convention  when  a  resolution  was  ' 
adopted  calling  for  an  Office  of  Consumer \        irs  in  Testing  and 
$j;vdent  Evaluation:  ■   .  ^ 


..    .  .  . 

OFFICE  OF  CONSUMER  AFFAIRS  IN  TESTING 
5   AND  STUDENT  gVALUTION  

WHEREAS    blacXs  and  othenr  mirtorities  are  being  increasingly 
subjected  to  various  kinds  of  itandardized. tests  whichVddvetseXy  affeot 
their  opportunities  a^^  accomplishments  in  later  lif^  and^ 

WHEREAS,  there  has  been  systematic  exclusion  o£  minorities  at  all 
phases  of  test  development  to  utilization/  and  such  exclusion  presents 
a'major  concern  in  the  evaluation  t?f  minority  intellectual  development 
and  subsequent  achievement  in  life,  and 

WHEREAS.'   there  is  a  need  to  halt*  current  discifiminatory  testing 
practices, 

n6w,  THEREFORE,  BE  IT  ^RESOLVED ^  that  we  direct  our  branches  and 
State  .conferences  to  ur^e  their  respective  states  to  establish  a  task  ^ 
for<&  for  the  development  of  an  Office,  of  Consumer  Affairs  in  Testing 
and  Student  Eva lu|tlon,.  or  in  the  alternative  assign  this  responsibility 
to  an  existing  state  agency  capable  of  pursuing  the  objectives  herein- 
The  responsibilities  of  this  agency  would  include,  but  not  be  limited  to, 
the  following:         ■  ' 

^     (a)    Consumer  advocacy  regarding  the  use  and  misuse  of  teats  as. 
well  as  advisipg  parents  of  their  16gal  rights  in  thja  testing  of  their 
cbildren. 

(b)  Advocacy  for  the  adoption  of  a  ^Truth-in-Testing"  law. 

(c)  A  test  review  board  to  scrutinize  and  systematically  monitor 

^  test  utility,  development f  policies  and  pr^ctic|s  of.  all  agencies  employing 

assessment  procedures^  \  -'^  

/     (d)    The  development  of  informational,  advi^jry  centers  and  laymafi 
documents  .on  testing  for  pareJits  of  ,  school  childiren-  J  *  - 

(e)    The  development  of  comprehensive  State4;ide  Stahdards  ,on  Testing 
Wliich  reflect  the  interests  bf^minority  groups  om.the  festing  isfeue:  'U. 
BE  rr  FORIHER  RESCtVED,  that  we  se^  legislation  in  to  establish 

^a  Resiparth  an^a    Develo-jment"  Off  ice  whiqh  will  have  the  latit^e  ..to  study  , 


o|%ixiaa  quBsticna  of  tefttAep  wid  )?upU  fe(i:^ojcft)^^.4n  wrtjc?^  tx?  an  office 
functim  as  a  statistics  miU^  for  legislative  acxaountabiUiy. 

The  NAACP  is  fully  in  accord  with  the.  purpose  of  the  Act  ^s 
^dt  forth  in  H.  R,     4949,     We  believe  that  test  publishers  must /be. 
responsible  for  monitoring  the  use  of  their  tests  by  assuming  ^n 
advocacy  role  when  necessary.    In  our  Report  on  Minority  Testing* 
supplied  to  the  Committee^  we  state  that  in  instances  wher^^ tests 
are  used  (or  about  to' be  used) -without  due  observance  of  /his  advocacy 

role/  test  publishers  should  apply  sanctions,  including/the  denial 

<j       •  .  '  '  ' 

of  the  use  of 'their'  product  by  those  who  misuse  it. 

•  Moreover,  test  publishers  have  an  advocacy^ yesponsibility 

which  requires  that  test  objectives  be    clearly  stated,  that  the  process 

of  administering  the  test  be  fully  described  so/that  subjects  and  users 

both  understand  exactly  what  is  expected  to  /lappen  and  how  it  will 

happen,  in  non-threateninq ,  affirmative  terms.     Publishers  must  state  ^ 

with  clairity,  in  ^11  descriptive  information  concerning  a  test  they  • 

publish,  the  specific  uses  fox  which  the  test  is  designed,  the  specific 

limitations  of  the  instrument  and  full,  explanation  as  to  how  the  results 

should  be  interpreted.  ,  ^ 

g  3.    (a)    (l)i    It  is  our  understanding  that  there  is  Jittle 

systematic  information  gathered  on  the  relationship  between  test  scores 

and  future  sycce^s,  but  indications  are  that  tihis  is  a  low  correlation. 

The  definition  6f  future  occupational  success  is  ambiguous  as  many 

viariables  detertnlhe  thijs  whidh  chailetiges  the  emphasis  of  test  scores 

for  admission^ 

I  g  3  (4)   (C).    The  NAACP   endorses  test  preparation  courses  so 

long  as  organizations  and -persons  can  verify  th^ir  utility  .  Such 
brganizatioiis  shoulcl  also  be  regulated  for  their  claims  and  services; 
likewise  test  agencies  should  be  required  to  acknowledge  and  state  to 
Inquirers  where  coaching,  is  efjfective. 


,  1  ■ 


f  3  (5).    We  recognize  that  the  test,  agency  and  tests  are  not 
wholly  responsible  for  determinino  academi^  admissions*  or  future  peBffor- 
mance?  however,  the  test  userd  could  provide  test  agencies  and  pubtfic  Jthe 
estimated  weight  of  percentage  carried  by  tests  in  admissions  considdration. 
«.The  NAACP.  i^- aware  that  teie^  scores  are  being  supplemented,.' 
in  some  Instances,  by  other  criteria,  but  we  also  know  that  College 
Board  scores  are  stil^l  the  deciding  factor  reqardinq  who  .gets  ' 
admitted  to  what  institAitioh. 

May  I  take  a  few  minutes  to  share  .with  the  committjce  a  glaring 
example  of  how  much  weight  is  given'  to  standardized  test  scored 
in  a  Virginia  community  several  years  ago.     The  local  NAACP  branch 
in  Greenvillie  County  hAd  gathered  a  large  number  o£  report  cards  of- 
pupils  who  had  been  "partially  promoted"  as  a  result  of  a  "get  tough, 
-learn  or  .else  stay  behind"  policy.    A  number  of  the  students' report 
cards  showed  passing  gradqs  A's,  B's  and  C's,  yet  the  students  were 
"partially  fproraoted" ,     Investigation  on.  our  ppirt  elicited  information 
*  that  the  students  whose  cards  we  held  had  fared  poorly  on  the 
■  standardized  test  administered  by  th^  school  system.     In  a  conf rontatio:n 
with  school  officials,  school  officials  rejected  the  charge  that 
standardized  test  scores  were  .the  s.ole  criterion  for  the  action; 
however,  they  were  unable  to  explain  how  a  student  .who  recioved 
•passing  grades  as  evidenced  by  the  report  cards  could  be  "partially 
promoted"  if  you  disregarded  the  fact  that  they  had  scored  poqrly  . 
on  the  standardized  test.     The  test  scores  were  48ed  to  classify 
students  into  either  collecre  bound  courses  or  OPT  courses. 

..   The  widespread  use  of  testing  has  already  directed  minorities  into 

-A  '  \  ' 

opportunities  which  wiVl  not  allow  them  t(>  perform  wen  on  post- 
secondary  tests*.     The  distinguished  member  of  the  New  York  Board  of 
Regents,  Dr.  Kenneth  Clark, said  in  his  letter  to  the  editor  in  the 


Augustus »  W6W  York  ^^mesi^  .     *  '  /    *^       *  ' 

*  y  /'/     .  •     .      '         .  •  •  ■ 

"Admigaiorv  tee^tj^/ measure  the  abilities  devleoped  by 
!  individuals/ over  a  long  pei^iod  of  time»  both  in  and 
••  ,        ^  oi^f  .of  schQo):,     The  value  of  teat  results  is  direct-  « 

.  ly  r e  1  ated  tb  t ha /^quc^l i ty  9f' oppor t un Ity ; i^orded.         ,  #    . , 
to  th^>cimdj.dai:B8  t^^King'^ 'ptfrticular  test.  "'♦^ 

tt  testfa  used  in  yBletnientary  sehobX  already  begin,  to  put  oiir:  chil-  .  „ 
y  [        '     :      7      .  '  ■  .    • ' .   '  .■  :      .  .  '  . .  .  •  . 

^drep  in  .a  disadvantageous  position,  how*  bah . we  pq:^son'ably  expect  thet^  t^  s.' 


be"  competitivfe  on  post-3econdary  education  tests?  . 

^         Teachers^  co^6ndelors  arid  admi&a ions  officers  are  publics  iinpor^ant^:'^^ 

to        testing  ihdus try  since  they  flit:  at  the  entrance  gates  throiighiv,"  . 

f .  ■  "    •  '  '    r   .       ■• "     ;  *  u-  .  . 

which  !mimy  test  takers  must  go  if  they  are  to  realize  thelj:  goali^.    fhe:  ^ 

■  1 .1  .;•  •>  ■  .  ^  '      •  ■  "  ..  > 

extenii  to  wh^h  these  piiblics  can  correctly  iiiterpret  and  effectively-  : 
use  those  jy^trinionty^tB^  the  .extent  to  which  decisio'hs  will  4je*  mad6  that^ 
■  are  J^air.  to  minority-  test  takers.   .The  testing  industry  is'  called  ugon  ,  :  ' 

.to  help  bridge- that  gap  which  exists  bfetween  effective  uSe  and  lack  .ot/J?*.  ' 

ft      ■    "  *  .     .,  '  ^'  i^"' 

undeji^standing,  by  conducting  wprks^iopd.  arid  institutes,  and  writing  .  '  ' 

','    •      '         '    ■         ■    f  ,^  • 

•  special  publications  th^t  are-aiiAed  at  interpretatioh.  6¥  tests.', 

■  „  '  V"    ■■  .    ■  .   ■  ^  '  *  ■  ■ 

I  ^         i'       "        PROMOTING  A  BETl'ER.  UNDERS-^ANDll^G  Of  TESTS      '  ^ 

\Kel^ase;o£>.1;est  questions  and  answers  i tfi' an «  over-fitalie^ -concern.  There ^  , 

a^e^vpther  pro^ess'ionai^  j^ho  will  testify  tifiAt  it  Is  not  a^Viichnically^ 

serious  aSkTfany  tend  to  repre^en^.    it  my  'ijnc£^Ga&6  codt  somewhat  but>-we  ^ 

bc^lieve  the  benefit,  gi&ined  by- the  irtdividual/  frpjrt  Icaifning  *^  strengths  ■  :  ^ 

and  weakn^sfG^  4^}  knovJledg^/fajc  jc>uti^eigh»  ..the  wdn^tf^ry  %pj^ue,  '  rurtliet-  •  ,r  ^ 

|nore,'Sth^relWr^  "^ppr^  ;,jfbat^*im^  Vf  "the.ci'aiin^d  coui9  . 

•\)ir.  usin^^.  soit^»  of  thecal ]f  eady  " ^iz^ab(?e^p^o;f  j,t  mikt^in^^h^^fij^^^];;  \,  *  ,^ 

sJe\he  di'srloBure  of  .t^at;  q^egtldris;  iA  /th^^  - 

teaphers  oyer  the  di^ade^^''havi^,;'r.€rtiirne^"corjnBc£6d^  c^  ir., 

.'.    ■        ■  .'^  ^  o  \        -fv.  ■     y\    ^  '  ■  -'^   '       .  '  ' 

.and  term  papers- a^  a„mean8       ^ee^btii^' on^studerit^'i)^!;^^  '* 


be  of^sb^t; 
£TS.  We 
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• '    ■  ■  ^         ■  / 

we  tend  tio  compate  the  disclosuce  of  test  information  to  t|^  public  as 
similar  to  the  need  to  know  the  effects  of  drugs  on  the  human  body.  The 
life  determining  impact  a  test  Score  can  haj^e  on  the  future  of  an  indivi- 
dual, can  be;, just  as  consequential  as  taking  a  drug.    To  date  we  have  had 
no  regulation  ;Or  accountabil5«by  for  test  agencies. 6r  their  usogrs  Which  > 
j^" 'inl^ires  the.  consum.er  .i«  getting  a  fa'ir  break.  •  -> 

.   "  '     -JMrt  Chairman,  thfe  NAAQP  believes  fch^t  H.  R.  5564  should  call  for  a 
..   hi^h  degrpV^of  vaj^^dity;:^^^^^  It  i.?  o.ur*  undjerstahdlng  from 

;  •  psychometriciai*  th^tl'tjiSw;' is  mq^  conypvite^  a  e?peffl6ient 

».vpcf  ■r^liablULy       ^  ebef  «icient  of  validity  alia;  th^    ft  -Would  ' not  be  amies 
'  ■  -to-  fiave-  a  (fcimjariy-  mkKV^nbwo  Uih©  ■f^tmUla'  wea'  tb^,  sOch  purp6fe6  .sirvteje  ^^o^ie 
,  ^Iprrtulao  &an  ig^vtf  spujrious;  Ki'g'h*c»ef^^^  -       -     *  ■* 

"  "  ■  *  5*he ."^AACP  dqifes  'iibt  -^pposfi.  the  .  use'       tc>&  .plftr  ',s«fr»,-  -  .«e^have  called  on 


.:  ... 


^.^ajit s  -r ( 

called- "f6r  ijp  .hibratol^.m*      »  t^st^ing  vheJeyer  such  testa  have-. 

'not 'been  corrected  JoV'cuibur^^^^  b|sie''aftd^d3jr?cte^  its  br'atJches,  to -use  all  * 

adfniTiis^tltive^^^  renieaieB  to.prel^^ent  ttterv^olatl^^^^^^ 

onstitutional  rights  "tlvrpugh  "the.  ipisuse:' of  teStB;.  ^  ^. . 

.  Rpnal,d  BaWV<3*  .i"  Psyohologlcal  Testiiig"  of  Aitter^ican  ..MftiQrities  d^ea-^  . 

crimes -the  problem- we 'j£iei;cefve  thusly:    .  .  *  7  .      *  *  " 

.-The  system  6r  higher  Jraucation -is  inextricably  i^tffij^    :  ^      .  . 
.  woven  with  the  total  ftbric  of  American- fiociety.  Poverty,  "    r  . 
"  place 'bf  residence,  tU  history  of  racial  ^^.scrimination 

.  "  "    -  "  iJnd  SMregation,  the  social  stereotypes^.of  ratie,  the.^pre-     .  ^ 
"-Lv"^-"   -     domlnanCB  of  minoriVles  .within; the  lower  stratum- of  the       ^  ^ 

'    "       .:  society,  and  the  concomitant  ^.eniaX  of  educational  oBpor-. 
-  :  -    '        I'bimirtiM  -  ait  thcise  aonspire  to  create,  and  -to  perpetuatjr  | 
^-^^  :    -  ^:  *tho  «hrt  tn  entrench,  ethnic  cleavages  in  the  an^ae  . 

oTl 


aducation  and  standafdized  testing  plays  a  part  (inasfed  . 
■.quite^a  significantfone.),."  ' 
,     .  V."-  U.;  -  .I*;- 
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Mr.  Chairman  we  have  a  few  recOmmehdftlons  to  make  to  the.  Committee, 
If  we  may.    We  believ^  that  there  is  a  need  for  clarity  in  the  definition 
regarding  who  the  '*ffest  agency"  is  so  that  the  person  who  administers 
or  develops  tests  knows  the  rosponsibili ty ^mandated  under  this  bill, 

Sectlon'^4  (2)  (b)  is  probably  the  best  section  in  H.R,  4949 
for  it  comes  cl6ser  to  what  Is  needed  in  the  whole  area  of  testing}  We 
believe  there  is  a  need  for  a  nnand^te  for  the  Commissioner  to  gather  r^- 
vant  data  over  a  period  of  time  to  see  What  J^ind  of  things  are  going  on. 
The  data,*r  am  reliably  informed  is  available  in  the  computGrs,  but 

' .      ,  -  ^    '  •  i 

thiire  is  feeling  among  professionals  with  Whom,  i  have  conferred  that 
they  do  not  believe  the  "testing. companies  will  pre  lease  such  datsa  unlessIP 
there  is  a  Congressional  jitandate.     If.  the  Commissioner  has  information 
on  what  is  happening  through  the.  use  of  these  tests,  the  Commissioner 
would  then  be  in  a  position  to  report-  tx>  the  Congress  and  it  coulBVthen 
make  a  determination  if  further  action  is*  needed. 

We  believe  that  it  is  necessary. to  establish  a  monitoring  body 
for  the  collection  of  data  J^rom  each  testing  , agency.    We  believe  the 
bill, should  spell  out  the  type  of  data  to  be  cpllected. 

Under  "^gula^^i^is  and  Enforcement",  we  were  not  certaixi  whether 
the  bill  was  caTling  .for  a  civil  penalty  hot  to  exceed  $2000  for  each 
individual  violation   (one  person)  or  group  violation.     In  other  words, 
if  10,000  persons  are  tested  and  there  was  a  violation  would  the  pen^ty 
be  not  more  than  $2000. for  the  group  of  10,000  or  10,00^  *t;^fl>^  $2000. 
This  section  needs  clarification. 

•  We  bSrfeve  that  the  bill  dips  into  psyschological  jargon  which 
will,  in  turn,-  lend  itself  to  a  response  in  the 'same  vein.-    We  would 
suggest  that,  wherever  possible,  the  bill language  be  simple 
enough  for  a  layman,  like  mysqlf,  to  understand. 


d^^ 
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We  believe  there  needs  to' be  massive  data  coljlected  on  ..what 
'  has . happened  to  students  who  have  been  tiu^Ksd  do^n. because  of  their 
SAT  scores  or  ACT  scores.    As  a  former  polloge  teaeher^  I  know  o'f  a 

number. of  Instances  where  students^  wete  turnted  down  by  one  school 

'     r  '    '  .         ' '  '  ' 

because  of  scores  on  standardized  ^ests  and  were  admitted  to  another 
institution  and  performed  ^jjjpdi^^bly .        It  should  be  noted  that  ^ 
this  also  pertains  to  pre*-pr6f e^slonal  and  post-baccalaureate  such 
as  LSAT  and  GRE  tests.     Test  ^cores  do  not^  we  believe',  {>redict.  precisely 
coll6gB.or  job  success  and  t^^iey  have  a  low  relationship. of  whatT 
students  are  g'o'lng  to  do  academically  when  they  get  into  School. 

We  wuat  to  dlignose  </hat  the  students  n^ed  and  design  a  xerogram 
to  meet  those  needs,     I'he  intent  of  testing  should  be  to  Q^en  up 
avenues/^ for  students  1  Resting  should  be'  educational  and  not  simply 
evaluative  and  discriminatory  in  natui^e. 

'■■■.,■•■■•■/ 

■•         T  .  /ADDITIOyAI.  RECOMMENDATIONS  « 

V  .   ■         :  .  '.    .  .  '  ■  ■  '  • 

I.    The  Test  User  . 

(a)    Test  agencies  be  responsible  for  thi^training  of  test 
users.    iTfest  users  should^e  informed  of  the  validity 

■   ,  reliability  and  bias  df  t^ests.    They  phould  have  at* 

their  dlspdaal  reports  substantiating  these  factors  » 
as* well.  a«  any  other  Information  which  clarifies  the 

use  and  limitations  pf  tests. 

c?  _  '    .  »     ■  -  • 

\  '    ft>l^  Test  users  or  any  cj^fier  contracting    agency  must  demon-., 
strate      th&t  they  hav6  personnel  trained  in  the  use  and 
».      lYiterpretation  of  tests.  "     .  . 


Since,  misconceptions  of  testf^|^|on  lead  to  damAging  uses,  tho  testing 
Industry  Is  obligated  . to  make  fuij^^^plosure  of  the. purposes  for  wVich' 
tests  are  designed,  the  processes  l^Y  ^^^P^  -they  were  dosigne^df  the 
population ^on  which  *t hey  were  standardw!||L  the  statistical  charabteristica 
which  delimit  their  use,  e.g.'»  standar<3  or»r  of  measuromenti ,  sj^andhrd  » 
error  of  estlyiatei  and  othet  "do's  and  don^j^^vhich  wi'l^^  *af f o^i^^cij^ti^jMi 

use  and  interpretation.    More  specifically  It       *  ^^..^^^^.^ 

testing  industry  to  give  clear  and  precise  in^^r^'^^^ation  Vf  ^t)^  s.core 
their  tests  yield.     The  public  must  be  informed  i\pK^|nly  ^Ka^ 
test  scores  are  fallible  and  that  their  ):eliability^V>y.mperf ect\ 

must  be  told  the  extent  9'f  tha|^  fallability  and  imper^eolMon The 

.*    ■  .  ■         t      f  ^ 

public  must  be  informed  that  test  scores  are  only  a  samt^le^f  a  student  Vs 

.    .  ■       .   >>-^ 

performance  and  Are  never  more  .than  qn  estimate  of  truth/ 

CONSTRUCTIVE  USES  PF  TESTS  *  V  ^ 

• EPfective  uses  can  be* made  of  tests,  regardless  to  their  ^VP^^A- 
only,  if  the.  user  knows  what  the  test  contains,  what  |its  purposes  ^rej 
an<?  what  its  limitations,  are;    We  ;nove  ort^e  assumption  that  an 
educational- lays t'em,  and  partiouXarly  a  scjrool  within  the  systemi  im- 
plicitly guarantees/that  students  to  whom  achievement  examinations 
(tests)  are  administered  have  been,  taught  in  way-s  such  that  they  can 
reasonably  be  expected  to  harve  learned  the'  informatiotn  required  by  the 
examination.    Therefore^  we  call  on  the  testing  industry *to  assist  school 
systems  and  other  users  in  understandii>g  "feetter  the  conteiit-  and 
constraints  of  the  examinations^  and  in  helping  them  Qnder'stand  hoW  to 
make  optimal  use  of  the  results',    Moreover,  we  dall  upon  the  educational 
community  and  the  public  private  sector^  to  er>^re  that  tests  are  not 
used  or  relied  upon  where  such  guarantees  do  not  exibt. 


• (See  al%o  pages  22 Xand  29  (Minority  Report) 

II.    Conauwer  Agency 

see  Minority  Report. 

Mr.  Chairman' and  membeM  of  the  Committee,  the-^NAACP  strongly 
supports  the  bill  H.R.  4949  Wfecause  the  key  features  provides  for  things 
never' before  available.    True  Vgsts  can  be  determined;  real  predictive 
validity  can'be  appi^ched  on  a\job  or  school -re  la  tod  basis  and  more- 
iropor'tantr  the  inonbpoly* would  haV^  public  oversight. 

Wpendix^ 

•   ■    \  ; 

•  RESOLUTIONS' ON  TESTING  AOOPTPiD  BY 

NAACP  NATIONAL  CONVENTION  . 
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f  .    • .  •  * 
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TESTING  AND 
TESTING  AND 
TESTING      ■  .      ■  , 

■  TESTING  ^        '    '  ' 

THE  TESTING  IJ^DUSTRY, 

FEDERAL  REGULATORY  AGENCY  FOR  TE.STING 

NAACP  RJEPORT  ON  iilUORITY  TESTING  . 

OFFICE  OF  CONSUMER  AFFAIRS  IN  TESTING  AND  . 

STUDENT  EVALUATIOH   ■  .  . 

MONITORING  USE,  OF .  TESTS 

SPECIAL  EDUCA'nOl^     *  ' 

'COMPfeTENCY-BAfiED  TESTING.  /  MINIMUM  COMPETENCY- .TESTING 
NATIONAL  TESTING  MOVEMENT  *     "  ^ 


OFFICE  OF  CONSUHKR  AFFAIRS  IN  TESTING 
AND  STUDENT  EVALUATION    . ■ 


WllEKKASi  -b-l  n<cXs  and  oth<*r  ininoritios  <Ji  o  being  i  ncrc-.iHingly  «t 
subJ<?cL(.»d  to  various  kinds  of  stdndiii'd  j  i:i*d  i  f»sts  \>^ich  ridvnrnoly 
affect  thoir  opportvinities  and  Ticcoinplishments  .in  laler  life,  and* 

WilKKEAS  I  '  there  has  been  systematic  exclusion  of  minorities  at 
all  phases  of  test  development  to  uti  1  i zat  i  on,  and  such  r»xcl,u8ion* 
presents  a  major  concern  in  the 'ovaluat i oh  of  minor ^ty  int'ell-eo- 
t\ja  If  development  and  subsequent  achievement  in  life,  and 

MiEHEAS,   there  is  a  need  to  halt  current  discriminatory  test- 
ing practices, 

NOW,  THEREFORE,   BE  iT  RESOLVED,   that  \5e  direct  our  branches  and" 
state  conferences  to  urge  their  respedt ive -states  to  establish  a 
task  force  for  the  development  of  an  Office  pt  Conuumer  Affairs  in 
Testing  and  Student  Evaluation,  or  in  the  alternative  assign  this 
responsibility  to  an  existing  state  agency  capable  of  pur.suing  the 
objectives  herein.     The  responsibilities  of  this  agency  would  ^o* 
elude,  but  not  be  limited  to,,  the  following: 

(a)  Consumer  advocacy  regarding  the  use  and  misuse  of  tests  as 
well  as  advising  parerits  of  their  logal  rights  in  the  testing  of 
their  •chi*ldr&n .  ■    .      .  .  " 

(b)  Advocacy  for  the.  adoption  of  a  ■  "Truth-in-Testihg'*  law. 

(c)  ,A  test  review  board  to  scrutinize  and  systemat ideally  monitor 
test  utility^  development,  policies  and  practices  of  all  agencies 
employing  acsesshient  procedures. 

^  (d)  The  development  Of  informational  advisory  centers ■ and  layr  / 
•  man  docuinents  on  tesfing  for  pcft^rits  of  school  children. 

(e).     The  development  of  comprehensive  Statewide  Standards  On 
Testing,  whjjjh' reflect  the  interests  of  minority  groups  on  the  test- 
ing ISSUWnp^ 

.   DB  IT  FURTHER  RESOLVED,   that  we  Koek  legislation  in  each  state  / 
to  establish  a  Research  and'  Development  Office  which  will  hav.e  the 
latitude  to  study  empirical ^questions  of  teacher  and  pupil  .perfor- 
mance in  contrast  Jto  an  office  which  functions  ais  ^  statistics  mill  • 
for  legislative  accountability.  .  • 

.      ■         ■      ■■  '    %^    .■  .  '■ 

V    ■     .  '  •      .  ^  .     ADOPTED  1976 

-  BASIC  POLICY  STATEMENT. 

\'  RESOLUTIONS  ON  EDUCATION 

.       •  NATIONAL  ASSOCIATIQN  FOR 
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THE  TESTING  INDUSTRY 


WHEREAS,  cpmpanies  thiat  develop,  publish  and  sell  tests  should 
assume  (or  continue  ,  to  ejSaume)  major  responsibility  ':f or  assuring 
the  correction  or  ^ief  iciencies  In  th^ir  ihatruments,  and  \ 

■  • 

WHEREASi.the  testing. industry  makes  moA«y  from  the  administra-v 
tion  of  tests^and  has  the  responsibility  of  devising  satisfactory 
and  systematic  ways  of  taking  into  aqcoiint  probable  main  effect-, 
variables  in.  the  instructional  setting.  , 

THEREFORE,  BE  IT  RESOLVED,  that  we  call  upon  the  testing  ir^-r' 
dustry,  including  the  Educational  'iosting  SoWice,  American  CoX^qe 
Testing  l>rogram  (ACT)  ,  iPsychoiogical  Corp.,  »arcourt,  Brac^^nd 
Jovanovich,  Science  Research  Associates,  College  Entr^ce  Exam- 
ination Board,.  C.TB-McGra|/  Hill  to  state  with  c3arity<pn  all  des- 
criptive information  concerning  a  test,  the  specific  uses  for  which 
the  test  is  designed;  the  specific  limitations^  the  instrument',  . 
and  iniforma tion  as  to  how  the  results  3hQu\6A>e  interpreted  in 
acceptable  prpfessibnal  practice; 

BE  IT  FURTHER  RESOLVED,  that  we  ur>^'  the  testing  industry,  ,  at 
a  minifnum  to  include  within  the  inforiffatioTi  it  publishes  concerning 
standardized  tests  of  ability/  achi^ement,  per8onal^ity  and  any  other 
>asaessment  procedui*es,  specific  d^a-rega;?<3ing  predictive  content 


and  prescriptive  validity^ 


BE  IT  FURTHER  RESOtVED, 

ir  ^ 


/theft  we/call  upon,  the  testing  industry 
to  establish  and'fund'an  indepfepdent  research  and  development  corp- 
oration charged  with' the /osjforislfeaiity  to  (1)  identify  the  critical 
problems  in.  asseesnfent  «4  irh^fi^  relate  to  minority  groups,   (2)  to 
sponsor  research  to  in/estl^atjtf  those  problems  requiring  study,. (3) 
to  sponsor  appropriate  ^eye5,<>pment  work  #ind  to  involve  researchers 
wJ\o  have'  the  endora^ont/of/minority  professional  land  community 
associationSAand  ti6  afe^^^^      ^  minimum  df  4/percpnt  of  net  income 
to  support  'ffiese/ofyi^tij/es: 


rter)t 


'REdbLVBD,  that^e  urqe  the  testing  industry  to 
^ipnal  black  organizations  to  initiate,  dialogue^ 
ation  of  recommendjitipris  and  issues  raised ^in 


>BE 

through 
problen 


^il^ALLY.  RESOLVED,   th<\t  we  call  ui5on  the  National  Office, 
^Education  Dbpartment,'- to  assist  local  units  Ih  resolving 
Ising  from  the, misuse  of  tests  in  their  locality* 

'     '  t 

'  ,        r       ADOPTED  1976  ' 

'      BAS;[C  POLICY  STATEMENT 
RESOLUTIONS  OK  EDUCATION 
NATIONAL  ASSOCIATION  FOR, . 
THE  ADVANCEMENT  OF  COLORED 
■-^  .  PeOPLlB 


ft  '     ■  .  • 

FEDERAL  REGULATORY  AGENCY  FOR  TESTING 


WHER^S#  the  Congress  through  recent  Federal  legislation  is 
^.placing  increasing  emphasis  on  program  evaluation  with  the  recent 
amendment  of  Title  I  of  the  Elementary  and  Secondary  Education  Act 
(as  amended 'by  PL  93-380)  charging  the  Coinmi^ioner- of  Education 
with  the  responsibility  of  developing  and  publishing  "Standards 
and  Mddels  for  Program  Evaluation/'  including  the  use  of  specific 
techniques  and  methodologies  for  such  evaluations,  and 

Whereas,  the  office  of  Education,  in  Carrying  out  this  Cong- 
ressional mandate,  is  publishing  a  Series  of  Monographs  on  Evalua- 
tion in  Education  covering  v'arious  issues  regarding  testing  a^nd 
evaluation^-  and 

WHEREAS,  the  testing  industry  is  a  multi^-million  dollar  ihdustry, 
receiving  millions,  of  Federal  dollars,  and  ^ 

*'      '  '■         ■  ■  t 

WHEREAS,  Title  IV  of  the  Elementary  and  Secondary  iEducat ion  Act. 
(E&EA)  as  amended'^  gives  the  state  increased  responsibility  ""In  VU& 
area  of  program  evaluation  (including  p^rogram  evaluation)  and  staties 
are  currently  selecting. hdyisory  councils  and  developing  methods  of 
evaluation,  and  ■     ^'         ■  • 

WHEREAS,  the  Edycatioh  of.  the  Handicapped  Act  of  1*975,  recogni- 
zed- the  importance  of  protecting  children  from  misdiagnosis  by  in- 
jSisting^on  tfie.  developmeht.  and  Use  of  J'culture  fair  tesj^s"  and  the 
bill.  (PL  94-142)   includes  a  short  statement  of  the  importance  6f  , 
gathering  data  from  various  sources  r^thpr  than  a  Single  test,  when 
,  diagnosing  a' handicapped  condition,  and  ^  . 

WHEREAS >  the  Developmentftlly  DisabXjBd  Assistance  and  Bill  of 
Rights  (PL  94-103)  calls  for  the  establishnient;  of  a  comprehensive 
system  for  evaluating  the  progress  of  individuals  with  develop- 
mental disabilities, 

.1  i.    .'  ■ 

NOW^  THEREFORE,  ' BE  IT  RESOLVED,  that  we  call  upon  the  Congress 
to  establish  a  Federal  Regulatory  Agency  for  the  testing  industry 
similai:  .to  the  Federal  Communications  Commission,  the  Food  and  Drug 
Administration  and  the  Environmental  Protection  Agency  for  the  pro- 
tection of  the  citizen    consumer  of  tests  and .evaluative  and  assessr 
ment  procedures •  ' 

.    ADOPTED  1976  .  *  . 

*      •  BASIC  POLICY  STATEMENT 

^  .      .       *       .  .       RESOLUTIONS  ON  EDUCATION 

NATIONAL  ASSOCIATION  FOR 
THE  ADVANCEMENT  OF  COLORED  * 
PEOPLE 


MONITORING  USE  OF  TESTS 


WHEREAS,  standrfrdized  testing  is  inpreasingly  used  to  classify  . 
stratify  and  certify  individuals  and  groups^in  Out  society,  and 

.   .     WHEREAS^,  the  determination  of  public  policy  related  to  the  test^ 
ing  of  minorities  has  been  insidious  and  extffemely  deleterious,  and 

wyEREAS,  there  is  a  need  for  more'  fair  and  effective  processes  • 
of  asaeessment  which  more  adequately  consider  the  diverse  abilities, 
talents  and  cultural,  backgrounds  of  children  if  standardized  Jiests 
are  to  be  used,  and      ■  ».  ■  / 

WHEREAS,  test  .scores  influence  the  way  children  think  about  them- 
selves; and  teacher,  expectations  of  the  children,,  and 

.  WHEREAS,  there  is  increasing  evidence  that  tests,  as  used,  are 
determining  what  is  being  taught,  rather  fhan  measuring .what  is  being 
learnedT" 

BE  IT  RESOLVED,  that  MAACP  units'  mount' a  campaign  against  misuse 
of  tests  bir urging  parents  to  question  not  only  their  own  child  s 
test  scores  but  al^o  A:he^ testing  programs  injtheir  school,  city  and 
school  district, 

BE  IT  FURTHER  RESOLVED,  that  the  NAACP  units,  through  their 
education  committees,  make  inquiries  of  testing^licies  and  pi'*;^- 
tices  in  theit  School  districts,  regarding; 

1)  What  standardized  IQ  and  achievement  tests  are  given  in  the 
school  districty^at  what  ages? 

2)  .How,  and  by  whom.,  are  the  tests  selected?    Can  the  tests  be 
I  seen  and  reviewed?     By  whom  and^under  what  conditions? 

3)  What  learning,  goals   do  achievement  tests  serve?^   What  is  the 
impact  of  the  various  testis  used  on  what  is  taught  In  the  curriculum, 
on  books  and  other  materials  pilrch*ased? 

4)  What  decisions  are  made  oTT  tTe  basis  of  test  scoir^s  (e.g, , 
placement  in  "tracks,-  special  educatibn,  recommendation  td  college) 7 

5)  Are  tests  used  in  the.  local' school  district  free  o.^^^'^hnic. 
racial  and  class.  J^i as?    Are  they  fair  or  unfair  to  children  of  dif- 
ferent backgrounds?      \     \  -■ —  . 

BE  IT  FURTHER  RESOLVED,  that  We  direct  Our  branches  to  request 
, copies  of  all  tests  currently  used  by  the  local  school . district  as  a 
basis  for  educational  decisions  regarding  pujpil  placement,  assign-^ 
ment,  promotion  or  academic,  programming* 
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BE  IT  FINALLY  RESOLVED,; that  the  results  of  Such  survey  and 
copies  of  tests  secured  be  forwarded  to  the  ^duc^tion  Department  * 
of  t.he  National  Office  for  follow-up,  including  the  Education- 
Degartment^s  calling  upon . the  Department  of  HEW  to  cohduat  syste- 
matip* analyses  of  t^je  federally-funded  testing  and  assdaamont  pro- 
grams or-  instruments  used /in  public  achcpls  across  the  country^ 

*  .  • 

ADOPTED  1976  . 

■  .   •  .  ^  .  BASIC  POLICY  STATEMENT. 

;  RESOLUTIONS  ON  EDUCATION 

•  :  ...       »  NATIONAL  ASS0CIA!'I0N  FOR 

THE  ADVANCEMENT  OF  COLORED 
*    .         \.  PEOPLE 

^  TESTING  AND  TRACK  SYSTEMS 


The  practice. of  placing'childron  in  "ability  groupings" 
based  upon,  culturally  biased  tests    ^iaB  been  discredited  by 
leading  e»ducationa,l  authorities.     As  a  result  of  thosp  t1>st- 
ing  procedures,  many  Negro  students* are  placed  at  an  initial, 
disadvantage  and  are  relegeited  to  slpw  learning  tracks,  from 
which  they  rarely  escape. 

The  discrimination  aspects  of  the  race  and  class  concepts 
underlying  the  tracking  system  were  starkly  set  forth,  by  Jiidge 
J.  Skelly  Wright  in  the  Hobson  V.  Hansen  decision  in  which  the 
trackirtg  system  in  Washijigtpn^  P.  C,  was  declared  unconstitu- 
tional. ■       _  " 

We  call  on  NAACP  branches  to* vigorously  oppose  homogeneous 
groupings  or  tracking  systems  wherever  th6y  discriminate  in  this 
manner. 


ADOPTED  1968 
3AsiC  POLICY  STATEMENT 
RESOLUTIONS  ON  EDUCATION 
NOTIONAL  ASSOCIATION  FOR 
THE  ADVANCEMENT  OF  COLORED 
PEOPLE  .  . 


TESTING  AND  TRACK  SYSTEMS 


The  concept  Of  placing  children  py  means  of  "ability  group- 
ing** based  upon  the  results  of  tests  administered  in  the  early 
gradeauhas  been  discredited  by  educational  expert^  and  authorities 
Virtually  all  tests  used  are  culWrally  biased  and  Unsuitable 
for  actually  determining  the  ability  to  learrx.     AS  a  result  of* 
these  testing  prosedures,  Tnany  Negr'o  students  are  placed  at  an  •  . 
Initial  disadvantage  and  are  relegated  to  slow-learning  tracks 
firom  which  they  i^rely  escape.    As  a  result,  phe  overwhelming 
proppr^on  of  Ne^o  students  are  thereby  exposed  to  a  siSbtle,  but 
Bystemalic,.  form  ^f  discrimination  within  the  school  and  class 
which  does  not  prepare  them  for  other  thlin  menial  Jobs.  More- 
oJfer,  this  use  of  these  devices  tends  to  stigmatise  the  Negro 
student  as  intellectually  infe^riorl-.  » 


ADOPTED  1967  / 
BASIC  POLICY  STATEMENT 
RESOLUTIONS  ON  EDUCATION 
NATIONAL  aIsOCIATION  FOR 
THE  ADVANCEMENT  OF  COLORED 
"PEOPLE 
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•NAACP  REPORT  0|J  MINORITY  TESTING 


.WHEREASi  the  NAACP  expressed  its  concern  re  this  dispropor- 
tiortately  large  number  of  black  students  being  misplaced  in  special* 
Education. classes  as  a  result  of  scores  on  standar<3ized  tests,  and 

WHEREAS,  the  1974  co#ivention  majidat^.d  the  Education  Depart- 
ni#nt  at  the  National  Office  to  use  its  influence  to  bring  together 
the  Educational  Testing  Service,  the  College  Entrance  Examination. 
Board,  and  the  Association  of  Black  Psychologists  regarding  this 
issue,  and 

VJHEREAS,  the  Education  Department  has  published  the  NAACP  REPORT  . 
ON  MINORITY  TESTINg,.  setting  forth  recoipmendations  and  an  action 
agenda;  „  ' 

NOW,  TMEREFORJ;,  BE-  TT^RESbLVED,  that  We  direct  our  units,  youth 
and  adult,  to  'implement  the  lyecommendatipns  of  the  Repc4-t , 

BE  IT  FURTHER  RESOLVED/  that  the  NAACP  Education  Department 
establish  a  national^ask  fArce  to  develop  specific  guidelines  for 
laymen's  participation  In  and  support  of  standardized  assessment 
procedures  and  dissentinnte/ the  guidelines  to  the  broadest  possible 
audience*.  ' 

BE  IT. ALSO  RESOLVED,  |that  we  direct  our  units     to  establish 
contact  with  local  chapters  of  the  Association  of  Black  Psycholo- 
gists for  technical  assistance  in. implementing  this* resolution.- 


ADOPTED  1976 
BASIC  POLICY  STATEMENT 
RESOLUTIONS  ON  EDUCATION 
NATIONAL  ASSOCIATION  FOR 
THE  ADVANCEMENT  OF  COLORED 
PEOPLE  . 
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rTESTING 


WHEREAS/the  National  Black  Psychologists  have  called  fo;:  a 
moratorium  oh  stdhdardized  testi-ng;  and,  ' 

■..  .       '  Y- 

WHEI^EAS,  the  1972  National  Education  Association  conferees 
recommended  that  IQ  scM^ee       removed  from  pupil/^tudertt  cumu-    ,  , 
lative  re/ord  folders;*  that  "the  National  Teacher^. tjftimination 
be  abolished;  that  NEA  provide  legal  aid  to  persoi>8  Sufng  against 
misuse  of  tests;  and.  that  colleges  and  universities  eliminate  the  • 
use  of  the  Graduate  Record  Examination  and  Millers  Analogy;  and,* 

•  WHEREAS,  there  is  evidence  to  suggest  that  intelligence' tests 
do  nc^t  represent  %  true  measure  of  the  scholastic  epcperience  or 
ability  of  the  ehild,.  be  it  hereby  t  . 

RESOLVED,  that  all  units  of  the  Kaacp  call  upon  their  school  •  < 
administrators  to  be  alert  to  the  forthcoming  recommendations  of 
.1>flfe.  National  Black  Psychologists  Association  and  be  prepared  tip  de- 
clare a  moratorium  on  standiirdized  -testing^ af tor  other  suitable  and^ 
non-biased  criteria  for  measuring'  pupil  progress  and  teaching- 
accountability  has  been  devis^sd. 


ADOPTED  1972 

BASIC  POLIOY  STATEMENT  ^ 
RESOLUTIONS  ON  EDUCATION 
tJATlONAL  ASSOiCIATION  FOR 
THE  ADVANCEMENT  OF  COLORED 
PEOPLE  , 


*  *  TfiSTING  '  '    ;  '  " 

♦  WHEREAS*  a  disproportiqnately  large  number  of  black 

students* ate  being  misplaced  in  special  education  classes  and 
denied  admissions        higheif  educational  opportunities.  «  4i> 

WH^R^AS,  standardized  tests*  e.g.  ,  Stanfoad-Binet  and  the 
Wechsler  Scale  tor  Childre)i  exclude  blacks,.  Puerto  Rioans  and 
Mexican  Americans  from. the  representative  sample,  and, 

WHEREAS,  such  tests  label  black  children>as  uneducable,' 
assi^  them-  to  lower  educational  tracks  than' whites;  deny  black 
chij^dren  higher  education  opportunities;  perpetuate  inferior 
Education;  place  black  chiLldren  in  special  classed  and  destroy 
growth  and  development  of  black  children,  and,. 

WHEREAS,  students  Who  fail  to  show  a  high  verbal  or  numerical 
ability,  score  low  on  the  Scholastic  Achievement .Test  (SAT),  the 
Law  Scliool  Admissions  Tests  (LSAT)  ,  the  Graduate  Record  Examination 
(GRE) #  etc. «  and  are  routinely  excluded  from  College  and  graduate 
or  professional  education,      .  . 

,BE  IT  RESOLVED,  that  the  NAACP  Qemand  a  moratorium  qn  standard- 
ized testing  vgiherever  suoh  tests-  have  not  been  corrected*  for  cultural 
bias  and. direct  its  units  to  use  all  administrative  and  legal  reme- 
dies to  prevent  the  violation  of  'students'  constitutional  ri9hts 
through  the,  misuse ^of  tests,  and  ' 

BE  IT* FURTHER  RESOLVPD,  that^  the  NAACP  call  upon  the  Associa- 
tion Of  Black  PsycKol6gist8  to  assert . leadership  in  aiding  the 
-College  Entrai^oe  Examination  ■  Board  to  develop  standardised  tests  • 
wh^ch  have  be6n  cojrrected  for  cultural  bias  and  which  flirly 
m^sure  the  amount  of  *  knowledge  retained  by  students  regardless 
of- his  or-»her  .  individual  background.'  .  . 

BE  .IT  FINALLY  RESOLVED,  that  th«  NAACP  direct  its  units  to  Mae* 
all  iadministrative  remedies  in  the  event  ^f  violation  ,of  >ztud&nts 
constitutional  rights  through  the  misuse  of  tests  and  directs  \ 
I)a^onal  Office  staff  to  use  its  influence  to  bring  the  CEEBi  and 
ABP  together,  to  revise  such  tests.. 


/  >  ADOPfED  1974, 

BASIC  PPLIOY  STATEMENT  '  * 
RESOLUTIONS  ON  EDUCATION 
.    NATIONAL  ASSOCIATION  FOR 
THE  ADVANCEMeJnT  OF  COLORED 
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FOREWOfiD 

Some  people  teem  to  think  that  '^Intelligence  tests^^  measure  IntelUgenoe*  I've  got 
news  for  t)iein,  '^Intelligence  teata^'  do  not  measure  intelligence:  they  meai^ure  one 'a  ability 
to  react  to  Intelligence  teats* 

I  know  a  Aian  who  waa  tested  to  determine  hi  a  dexterity  and  qulcknesa  In  seeing 
relationahlpa  between  sbapea  and  forms—a  very  Important  part  of  Intefilgence.  On  thot 
taat,  Jie  came  out  a  littje  lower  than  a  low-grade  moron*  Tben'be  tooTa.aecond  teat,  to  ^  . 
meaaure  another  Important  component  of  intelligence,  accuracy  of  memory  and  qulckneas  of 
recall;  Thla.tlme,  be  came  out  a  little  higher  than  a  iilgh-grade  genius*  Waa  he  a  moron 
or  ^1  genius  ? 

I  once  watched  two  persons  taking  the  same  test  for  accuracy  of  memory  and  quick- 
ness  of  recall*  Tbey  showed  startling  differences;  one  rank^  very  high,  the  other  quite 
low*  The  reason  was  nptbaxd  to  find:  they  came  from  opposite  sldes'of  the  tracks*  The 
test  Items  were  things  which  bad  been  part  of  the  Intimate  dally  life  of  one,  while  the  other 
had  never  seeh  and  seldom  beard  of  the  Items  mentlonedMn  the  test* 

'  *  Another  case  in  point,  directly  relevant  to  the  question. of  alleged  'Vadal"  difference 
In  Intelligence,  waa  the.  adnnnlstraUon  of  a  test  to  children  th  Central  Harlem  a  few  aurnmers 
ago*  The  children  were  told  to  indicate  whether  a  lark  waa  a  dog,  an  automobile,  a  blttdj  or 
a  kind  of  cheese ^"Cinlse  one*")  None  of  the^  answered  the  queatlon*'  Mindful  of  the^^LAI^K 
plaatered  throu^olt  the  neighborhood  on  glant-alzed  blUboaPHa,  they  later  (Bxplalned  their 
failute  on  the  teat  (Juestlon  by  proteatlng";  "It  didn't  aay  'cigarette' f" 

If  the  matter  atppped  there.  It  would  be*aerloua  enough;  but  It. does  not  atop  there* 
Not  only  are  individual  chlldr^  teated  In  order,  to  be  debated,  standardized  teata  of  In- 
telligence are  being  uaed  throughout  the  nation,  in  waya  which  permanently  Affect  the  self- 
image  of  the  teated,  thereby  profoundly  altering  their  own  ex|ibctatlona*f  a  to  their  probable 
fjiitmre8--and  equally  affecting  the  expectatlona  of  their  teachera*  Whole  achoola,  entire 
school  syatems,  states  and  reglonSi  are  compared  to  each  other  on  the  baals  of  uniform 
standardised  teste*  Radla)  and  ethnic  groupa  are  sUgmatized.  'i;he  alleged  dlfferencee  thua 
"eq^ientlifically^'  validated  become  aeif-fulfllUng  prophociea*  . 

But  that'a  not  all*  The  general  mind-'aet  of  the  nation  welcomea  theae  reaults, 
because,  by  training  and  experience,  moiit  people  have  a  need  to  have  somebody  else  they 
can  feel  ''better  than;"  We  are  a  highly  competia<re  collection  of  peoples;  living  In  a  nation 
where  competitive  aporte  outdraw'^all  other  tefS^aion  audiencea*  The  dealre  to  win  la 
pandemic**  From  ei^lleat  childhood,  we  are  praised  for  wlnnlng--sometImes  consoled  ahd 
often  ri»primanded  for  loalng*  The  almpat  paychotic  fervor  of  a  Little  Lcaguer'a  parenta 
doinlnatea  our  culture*  And  since  the  schools  are  part  of  that  culture,  each  Indtvldual  ia  . 
encouraged  to  out«do  his  peers*.  Graded  on  a  bell  curve,  tested  and  compared  to  averpges 
and  norma,  aohild  Is  rewairded  or  puniahed  by/^e  educational  ayatem  on  the  baals  of  his 
suoceaa  in  outdistancing  6thera» 


590 


'584 

'    ■'  ' 
'.  .  ■   <       .  ^ 

"So  what^fi  wrong  with  thati"  the  true-bell^vln^f  American  demands.  Much  Is  wrong 
with  H.  Of  course  there  IB  nothing  wrong— indeed  much  Is  right— In  stressing  "excellence." 
But  we  don't  stress  "excellence;"  we  stress  "excelling,"  To  be  excellent  Is  to  shine:  to 
excel  is  to  out~shlne.  In  our  national  effort  to  be  Number  One,  we  miss  the  goal  of  excel- 
lency! We  settle  for  Its  cheap  and  deceitful  substitute^  excelling.  , 

that  Is  why  a  Parent-Teacher  Association  tha  other  night  complained  bitterly  to  a 
bewildered  principal  that  in  every  grade  half  of  the  children  were  below  the  median  of  their 
grade.   Unfortunately,  the  general  understanding  of  the  meaning  of  standardized  tests/is 
atjout  on  the  level  of  that  PTA . 

The  necessity,  compulsion!  drive  to  excel  others  vitiates  the  more  admirable  prin- 
ciple of  becoming  excellent.  And  because  the  general  public  has  much  at  stake  In  this  matter 
of  serving  the  purposes  of  a  put-down  society,  th^  materials  In  this  lUtfe  Report  are  Impor- 
tant. One  doubts  that,  as  a  nation,  we  will  quickly  put  aside  our  boastful  competitive  ad- 
versary urge  to  excel;  but  we  ought,  at  the  very  least,  to  observe  the  elementary  dictates 
of  good  sportsmanship  and  fair  play.  We  ought  no  longer  to  use  standapdlRod  tests  to' 
announce  to. the  world  that  some  children  are  "better"  than  others— particularly  when 
elements  of  unfairness  are  built  Into  the  testing  programs.  (Remember  the  "lark"  question 
for  city  children.)  But  even  If  the  tests  could  be  made  "culture -free,"  their  «se  would  sUH 
be  questionable  because  they  are  used  to  predict  a  chlld't  future,  condemning  some  to  be 
^'slpw  learners" — (or  life.  .  • 

This  nation  ought  no  longer  tojJermlt  pseudo-scientists  to  tell  us  diat  some  racial 
groups  are  Inferior  to  others.  We  ought  not  to  stand  quietly  by,  permitting  the  results,  of 
nation-wide  testing  to  be  used  to  destroy  the  self-image  of  some  whlle<falsely  inflatintfrthe 
self-image  of  others. 

The  men  arid  women  who  have  Invested  their *profeselonal  careers  li)  the  testing  in- 
dustry are  not  knaves  or  fools;  but  neither  are  they  sainte,   \fre  should  not  despair  of  them, 
Ukeuall  the  rest  of  us,  they  should  be  presumed  to  have  the  abill^ty  to  l«arh.  ^Among  other 
things^  this  means  that  we  must  presume  that;  given  siifhcient  stimulus,- they  will  put  off 
their  oil  ways  and  begin  to  direct  their  industry  toward  the  produ6(ipn  6f  a  new  and  accept- 
able product;  a  testing  system  designed  not  to  measure  degrees  bf  excelling  In  a  competitive 
*rat  race  but  to  promote  self -understanding  in  all,  as  each  becomes  mor^  excellent:  We 
have  no  business  permitting  achools  to  be  run  as  though  life  were  a  rat  raCe.  We  should  be 
interested  in  but  one  raoOi  the  humarf  race, 

V  With  something  of  this  purpose  in  mind,  the  Conference  on  Testing  was  convened. 
The  membership  of  .the  conference,  was  representative  of  many  points  of  view.  Noticeably 
lacking,  hoWever,  wm  repi^esentatlon  from  the  elitist  esUblishment  whose  antl-domooratic 
bias  make»  (hem  perfect  practitioners  of  the  art  of  the  put-down*  Another  unfortunate 
hiatus  in  the  conference  membership  was  occasioned  by  the  absence  of  representatives  from 
the  two  largest,cu8tomer$  of  the  testing  .industry,  the  Federal^  and  SUte  Educational 


585 


EfltabliahmentSt  Never  mind.  These  others  have  been  having  their  say  and  they  do  not  ifLck 
^orum.  It  is  our  belief  thatlhe  time  has  con^j^or  another  Voice  to  be  hear(;l,  a  voice 
which  speaks  without  equivocation  iii  behalf  of  equity  and  decency  and  fair^play  and  mutual 
respect:  a  voice  which  will  not  cease  as  long  as  inequity,  indecency,  unfairness  and  mutual 
'  contempt  are  thrust  upon  the  liVes  of  our  children  by  elders  who  should  knc^  better.         ^ ' 

May  I  thank  the  participants  in  the  Conferend^,  even  as  I  apologize  for  what  I  have 
done  to  th^ir  carefully  crafted  reports  from  the  four  Task  Forces,  In  editing,  I  have  en-  . 

.ft  4  ' 

deavored  to  retain  Ab  much  as  I  could  of  the  technical  professional  language  which  is 
natural  to  them  as  t^ey  communicate  with  each  other;  but  I  have  al8o\)een  mindful  of  the 
n^eds  of  the  general  reader.  I  mfty  have  sacrificed  something  of  technical  accuracy  in 
order  to  achieve  lucidity.  If  experts  in  the  field  of  testing  find  the  laimtfge  sometimes  less 
than  completely  professional,  they  iDuSt  put  the  blame  not  on  a  supposed  incompetence  of 
the  Confer*ence  participants  but  upon  the  tender  concerns  of  tm  editor  who  wai^ted  common 
people  like  himself  to  understand  what  was  being  said. 

^    V.  •  BUELL  G.  GALLAGHER  ^ 

■  Vice  Chairman,  Emeritus, 
National  Board  of  Directors,  , 
National  Association  for  the  .'      /' , 
\  Advancement  of  Colored  People 


^^ay  17,  1976 
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parI^icipaMts  m  naacp  invitational  conference  on 

.•       ^  "^^         MINORITY  TESTING  ^  ^ 

Dr*  WllUamiF*  Brazzlel,  Professor  of  Higher  Eduoation,  University  of  Connecticut 

Mr*  Silas  cAaft,  N>UCP  National  Board  of  Directors 

■^^^Dr.  Anderson  J'.  Franklin,  Asdoolate  Professor,  The  City  College  of  the  City 
University  of  New  Yopk  aiid  the  Rockefeller  University  ./  , 

Dr.  Wllliaiffl  Hayes,  Chalt*inan,  Assoolatlon  of  3lack  Psybhologlsts 

^Dr.  Asa  Hilliard,;  Dean>  School. of  Education,  Sun  Francisco  State  University  '  . 

^    Dr.  George  D.  Jackson,  1>rofQssor  School  of  Social  Work,  Howard  University 

■^^Dr.  Walter  J;  Leonard itlAsslstant  to  the  President,.  Harvard  University 

Mrs.  Thelznai  C.  Lennon,  Director,  Division  of  Pupil  Personnel  Services,  Department 
of  Public  Instruction,  State  of  North  Carolina 

Dr.  Arthur  L.  Mathls,  Director,  Research  and  Ev  iluatlon.  Community  Mental  Health  Center, 
Mebnrry  Medical  College  .  ' 

Dr*  Ann  Borders- Fatter  sob.  University  of  North  Carolina  at  Chapel  Hill 

Mr.  Silas  Pumell,  Ada  S.  McKlnley  Community  Center,  Chicago 

'^'^'^Dr.  S.  O.  Rotierts,  Chairman,  Department,  of  Psychology,  risk  University 

>»«**0|.,  Melvln  P.  Slkes,  Professor  of  Educational  Psychologyi  University  of  Texas  at  Austin 

Dr*  Madelon  D.  Stent,  Professor  of  ^Iducatlon,  The  City  College  of  the  City  University 
of  New  York  .  .  ♦ 

1  faESOURCES  CONSULTANTS 

Mr.  Lawrence  Barclay,  Minority  Affairs  Officer,  College  Entrance  Examination  Board 

^    .  Dr.  Edmund  Gordon,  Director,  Institute  for  Urban  and  Minority  Education,  Educational 
Testing  Service 

George  H*  Hanford,  .Senior  Vice  President,  College  Entrance  Examination  Board 
MlohaerMeyers,  Assistant  Director,  NAACP 

Dr.  E.  .Belvin  Williams,  Vice  President,  College  Board  Programs,  Educational  Testing 
Service  .  .    •  . 

Julius  E.  Williams,  Director,  Armed  Services  &  Veterans  I^ffnirs,  NAACP 

♦♦♦♦♦Althea  T.  L.  Simmons,  Plrector  for  Educatiop  Programs,  NAACP  r 

Dr*  Stephen  J.  Wright,  Vice  Pre^ldent^CoIIegQ  Entrance  Exam^fiation  Board 

BipCORDERS  .  .'^ 

Ms.  Ana  Aponte,  Secretary!  NAACP 

.J^e^jamln  J.  Colbert, ^As^stant  Program  Dlrebtor,  Educational  Testing  Service 
William  U.  Harrls,/Areapii*eoior,  Admissions  (^ndQujdance,  Educational  Testing  Service 
Ms.  Yvonne  Lada.on,  Assistant  to  the  Director  for  Housltig  Programs, , NAACP 
Ms.  Esther  Spann,  Secretary,  NAACP  ...  V 


.     .^Chairman,-  Taslc  Foroi^  on  Use  and  Misuse  oif  Tests 
♦♦Chairman,  Task  Fojfoe  on  Code  on  Testing 
♦♦♦Chairman I  Task  Force  on  Psyohometrlo  Integrity  of  Tests 
♦♦♦CQ^Chalrman,  Task  Force  Qn  Psychometric  Integrity  of.  Tests 
♦♦♦♦Chalrmi^,  Task. Forcii  01)  Social  Policy  « 
♦♦♦♦♦llJpnference  Convener '  ^  ;  •  .  % 


DISCLAIMER  BY  THE  COLLEGE  ENTRANCE  EXAMINATION  BOARD 
■    .  m 

'      »  ■  '  * 

The  College  Entrance  Examination  Board  haa:  participated  actively  in,  and  provided 

•?  •  ' 

partial  financial  su^jport  for,  the  deliberations  which  have  leti  to  the  publication  of  this 

•  A    •  ...   .  ^  / 

report.  Co  Age  Board  participation  has  been  with  the  titin  belief  that  vigorous  and  con-  • 

tlnulng  efforts  should  be  made  to  improve  standardized  tests,  to  see  that  they  afe  sen- 

Bitively  administered  and  accurately  Interpreted,  and  to  eliminate  testing  abuses  of  all 

klndy.  There  are,  however,  sevisral  recommendations  lathe  report, ^Inpludlng  the  one  . 

pertaining  to  a  moratorium  which  th^fCol^pge.  Board  cannot  suppo^t^^ 

Nevertheless,  the  College  Board  will  give  the  most  serj^ff  attlntlon  to  those  * 

recommendationa  having  to  do  with  the  Improvement  of  tests,  their  administration  and  their 

Interpretation.  .  Moreover,  it  will  continue  to' be  particularly  vigilant  with  respect  to  any 

and  all  abuses.  , 


.  DISCLAIMER  BY  THE  EDUCATIONAL  TESTING  SERVICE 


The  Educational  Testing  Service  has  participated  actively  in,  ^and  provided  partial 
financial  su)port  for,  the  deliberations  which  have  led  to  the  publication  of  this  report. 
Educational  Testing  Service  has  participated  in  the  firm  belief  that  vigorous  and  continuing,  ' 

efforta  should  be  made  to  improve  standardized  tests, .to  see  that  they  are  sensitively  '  ^  .i 

o  ■  . 

administered  and  accurately  interpreted  and  to  eliminate, testing  abuses  of  all  kinds,  jhet^/ 

*  ■ 

are,  however,  several  recommendations  in  the  report,  including  the  one  pertainiiig  t6^<^;^' 
moratorium,^wblch  it  cannot  support.  ^  *  /  ^ 

On  the  other  hand,  the  Educational  Testing  Service  will  give  the  most  serious. . 


attention  to  those  recommendations  having  to  do  with  the  improvement  o^  tests,  thoi^' 
administration  and  their  interpretation.  Moreover,  it  will  be  particularly  yigllant/^ltb 
.respect  to  any  and  all  abuses.  .■  \         /  / 


CONVENER'S  INTRODUCTION 

/    ■  ■ 

The  Conference  on  Minority  Testing  held  In  Septen)ber»  1975  was  convened  by  the 
National  Association  for  the  Advancement  of  Colored  People.  It  reflects  the  NAACP's 
concer'n  with  the  negative  Impact  on  Blacks  of  the  national  trend  toward  assessing  aptitude,, 
achievement  and  Intelligence  almost  solely  through  test  Instruments,  the  validity  ithd/^r 
administering  of  w^ch  is' often  suspect.  This  trend  which  began  with  the  mass  objective 
testing  during  World  War  I,  has  accelerated  to  the  point  where  in  the  last  two  decades  great  ^ 
emphasis  h^  been  placed  on  gi^oup  assessment,  which  often  appear  to  operate  to  the 
detriment  of  many  Blacks, 

.  The  assessifig  of  achievement  and  intelligence  of  Blacks  has  been  a$ohce^  to  the 
NAACP  since  its  founding,,  for  the  theme  of  the  NAACP  Founding  Conference  in  id09, 
a  refutation  of  arguments  that  the  Negro  was  physically  and  mentally  inferior.  At  that 
historic  conference,  leading  scfentists  presented  papery  to  refute  that  widely-held  opinion, 

During  the  ensuing  66,years,  the  issue. has  been  periodically  debated,  cfither  formally 
or  ihformally*  by  NAACP  and  others,  from  time  to  time,  ♦^he  writings  of  ttie  Moynihans 
Jensens  and  Schookleys  and  the  key  Supreme  Court  deolslpns  in  Hdbson  v.  Hansen,  Griggs 
V,  Duke  Power  Co,  and  De Funis  v,  OdgiRard  have  sUrred  much  controversy.  More  and 
mpreV  tests  have  been  utilized  as  the  sole^  or  principal^  means  of  making  assessments  under 
circumstances  which  may'adversely  Influence  one.'fl  opportunities  and  achievements  through- 
out one's  entire  life,  .  . 

The-MAACP  has  been  particularly  concerned  with  the  consequences  of  ability  grouping 
practiced  by  \vhole  educational  systems  which  result  in  racial  isolation,  the  enfprcement 
of  stereotypes,  the  labeling  of  phildren,  and  in  the  reinforcements  of  feelings  of  inferiority 
which  can  lead  to  a  third  class  education.. 

The  following  vigQettes  of  experiences  related  to  oUf  more  than 2, 000  units  across ^e 
country,  illustrate  the  scope  of  th%  problem;  ,  -  ^ 

^         -  Examination  scores  are  used  to  determine  Who  has  access  to  so-called 

"examination  soljools"  and  who  Is  admitted  to  the  more  prestigious 
'         colleges  and  universities, 

-  Classification  systems  based  on  standardi'zed  tests  label  a  dispropor-'  . 
tlonately  large  number  of  minority  children  as  subnormal  and  a  dispro- 
portionately small  numbei"  of  blaok  and  other  minority  children  as  gifted, 

>•  Many  black  teachers  are  kept  out  of  the  classroom  based  on  their  "  ^ 
scores  on  the  ^latlonai  Teachers  Examination,  '  * 

-  Many  minority  group  students  are  unable  to  enter  graduate  and/or 
professional  school  because  of  test  scores,  "  - 

Students  aJ^  placisd  in  EMR  or  other  Apeoial  education  olaflses  on  the  ' 
basi9  of  testHioores, 
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H         111.1972  the  NAACP  adopted  a  convention  resolution  calling  for  a  moratorium  on 

aUmdatdleed  tests  after  other  suitable  and  npn-blased  criteria  for  measuring  pupil  progress 

.  and  teaching;  accountability  has  been  devlsetjt/'        ^  ^ 

bi  1974  the  following  resolu^on  on  testing  was  adopted  by  the  NAACP  convention. 

WHEREASi  a  disproportionately  .ia!>ge  number  of  blarck  students  are  being  misplaced 
in  spepial  eduofitlon  olasses  andtlenled  admissions  to  higher  educational  opportunities, 

WHEREAS.  sljtfidai^Ued  tests,  e.g.,  Stanford-Blnet  and  the  Wechsler^cale  for 
Children  exclude  blaoks,  Puerto  Rlcans  and  Mexican" Americans  from  the  representative 
'  sample,  and,  - 1  * 

WHEREAS,  Buob  tesU. label  black  children  as  uneducable,  assign  them  to  lower 
educational  tracks  than'wbltes;  deny  black  children  higher  education  pppprtChiltles; 
perpetuate  Inferior  education;  place  black  children  In  spec^'classes  and  destroy  growth 
/  and  development  of  black  children,  and,  v 

WHEREAS,  students  who  fall  to  show  a  Ijlgh  verbal  or  numerical  ability,  scbre  low 
on  the  Scholastic  Achievement  Test  (SAT),  the  Law  School  Admissions  Test«(I£AT),  the 
Graduate  Record  Examination  (GRE),  etc.«  and  are  routinely  excluded  from  college  and 
graduate  or  professifial  education, 

BE  IT  RESOLVED,  that  the  NAACP  demand  a  moratorium  on  standardized  testing 
wherever  such  tests  have  not  been  corrected  for  cultural  bias  and  direct  Its  units  to  use  all 
administrative  and  legal  remedies  to  prevent  the  violation  of  students*  constitutional  rights 
through  the  misuse  of  tests,  and, 

BE  IT  FURTHER  RESOLVED,  that  the  NAACP  call6  upon  the  Association  of  Black 
Psychologists  to  assert  Leadership  in  aiding  the  College  Entrance  Examination  Board  and 
Educational  Testing  Service  to  develof^standardlzed  tests  which  have  been  corrected  for 
cultural  bias  ipd  which  fairly  meMiire  the  amount  of  knowledge  retained  by  students 
regardless  of  his  or  her  indivlduarFaokgit>und, 

BE  IT  FINALLY  RESOLVED,  that  the  NAACP  directs  Its  units  to  use  alj  admin- 
istrative remedies  in  the  event  of  violation  of  students  constltutionM  rights  though  the 
misuse  of  tests  and  directs  National  Office  staff  fo  use.  its  Influence  to. bring  the  GEEB, 
•     ETS  and  ABP  together  to  revlBQ  suQh  tests.  ^  0 

Allowing  the  adoption  of  this  resolution,  the  Education  Department  of  the  NAACP 

extended  invitations  to  the  Association  for  Bl«!ck  Psychologists,  The  College  Entrance 

>  Examination  Board  and  the  Educatlort:  Testing  Service  to  meet  with  us  to  discuss  tj!e 
concerns  of  our  Association  regarding  testing.  During  thp  ensuing  year/  representatives 
from  these  brganizatlons  met  with  us  on  three  occasions  to  identify  and  focus  on  selected 

^  key  issues .  the  results  of  our  deliberations  led  us  to  convene  the  Conference  on  Minority 

Testing.  'I 

This  Conference  was  not  designed  to  resolve  all  the  issues  In  testing.  Rather  It  was 
designed  to  explore  certain  issues  regarding  how  testing  ImpaoU  public  policy;  whether  or 
^      not  there  should  be  a  code  on  testlng*an(i  if  so,  what  should  the  code  ei/pompass;  the. use  and 
misuse  of  tests  and  the  psychometric  integrity  of  teats.  The  specific  i^ject|||fes  as  outlined 
to  the  conferees,  was  to  elicit: 

1,  a  set  of  specific  reCoinmeridatlons  thaNseek  to  deal  with  the  lasiies 

and  problems  that  have  been  identified.  \  .  • 

,2.  a  rationale  for  the  Task  Forceps  recommendations  that  give  meaning  . 


/ 
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.  to  and  a  basis  for  interpreting  the  recommendations* 
•  3.  Buggeations  for  ways  and  j^eahs  to  implement  the  recommendations  • 

4.  a  summary  of  Ul  issues  considered  with  pros  an^  cons.         ,  • 
*  The  relevance^f  Uy  issues  adUressed  during  the  Minority  Testing  Conference  was 
underscored  in  many  waw. '  To  mention  two >  we  can  point  ta^he  fact  that  participants  at 
the  Conference  were  educators,  representatives  from  the-testing  industry,  professional, 
and  Qomm unity- or g^izations  and,  secondly,  we  noted  the^any  common  threads  running  . 
through  the  four  Task  Force  reports.  .    .  - 

Those  threads  include  an  awareness  Jthat:  /  v      .  d 

-  Some  type  of  assessment  is  needed,  -  \ 

-  Tests,  In  our  credential-roriented  society,  vastly  influence  th«  '  ^ 

'  economic  potential  of  human  beings.      ^  ^        '■  . 

-  There  is  a  need  for  widepsre^d  dissemination  of  information  regarding  .  r 
testing  in  a  form  easily  understood  by  all  segments  of  tl^e  population. 

-  Test  developers  have' an  advocacy  role  to  perform  including  sanctions 
for  continued  abuses. 

-  Test  develoi^ers  have  a  responsibility  to  tell  what  tests ^o  and. do  not 
measure. 

-  Persons  who  take  staiKiat'dized  tests  must  knoyv  their  rights* 

-  Guidelines  for  the  administration  of  tests  should  include, specifics 
regarding  the  type  of  envlrop|nent  necessary  for  optimum  test^ 
performance.  ■  ^  . 

-  Subjects  and  userii  m'^ust  understand  what  is  expected.  * 

-  Criterion -referenced  approaches  and  materials  shoidd  be  further 
*  '    investigated.  ' 

In  view  of  the  fapt  that  tests,  (since  they  stratify  or  certify  people)  are,  in  effect, 
married  to  national  policy  issues,  and  determine  what  kinds  of  people,  from  what  back- 
ground, where  they  will  fit  in  the  society,  what  role  they  will  play,  and  tlje  like,  it  is 
inouxJfbent  on  the  Minority  Community  to  galvanize  educators,  the  testing  industry,  parents', 
students  and  oommuniiy  organizations  to  work  systematically  to  insure  that  the  assessment- 
bf  individuals  is  cultui'ally  fair*  ^  . 

This  is  vital  if  all  Americans  are  to  enjoy  equal  opportunity  in  every  aspect  of  public 
life.  ♦  ^ 

The  NAACP  expresses  its  sincere  appr^eciatlon  ^  the  Task  Force  Chairmen  and  the 
support  staff.  ,      .  ^ 

We  are  also  grateful  to  the  individuals  and  organizations  that  contributed  materials 
and  data  as  background  information  and  to  the.  College  Entrance  Examination  Board  and  the 
Educational  Testing  Service  for  the  financial  assistance  which  made  thjs  Conference 
poesible. 

'  ALTriEA  T.  L»  SIMMONS 

•  ^  Dlrtfotor  for  Education  Programs 

'  The  National  Association  for  the 

«  Advancement  of  Colored  People.  V 


May,  1976 


691 


SUMMARY  OF  RECOMMENDATIONS 

1.  That  there  bo  a  moratorium  on  all  current  standardized  testa  unless  such  Instru- 
ments  conform  to  recommendations  set  forth  In  this  Report. 

2.  That  a  national  monitoring  body  be  established  with  the  power  to  enforce,  through 
sanctions,  to  assure  pjfC^r  assessment  and  policy  regarding  the  administration  of  assess-: 
ment  tools , 

3.  That  companies  that  develop,  publish  and  sell  teats  assume  (ot*  continue  to  assume) 
'  major  responsibility  tor  assuring  the  correction  of  the  deficiencies  In  their  Instruments , 

4.  That  the  testing  Industry  be  held  responsible  for  the  development  of  assessment 
procedures  which  conform  to  professional  standards  as  described  In  Kandards  foi^Educa- 
tlonal  and  Psychological  Tests  developed  by  the.Jolnt  Committee  *bf  tl^^merlcan  Psycho- 
lo|^ai  Association,  American  Educational  Research  Assoclatjon  and  tn^Natlonal  Council 
on  l^easu.rement  In  Education,:  .  ^ 

5.  That  the  testing  Industry,  at  a  minimum,  include  within  the  Information  It  pub- 
lishes concerning  standardized  tetfts  of  ability,  achievement,  personality  and  any  other 
assessment  procedure,  ^Specific  data  regarding  predictive,  content  and  prescriptive  validity. 

6.  That,  where  standardized  assessment  results  In  the  disproportionate*  sorting  of 
'groups  according  to  ethnicity,  the  test  daveloper  provide  separate  validity  coefficients  for 
ethnic  groups  to  which  the  assessment  procedure  Is  to  bO  applied.  ^ 

7.  That  test  developers  describe  the  probable'maln  effect-variables  lii  the  instruc- 
tional setting,  in  standardized  terms,  which  must  be  considered  jUong  with  the  results  from 
standardized  testing  If  the  Interpretations  of  results  are  to  be  meahingful  or  acceptable. 
F<^r  example,  the  ethnic  background  of  the  examiner  Is  known.  In  some  cases,  to  affect  the 

\  scores  which  children  earn  on  IQ  tests;  therefore  Information  about  the  ethnic  and  other 
important  background  factors  Of  the  examiner  should  be  reported.slmultaneously  with  the 
test  scores.  , 

r,       b.  That  the  testing  Industry  establish  and  fund  an  Independent  research  and  develop- 
ment corporation  charged  *Ith  the  responsibility  (1)  to  Identify  the  cHUcal  problems  in 
assessment  as  they  relate  to  minority  groups;    (2)  to  sponsor.  researcB  to  Investigate  those, 
problems  requiring  study;  (3)  to  sponsor  appropriate  development  work;  and  (4)  to^volve 
researchers  who  have  the  endorsement  of  minority  professional  and  community  associations, 
and  that  a  minimum  sum  Of  four  per  cent  (4%)  of  the  Income  over  expenses  for  non-profit^ 
testing  corporations  and  the  rifm  of  fpur  per  cent  (4%)  of  profits  for  profit-making  testing 
corporations  be  set  aside  In  support  of  the  aboVe  objectives. 

9,;  That  tesC  publishers  exercise  an  advocacy  responsibility  whloh  require  that  test 
objectives  be  stated  clearly^at  the  process  be  fully  described  so -that  subJecU  and  users 
understand  exactly  what  Is  exj^cted  and  how  It  will  happen.  This  is  the  prlnclp^le  of  Informed 
use  and  Informed  consent.  ^  "  i 
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10*  Thatr  publishers  of  testa  state,  with  clarity,  on.  all  descriptive  information  con- 
cerning a  test,  the  specific  uses  for  which  the  test  is  designed,  the  specific  limitsltions  of 
the  instrument,  and  that  they  provide  information  as  to  how  the  results  should  be  interpreted 
in  acceptable  professionkl  practice*    •  ^ 

11..  That  we  call  upon  the  appropriate  j^rofessional  associations,  specifically  the  . 
Association  of. Black  Psychologists  (ABPsi),  Amsrioan  Psychological  Association  (APA), 
the  Atnerican  Education  Research  Association  (AE RAJ,  the  Association  for  Non-White 
Concerns  of  the  American  Personnel  and  Quldance  Association  (ANWC),  and  other  appro-  • 
priate  groups  to  establish  minimum  standards  forUhose  who  administer  and  interpret  such 
standardized  tests  as  tests  of  intelligence,  aptitude,  ac|iievement  and  personality,  and  to 
develop  standardized  basic  information  about  test  administrators  and  the  testii^g  envlronr 
ment,  to  be  provided  routinely  with  any  test  scores* 

12*  That  the  NAACP  mount  a  concerted  effort  to  identify  Instances  of  testing  abuse 
which  call  for  legal  remedies*  m 

13.  That  the  NAACP  establish  a  national  task-force  for  the  purpose  of  developing 
specific  guidelines  for  laymen*s  participation  in  and  support  of  any  standardized  assessment 
procedures,  and  that  the  NAACP  insure  disdemination  of  the  guidelines  to  the  broadest 
possible  audience. 

14.  That  citizen^  urge  state  elected^fficials  to  pass  iegislatioii  to  establish  a  task 
force  for  the  development  of  an  independent  Office  of  Consumer  Affairs  for  Testing  and 
Student  Evaluation. 

15.  'That  the  Association  of  Black  l^sychologis'ts  design  and  conduct  workshops  arbund 
the  Task  Force  Reports  which  will  incmde,  but  not  be  limited  to,  the  effects  of  race  of 
examiner  on  test  taker;  differential  vaJidation  and  reliability;  improper  use  of  IQ  as  de-^  ' 
pendent  variables  in  research  projects,  jDiased  in  test  construction;^ the  problem  of  mis- 
interpretation and  the  development  of  alternative  means  of  assessment*  , 

I.  .  •  ^  , 
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ON  THE  USE  AND  MISUSE^F  TESTS 

Competent  echolare  have  alwaye  recognized  the  poselbiu^  that  Intelligence  tests  and 
aptitude  teeU'  might  be  abueed,  Beghining  with  Blnet,  and  Including  euch  later  echolars  ae 
EUe,  Kllneberg,  Allison  Davie  ;and  such  contemporary  scholare  as  Robert  WlUlame  and 
Ledli  KamlD»  they  have  called  attention  to  potential  and  actual  Iftsuses.  Neverthelees»  the||| 
abusea  have  continued.  Many  black  and  other  mifforlty  children  have  been  unfairly  etlg- 
roatized  or  InjDproprlately  grouped  for  Instructional  purposes.  Culturally  eophlstlcated 
teachers  and  Ifettpglsta  have  protested  that  children  who  have  been  thue  Identified  as 
•less  able/'^WBcd,"  or  what  might  be  called  ''the  sU-hour  mentally  retarded/'  seem 
to  lose  thai  retardation  immediately  at  the  end  of  the  echool  day.  But  back  In  the  claseroom 
the  next  morning,  they  conform  to  the  predictions  of  thoee  who  flret  sequeetered  them^in^ 
"epeclal"  classes.  .  ^ 

The  racist  history  of  the  testing  movement  Is  dooumented  In  l^onKamln'e  The 
PoilticB  and  Science  of  KQ.,  as  well  ae.ln  the  writings  6f  othere.  (Seefflst  of  References 
appen^).  The  current  jnlsaesesstnent  of  blacks  and  others  Is  rooted  in  a  long— and  often 
unscientific  and  malevolent^-filBtory.  in  this  Task  Force  report,  we  are  concerned  with 
tests  of  "aptitude,"  "achievement,"  "personailty,"— both  Individual  and  group— and  any 
other  method  of  assessment  of  Individuals  which  reeults  In  ranking,  eortlng  out  and  Invi- 
diously compilring« 

It  should  be  the  function  of  assessment.  Including  teeting,  to  facilitate  the  devel(Jpment 
of  human  resources.  To  b^  acOeptable  la  the  field  of  education,  testing  programs  should 
reveal  student  growth  in  sklllB,  attltudee  and  understanding.  To  be  ueed  In  connecti»n  with 
selection  for  employment,  testa  must^  measure' variables  whfch  have  something  to  dp  with  the 
Job  for  which  an  individual  Is  being  tested,  "^iese  are  the  criteria  against  which  all  teste 
and  teptlng  programs  must  Initially  be  measured:  every  profeeslorial  testUig  procedurcr 
'  method,  technique,  Instrument  or  material— an'd  the  environment  In. which  the  tests  are 
admlnleterftS— jmust  conform  to  theee  standards.  That  le  the  Initial  judgnwnt  by  which  any 
teeting  program  roui|t  be  evaluated,  even  before  it  Is  put  Into  u^e. 

It  ^B  important  to  note  here  that- we  are  very  muchin  favor  of,  and  recognlie  the  need 
for,  approprlatfl  and  competent  asseesroent.  However,  the  existing  standardized  tests  are 
unacceptable*  Th^y  fall  short  of  meeting  three  l\ihdaroental  criteria  (In  addition  to  that  of 
relevance,  noted  in  the  previoufl  paragraph).  Testa  an<f.tesUng  procedures  must  predict 
accurately  what  they  promise  (predictive  validity).  Testa  must  measure  adequately  the 
content  of  the  area  they  purport  to  cover  (content  validity).  The  testing  program  must  be 
capable  of  leading  to  prescripUons  which  result  in  positive  growth  for  the  pereon  being 

tested  (prescriptive  validity).  It  la  abualve  to  mlsaasess  with  an  Inadequate  Instrument. 
Equally  Iroportknt,  It  Is  abusive  to  oonttoue,  jjyear  after  year,  to  use  teaUng  pro^juns  which 
have  proved  themselves  to  be  Ujols  which  are  either  irrelevant  to  student  progres^  or  which 
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actually^  by  predicting  failure,  induce  malevolent  results.  Current  aptitude  testing  or  other 
teaming  processeB  and  practices  whlcb  result  in  the  niisassessmentof  blacks  and  oi\^et 
mlnorltiea  result  In  educational  mistreatment.  All  such  tests  must  therefore  b^  examined, 
not  only  fOr  cultural  or  ethnic  bias,  but  more  importantly,  in  the  light. of  their  intended 
ultfinate  use.  For  all  these  reasons,  we  assert  that  fundamental  questions  must  be  asked 
about  testing,  beginning  with  .the  motivation  of  the  movement  and  continuing  through  the 
assumptions  which  underlie  the  use  of  the  instruments,  raising  questions  about ^e  account-, 
ability  of  the  "testing  industry  whet)  measured  against  the  educational  outcomes  forTstudents. 
In  the  light  of  the  foregoing  general  considerations,  the  following  recommendations 

fi  made:  '  ^ . 

COMMENDATIONS  TQ  THE  TESTING  INDUSTRY^ 

We  recognize  that  a  number  of  theoretical  problems^ in  assessment  need  attention* 
Among  these  are  the  issues  of  norm  versus  criterion-referenced  testing;  predictive  versus 
prescriptive  validity;  aptitude  versus  acbfevement  testing;  content  versus  contextual 
validity;  status  versus  process  assessment;  ^d  the  extent  to  which  some  less  readily 
measured  goals  will  be  disregarded  if  Btandardized  testing  is  given  principal  priority  and 
Bup^^ort,    (lyiowled^eable  members  of  the  teaching  pifofession  will  recognize  that  e^h  item 
In  this  list  calls  for  book-length  treatment). 

In  addition,  underlying  all  of  these  theoretical  Issues  is  a  basic  one)  the  question  of 
^Hmlverri^lit^"  in  hunian  behaviour.  Wl^n  a  single  standardized  test  is  kdministered  to  an 
entire  population,  the  underlying  assumptioi^muat  be  that  it  is  f^ir  to  all  because  all  iare 
"alike**  In  their  posses siof\^ of  the  qualities  and  information  to  be  tested:  they  dfffe^r  only  in 
the  degrees  to  which  they  possess  these  qualities  or  have  the  information*  Such  an  .assump- 
tion cannot  legitimately  be  made  f6r  the  entire  population. of  the  Uhlt^  States.  In  the  llg»\f 
of  the  Information  that  we  have  about  differences. between  and  within  cultural  groups  within 
this  nation,  we  beUeve  the  assumption  of  "universality"  to  be  a  serious  error*  Since  there 
is  no  standard  experience,  ^la  "standardized**  test  poses  a  serious  problem  of  theoretical 
difficulty.  When  applied  to  the  problem  of  testing  minorities,  this  dUflculty  is  greatly, 
increased.  ■        m  ■ 

The  foregoing  concerns  by  no  means  exhaust  the  list;  ftut  this  weekend^ conference  can 
»  da  Jo  more  than  suggest  the  magnitude  of  the  problems  before  us,  without  presuming  to  In- 
clAe  everything.  We  know  that  existing  tesU  have  been  built  at  cosis  that  run  into  millions 
of  dollar*;  yet,  even  with  such  an  investment,  we  do  not  have  teste  that  work  as  they  are 
supposed  to  work.  The  truth  Is  that  the  task  rf  devising  a  full  remedy  is  beyond  the  com- 
petenoe  of  a  weekend  cpnference,  but  the  burden  of  firoof  fofc  the  utility  ai^sfttlsfactorlnqsB 
yf  any  testing  procedure  reate  with  the  producers.  We  will  have  discharged  our  function^ 
this  Task  Force  Ufre  point  to  Inadequacies  and  Indicate  general  directions  pf  needed  Improve 
ment« 

.  The  testing  Industry  is  (or  oupM  to  be  held)  responsible  for  the  development  of  assess- 
ment i»e<J^reS  which  conform  to  fcrofessronal  standard^*-  Those  stairdards  are  provlslon- 
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ally  described  In  Standards  for  Educational  and  Psychpldglcal  Teetg  pul)ll8hed  tfy  the  Arner-* 
lean  Psychological  ABBoolation  bicr  In  1974.  *• 

Within  these  general  prescriptions,  Uie  minlmutn  responsibility  of  the  testing  Industry  • 
Hi  to  Include  within  any  standardized  teststf  ability,  achievement,  personality,  or  any  other^ 
assessment  procedure,  specific  consideration  of  and  data  related  to' three  kinds  of  validity- 
predictive,  content,  and  prescriptive  (as  we  iig>ted  above).  These  data  must  be  expressed  as 
a. coefficient  or  other  appropriate  systematic  expression  which  is  developed  as  a  result oi*  an 
*  adequate  validation  atudy.  Such  data  must  accompany  all  administrative  manuals  for  use  . 
with  standardised  tests.  Furthermore,  in  instances  where  standardized  assessment  results  ^ 
in  a  disproportionate  sorting  of  groupa  according  to  ethniclt^,/ihe  test  developer  mupt  provide 
separate  validity  coefficients  for  the  ethnlc'groups  to  which  the  assessment  procedure  is  to 


be  apnlied, 
^to^Pjddttfo 


on  to  the"  foregoing,  it  is  also  the  responsibility  of  the  producers  of  assessment 
procediu^es  to  de$bribe  probable' main  effect- variables  in  the  Instructional  setting,  in  ^tan-       n  ^ 
.  dardlted  tsrmB,  wbleh  muBt  be  considered  along  with  the  results  from  staridatdized  testing.        '     ■  . 
if  the  interpretations  of  test  results  are  to  be  noeaningful  or  acceptable .i For  example,  we  y  ^ 

know  that  the  ethxiic  bacj(ground  or  . level  of  skill  of  those  who  administer  or  interpret  tests 
often  has  a  major  effect  on  the  announced  results  of  the  program. .  Therefore »  we  have  the 
right  to  expect  that  the  testing  industry  will  devise  satisfactory  and  systematic  w^s  of  tak- 
ing such  effects  Into  account.  '  \  ' .        ,     ■'  .  ^ 

Agencies  make  money  from  the  admlnii^tration  of  tests.  Therefore,  they  bavejthe 
responsibllUy  to  finance  the  measurei  necettary  to  the  correction  of  their  test 
Among  these  measures  must  be  the  incl^iof,  within  the  test-construction  process  Itself  i^f- 
persons  drawn  from  culturally  diverse  backgrounds  and  ofVarlous  ethnic  identities.  The  ; 
•  evaluating  experts  must  include  representatives  who  are  acceptable  to  the  minority  pro-  ^ 
fessional  groupa  and  bthir  m^or  community  groygs  if  the  jesting  prograim  is  to  esoapfk^ts  • 
preaetit  image  as  being  unduly  weighted  In  favor^Wthe  dominant  forces  of  American  ^society. 

The  testing  industry  must  establish  and  fund  an  independent  reisearch  and  development 
corporatlbn  charged  with  the  reBponsibillty*(l)  to  IdenUfy  the  critioal  problems  in  assess- 
;  ment  |a  they  relate  tdtoinority  groups;  (2)  to  sponsor  research  which  nrlll  Investigate  these 
probleW;  (3)  tp  spcmspr  appropriate  development  work;  and  (4)  to  involve  resejffChot'S  who 
.  have!  the  endorsement  of  minority-rooted  professional  and  community  associations .  # 
7   In  view  of  the  enormous  profits  which  have  been  made  over  the  years  by  the  testing 
tnduktry*  we  recommend  Chat  some  small  redress  of  past  errors  be  madec  by  the  voluntary 
application  of  four  per  cent  (4%)  of  the  net'incofloe  of  non*  prof  it  testing  corporations  and  four 
.  |)er  cent  (4%)  of  the  net  profits  of  profit-making  testing  corporations,  t9^  t^^  .  \ 

; 'foregoing  o))jiactives.  *  .    ,  -  ' 

V. ;    bur  next  point  is  that  the  makers  of  teste  must  be  accountable  for  the  uses  to  which  .  . 
thciir  tests  are  put.  Test  publishers  must  be  responsible  for  monitoring  the  use  of  their  - ^  .  ^ 


tests  by  assuming  an.adVpcacy  role  when  noceelsary*  In  instances  where  tests  are  used  (or 

are  about  to  be  U^ed)  without  due  observance  ol  this  advocacy  role»  test  publishers  should  ^ 

apply  sanctions »  including  Ih^  <lenial  of  the  use  of  their  product  by  those  who  rhlsuse  U.  . 

Moreover »  test  publishers  have  an  advocacy  responsibility  which  requires  .that  test 
objectives  be  clearly  stated^  that  ^he  process  of  admlnistemg  the  ^st  bo  fully  described  so 
that  subJeQ|s  and  users  both  Will  understand  e^s^cMif  what  Is  expected  to  happen  anj^how  it 
win  happen,  lii  non-threatening,  affirmative  teriris.  This  we  would  call  the  principle  of 
informed  ube  and  informed  coAsent*  .  - 

Finally,  publishers  of  tests  must  s^te  with  ciarity,  i^i  all  descriptive  information  . 
conbeming  a, test  thoy  publish,  the  specific  uses  for  which  the  test  Is  designed,  the  specific 
Imitations  of  the  instrument!  andfulJi  .e}q)lanation  as  to  )low.  the  results  should  ^  interpreted. 

Ali^of  the  foregoing  steps  must  be  taken  by  the  ieistlng  industry  itsel(*  The  broadest 
Interpretation  possible  should  be  made  of  tKe  conc^t  of  abuse,  within  the  field  of  standard* 
ized  testing,  since  abuse  can  occur  at  any  and  all  points  of  the  testing  process,  from  initial 
deveippmeht  and  conceptualization  through  utilization  and  interpretation  # 

We  assort  here  that  the  misuse  of  tests,  whether  due  to  igilorance  or  to  bias  or  to  in- 
difference,  is  an  important  faotor'ln  the  total  problem  we  are  dlscuaaingrbut  we  also  assert 
that  it  is  by  no  means  th^* whole  problem*   Inherent  in  the  instruments  themselves,  partic- 
ularly in  the  instruments  designed  to  measure  aptitude  j  is  a  basic  bias  which  must  bo  cor- 
rected at  Its  source.  That  source  is  within  the  offices  and  work-rooms  of  the  testing  industry. 
No  amount  of  training  or  orientation  of  users  of  the  tests  will  correct  this  built^n  bias;  but 
a  successful  effort  to  correct  such. bias  will  result  in  hi^  predictive-,  content-,  and  pre- 
scriptive-validity* 

RECpMMENDATlONjS  TO  PRACTITIONERS 

V  .         "       ■        /  ■  ■  ■  t 

Valid  stapdardized  tebts,  even  when  they«aro  produced  by  the  industry,  can  still  b^ 
used  in  error,  or  their  full  potential  lost*  Appropriate  use  would  include  diagnostic  and    ^  *  - 
prescriptive  procedures  which  lead^to  pupil  galn%^  In  the"tnstance  of  educational  tests  de-r^ 
Signed  to  measure  achievement,  recent  innovations  in  standardized  assessment  seem  to  offer 
possiblliti$s  which  may  be  supportable* 

Some  recefttly  devised  tests  would  seem  to  have  a  greater  utility  for  use  in  the  school 
room  than  earlier  tests*  Those  with  the  greatest  utility  have  a  closer  relationship  to  tti| 
instructional  process,  offering  valuable  insights  as  tp  teaching  strategies*  These  tests  Ire 
often  preferred  to  as  "formative-'summatlve**  tests*  >^oofhmon  use  of  these  tests  occurs  in 
reading  i|Dd  mathematics  pi^pgrams,  where  short  "looiter  tests"  are  used  to  ascertain 
proper  beginning^points  for  individual  students  in  appropriate  units  of  instruction,  and  ^ 
"summative"  tests  are  used  to  asoert^  the  degi^ee  of  mastery  of  materials  and  the  readiness 
of  the  child. to  move  on  a  more  advanced  level*  '  ' 

.  Whlfen^j  speolfioexiitftg  tests  can  be  fully  eWorsed  at  this  time, Ue.prind^^ 
volved  in  the  assessment  procedure  just  described  appears  to  merit  our  support*. 
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Praotitlonera  are  remind^  that  abuses  In  testing  programs  often  occur  with  reference 
to  majority  as  well  as  minority  children*  While  we  stress  the  pattern  of  abuse  with  refer- 
ence  Xq  minority  children »  because  the  magnitude  of  the  error  Is  greater,*  we  do  not  overlook 
the  welfare  and  progress  of  the  jpiajorlty  chlld--who  should  also  benefit  from  a  testing  pro- 
gram  deslgnpd  to  meet  the  criteria  and  serve  the  purposes  we  are  discussing* 


Any  test,  which  restUta  In  a  disproportlonate.distribution  of  students  on  an  ethnic  basis 
must  demonstrate  that  th'ljl  disproportion  does  not  pome  as  a  bi|ilt-ln  error  due  to  low  pre- 
dictive-, content-,  or  prescrlptive*^validlty.  Where  such  a  conclusion  cannot  be  established, 
persons  agked  to  participate  in  ti>e  use  of  the  test  should  decline  to  do  so» 

Perhaps  an  example  will  help  to  explain  what  we  mean*  Persons  familiar  with  the 

a'         .  f      .  ■ 

<_j>rbcesses  of  test  construbtloQ  will  admit  that  Items  which,  In  the  preliminary  testing  and 
validation,  appear  to  dilferentlate  tietweefi  males  and  females  are  wrown  out,  presumably  on  . 
the  assumption. that  there  are  no  real  differences  in  Intellectual  fun|Q|i|^Dg  as  between  the 
two  ^exes,  Yet  items  which  ap^ar  to  differentiate  between  whites  and  bUoks;  in  the  same 
battery  of  tests,  are  retained- -presuittal^ly  on^the  assumption  that  there  are  real  differences 
between  the  races*  Thus»  ^e  test  which  is  published  and  administered,  after  the  prelim- 
inary run »  carries  no  built-in  bias  as  to  sex  but  does  carry  a  built-in  bias  as  to  race»  The 
fault  is  clear*  The  correction  ougtit  to  be  equally  clear* 

We  call  upon  the  appropriate  profelsslonal.  associations,  specifically  the  Association  of 
Black  Psychologists  (ABPsi),  the  American  Psychological  Association  (APA),  the  American 
Educational  Research  Association  (AERA),  the  Association  for  Non- White  Concerns  (ANWCy, 
Of  the  American  Personnel  and  Guidance  Association,  and  other  appropriate  groups  to  estab- 
lish  minimum  standards  for  those  who  administer  and  Interpret  standardized  tests  such  ae 
tests  of  Intelligence,  aptitude,  achievement  and  pei^sonallty< .  These  standards  %nust  be  ' 
'equivalent  in  rigor  to  the  standards  which  have  been  established  for  publlshers  of  standard- 
ized tostis  and  diagnostic  tochnlques.  Further,  we^ball  upon  these  same  Associations  to  * 
develop  standikrdized  basic  Information  about  teist. administrators  and  Ihe  tost  environment, 
to  be  provided  routinely  with  any  tost  scores , 

RECOMMENDATIONS^O  THE  NAACP  '  • 

Recent  court  dedsloiis  (Layry  P*  et*al*  v  Wilson  Riles ^  et,al,:  Diana,  et*al»  y  Cali- 
fornia ^tate  Board  of  Education)  have  been  won  on  the  principle  that  predictive  vnlldlty  for  a 
standardized  tost  was  lacking  In  the  Instances  Invoked,  In  the  case  of  Griggs  V,  Duke  Power  ^ 
COti  ^he  case  .was  won  on  the  principle  that  employment  tosts.must  be  '!Job  relatod*\  To 
maintain  the  momentum  generated  In  these  cases »  it  is  recommended  that  other  Instances 
which  may  appropriatoly  be  pursued  to  a  legftl  remedy'be  Immedll^ly  identified  amf  pursued. 

Particular  attontlon  should  be  paid  to  the  results  flowing  from  the  use  of  the  National 
Teachers  Examination.  A  di9proportlonately  high  number  of  those  falling  this  examination 
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oome  from  the  mlnorltleB.  Teaching  certificate^  are  denied  or  ciredlt  for  promotion's  With* 
held  aa  a  i^eault.  Yet  there. la  llttlei  if  any*,  evidence  to  Indicate  that  these  examinations  have 
any  predictive  relationship  to  the  Jobs  sought/  The  principle  of  drlggs  v.  Duke  Power  Co. 
woul^  appear  to  apply. 

'If  predictive  validity  qannot  be  demonstrated  by  the  Law  School  Admissions  Test 
(I^AT),  the  Graduate  Recoil  Examination  (GRE),  the  Medical  College  Admissions  Test 
(MCAT)i  the  Graduate  Management  Admissions  Test  (dMAT)^  and  other  screening  devices 
used  in  connection  with  admission  to  graduate  and  professional  schools |.  technics l^sohools  or 
other  institutions  of  higher  educatloni  legal  redress  should  be  sought. 

We  call  upon  the  NAACP  to  establish  a  Task  Force  for  the  purpose  of  developing  spe- 
cifiD  giildelijieB  for  the  participation  by  laymen  in  the  effort  to  devise  satisfaQtory  assessment 
procedures.  Further,  we  call  upon  the  NAACP  to  insure  dissemination  of  acceptable  guide- 
lines to  the  broadest  possible  audience*  ~  .  ^ 

RECOMMENDATIONS  TO  LAYMEN 

•.>*■'■  '  "  ■  ■ 

■  No  person  should  consent  to  participate  in  an  assessment  program  unless  he  or  she  has 

a  reasonable  uhders landing  of  the  procedures  to  be  applied ■  and  of  the  outcomes  to  be  ex- 
pected; * 

RECOMMENDATIONS  TO  OFFICE  HOLDERS 

We  urge  that  the  public  obligation  to  protect  consumers  against  Improper  exploitation 
and  victimization  be  recognized  by  legislative  action  to  establish,  outside  the  educational 
bureaucracy,  a  properly  staffed  Office  for  Consumer  Affairs  (Seating  and  Student  Evaluation). 


^  u 
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.    ■        ON  THE  PSYCHOMETRIC  INTEORITY  OiF  TESTS 
INTRODUCTION  . 


ThQ  purpoae  of  the  Task  Force  on  Psyohoroetrlc  Integrity  of  Tests  was  to  highlight  a 

■  * 

number  of  quAstlbns  and  Issues  central  to  the  technical  development  of  t^sts.  There  are 
inaoy  techniques  and  procedures  In  test  construction  that  must  k>e  followed  to  ensure  that  an 
appropriate  measure  has  been  devised..  Although  most  bf  us  know  very  little  of  the  teohnlcal  . 
skills  required  In  building  a  house,  wd  place  ffilth  In  the  constructor's  ability  to  pl*ovide  a  . 
safe  and  secure  home*  If  too  many  flaws  ocoui^  In  its  construction  our  lives  may  be  placed  ^ 
in  Jeopardy  and  we  must  question  the  ability,  perhaps  the  integrity ,  of : the  constructor's. 
Over  the  years  a  plethora  of  regulatlonjBrhave  helped  govern  the  construction  industry  as  ai 
guaranteed  protection  of  the  citizen  from  fraud  and  misrepresentation  of  quality  of  product » 
Comparable  to  the  bulldlng-triide  Industry  Is  the  test-constrilctlon  Indtfstry,  whose  technical, 
.procedures  mustpalso  be  scrutinized  for  quality  of  produdt.  Decisions  n)ade  using  test 
results  oftimes  place,  the  lives  and  futures  of  children  and  adults  In  Jeopardy.  That  Is 
to  say  that  test  data  must  provide*  constructive  information  which  will  enhance  the  personal 
development  of  all  Indfvicluals  regardless  of  group  membership.  To  date  tests  have  prln- 
olpally  been  used  as  instruments  for  screening  individuals  and  placing  them  In  classes  of 
opportunities.  However,  tests  rouat  also  safeguard  the  Individuals*  potential  and  capacity  to 
grow,  if  not  specif icaliy  reveal  ways  In  which  they  may  be  developed  (e.g.  i  in  perhaps  the; 
dlagnostlo-presoriptive  manner).'  This  Task  Force  therefore  raises  questions  ^out  Impor- 
tant technical  areas  of  test  conatrubtion  which  must  be  considered  in  the  totaJj^M  issues  on 
cultural  falimess  in  testing  for  minorities.  These  qtkestlons  represent  areas        ore  com- 
plete analysis  and  discussion. 

The  Charge  to  the  Task  Force  listed  a  numbed  of  questions  which  must  be  fully  ad- 
dressed by  competent  experts  in  the  t^chnlokl  procedures  of  test  construction  and  utilization. 
Our  response  cannot  be  definitive,  glveh  their  complexity  ^nd  our  shortnesii^ of  tlmoi  How- 
ever, our  intent,  is  to  share  Mrlth  others  our  awareness  that  part  of  the  problem  In  fair  test- 
ing of  minorities  rests  with  the  technical  development  of  tests  as  well  as^thelr  use.  Each 
issue,  therefore,  will  be  treated  separately  with  a  etatement  reflecting,  in  our  Judgment,  ^ 
an  e)cpanBion  of  the  issue  In  terms  of  minority  concerns  as  well  as  suggesting  the  areas  .  ^ 
which  need  further  inquiry. . 

1.  As  In  most  things,  tests  should  have  a  reason  and  purpose  underlying  their  develop- 
ment, Although  attention  inay  be  given  to  the  purpose  for  which  tests  are  used,  there,  is  an 
equally  important  problem  to  conalder-^namely,  the  theoretical  assumptions  about  human 
performance  (usually  intellectual  performance)  and  about  how  the  test  format  purports  to 
ineasure  and  actually  does  meaaure  the  areas  of  interest.  For  example,  one  would  assume 
that  to  test  foAntelligenue  a  concept  of  what  ^'intelligenoe"  is  and  lis  beha^ral  manlfesta- 
tions  would  be  clear.  Technio|lly,  it  is  not.  Intelligence  has  become  synon^gnoua  with 
scores  oh  tests  of  intelli|;enDe  (l«e. »  the  Intelligence  Quotient  or  IQ).  The  full  range  of 
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intellectual  potential  and  capacity  or  humans  is  still  unknown.  Wc  know  even  loss  about  how 
humans  process  information^ .  Therefore,  it  is  a  gross  injustice  to  discredit  n  person'a 
present  intellectual  capacity,  muoh  leap  potential,  solely  ^  the  basis  of  test  scores 
which  are  in  turn  frequently  abased  on  a  fragile  foundatipn^of  thooi^eticaV  understanding  and 
empirical  evidence  about. human  intellectual  ability.  The  tendency  is  io  take  what  the  major- 
ity of  people  can  .do  as  indicative  of  ability  levels.  However,  the  presupposition  is  that  all 
persons  have  had  at  least  equal  access  to  the  e;Kperience  central  to  the  skills  of  the  mnjority. 
Nevertheless,  within  the  issue  of  theoretical  concepts  explaining  behavior,  wc  must  ask 
whether  these  basic  assumptions  consider  the^breadth  of  life  contingencies  (pnrticularly 
minority  human  development  within  a  racist  socij^ty)  which  might  nffect  intellectual  growth. 
Certainly  minority  scholars  have  had. little  opportunity  to  participate  in  this  domain  of  scholr 
larly  speculation,  much  less  positive  reception  and  support  of  their  idoa^  and  assumptions 
about  human  performance. 

It  is  therefore  necessary  to  scrutinize  fully  the  assumption  underlying  many  of  these 
tests  to  see  whether  the  root  of  unfairness  in  testing  stems  from  the  initial  conceptualisation 
of  the  behavior  one  is  trying  to  measure,  and  ultimately  how  it  is  incorponnlcd  into  a  9tand- 
ard  leSt  format.  '  \ 

2.  Many  tests,  particularly  intelligence  tests,  l^ave  several  parts  (sim-tcats)  which, 
when  taken  together,  are  supposed  to  represent  a  total  picture  of  a  person'u  nbilities.  The 
same  stringency,  of  controls  employed,  in  general,  for  the  overall  develoonient  of  a  tent 
applies  also  to  the  establishment  of  criteria  in  the  selection  and  use  of  ^rta  of  a  test.  For 
example,  commonly  used  subtests  in  a  test  require  demonstration  of  one's  verbal,  quanti- 
"tative,  or  performance  abilities.  Certainly  we  agree  that  these  components  of  ability  are 
important  in  intellectual  competence,  but  wo  are  also  concerned  about  the  tendency  for  test 
developers  and  clients  to  neglect  other  domains  of  human  capacity  which  affect  performance 
(e.g.  t  tnotivation,  personality,  emotions,  memory  strategies,  etc.)  Our  concern,  there- 
fore, is  to  question  the  ekcluslvity  of  priorRy  areas  In  ability  testing  and  to  emphasise  the 
need  to  broaden  the  areas  of  human  capacities  considered. 

3.  Another  area  of  Important  concern  to  us  Is  the  process  of  determining  test  ques- 
tions which  are  ultimately  selected  to  be  a  part  of  the  Instrument.  It  Is  acknowledged  that 
*4hls  Is  an  arduous  process  of  sifting  through  numerous  questions  until  a  final  group  of  Items 
best  represent  the  purpose  of  yie  test.  Moreover,  It  is  noknbwiodged  that  the  statistical 
process  Involved  Jias  immense  utility.  However,  the  judgments  in  the  development  of  ques- 
tions and  the  interpretation  of  statistical  data  in  the  process  of  selecting  items  is  still  a 
human  one,  ItXJan  be  no  better  than  the  competence  and  sensitivity  of  the  experts  assigned  to 
this  stage  of  test  construction.  Therefore  It  Is  Important  that  at  this  Juncture  of  test  devel- 
opment we  are  clear  about  the  orlterltfof  the  excellence  wo  are  trying  to  measure,  and  how 
widely  that  excellence  Is  represented^^lthln  the  pluralistic  cultural  milieu  of  Amerlpan 
society. 

It  Is  precisely  the  fact  that  American  society  Is  culturally  pluralistic  which  concerns 


UB,  in  tfnp  item  aeleoilott  proceas  M'well  iui  other  stages  In  test  construction.  Many  IteAs 
arej^lected  on  the  baala  of  their  al^ge<j[' libllity  to  roeaaure  thctaklUB  of  the  average  pei  - 
■on,  the  population  In  general*  Very  often  this  la  at  the  .expense  of  those  Itema  which  dU  f 
ferentlally  distinguish  between  vfur^cus  giroups.  In  other  words,  a  question  which  blacks  laay 
do  well  on,  but  not  necessarily  other  grdbpB  reprea^hted  in  the  tested  population,  may  W> 
exclvided  from,  the  final  form       test  because  of  its  lack  of  representativeness  within  the 
general  population.  iXhis  ^aiijDao  l^i  true  of  any  other  group  distinctlona  bne'wants  to  malce. 
The  fact  l#  that  In  the  pursuit  of  questiona  which  repreaent  the  general  population,  we  may  be 
overlooking  Information  whldi  has;^  comparable  potential  for  representing  hiimftn  capacities, 
but  in  a  selective  mam^r,  jMorepVer,  excluding ^tepis  from  a  test  which  fayor  one  group 
but  not  necessarily  anoth^ry  may Jbe  placing  in  Jeopardy  the  representation  of  ^t  group^ 
ability      potential.     '  /  i  -    .      .  . 

'   4«  The  factor  analytic, ptAoedui^  is  a  staUstloal  method  for  finding  out  how  a  pool  of 
items  cluster  together  or  ^|t/uly  independent.  I^ls  a  procedure  central  to  the  item  select 
tlon  process  in  test  idevejc^padnt;  The>rgument8  for  and  against  this  procfdure  and  its 
dominance  in  determining  testfltems  Ir  recognized  as  too  technical  to  entertain  within  tlils 
document.  Th^  important  j|>ol|it,  hoWeverTla  the  recognition  of  the  fact  that  this  procedure  • 


orocedure  of  test  deveioomej 

irm               iNwv>»w             .w.,                          ^.  , 

it  as  particlDahts  in  Jud^ns  th^use  of  this  statistical  teohnioue 

in  the  best  interest  of  mlnon 

lyi^ups*  There  ls«  critical  need  to  determine  how  much  this 

>UtistJical  procedure  ina^  (ijjfluence  the  type.pf  test  items  -selected,  and  what  impact  deci- 
sions by  statisticians  may  l|^ve  on  the  way  minority  ability  is  profiled  on  standard  tests. 

In  addition)  since,  tjiere  is  considerable  dependency  on  this  procedure  in  test  construe- 
tloni  we  again  (luestion  ^hejher  there  up  not  other  methods  which  ml^t  be  coinpari^ble  in 
objective,  but  more  sensjitiile^  the  way  different  groups  exhlblt.thelr  abilities.  In  essence, 
we  request  a  broadenlni;  of  methods  of  test  construction  and  assessments  particularly  adopt- 
Injg  those  whipb  would  P^Qviite  a  fair  reoresentation  ofydlvidual  and  group  skills. 

6.  One  area  of  tes^ng  which  has  been,  controversial  is  the  issue  d  standardlgatlon 
procedurea.  the  developinent  of  norms  for  a  given  population.  Essentially,  this  Involves 
profiling  the  range  of  cam)|)etenoe  demonstrated  by.  a  population  on  a  set  of  questions  com- 
prising a  test*  These  are  ultimately  refined  into  standards  to  which  levels  of  individual 
achievement  are  to  be  coibpared.  Central  to  this  procedure  is  to  profile  the  range  of  test 
performance  from  a  gepresentative  assortment  of  Individuals  and  groups.  It  has  always  ^ 
•  been  a  ooncem  of  minorities  taat  ap  a  group  we  have  not  been  adequately  represented  in  the  . 
i^rmative  populations.  Recently,  some  testing  agencies  have  attempted  to  re  viae  their 
.4K>rma  by  including. a  broader  representation  of  tnlnoritles  in  the  sample  (e*S*i  Wesdhler,- 
Ototemgence  So^eior  Children.  Revised  (WlSC-Rh)  There  1»  still  cbntrovprsy  as  to  whether 
proportionate  representation  wilnresolve  the'lskue  of  fairness.  The  selection  process 
'  should  include  those  factors  (9.  g.\  sboio-econpmic  .apd  geographical  residency)  that  are 
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approj^iritfie  for  the  reprdsentat^ve  group  which  Is  to  be  toBtod.  If  the  niajor  concern  16  to 
have  a  test  whieh  ie  representative  of  the  general  population,  the  majority  group  in  this 
country  (whites)  will  prevail  in  the  p^rformanceYesults  of  the  test.  Consequently,  the 
peers  to  whom  one's  ability  is  compared  are  essentially  representative  of  the  standards 
set  by  individuals  or  groups  outside  the  target  populations.      '  ' 

6..  Two^major  conce  rns  about  tests  are  whether       are  reliable  and  whether  they 
are  valid.  By  reltfibility  id  meant  the  consistency  of  a  p^erson's  performance  on  a  test  if 
repeated;  that  is,  confidence  that  the  level  of  an  individual's  or  group's  pei^rmance  will 
not  vtLty  significantly  the  second  time  around.  Vaiidity  of  a  test  focuses  on  the  truth  or 
accuracy  of  test  results,  the  decree  of  faith  that  can  be  placed  in  the  test  w  measuring  what 
it  clatnlB  to  measure*.  The  importance  of  these  dimensions  for  the  issue  of  test  fairness  for 
minorities  rests  with  the  interdopendency  of  these  two  factors.  A  test  should  be  both  highly 
valid  and  highly  reliablet  This  is  not  always  the  case.  A  test  with  little  validity  may  be  re* 
liable  (i>e, ,  one's  performance  may  be  consistently  higher  low  in  a  test- re  test' circum- 
stance)^ but  the  content  or  predictive  capability  may  be  unrelated  to  the  test  objective  or  .  a 
thie  desired  basis  for  judgnjpnts,   Paronthelically,  this  is  ah  issue  in  tKe  IQ  controversyi  / 

Similarly,  a  test  may  wrongly  be  considered  valid  if  it  meets  only  one  or  some  oriX 
teria—rthat  is,  If  it  had  content  validity,  predictive  v^idity,  concurrent  validity  and/or  I 
construot  validity,  In  the  testing  controversy,  discussion  tends  to  center  on  predictive  and 
content  validity.  The  issue  of  ^'culturally  biased  tests"  principal]^  refers  to  the  fact  that  the 

contents  of  tests  are  not  representative  of  th.6  socio-educational  experiences  of  minorities, 

■'■*.*■ 

The  predictive  validity  of  any  tegt  can  really  be  Do  better  than  the  defined  future  for  which  . 
probable  success  is  being  predicted  (i,e,,  success  in  school  or  oo  the  job).  The  numerous 
issues  within  the  meaning  and  significance  of  validily  and  reliability  of  tests  (particularly  as 
germane  to  the  use  and  abuse  of'tests)  requires  that  this  area  not  be  treated  lightly,  The 
t)ublic  must  fully  UnderstaiKl  the  oonsequences  in  the  assessment  cap^abillties  of  a  test  when 
it  does  Jiot  meet  acceptable  standards  of  validity  and  reliability, 

7.  Cut-off  scores  and  griterion  variables  are  two  othej  important  faotoris  in  the  testing 
process.  By  cut-off  scores  Is  meant  the  point  at  which  a  person's  performance  (a  test  score) 
permits  a  judgment  about  acceptance  or  rejection,  that  is;  his  or  her  abili^  or  potential  in 
terms  of  likelihood  of  success,  Related  to  cut-off  scores  is  the  criterion  variable  or  the 
performance  goal.  This  refers  to  skillswhich  a  person  or  institution  establishes  as  rep* 
resentative  of  acceptable  performance.  For  example,  a  criterion  variable  for  college  ad*, 
missions  is  /'potential  grade  point  average'^  This  4b  purported  to  be  indicative  of  college 
success^  It  may  be  (determined  that  scores  at  a  particular  level  on  a  test  correspond  to  a 
projected  level  of  perfonnance  in  college  (l,e,,  expected  OPA)j  Consequently,  as  in  the  case 
of  admlssiODB  tests,  e«f »,  Ck)llege  Boards  (SAT)  or  Graduate  Record  E:xQt|(natlon  (GRE),  a 
person's  score  supposedly  serves  as  a.  predictor  of  the  level  of  achievement  he  or  she  will 
attain.  By  looking  at  the  relationship  between  the  admissions  tests  scores  of  students  who 


are  suoceBBfol  in  college,  sohools  establish  their  **out«off  aoores"  aa  well  as  oriterion 
variables.  ^         *  '       .  ' 

The  Task  Force's  diffioalty  with  this  pi^ooess  la  that  prediotlon  models  of  potential 
success^  build  a  dependency  on  two  factors     the  'test  score  and  the  institution's  definition 
of  ^'success with  little  consideration  for  oth^r  factors  which  might  contribute  to  a  peT- 
son's  Success  (e.g.  i  motivation).  -As  previously  nctedi  if  there. are  serious  questions  about., 
the  validity  of  a  test i  then  the  stgniflcange  of  the  test  scores  is  brought  into  question.  Fur- 
thonniiiirai  if  test  scores  are  used  in  a  process  of  s|||Bctlon  based  on  predlction«  the  criteria 
of  '^suco^s**  depends  upon  the  institution's  valid  appraisal  and  inclusion  of  all  salient  factors 
that  repr^entoompetent  performance.  Very  often  institutions  provide  a  narrow  definition 
of  BUC(|98S  or  s mill  required  (e«g.  i  sbccess  in  oollege  equids  potential  jgrside  point  average). 

'  Many  minorities -are  denied  access '  to  e^lucatlonal  oppprtunity  because  of  institutional 
dependence  on  poorly  determined  levels  of  cut-off  scores,  or  are  .enrolled  in  institutions  . 
where,  if  traditional  criteria  of  selection  had  been  employed^  they  would  have  been  excluded 
from  this  opportunity  (a  case  lb  point  is  the  City  Universit^^J^ew  York's  Open  Admission^ 
Policy). 

■    B.  Because  standardised  tests  are  reasonably  short,  economical  and  easy  to  admin-  . 
later,  they  have  become  th/d  most^onvenient  method  of  assessment.  The  task  Force's 
concern  is  that  this  dependency  on  such  a  structured  format  has  limited  the  exploration  of 
other  means  of  assessing  intellectual  ability.  We  are  co&cerned  hot  only  with  the  limited 
domain  of  demonstrated  competence  on  which  tests  tend  to  focus,  but  also  the  limited  strate- 
gies of  assessment  (e,g.,  itandardlsed  pencil  and  papor  tests)  employed  by  insti^tipns.  It 
seems  unfair  to  Judge  the  obviously  broad  capacities  of  human  growth  and  deyelofiment  in 
such  a  narrow  manner,  likewise,  given  the  breadth  and  variety  of  human  social  experience 
it  seems  unfair  to  build  dependency  on  measures  which  actually  test  oniy  for  degrees  of 
conformity  (in  knowledge  and  expedience)  among  the  general  population  —  not  innate  abilities. 
The  judgments  abou^  one^s  ability  and,,  subsequently,  the  consequenoef  for  one's  Ufe  are  too 
Important  to  be  limited  to  performance  on  tests.  Other  alternative  means  for  measuring  and 
predicting  human  potential  and  capacity  mustHt>e  developed  and  employed.  The  multitude  of 
asiitssment  strategies  must  reflect  the  pluralistic  compositions  of  American  society,  ^^is 
iflino  easy  accomplishment,  but  at  the  same  time  this  objective  must  not  be  ignored  at  the 
eTqiense  of  someone's  life  opportunities.  ^ 

9.  The  importance  of  how  a  test  is  used  is  an  enormous  issue  In  and  of  itself.  Within 
thlf  Report,  another  Task  Force  is  discussing  this  problem  alone.  Although  the  content  of 
that  Task  Force's  Heport  covers  this  issue  In  depth;  it  cannot  be  overemphasited  that  the 
qualifications  of  th»»xa|n|ner  or  test  user  are  equal  to,  if  not  more  toportant  than,  the  testa 
which  ar<>  used»  since  even  the  best  instrument  in  the  hands  6f  unouAllfled  users  can  lead  to 
disastrous  results.  *No  meohanls^  eidtfis  at  present  to  Insure  that  onlv  we  Unqualified  per- 
■sdbs  (or  agencies)  will  use  thsf  tests  or  establish  polloies  and  procedures  based  upon  test 
results. 


'  10.  The  Task  Force  on  Uae  and^sufle  of  featp  speaks^  specifically  to  the  current 
objective  of  ^'criterion-referenced**  ^B^l  Therefore,  this  Task  Force  will  addresa  Itself  to 
a  related  assessment  methodology,  l.e.,NleVelopi&ent  of  teats  which  are  a  derivative  of  the. 
social  and  cultural  experiences  of  the  specific  group  to  be  tested.  Tests  of  this  nature  are 
considered  ' 'culture -specific  tests'**  The  utility  of  these  tests  baa  been  hotly  debated;  but 
in  the  Task  Force's  Judgdient  they  serve  a  purpose  —  if  only  In  delineating  the  context  and 
content  of  learning  experiences  for  that  particular  group*  In,  this  regard,  It  1^9t>^^ved  that 
efforts  to  develop  '^culture-specific  tests"  aa  an  inductive  procedure  ultimately  ad^cea  our 
knowledge  from  specific  bases  of .  Information  to  those  common  features  which  deacrihe  the 
genetal  population.  ^Ith  the  current  teat-^lndustry  effort  to  find  the  domains  of  convergence 
In  excellence  and  performance  of  a  general  population  (whlob  in  effect  atandardlzed  tests  do), 
little  weight  is  given  to  the  idiosyncratic  nature  ^  leamlng.~iri8  this  Task  Force's^Jb^lef 
UiatielHO tandard l zed  both  for  the  general  population  and  for  apeclflo  populations  a()jc}  to  the* 
information  on  variations  in  the  acquisition  of  knowledge.  Within  a  pluralistic  socle^,  we^ 
must  know  what  pebple  have  in  common,  but  also  where  they  differ,  without  discrediting 
either  in  the  quest  for  understanding.  To  6eek  a  test  which  la  ''oultur»-free"  in  content  la 
nice  in  theory*  but  to  date  has  proven  impractical.  There  la  very  little  tha(  can  be  IdenU- 
f led  which  is  not  influenced  by  the  cultural  context  in  which  it  is  nurtured  and  expressedt 
In  general,  the  Task  Force  'endorses  the  efforts  to  develop  and  refine  criterion-referenced 
and  culture-apeclfic  teats  as  part  of  alternative  assessment  strategies. 

In  conclusion,  . the  Task  Force  on  the  Psychometric  Integrity  of  Tests  recognizes  that 
there  are  many  technical  Issues  involved  in  the  construction^f  tests.  These  must  be  con- 
sidered within  the  context  of  their  Impact  on  fairness  in  testing  minorities.  Becauae  of  the  ^ 
complexity  of  many  of  the  areas  discussed  within  this  report,  it  should  not  be  construed  that 
all  points  have  been  raised  —  much  less  exhausted.  Olie  Task  Forpe  has  tried  tq  highlight 
what  coQstitutes  some  of  the  major  concerns  presented  to  minorities  by  the  technical  pro-  • 
ceaa  in  test  construction.  As  in  so  many  other  profesalonal  areas,  minority  professlonala 
are  badly  under-represented  in  the  teating  Industry.  In  particular,  the  contribution  of 
minorities  within  the  institutions  and  agencies  which  develop  teats  and  set  policy  has  been 
negligible*  The  test  development  proceas  has  remained  untouched  by  an  external  system  of 
public  accountability.  The  consequences  to  one's  life  from  performance  on  tests  can  be  as  . 
pivotal  as  any  llfesaving  drug.  In  the  latter  instance,  there  is  public  acQOuntabllity  (l«e« , 
FDA),  in  the  former,  there  is  none.  The  following  recommendations  of  this  Task  Force  are 
a  step  in  the  direction  of  public  accountability  of  the  testing  industry* 

RECOMMENDATIONS  ' 

The  Task  Toroa  asuarts  that  the  basic  goals  and  purposes  of  assessment  are  as  ap^ 
proprlate  for  minority  individuals  as  for  persons  in  the  majority  group*  It  is  the  oonsenatis 
of  the  Task  Fonoa  that  there  can  be  a  meaningful  and  worthwhile  place  for  the  testing  fUnc- 
.  tion  in  the  asseasnrtent  of  indlvldualsu  However,  the  Issues  which  concern  the  NAACP,  and 
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in  faoti  the  r^i^j^ea  of  this  ConferenoOi  relate  to  the  cobatrainta  and  roitrlotlona  placed  on 
minorities  by  testing;  by  the  fact  that  those  negative  results  preclude  access  to  educational.  . 
and  oooupatlonal  advancement;  by  the  absence  of  social  and  cultural  consideration^  In  test 
ooostruotioD;  and  by  individual  and  group  values  which  affect  test  performance  and  Int^r-  f 
.  pretatlon.  / 
.    .    The  Task  Forpe*s  Interpreftatilon  of^the^ReAolutlon  adopted  by  the  6Sth  NAACP  Annual 
Coiiventibn»  Is  that  It  serves  |w  a  means  for  Identifying  the  need  to  Investigate  the  concerns 
of  minoriUes  in  tesUng.  It  has  also  provided  opportunity  for  study  which  may  devise  better 
ways  of  developing  and  using  test  data. 

SPECiriC  RECOMilENPATIOWS 

f      1.    NormiUlve  procedures  and  specification  must  b^  carefiiUy  developed 
to  ensure  fairness  to  the  test-<takingl[>opulatlon«   Information  of  this  - 
type  should  not  be  used  for  minority  groups  or  individuals  without 
appropriate  normlng  (study)  on  that  population* 

2#    the  test  development  process  mus|  consider  the  different  cognitive 
itructures  and  styles  of  different  groups*  Studies  relaied  to  minority 
test  performance  indicate  that  group  differences  do  affect  performance. 
Factor  anabrtical  metbbds  may  yield  information  relevant  to  under- 

^     standing  these  cognitive  stmtureA; and  styles,  biit  there  still  remains 
the  prc^lem  of  how  these  factors  are  related  to  effective  performance » 

a.    The  test  seleotlon-prediotlve  system  should  include  pther  variables ,  * 
^•g*  I  mottvation»  persistence,  "oreativity**i  and  other  personality 
measures.  There  is  frequent  mention  of  these  important  factors  in 
the  discussion  of  minority  assessmenti  with  little  follow-through* 

.  4.    The  relationship  between  the  time  factor  and  test  resulU  should  be 

expanded  with  minority  groups*  This  exploration  should  not  be  limited  - 
to  test  speedlnessi  but  also  to  the  length  of  time  oovered  by  the 
criterion  measure*  '  « 

5*   The  test  admlnistraUon  process,  both  for  individual  aiid  for  groups 
testing  situations  needs  to  be  monitored  to  ensui^  quality  control  of- 
tests  resuJits*  We  recommend  that  guidelines  be  developed  that  will 
provide  opportunities  for  optimum  test  performative* 

9*    Culture-speolfto  tests  should  be  considered  an  integral  part  of  the 

test  oonmuotlon  process*  \    '  \ 

^.7,    NoUng  (iMlffloulty  of  establishing  the  relevant  criteria,  particularly 
where  pi|dlotive  validity  strategies  are  used,  it  is  strongly  recom- 
mended that  oultur^Uy-*appropriate  and  .content- valid,  orUerion- 


referenced  procedures  be  inveitlgatod  and  adopted.  Some  guidance 
should  be  provided  to  the  development  of  criterion  Ararlables,  t.f.  • 
testa  fpr  firemen  I  policemen  I  eto. 

6«   The  development  of.altematlve  strategies  In  assessment  Is. strongly 
encouraged.  '  ^ 

9.  There  should  be  a  thorough  review  of  current  tesU  being  used. 
NAACPi  ABPsI,      others  should  actively  pursue  the  possibility 
of  seeking  funding  sources  for  such  a  projectt 

10.  There  should  be  a  concerted  effort  by  tesUng  Industries  and  pro- 
fessloosl  schools  to  recruit  and  train  more  minority  persons  In 

^  •     psychontetrio  techniques.  Furthermore,  testing  Industries  should 
increase  partloipiUon  of  minority  professlonq^ls  In  tUfS^ni  develop- 
ment process. 


ON  PUBUC  POLICY 


INTRODUCTION 


We  live  in  a  highly  diverse,  hl^ly  oonipetltive,  oredential-orlented  sodlety  Where 
•U0C688  and  winning  have  become  sp  prlzed^ihat  often  they  beoonie  ends  within  theinselves. 
As  a  result  of  the  frenetic  mlUeu  created  by  this  kind  of  attitude  and  philosophy  on  the  part 
of  most  Anerioans,  an" Increasing  number     assessment  tools  and  techniques  are  being 
employed  to  faolUtate  the  clajiiflCatlon,  stratification  ai^d  certlflcation^of  Individuals  and 
groups  in  our  society.       M  ■ . 

The  fact  that  testing^  the  results  of  testing  (assessment)  have  had  (and  continue  to 
have)  a  strong  impact  upon  public  policy. Is  not  hew*  A  review  of  litigation  Involving  the' 
.  alleged  mleuse  of  tests  by  certain  businesses  and  certain  Industries  and  the  results  of 
judgments  in  those  cases  indicated  clearly  the  role  that  testing  has  played  in  hiring  practices 
and  the  Impact  that  they  were  seen  to  have  on  policy*  The  cases  to  which  we  allude  here 
Involved  white  plaintiffs* 

The  determination -of  public  policy  related  to  the  tesUng  of  minorities  (and  more  par- 
tlcularly  American  blacks)  hAs  been  Insidious  sjkI  extremely  deleterious*  The  history  of 
our  country  Is  replete  with  evidence  of  so-called  scientific  material  designed  to  show  the 
Infertorlty  of  the  Negro.  The  Police  Reference  Notebook  states,  "A  large  body  of  literature 
came  bio  existence  to  prove  fhat  the  Negro  was  iinper/ectly  developed  In  mind  and  body,  . 
tha/he  belonged  to  a  lower  order  of  man,  that  slavery  was  right  on  ethnic,  economic  and 
social  grounds***"   The  rationale  for  counting  slaves  as  three -fifths  of  a  person  for  de- 
termining the  number  of  rspresentatives  that  a  state  might  send  to  Congress  was  based  on 
"sclentUic^*  tests  that  *'pr|ved"  the  Inferiority  of  the  Negro.  For  centuries  blacks  were  dis- 
franchised <>y  the  use  of  "tests.*"  It  Is  unnecessary  to  belabor  th^se  historic  truths;  It  Is 

portant  to  realize,  however,  that  testing  helped  weave  the  racist  fabric  of  the  United 
States.  There  are  dally,  painful  reminders  that  white  racism  (the  unfair  treatment  of  non- 
white  persons,  based  solely  OQ  skin  color)  continues  to  flourish  In  the  United  dtotes.  The 
insidious  character  of  white  racism  (and  the  most  dangerous  component  of  Its  Insidious 
nature)  Is  most  harmful  when  It  becomes  an  Inextricable  part  of  test  cohstructlonX  This 
situation  can  obtain  without  the  conscious  participation  of  the  developer  or  publlshe 
Nevertheless  the  disastrous  results,  however  unintentional,  are  assured*  When  public 
policy  Is  based  on  an  already  abusive  Instrument  and  the  Interpretation  of  an  insftnsitl 
researcher,  persons  belonging  to  minority  groups  are  exposed  to  a  vaj^ety  of  In 
and  unethical  behaviors  and  treatments^  ^  ^ 

THE  PROBLEM 

The  Task  Force  on  Public  Policy,  In  Its  concern  about  the  impact  of  tests  on  public 
policyi  felt  It  Itioumbent  upon  its  members  to  consider  various  facets  of  the  problem .  That 


Is. to  say,  thet>erson  who  uses  the  test  and  the  Individual  who  formulates  public  policy  are 
aB  important  hs  are  the  teats,  In  the  overall  conBl(iesatlon.  Naturally,  the  publisher  musi. 
assume  his  part  of  the  total  responsibility  for  fair  and  equitable  public  policy.  - 

Some  of  the  psychometric  instruments  having  the  greatest  impact  upon  public  policy 
have  been:  ^ 

.     .   .1.  tests  of  "intelligence"  I'ests) 
*  2,  Personality  Tests  -  ^ 

3.  Placement  Tests 

4.  Achievement  Tests 

^  ,       6.  American  College  Testing  Program  (ACT) 

.  '        '      6.  Scholastic  Aptitude  Test  (SAT]r  . 

7.  NUller's  Analogies  V 

8.  Graduate  Record  Examination  (GRE)  . 

9.  Interest  Inventories  ^ 

10.  Graduate  Management  Admissions  Test  (G^T) 

11.  Law  School  Admissions  Test  (LSAT) 

12.  Medical  College  Admissions  Test  (MCAT) 

13.  Other  Admission  or  Aptitude  Tests 
Certain  questionnaires  h^e  also  been  responsible  for  questionable  public  policy,  buf 

this  Task  Force  could  not  consider  them  as  a  part  of  this  report. 

RECOMMENDApONSo 

After  careful  study  of  the  charge  to  the  members  of  the  Task  Force,  and  following  in- 
depth  deliberations,,  the  Task  F^rce  on  Public  Policy  makes  the  following  recommendations: 

1,  There  should  be  a  moratorium  on  all  current  standardized  testa  i  unless  these 
'instruments  conform  to  recommendations  submitted  by  the  other  Task  Forces  that  comprise 
the  Conference  on  Minority  Testing. 

This  recommendation  is  based  on  studies  which  (end  to  prove  that  most  standardized 
tests  are  inherently  racist  (intentionally  and  unintentionally)  and  that  they  dg  discriminate 
against  minorities.  The  precedent  for  calling  for  this  moratorium  has  been  set  by  (a)- the 
National  Association  for  the  Advancement  of  Colored  People  (NAACP),  (b)  the  National 
EducaUon  Assoptfttion  (NEA),.  (c)  the  Association  of  Black  Psychologists  (ABPsl),  and  (d) 
the  Na^onal  AssooUtion  of  Elementary  School  Principals  (NAESP). 

This  call  for  ijnoratorlum  does  not  mean  that  all  forms  of  assessment  should  be 
abolished.  Some  forik  of  assessment  is  and  will  always  ^  necessary.  It  does  recognise 
the  damage  that  has  bJin  done  and  is  being  done  as  a  result  of  public  policy  based  on  the 
spurious  results.  ot)taln0d  by  the  use  ^questionable  instruments,  fts  well  as  by  men  whoso 
motives  and  preparation  for  their  wy^k are  questionable* 

The  over-representation  of  mlnoritdos  in  Special  Education  classes  across  the  coun- 
try and  the  many  cases  of  litigation  Yesulting  from  the  misuse  or  abusp  of  I. Q..  tests  gives 


further  oredepoe  to  this  recoinniendation.  The  labels  reiultlng  from* the  misuse  of  t,Q, 

•  tests  and  the  damage  to  the  victims  of  the^e  labels  are  evident  In  our  public  schools* 
Loss  of  financial  assistance  both  for  programs  and  for  individuals  have  resulted  from 

public  policy,  bassd  on  student  achievement.  A  case  in  polnAis  the  Head  Start  Program  that 
actually  was  veiy  subcessful,  but  was  Judged  on  lU-cbnceived  measures 'and  Improper 
assessment  tools.  Oth!er  programs  have  suffered  budget  cuts  or  have  been  eliminated  on  the 

*  basis  ortest  results»  it  wai  the  test  jhat  wiCs  the  failure^  not  tlm  program.  The  same 
may  be  said  for  many  studients  who  have  been  denied  financial  assistance  for  their  education 
based  largwy  or  solely  on  test  results. 

The  Graduate  Re6ord  Examlnatipn  has  a  very  poor  predictive  record  but  universities 
continue  tause  it  as  an  exclusionary  instrui»ent«  Standardised  Admissions  tests  for  entrance 
to  coUegit  and  professional  schools  have  such  questionable  predictive  validity  for  certain  , 
segments  of  our  student  population  that^m|oratbriui»  would  seem  to  benefit  all  app^gants  — 
not  Just  black  applicants*  ..    -     ^       y  ^ 

There  are.suffioient^studies  to  support  this  position.  Some  of  these  can  b^ found  in  the 
iippended  bibllo||raphy.  It  Is  both  unethical  and  inapproprUte  to  base  public,  policy  on  any 
rosults  obtained  throui^  the  use  of  current  I.Q.  tests  on  minority  groups. 

.  2.  It  IS  recommended  that  a  national  monitoring  body»  with  the  power  to  enforce^, 
throu^  sanctions •  be  established  to  assure  proper  assessment  and  policy  regarding  the 
administratioh  of  assessment  tools. 

-    Without  such  a  monitoring  body»  'there^is  no  guarantee  that  even.le^slation  related  to 
ethiOal  testing  jj^ocedures  will  be  honored.  This  group  should  be  >  national  body  aiid  should^ 
by  composition  and  sensitivity,  Reflect  the  best  Interests  of  our  V|rious  minority  populations 
along  With  those  of  the  majority.  Selection  procedures  may  be. determined  after  further 
delibetration.  .  '  ;  ^ 

A  test  or  other  assessment  tool  is  no  better  than  its  user,  Wa  are  concerned  about 
what  maybe  called  the  "experimenter  variable^"  Ue.,  Aen  the  value  of  an  acceptable  in-  . 
'strument  may  be  destroyed  by  one  who  is  not  qualified  professionally  or  |>etsonally.  The 
individual  who  assumes  the  responsibility  of  interpreting  the  test  results^  minority  group 
individuals  muit  be  senaittve  \o  the  nuances  of  the  many  cultures  within  our  pluralistic 
.  society.  An  Insensitive  person  can  contaminate  test  resiilts^r  adversely  affect  the  individual 
being  tested  by  even  unconscious  n^anlfestations  of  his  insensitivity.  This  position »  too»  is 
. '  based  onjreaisatoh  in  this  area, 

r  AnMiftl'Mi^^  tligt  develop^  publish^  and  sell  tests  must  assume  (or  continue  to  assume) 


a  njaJoPrespobsiblllty.  for  assuring  the  corrections  of  Ills  related  to  their  product.  This 
Task  Force  hua  stn>ng  feelings  about  this  issue,  and  concurs  with  the  other  Taqk  Forces  on. 
the  mandatory  nature  of  this  obligation. 

4.  The  Appointment  to  publle  office  or  thB  nomination  and  election  to  office  (particularly 
as  that  office  Involves  th^jlsstabllshment  of  public  policy  based  upon  the  testing  process) 
should»alwaysi)e  based  upiSl^il^indL^^       knowledge  of.  sensitivity  to»  and  ability  to  bon- 
ve^rse  with  £^1  segments  ofaooJ^^Jrsinoe  all  will  be  affected. 

9.  No  individual  ourrentl)^  public  office  should  make  decisions  about  public,  policy 
based  on  this  results  of  testing  ^J^Nftearoh  on  minority  groups  ivithouti^e  concurrence  of 
groups,  organisations  or  indivldufls  most  knowledgeable  of  and  conveMmt  with  lire-*styles» 
value-aUltu()ef|  and  "experienoe-itt-*AiDerioa"  of  those  minority  groups,  .  ^ 
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FAIR  TE3TIN0  CODE 

PREAMBLE  /      \  -  j  / 

.  In  a  purport^  xnerltooratlc  '4nd  adversarial  milieu  in  wbloh  so  much  credence  Is  " 
placed       ^ucatlbn,  and  In  all  of  the  values  and  status  derived  Crom  It,  the  need  for 
evaluative  crltarU  and  assessment  tools  Is  prominent.  From  the  cr.adio  to  the  grave  there . 
has  been  an  Increasing  reliance  In  thif  country  t>n  the  use  of  an  assortment  of  standardized 
tests^to  screen r  selectV  admit,  rejects  to.classify,  stratify,  track,  license  or  certify^  Such 
subjective  dependence,  on  **obJective*'  tools  makes  U  possible,  and  ev^n  attractive  In  some 
quarters,  to  use  them  inequitably  in  ways  which  preclude  a  segmentW  the  population  from 
reaching  the  heights  of  Its  asplratloQS  and  realising  Its  potential,  or  from  acquiring  the 
skills  and  financial  resources  to  develop  t^elr  own. 

^    In  order  to  prevent  the  further  m  Isuse.of  tests  or  oth^r  measuring  device»|  to  dispel 
existing  myths  about  their  Infallibility,  to  ensure  a' fair  and  equitable  use  across  all  seg-  ^ 
ments  of  the  population  And  to  promote  Uie  Intended  best  use  of  standardized  tests,  thoptest- 
ing  Industry  and  those  who  subscribe  to  the^t  services  must  become  mbi^e  Introspective  aboutf^ 
the  impact  of  the  testing  phenomenon. '   ^         •  ^ 

'    ^    Further,  the  testing  Industry  must  assume^a  greater  responsibility  In  correcting  the 

•         ■  ■   ■  < 

abuses  and  misuses  that  result  frotaii;4|2B)^oatlon  of  their  products  (tests),  which  attempt  to 

measure  intelligence,  ability,  aptitude,  achlevementi  and  other  potei^als,  matters  which 

are  critically  Impi^tant  for  participating  In  the  mainstream  of  society^  The  TaskyForce  oh. 


TaskyFo 
only  to  ( 


the  Code  for.  Tests  and  Testjitg  callsrupon  both  the  Industry  and  the  user,  not  omy  to  engage 
in  introspection,'  t^ut  to  adof^t  the  code  which  foUo^ys,  and  to  be  governed  by  It  as  they  con-  . 
tlnue  to  work  with  tests  and  test- related  activities*  '      .  .  '  "^ 

CONSTRUCTION  OF  TESTS 

Testa,  regardless  of  their  claims  of  objectivity*  are  a  reflection  of  the  experiences! 
oharactetlstlcs,  values  and  training  of  those  individuals  who  construct  them.  Many  pf  these 
tests  jge. then  used  in  the  declsion-^m^king  process  which  determines  the.future  of  minority 
peopl^ivho  are  excluded  from  the  developmental  process.  T^ae  tests  which  are  admlnr 
Utered  w^ely  to  minority  and  maiority;^ople  alike,  and  which  attempt  to  measur^intelU-  ' 
gence,  achievement,  aptitude  and  to  predict  the  potential  of  all  test- takers,  must  employ  . 
trained  persons  who  have  experienced  life  as. a  member  of  a  minority.  Minority  reprepen- 
^  tation  must  be  Involved  in  the  process  of  conceptualizing. and  developing  tests.  More  spe- 
cifically, minority  persons  must  be  involved  in  the  overall  development  from  Its  initial 
cpnceptusllKation  to  the  Qnal  product*  As  ah  alternative,  minorities  may  be  forced  to  find 
flnanoil^resources  and  to  (^Velop  Aelr      testing  programs  ^ 

*  Minority  people  as  used  in  this  Code  designates  the  following:  Black,  Spanish  speaking 
(Puerto  Rioans,  HiSpanlos,  Chicanes,  l4ftinos)(  Native  Americans  (Indians);  Aslan- 
Americandl  (Japanese ,  Chinese,  other  orientals)*  * 


/ 
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STANDAHDIZATION  process  ; 

Slnoe  m^t  test  scores  are  Interpretable.only  in  relaUonBhlp  to  the  gr6up  on  which  the 
test. was  nqrindd  or  st^dardlzed»  and  sin^  the  nortning  process  ii  so  critical  to  the  entire 
obnoept  of  standardised  tes.tS|  the  testi^  industry  Is  called  upon  to  define  and  inake  public 
in  prominent,  clear  and  approprlatoliteraturelhe  process     which  its  te9ts  were  stan-  . 
dardised,  Furtherp  sinc^  there  exists  an  assunaptlon  that  bla^cks  and  other  minorities  are 
lAuilUy  at  or  below  the  norm  of/their  white  counterparts,  it  is  imperative  that  the  norms 
reflect  the^luralistlo  characteristics  of  the  different  ethnic  groups  that  ttake  up  Ihe  tested, 
population,  Kbt  only  shouli^  minority  pc^ople  be  included  in  the  nprming  populatloni  but  the 
testing  industry  must  id^niify  the  sample  charapteiisticB  on  and  by  which  the  test  was  stan- 
dardised* 


CONDITIONS  OF/ADMINISTRATIOK  i 

Inasmuch  as  the  tejit  results  of  individuals  frequently  have  immeasurable  influence  on 
their  status  in  life^  the  testing  industry  and  those  wfllo  administer  tests  should  ensure  that 
optimal  and  v^M^rm  conditions  always  iirevalU  For  example,  where  centers  are  established 
'for  local  administration  of  nationwide  tests  consideration  should  be  given  to  logistical  prob- 
lems, e.g. ,  the  dhitance  candidates  igre  required  to  travel •  Buildings  should  be  propecly 
placanled  so  that  students  who  are  unfamiliar  with  the  location  of  testing  roQfts«  rest  rooms «  * 
and  other  critical  areas  are  not  disadvantaged.  Testing  rooms  should  be  well  lighted  and 
ventilated  and  should  contain  writing  surfaces  which  are  comfortfible  fof  all.  Proctors 
should'i)^  hix4d  to  reflect  the  ethnidjmako  up  of  the  candidates  being  tested.  All  Proctors 
must  be.BGfnsitive  to  the  need9»  questio^  and/or  anxieties  of  all  candidates. 

No  individual  may  be  permitted  to  administer  tests  to  meml^rs  of  minority  groups  or 
to  interpret  sUbh  data  unless  (a)  he  is  duly  qualified  and  proficient  in  th6  technical  aspects  of 
the  testing  process  and  (b)  he  can  demonstxiate  a  kden  sensitivity  to  the  life-styles,  value- 
« attitudes  and  "experience-in-America"  of  the  several  populations  being  submitted  to  the 
assessment  procedures. 

In  sumfiiary,  there  should  be  a^regulatory  mechanism  which  not  only  monitors  test 
adipinistration,      one  which  takes  the  necessary  corrective  actions  to  proscribe  irregular 
and  unfair  administration  of  tests,         •  . 

LIMITATIONS  OF  USES'  ' 

Failure  to  adhere  to  a  oq^  of  i)onduct  or  to  regulate  oneself,  on  thQ  part  of  the  test  - 
developer  and  the  test  user  could  not  only  escalate  the  now  rampant  misconceptions  that^ 
exist  about  standardised  tests,  but  also  invite^xtemal  regulation  of  the  testing  industry,  ^ 
Th0  testing  industry,  accompanied  by  the  ^si  user,  must  take  tlie  lead  in  divesting  itself  of  | 
the  misconceptions  about  what  tests  can  and  cannot  d5»  and  then  in  dispelling  similar  mlB* 
^  understandings  among  ^e  pu^lic-at-large,  and  ultimateiy  in  promoting  a  more  diagnostic, 
cautious  and  creative  use  of  tests,  in  the  eduoaUonal  process,  to  wit; 


Intelligence  Testo  (or  ability  teata)  —  the|je  ia  a  notion  held  by  . 
many  teat  uaera  that  intelligence  or  aptitude  la  synpnyinouB  with 
an  immutable  or  fixed  charaoteriatio  wlt)iin  an  individual.  Tfaia 
#fixatiort,  or  one's  ''native  ability,*'  ia  said  to  determine  wtmt  ia 
expected  of  onct  and  also  one's  level  of  expectation  for  all  time, 
.The  testing  Industry  ^lua)  deacribe  and  publfdze  the  fact  that  its  , 
Intelligence  or  aptitude  teita  do  not  meaaure.  in  an  interpretable 
manner,  one's  level  of  expectation  tl^roughout  lifci  The  industry' 
must  be  toor6  forthright  in  calling  attention  to  the  fact,  that  learning 
depends  not  only  on  U^erited  abilities  but  importantly,  also  upon 
life  experience  in  a  particular  environment.  Since  what  is  learned 
may  differ  according  to  one's  economic  status  In  life,  the  tests 
should  not  be  used  as  a  predeterminer  of  the  level  to  which  an 
individual  aspl  res  and  may^obtaln. 

Adroissionjs  tests     myriad  tests  are  produced  and  used  in  the 
admissions  process  ta  post-Becondary  and  to  graduate  insti^ions. 
Because  of  the  nature  of  the  admissions  process,  many  of  these 
teatff  are  used  not  to  admit  but  to  exQlude.  The  testing  industry 
must  define  the  proper  use  of  admissions  tests,  and  explicitly  ^ 
state  the  conditions  imder  which  tests  should  not  be  used.  The 
extent  to  which  a  test  is  Intended  to  piredict  one's  performance  at 
a  given  level  dlotatea  the  extent  to  which  the  instrument  must  be 
validated  on  the  entire  entering  popultittion.  The  testing  industry 
is  obliged  to  encouragp  strongly,  such  validation  of  admissions 
tests  and  to  perfect  a  lilodel  or  mechanispn  for  effecting  it.  . 

OoouDational  and  Professional  Tests  —  tests  for  occupational  and 
professional  certification  or^eiitry  should  be  job-related.  A  major 
issue  in  the  test-seledtion  process  is  whether  the  (est^asures 
abilities  appropriate  to  performance  in  the  job-souj^t.  The  lack 
of  correspdndince  between  test  requirements  and  job  requirements 
invalidates  the  teAt  (e.g« ,  using  broad  aptitude  or  aohievement  tests 
,  for  hiring  fl|fenpen  or  policemen).^f'itting  tH^  test  to  performance 
in  the  jobhds  become  the  current  objective  of  ^'criterion-referenced 
tests*'.  r^In  a  Job  selection  situation  this  approach  makes  sense. 
Its  utlliKation  in  other  assessment  contexts  needs  further  exploration 

The  U.S.  Supreme  Court  in  Grliys  v.  Duke  Power  Co.  held,* 
"If  an  employmeni  pr«ldtio^  which  cftei^tftes  to  exclude  Negroel 
cannot  be  shoWn  to     related  to  Job  perform ^jfibe,  the  practice  is 


■  "  \  ■  r 
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ilhAiblted.'*  Griggs  v«  Duke  Power  Co,  and  Chance  v.  New  York 
have  indicated  that  there  must  be  a  match  ^bonafide  reiatedneBs)     .  * 
between  the  test  content  and  the  sldlle  and  knowledge  needed  in 
perfonning  a  Job.  Where  there  is  a  tniaxnatoh  between  test  content 
and  expected  performance,  a  serious  barrier  is  established  for  the 
person  who  is  subjected  to  the  tests. 

The  Task  Forc^  on  the  CodS  for  TeVing  calls  on  the  testing 
Industry  to  refiidn  from  establishing  coDtracttial  relationships 
which  require  variance  from  guidelines  Bugge|sted  by  the  courts,  - 

CLEAR  INTERPRETATION  I 

 '■  '  ~  .    -  .     ■  \   .  ' 

.  '  Since  misconceptions  of  tests  can  lead  to  damaging  uses,  the  testing  Industry  is  obll- 

.  gated  to  make  full  disclosui^  of  the  purposes  for  which  tests  are  designed,  the  processes  by 
which  they  were  designed,  the  population  on  which  they  were  standardized,  the  statistical 
characteristics  whichdelimit  their  use*,  e.g.,  standard  error  of  melasurement,. standard 
error  of  estimate,  and  other  ^*do»s  and,don*ta"^ich  will  affect  optimal  use  and  interpreta- 
tion. More  specifically  It  is  incilmbQnt  upon  the  testing  industry  to  give  clear  and  precise 
Interpretation  of  the  scores  their  tests  yield.  The  public  must  be  Informed  not  only  that  the 
test  scores  are  fallible  arid  that  their  reliability  is  Imperfect,  but  must  be  told  the  extent  of 
that  fallaWllty  ai^  imperfection.  The  public  mupt  be  informed  tbat  test  scores  are  only  a 
sample  of  d  fltudept's  performance  and  are^ver  more  than  an  estimate' of  truth. 

>  CONSTRUCTIVE  USES  OF  TESTS  .  / 

Effective  uses  can  be  made  of  tests,  regardless  to  their  type,  only  if  the  usei'  knows 
what  the  test  contains,  what  its  purposes  are,  and  what  Its  limitations  are.  We  move  on  the 
f  assumption. that. an  educational  system,  and  particularly  a  school  within  the  system,  implicitly 
guarantees  that  students  to  ♦horn  achievement  examinations  (tests)  are  administered  have  k 
^•been  taught  In  wdys  such  that  they  can  reasonably  be  expected  to  have  learned  the  informntlonf 
required  by  the  examination.  Therefore,  we^call  on  the  testing  industry  to  assist  school 
systems  and  bther  users.in  understanding  better  the  content  and  constraints  of  the  exam ina* 
tions,  and  in  helping  them  understand  how  to  make  optimal  use  of  ihe  results.  Moreover,  We 
call  upon  the  ^cational  community  and  the  puMc  and  private  sectors  to  ensure  that  tests 
are  ;iot  used  or  relied  upon  where  such  guaranteed  do  not  exi&t. 

\  , 

RESEARCH 

We  recognize  that  many  people  question  whether  any  tests  haiye  credibility.  With  regard 
to  the  validity  of  jome  tests  the  evidence  is  incondfisive,  even  among  the  strongest  advocates 
of  testing.  Rebogntzlng  that  some  device  is  goin^to  be  used  to  determine  access  to  institu- 
tions,' jobs,  professions,  and  'other  opportunities  within  society,  and  to  determine  the  various 
•  ways  in  which  human*  resources  are  used,  we  assert  that  any  testing  program  which  ressilts 
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in  a  significantly  disproportionate  distribution  of  scores  by  ethnicity  must  meet  thp  most 
striAgent  validity  requirement*.  Therefore,  continued  test  use  must  be  contingent  upon 
intensified  and  continued  research  on  the  effects  (both  negative  an^  positive)  of  tests, 
on  the  edu^ional  opportun^ies  and  related  problems  of  blacrks  and  other  minorities.  ^ 
Some  of  this  research  needs  to  be  reactive  In  thQ  senBe  that  it  addresses  things  that 
have  occurred,  and  some  phould  looMhead  to  what  ought  to  be  done  to  circumvent  certain 
problems.  Quality  of  the  research ,  credibility  of  the  researcher  and  methodology  continue  . 
to  be  essential  elements.  The  need  exists  for  more  than  the  traditional  n)ethoddl6Ky  which 
has  characterized  the  testing  Industry's  efforts  in  the  past,  and,  which,  for  an  increased 
number  of  Human  Resources  agencies,  has 'also  become  standard  practice.  Just  as  impor- 
tant as  these  components  is  the  w«y  Inr  which  data  from  that  research  are  interpreted*  We 
call  on  the  testing  industry^  educational  systems,  and  public  and  private  Rectors  who  have  a 
vested  interest  in  education;  to  hire  and  use  black  and  other  minority  researchers  who  can 
assist  in  collecting,  analyzing  and  interpreting  that  critical  mass  of  data  which  can  help  us 
understand  the  effects  of  tests,  on  the  problems  of  minorities,  ]■  ^ 

BETTER  TRAINING  OF  USERS  IN  INTERPRETATION 

Teachers,  counselors  and  admissions  officers  are  publics  Important  to  (he  testing  in- 
dustiry  since  they  sit  at  the  entrance  gates  through  which  many  test  takers  must  go  if  they  are 
to  realize  their  goals.  The  extent i|d  which  these  publics  can  correctly  interpret  and  effec- 
tively use  those  instruments  Is  the  extent  to  which  decisions  will  be  made  that  are  fair  to 
minority  test  takers.  The  testing  Industry  is  called  upon  to  help  bridge  that  gap  which  exists 
between  effective  use  and  lack  of  understanding,  by  conducting  Workshops  and  institutes,  and 
'  writing  special  publications  that  are  aimed  at  interpretation  of  tests,  -  '  ^ 


%  .  ACTION  AGENDA 

The  recomnoendatlons  for  an  Action  Agenda  are  ordered  according  to  the  publlci;  toward 
whom  our  recommendatlonB  are  directed»  l»ei »  the  testlikg  Industry,  the  Association  of  Black 
Piychologlats I  the  NAACP  and  laymen.  ^  ^ 

THE  TESTING  INDUSTRY 

1.  Develop  and  punish  standfirds  of  compeienoe  for  those  who  adminlBter^  ^SQore  and/ 
or  interpret  tests*  1^ 

2.  It  Is  known  thkt  the  technical  Information  about  the  test  varies  from  one  cultural 
group  to  another,  often  in  highly  significant  proportion*  It  is  eSjiential  that  the  testing  In- 
dustry provide  technical  infornoatioA  appropriate  for  ethnic  groups  for  whom  the  testing  is 
done» 

3.  EstablUh  and  ftind  an  independent  research  and  development  corporation  to  identify 
the  critical  problems  in  assessment  as  they  relate  to  minority  groups;  sponsor  investigative 
research  and  development  work  involvljig  researchers  who  have  the  endorsement  of  jpninority  * 
group  professibnal  and  community  associations*  ^ 

4.  State  with  clarity  on  all  descriptive  information  concerning  tests  they  publish,  the 
specific  uaes  for  which  the  test  is  designed,  the  specific  limitations  of  the  in  strument  and  a 
full  explanation  as  to  how  the  results  should  be  interpreted  i 

5.  Establish  a  national  monitoring  body,  with  the  power  to  enforce,  thrqup^  sanctions, 
to  assure  proper  assessmept  and  policy  of  aesessnient  tools* 

ASSOCIATION  OF  BLACK  PSYCHOLOGISTS 

1*  Design  a  project  to  identify  some  of  the  major  tests  now  operating  to  screen  in- 
dividuals out  of  educational  and  employment  opportunities  and  develop  a  position  statement 
on  those  tests,  applying  the  Standards  for  Educational,  and  Psychological  Tests,  developed  by 
a  Joint  Committee  of  the  American  Psychological  Association,  Inc.,  American  Educational 
Research  Association  and  the  National  CouncU'on  Measurement  in  Education*  Th^  results  of 
the  Project  to  be  published  and  disseminated  widely  -  to  users  and  to  clients,  e.g.,* major 
school  districts,  counselors,  and  the  black  helping  professions  such  as  social  worker's  and 
nurses*  < 

2.  Develop  an  empirical  demonstration  project  for  refuting  the  kind  of  cottoluslons 
drawn  from  I. Q,  and  achievement  tests.  , 

3*  Design  and  conduct  workshops  around  the  Task  Force  reports  including  effects  of 
race  of  examiner,  validation  and  reliability,  im|noper  use  of  I«QVas  dependent  variables  in 
research  projects,  biases  to  teet^onstructlon,  problem  of  mislnterpretatjon  and  the  developt 
me'nt  of  alternative  means  of  assessment »  '  * 

NAACP  *    ,  ■      .  ' 

  >''.'.  '        .  ^ 

1.  Develop  a  statemenj^  regarding  the  rli^its  of  clients,  including  whether  an  individual 
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baa  to  take  an  I.Q.  test;  wh^/q  they  can  gp  to  get  information  regarding  the  validity  of  the 

^8t. 

2*  Initiate  legal  aoticin  to  develop  a  body  of  caae  law  on  the  testing  iseue, 
3.  Approach  the  American  Psychological  Aesociation  regarding  the  inclusion  in  the 

accreditation,  crlteriai  tht  evaluation  of  the  capability  of  the  psychology  training  program  to  . 

produce  special  competence  in  cross-pultural  usessment;  standards  for  approving  programs 

of  training  and  curriculi/m  offerings  in  the  fieloMtosychology. 

4.,  Establish  a  N)(tional  Task  Force  to  deVeRi)  specific  guidelines  for  the  participation 

by  laymen  in  the  effort/to  ftevise  satisfactory  assessment  procedures  and  disseminate  the 

guidelines  on  th&  broadest  possible  ba8is«   '  ^  . 

5.  Develop  a  fact  sheet  or  "Know  Your  Rights''  pampl^let  for  parents  and  students 
regarding  standardizra  testing, 

6.  Urge  legfsflition  at  the  state  and  federal  level  establishing,  outside  the  educational 
bureaucracy,  a  pron^rly  staffed  Office  for  Consumer  Affairs  for  testing  and  Student  Eval- 
uation • 

7.  Bring  togjther^  coalition  of  organizations  to  implement  the  recommendations  of 
the  TasTi.ForcoB. 


LAYMEN 

1.  Know  youjr  rights  as  a  consumer.  Urge  the  NAACP,  the  Association  of  Black 
Psychologists  to  sjieak  to.  community  groups  regarding,  the  righti?  of  individuals  participating 
in  testing  programjs. 

.2.  Urge  you^  iegislators  at  the  State  Bnd  National  le^l  to  sponsor  legislation  to  estab- 
lish, ou^M(^e  the  educational  bureaucracy,  a  properly  staf^  office  of  Consumer  Affairs  for 
Testing  and  Student  Evaluation  • 
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Mr.  Weiss,  The  next  witness  is  Dr.  Lionel  Newsom.         ■  - 

STATEMENT  OF  LIONEL  NEWSOM,  MEMBER,  BOARD  OF  DIREC- 
TORS, NATIONAL  ASSOCIATION  FOR  EC^UAL  OPPORTUNITY  IN 
HIGHER  EDUCATION,  AND  PRESIDENT,  CENTRAL  STATE  UNI- 
VERSITY* (OHIO) 

Dr.  Newsom,  Mr,  Chairman/members  of  the  subcommittee:  My 
name  is  Lionel  Newsom*  I  ami  president  o£  Central  State  University 
in  Ohio,  I  am  also  a  member  of  the  Board  of  directors  of  the 
National  Association  for  BLjual  Opportunity  in  Higher  Education, 
/whose  acronym  is  NAFEO, 

With  me  is  our  executive  director,  the  former  president  of  Bowie 
Staite,  Dr,  Samuel  Meyers, 

NAFEO  is  the  membership  organization  consisting  primarily  of 
the  historically  black  colleges*  Our  membership  currently  consists 
of  107  historically  and  predominantly  black  colleges  that  enroll 
more  than  200,000  students  and  contmue  to  graduate  even  today 
approximately  one-half  the  black  rempients  of  the  baccalaureate 
degree, 

I  welcome  this  opportunity  to  speak  to  you  on  behalf  of  the 
NAFEO  membership  and  the  constituency  it  serves,  A  number  o| 
the  presidents  and  chancellors  of  our  institutions,  through  profe^ 
sional  training  and  experience,  qualify  as  experts  on  testing,  71 

In  addition,  as  educators,  we  have  Strong  views  on  the  wiae 
spectrum  of  issues  with  which  H,R,'  3564,  Truth  in  Testing  Act  of 
1979,  and  H,R,  4949,  Educational  testing  Act  of  1979,  are  con- 
cerned. 

HcAvevq^,  given  the  fact  that  extensive  and,  I  would  add,  high 
quality  testimony  has  been  prepared  by  such  groups  as  the  United 
States  Student  Association  and  the  American  Council  on  Education 
on  issues  such  as  Government  regulations,  individu^^  student 
rights,  disclosure,  reasonable  costs,  and  the  like,  and  given  the  fact 
that  relatively  Jittle  attention  has  been  given  to  the  possible  impact 
of  the  proposed  legislation  on  minorities  and  the  economically  de- 

g rived,  we  have  chosen  in  our  testimony  to  correct  this  imbalance 
y  focusing  attention  on  the  implications  of  testing  legislation  for 
these  groups.  * 

After  careful  analysis  and  extensive  discussion,  it  is  our  judg- 
ment that  the  enactment  of  H.R.  3564  would  have  a  deleterious 
impact  on  minorities  and  should  not  be  enacted  and  that  H.R.  4949 
should  be  delayed  in  pklssage,  modified  jn  soim  respects,  augment- 
ed and  expanded  in  others,  and  in  vet  otherfiL  changed  in  focus 
following  a  year-long  study  by*a  legfiwatively  mai^dated*  commission 
on  testing.*  '  ^^"^^ 

NAFEO  concurs  with  and^^dpplauds  those  asped^s  of  H.R.  3564 
that  recognize  the  import^af^  of  testing  of  scjiolastite  aptitudes  and 
achievements  as  a  factm?^  college  and  university  acbnissions,  and 
of  the  objective  of  th^/prodlsed  legislation  to  enhanc^\equal  oppor- 
tunity%iid  to  insur^equal  rights  and  fair  treatment  oil  individuals 
appl3dnglbr  admj^l^ion.  \ 

We  also  appiwe  the  recognition  of  the  importance  of\^&ting  of 
skills  as  a  fac^affectilig  occupational  enti^  and  the  necessity  for 
taking  some^'actqon  to  assuje  that  there  is  a  free  flow  of  skills  in 
'  interstatexfommerce.  We  interpret  this  to  be  consistent  with  the 


goals  of  expanding  the  flow  of  jail  persons,  including,  minorities,  ^ 
into  occupations.  ' 

Our  concern  is  that  th6  legislative  language  will  give  implicit 
endorsement  to  testing  as  the  prmcipal  factor  in  admissions  and  to 
testing  as  a  critical  factor  in  employment. 

.  There  are  many  of  us  who  believe  that  multiple  criteria,  of 
which  testing  is  only  one,  should  be  emjjloyed  in  determining  col- 
let and  university  admissions  £U)d  eniplo*yment  entry. 

Wfe  endorse  the  proposal  set  forth  in  section  6  of  H.R.  3564  to 
prohibit  the  conducing  of  educational  and  occupational  admission 
tests  untfess  such  tests  are  administeAid  in  a  manner  to  protect  the 
rights  of  the  individuals  tested.  ^  % 

We  also  concur,  (u^  general,  with  provisions  of  section  6(a)  that 
pretest  infommtion  should  be  provided  to  applicants  for  education- 
al or  occupations^  admission  tests.  We  also  endorse,  with  one  major 
exception,  section  ^(b)  which  requires  that  individuals  who  have 
taJ^en  an  educational  or  occupational  admission  test  should  be 
notified  of  their  individual  specific  peyformance. 

We  object  to  section "^XS)  requiring  notification  of  the  score 
required  to  pass  the  test  lor  admission  to  such  occupation  or  the 
score  which  is  generally  rei^uired  for  admission  to  institutions  of 
higher  education.  Such  a  reqiHrement  would  exaggerate  the  impor- 
tance of  tests  which  should  beNmly  one  of  a  (number  of  multiple, 
criteria  for  admissions.  . 

In  addition,  such  a  requirement  A^ld,  through  legislation,  insti- 
tute a  practice  of  specifying  a  cutotf\SCore  for  admissions,  which 
does  not  now  exist  -  and  would,  thereb^^,  erect  additional  college 
admissions  and  occupational  entry  barriers  to  minorities  and  the 
economically  disadvantaged.  \ 

Many  of  the  laudable  obje(Jtives  set^forth  in  H.R.  8564  could  be 
accomplished  by  building  upon  the  current^^ractices  of  testing 
agencies  reinforced  by  some  of  the  self-regulatory  proposals  set 
forth  .by  others.  The  rather  superficial,  and  often  ignored,  pretests 
distributed  testing  agencies  ^could  be  expanded,  made  more  un- 
derstandable, and  built  into  workshops,  institutes  and  curricul  of 
institutions  in  order  more  thoroughly  to  promote  an  understanding 
on  the  part  of  applicants  for  college  admissions.  Programs  could  be 
implemented  to  develop  similar  information  for  those  seeking  occu- 
pational entry.  The  emphasis  would,  accordingly,  properly  shift 
somewhat  to  the  use  of  testing  as  a  diagnostic  and  developmental 
instrument.  /  . 

In  summfi^ry,  we  concur  in  the  noble  purposes  of  H.R.  3564  to 
{jSroHiote  truth  in  testing  and  to  enhance  educational  opportunity 
arid  pccupational  mobility  through  improving  pre,test  information 
on  college  admissions  and  employnient  entry  tests  and  on  reporting 
test  rdlults  19  the  tested.  We  believe  that  these  laudable  objectives 
can  b^  accomplished  by  strengthening  arid  expanding  upon  existing 
mechanisms  and  through  enhanced  self-regulatory  measures. 

A  greater  concern  is  that  if  enacted  in  its  present  form,  H.R. 
3564  could  exacerbate  rather  thkn  resolye  the  problems  of  mincJfc- 
ities  and  other  Iqw-income  groups  by  e^ggerating  the  importance 
fif  testing  and  by  rising  barmrs  to  the  admissioris  and  entry  of 
/min()k»tiies  and  the  economically  disadvantaged  to  colleges  and 
trades.  / . 


%  We  are  in  .similar  concurrence  with  the  laudable  objectives  of 
lLR.^  4949,  the  Educational  Testing  Act  of  1979.  We  endorse  the 
coi^pt  that  education  is  fiihdamental  to  the  development  of  indi- 
vidual citizens  and  the  progress  of  the  Nation  as  a  whole.  Hiis  is 
partkulcurly  true  for  minorities  and  the  economically  disadvan- 

*^'alLo  concur  that  there  is  a  continuous  need  to  insure  equal 
access  for  all  Americans  to  educational  opportunities  of  high  qual- 
ity. We  also  recognize  that  standardized  tests  are  a  mcyor  factor  in 
the  admission  and  placement  of  students  in  pwt^fecondary  educa- 
tion and  also  plays  an  important  role  in  individuals'  professional 
lives.  I 

*  We  concur  with  the  Other  premises  of  this  propraed  legislation:  • 
Of  recognition  of  the  increasing  concern  about  testiog;  protection  of 
.the  rights  of  individuals;  serving  |the  public  interest;  and 'that 
standardized  tests  have  a  repeix^ussipQ  nationally. 

We  also  concur  in  the  purpose  of 'the  act:  to  moiprove  the  aware- 
ness of  test  subjects;  of  the  charajpj^ristics,  uses  and  limitation  of 
admission  tests;  to  make  available  to^the  public<appropriate  infor- 
mation about  tests  and  testing;  to  protect  the  public  interest  by 
developing  knowledge  from  research  on  tests  and  testing;  and  to 
encourage  the  use  of  multiple  adniissions  criteria.  /  \ 

The  tmrust  of  the  proposed  lee^lation  is  that: 

One;  The  test  agencies  would  be  required  to  provide  a  great  deal 
.  of  specific  information  to  the  test  subjects  before  and  immediately 
after  the  taking  of  the  testa. 

Two.  The  t^t  agencies  would  be  required  to  report  to  the  C!om- 
missioner  of  Education  statistical  data  and  reports  pertaining  to 
the  tests  that  would  form  the  basis  of  an  evaluation  required  of  the  ' 
Commissioner  of  the  impact  of  the  tests. 

^   Three.  There  would  be  full  vdisclosure  of  test  results  and  of  the 
''test  itself 9  although  privacy  rights  would  b6  protected.  There  would 
also  be  detailed  reporting  required  on  testing  costs  and  fees  to 
students. 

Four.  Finally,  implementation  of  the  act  is  called  for  within  a 
t   120-day  period  after  the  effective  date  of  the  act  with  promulgation 
.  of  regulations  authority  accorded  the  Commissioner  of  Education. 
Penalties  for  violators  ar6  also  specified; 

Our  interpretation  is  that  primary  emphasis  among  thpse  react- 
ing to  the  proposed  Ic^lation  has  focused  on  the  alleged  abuses  of 
;  the  testing  agencies.  The  agencies  have  been  characterized  ai  mo- 
liopolist-like  giants  victiniiizmg  helpless  students,  whose  entire  edu-, 
cational  careers  or  li|re's<  professions  h^ve  been  jeopardized,  by  a' 
fbr^e  testing,  ovei' wl&^ 
1^    We  recognize  also  that  test  agencies  contend  that  the  disclosure 
,  of  test  questions  will  invalidate  the  testsi|^  gr^tly 
;  increase  test  preparation  costs  and/  thus,  cosft,  to  student^.  iSealpo 
^  recognize  that  others  refute  the  contention  that  test  prepara^n 
•  coCiB  will  necessarily  rise.  n.  ^ 

We  are  convinced  that  co^ts  would  inqjrease  and,  thereby,  have  a 
disproportionatdy  adv^rfM^ffect  on  low-income  students.  We  are 
ev6<i  more  greatly  eo9$erne8^  by  a  corollary  effectf  that  we  consider 
likely.  We  believe  IjHitt  the  di^mination  of  the  test  quc»t^ns  will 
spawii  the  deVelopiAent  of  mo1f;e  coaching  schools.  Imnority  stu- 


dentin,  Who  are  disproportionately  overrepresented  in  Ipw-income 
gr.oups,  wosuld  generally  be  linabljB  to  attend  these  coaching  schools. 

We  believe  that  coaching  can  improve  test  performance  to  some 
degree.  The  net  impact  of  the  fticrease  in  the  cost  of  testing  and 
the  overrepresentation  of  the  affluent  in  coaching  restulting  from 
the  disclosure  provisions  of  the  act  would  be  adverse  to  the  interest  , 
of  minority  and  poor  students.  *      .  ' 

The  proposed  legislation  gives  inadequate  attention  to  the  misuse 
an4  abuse  of  test.  Our  impression  is  that  sophisticated  professors, 
admissions  officers,  and  others  who  are  in  a  position  to  observe 
both  test  scores  and  the  actual  performance  of  the  test  subjects, 
soon  lose  their  enchantment  with  the  inviolability  of  tests.  Experts 
in  the  testing  agfencies  appear  keenly  aware  of  the  limitation  of  the 
tiests  they  administer.  ■  a  .  ^ 

On  the  other  hand,  lay^  groups,  possibly  including  prospective 
employers,  tend  to  ha\te  an  exaggerated  impression  of  the  impor- 
tance of  testing.  The  proposed  legislation  directs  its  attention,  pri- 
marily, to  the  supply  side,  control  of  the  test  agencies.  It  is  possible 
that  more  consideration  should  be  given  to  the  use  of  cautions,  that 
are  now  §o  familiar  on  hazardous  substances,  to  warn  the  users  of 
the  dangers  and  limitations  .of  tests. 

More  corrective  action  directed  toward  the  demand  side  would 
seem  appropriate,  but  is  not  considered*  in  the  current  legislation. 

Even  though  miisused  and  abused,  testing  has  unfulfilled  poten- 
tial. At  the  present  time,  standardized  tests  together  yvith  prior 
academic  grades,  family  characteristics,  reidfommendations,-  and  sim- 
ilar factors  predict  with  fair  accuracy^  the  academic , performance 
for  1  year  in  the  future.  They  cannot  predict  long-term  acadenaic 
performance  or  long-rterm  success  in  professional  careers.  TSludi 
more  research  is  needed  to  improve  the  performance  of  the  test 
itself  as  a  long-run  productive  instrument. 

Perhaps  the  most  iniportant  area  t)verlooked  by  the  proposed 
legislation-concerns  the  possibility  of  improving  the  performance  of^ 
blacks  and  other  minorities  on  standardized  items. 

Researchers  at  a  sessioh  on  testing  at  a  conference  recently  held 
by  NAFEO  stressed  that  all  black  students  do  not  have  low  scores 
On  standardized  teste  and  all  educationally  disadyantaged  students 
•  are  not  bla(3l^#  Nevertheless,  it  was  pointed  out  ^at  black  students 
entering  the  jSig  Ten  institutions  tend  to  score  on  the  A(|T  from  t 
to  iy2  standard  deviations  below  the  l*^an  oft^  the  entermg  fresh- 
man class  for  the  institution. 
^jk  We  know  of  some  historically  black  colleges  that  take  students 
^Shosie  test  performance  is  poor  and  develop)  ihem  to  the  level  that 
rtey  are  above  the  average  at  some  of  the  Nation's  ntost  presti- 
gious graduate  Bchools,  and  they  prove  to  be  successful,  productive 
pfcfesifonals  in  our  society.  .         .  v 

'In  spite  of  these  success  stories,  there  seems  to  be  a  movement  to 
expand  the  use  of  test  t(|  exclude  low-scoring  subjects  from  higher 
^education  Channels  without  c#«ftemita/it  effort  being  exerted  ^tp 
improve  the  performance  Of  these  students  on  tests, 

Jt  should  be  stressed  that  a  systematic  and  cumulative  exclusion 
of  any  group  from  educational  channels  that  lead  to  the  benefits  of 
a  productive  society  will  deny  that  society  the  use  of  potentially 
productive  resources,  but  will  conco|iiitantly  create,  at  some  point, 


a  mass  of  malcontents  who  will  threaten  the  tranquillity  and 
strength  of  that  society.  . 
.  It  is  accordingly  vitsjily  important  to  use  the  research  and^he 
success  stories  mat  we^  nave  to*  identify  coaching  techniques,  cur^ 
ricula  chaDQges,  life  experiences,  and  overalT  strategies,  to  improve 
the  performance  of  blacks  and  other  minorities  on  standardized 
t^ts.  L^^lation  merely  designed  to  regulate  the 'testers  will  hot 
accomplish  this  broader  goal. 

Our  m^jor  recommendation,  accordingly,  is  to  delay  enactment  of 
H.R.  4949^  We  strongly  urge  thftt  a  commiission,  established  by 
legislation,  should  b^  fonned  so  that  within  a  1-year  period  it 
would  carefully  consider  proposed  legislation  that  would  change 
the  emphasis  from  regulating  testers  and,  thereby,  increasing  costs, 
and  adversely  .affecting  minorities  "to  a  more  positive  emphasis. 

The  new  proposed  legislation  would:  One,  carefully  consider  the 
research  ^^t  could  enable  us  to  get  eveif^ater  potential  from 
standarjdized  tests;  two,  outline  a  whole  series  of  h^usardous  labelli 
to  caution  users  against  the  abuse  of  tests  and;  three,  chart  strate- 
gics to  improve  peifformance  of .  minorities  and  the  poor  on  such 
tests.  ' 

would  hope  that  the  CommHsion  were  accorded  subpena 
powers  to  assure  availability,  at  least  for  confidential  use,  of  re- 
search data  already  available. 

Mr.  Chaimjan  and  members  of  the  subcommittee,  we  comiinend 
to  you  our  re^ommeiidatipn  to  delay  passage  of  H.R.  49^9  and  io 
apiK)ihV^a  conrnnissioh  to  provide  fectvial^data  so  that  the  propo^ 
legislation  might  be  modined,  augmented^  expanded,  and  refocused 
along  the  lines  we  haye  propCNsed.  \, 

"in  doing  so,  your  subcomnuttee,  we  predict,  will  fully  utilize  this 
opportuhity  to  resolve  some  Wdamental  issues  concerning  testing 
that  affect  the  stren^h  and  viability  of  our  Nation. 

Mr.  Weiss.  Thank  you,  Dr.  Newsom.*  ^ 

Next  we  >yiU  hear  r^.  Sheldon  R.  Goldstine. 

STATEMENT  OF  SHELDON  R.  GOLDSTINE^  CLEVELAND,  OHIO 

Mn  Goldstine.  Thank  you,  Mr.  Chairman. 

I  would  appreciate  the  opixjrtunity  to  express  my  gratitude  for 
being  invited  to  testify  at  this  hearing  today,  September  24,  1979, 
concemink  H.R.  3564,  the  Truth  and  Testing  Act  qU979,  and  H.R. 
4949,  the  Educational  Testing  Act  of  1979. 

My  testimony  is  in  favor  of  both  bills  oriented  toward  H.R.  3664 
based  on  mv  architectural  testing  experiences,  legal  involvements, 
arid  redeatch  into  the  architectural  licensing  process. 

My  academic  and  professional  background  is  as  foHpws:  Aca- 
demic: B.S.  Architecture^  the  Ohio  State  Universfty,  1972. 

B.S.  Business  Administration,  the  Ohio  State  University,  1972. 

Master  of  Business  Admmistratidn,  Case  Western  Reserve*  Uni- 
versity, 1974.  '  i 

Master  of  Architecture,  the  Ohiq'State  University,  1975.  ,  ^ 

The  combined  business/architectural  academic  progran^  wifs  de- 
signed and  implemented  ta  supplement  my  architectural  education 
(typicallv,  most,  architectural  schools  throughout  the  country  are 
extremely  weak  in  education  of  basic  business  principles)  to  enable 
me  ip  efficiently  and«etfectively  cope  with  the  economic  demands 
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being  placed  on  the  building  industry  today.  Per  one  of  my  appli- 
cant references  (exhibit  C-2),  (all  exhibits  referred  to  in  oral  test^ 
mony  retained  in  subcommittee  files)  submitted  to  the  State  Board^- 
of  Examiners  of  Architects  m  Ohio  on  October  111,  1976,  by  a 
former  Ohio  State  University  ar(^itectural  graduate 'school  profes- 
sor and  former  president  of  the  Architects  Socie^  of\  Ohio  (State 
component  of  the  American  Institute  of  Architects),  I  am  regarded 
as  one  of  the  top  students  overall  to  graduate  from  "Ohio  State 
University,  and  Kighly  quali^ed  to  be  brilliant  in  the  profession. 

Professional:  I  have  been  involved  professionally  in  the  architec- 
tural field  since  1973  and  have  experienced  all  conventional  phases 
of  the  practice. 

I  and  thousands  of  other  applicant  architects  throughout  the 
country  have  suffered  severe  professional  ^rdships  trying  to  gain 
entry  into  the  architectural  profession  by  means  of  the  current 
National  Council  of  Architectural  Registration  Boards  (NCARB) 
professional  exam. 

Personally,  I  have  tried,  three  times  unsuccessfully,  to  pass  the 
NCARB  examination.  An  exam  written  entirely  by  NCARB's  Pro- 
fessional Examination  Committee  aided  by  the  Educational  Testing 
Service  (ETS)  of  Princeton,  N.J.,  in  question  organization  and  for- 
mat. -  .   "  . 

The  NCARB,  Washington,  D.C.,  is  a  nonprofit,  membership  qrga.- 
nization  established  under  the  laws  of  Iowa,  comprising  the  archi- 
tectural licensing  boards  of  al)  50  States,  the  District  of  (Columbia, 
the  Canal  Zone,  Guam,  Puerto  Rico,  and  the  Virgin  Islands. 

It  was  established  in  1920  to  aid  in  the  interstate  practice  of 
ar^iitecture.  A.  certificate  issued  by  NCARB  to  an  architect  entitles 
him/her  to  be  admitt<Bd  to  practice  in  each  of  the  55^member  board 
jurisdictions.  .'i  _ 

The  100-percent  multiple  choice  NCARB  professional  exam,  first 
given  in  1973,  is  offered  only  once,  in  December  of  each  year.  Ohio 
and  several  other  States  have  required  a  1-day  graplue/ written 
exam  in  addition  to  the  NCARB  professional  exam. 

The  multiple-choice  exam  is  currently  adntinistered  by  all  55 
NCARB  member  boards,  machine  graded  by  ETS,  Berkeley,  Calif., 
results  sent  to  NCARB,  Washington,  D.C.,  for  a  national  pass-fail 
cutting-score  determination,  and  then  forwarded  Ipack  to  all  55 
member  boards  for  their  distribution  of  results,  * 

Several  States  have  modified  the  NCARB  cutoff  scores  slightly; 
hpwever,  all  candidates  must  meet  the  NCARB  cutoff  score  guide- 
lines to  be  eligible  for  NCARB  certification,  which  is  necessary  to 
compel  in  the  more  profitable  natipnal  architectural  building 
market.'  Also  note,  several  States  lare  currently  taking  definite 
steps  to  eliminate  and  replace  the  current  NCARB  professional 

exam.  '  "       .  .      ^ .  tl 

Per  a  phone  conversation  with  Mr.  Hal  Levm,  a  membei;  of  the 
California  Board  of  Architectural  Examiners,  on  September  17, 

1979,  his  board  has  been  funded  by  the  California  Legislature  to 
eliminate  and  replace  the  current  NCARB  exam  by  December 

1980.  California  will  offer  their  new  exam  twiceiper  year.    ^  # 
Per  another  phoiie  conversation  with  Mr.  Cass  Hurc,  former 

^  executive  secretary  of  the  Wisconsin  Architecti-Engineef  Board, 
also  on  September  ,17,  the  J^iscpnsin  board  is  definitely  taking 
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steps  to  move  away  ^om  the  NCARB  exam  with. pressure  from  the 
Wisconsm  Legislature  derived  from  a  series  of  exam.analyses  dat- 
ing back  to  1978.  The  Wisconsin  liegislature  gr^  concerned' over 
the  abnormally  high  failure  rate  among  NCARB  examinees. 

The  most  recent  Wisconsin  study,  based  on  a  task  analysis  by 
Wisconsin  practicing  architects,  to  my  understanding,  proved  the 
NGARB  exam  invalid.  For  years,  Statc^  throughout  the  country 
requested,'  wi^out  response,  that  NCARB  effectively  analyze  its 
exam.  The  Pflp^B  exam  will  be  diiscussed  in  more  detail  later  in 
this  presentation. 

In  regard  to  imy  testing  and  administrative  appeal  experiences,  I 
will  present  a  case  documenting  the  lack  of  basic  constitutional 
requirenients  for  due  process  of  law. 

Shortly  after  reoeiving  a  failure  score  on  the  Decemiber  1976 
NCARB  exam,  I  apFbaled  in  a  meeting  before  the  Ohio  !Board,^o 
that  they  could  ada  a  learning  element  to  the  testing  process. 

The  board^s  coercive  authoritarian  relationship  maint^ned  be- 
tween itself  and  applicant  architects  is  not  conducive  to  meanitig- 
ful  cooperative  negotiations  to  learn  from  past  examination  mis- 
takes. Test' questions  and  answers  aire  not  available  for  review^nd 
standardized  reporting  of  scaled  percentage  score  results  do  not 
allow  for  effective  i)erformance  analysis.  ^ 

That  particular  meeting  between  myself  and  the  board  ih  early. 
1977  was  to  me  intimidating  and  probably  did  more  harm  to  myself 
th'ftn.good  since  I  questioned  the  status  quo  of  exam  and  significant 
level  of  performaribe  feedback  secrecy. 

Again,  in  December  of  1977,  I  failed  the  NCARB  exam.  Still, 
unaware/of  various  State  attacks  against  the  validity  of  the  exam,  I 
rfelt  the  ex^m  per  se  had  many  problems.  Therefore,  since  I  be- 
lieved the  exam  was  inaliequate,  was^  unable  to  get  relevant  per- 
formance feedback  cmd  felt  I  could  make  a  significant  contribution 
to  the  advtocement  of  the  profession,  I  applied  for  licensure  with- 
out examination  uhdc^  section  4703.08(A)  Ohio  Revised.  ^ 

A  hearing  was  held  before  the  State  board  of  examiners  on  Mav 
'18, 1978.  The  board  |md  myself  were  represented  by  legal  counsel. 
Please  note,  prior  to  the  hearing,  my  Ohio  graphic/written  design 
problems,  two  failures  and  one  passing  were  destroyed  in  violation 
of  section  4743.02  Ohio  Revised  Code. 

The  boarats  executive  secretary  stated  in  the  hearing  transcript 
that  he  was  not  aware  of  that  proviision.  I  am  not  calling  this 
destruction  of  evidence  ah  intentional  act. 

However,  I  would  like  to  note  that  the  design  portion  of  the 
multiple  choice  NCARB  professional  exam  is  the  only  section  that  I 
have  not  passed,  by  2  percentage  jpoints. 

Also,  per  the  trade  magazine,, Building  Design  and  Con^trilction, 
i"A/E  Licensing  Under  Attack  in  Several  States,''  May  1979,  p. 
15,'^  ^  .  when  a  le^lative  committee  had  the  (Wisconsin)  board 
ask  a  panel  of  Wisconsin  ai^httects  to  regrade  portions  of  the 
December  1973  NCARB  exani^  the  results  of  that  regrading  corre- 
lated badly  with  the  official  results,  which  led  the  State  to  elimi- 
nate the  (graphic)  design  portion. from. the  State's  architectural 
yixdm.^'  -  . 

f  Evidence  wps  presented  by  myself  at  the  Mav  18,  1978^  hearing 
A^ocomenting  my  6-year  master  of  architecture  degree  and  satisfac- 


tory  completion  oLz  years  of  experience.  In  regard  to  the  satisfac- 
tory evidence  of  Iw>wledg{|  of  professional  practice  and  supervision 


of  construction  wBch  the!board  at  their  discretion  could  also  re- 
quire, I  cidled  th^Hward's  executive  secretary  1  week  prior  to  the 
hearing  in  front  c(f\my  attorney's  law  clerk  to  get  directions.  • 
^The  executive  Secretary  stated  that  he  did  not  knOw  what  would 
be  required  per  tnat  phone  conversation  and  this  also  was  docu- 
mented in  the  hejaring  transcript. 

The  board's  exteiutive  secretary,  in  response  to  their  legal  coun- 
sel's questioning,  testified  at  the  May  18,  1979,  heaxfin&  that  to  his 
knowledge  no  one  had  ever  been  admitted  to  practice  under  section 
4703.08(A)  0,R,C,,  and ^  list  pf  approximately  350  aitproved  ap^^^^ 
tions  was  documented  (see  exhibits  012  through  C-16),         ,  • 
Unfortunately,  the  above  facts  could  not  enter  the  court  as  evi- 
I  dence  since  the  board's  denial  of  certification  .was  upheld  by  the 
court  of  common  pleas  and  was  already  in  t^e  court  of  appeals 
V  process.  .  .  y 

4        The  analysis  of  senate  bill  No,  15,  as  passed  by  the  Senate,  Ohio's 
'  113th  Qeneral  Assembly,  regular  session  1979-80,  a  bill  which 

added, further  restrictions  to  architectural  professional  entry,  pa^a- 
1  phrases  section  4703,08(A)  0,R,C,  \and  states  that  i^  is  one  of  the 

two  basic  methods  of  establishing  proficiency  As  specified  in  the 
law  to  obtain  architectural  certifics^tion. 

However,  also  documented  iri  this  analysis  is  the  following  state- 
ment: i 
"According  to  the  board  this  method  was  used  to  grandfather 
into  the  system  architects  practicing  at  the  time  the  law  paeised, 
but  is  not  currently  used  by  the.bpard  to  grant  certification",  by 
reviewing  the  history  of  section  4703',08(A),  it  becomes  clear  that 
the  actual  'grandfather'  clause,  (sec,  1334-7(C)),  .was  repealed  in 
1932  iand  that  section  4703,08(A)  was  still  a  viable  alternative  ac- 
cording  to  the  Ohio  Legislature  at  the  time  I  applied. 

The  board  denied  my  application  under  section  4703;08(A)  0,R,C. 
with  the  justification  ^'that  the  applicant  did  not  provide  any  evi- 
dence at  the  hearing  which  would  show  that  he  possessed  any 
special  qualifications  for  licensure  without  taking  the  examination 
required  under  section  4703,07,  Ohio  Revised  Code"  and  "that  the 
applicant  at  the  time  of  the  hearing  had  not  peAsed  the  examina- 
tion required  by  section  4703,07^  Ohio  Revised  CMe, 
•  In  rebuttal,  the  statute  only  calls  for  satisfciMiory  evidence  and 
the  facts  printed  strongly  indicated  that  the  board  had  deter- 
mined prior  to  the  hearing  that  no  matter  what  evidence  I  submit- 
ted, their  willingnesi?  to  license  under  the  "li(^ense  without  exami- 
nation statute",  a  separate  alternative  statute  for  licensure,  would 
'  >       be  negative.  -      '  ,  '      v  n  xt 

.  The  presented  facts  included  the  analysis  of  Ohio  Senate  bill  No, 
15  indicate,  iri  my  opinion,  that  an  abuse  of  discretion  did  occur.  It 
is  most  difficuu  to  spend  over  1  year  in  Administrative  appeal 
\         proceedings  with  the  conceptual  framework  of  the  matter  predeter- 
mined bwore  the  presentation  of  facts  elkhinating  probability  of 
I  .         true  due  process  of  law,  [ 
,  ^        One  of  my  major  Justifications  for  presdhting  my  personal  case 
analysis  here;^is  to  illustrate  the  need  fpr  this  Congress  to  design  a 
stai^dardized  due  process  conceptual /franework  of  professional 
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lieBtiiig  guideiines  to  insure  that  ftU  matters  of  biisMesa  haiidled  by 
State  liceinaiiig  board  frovidaJToi^^a^contihuoua  process  of  due 
•process,  x.       .  j,,.^''-'^^'^  '  "*  ;*    •   '^^    ■    ■  ■ 

In  r^ard'  to  therenuques  of  NGARB  professional  exam  per  se,  I 
mail  briefly  present  information,  from  relevant  research  data  ac- 
"^mmulated.  .  . 

^'An  evaluation  of  the  examinations  adminisfered  by  the  archi-> 
tects  section  of  the  Architects,  Profesffional  Engineers,  Designers 
and  Land  Surveyors.  Examining  Board/'  submitted  to  the  State  of 
Wisconsin,  Depcu^ment  of  Regulation  and  Licensing  by  ,Dr.  Crlenn 
E.  Tagatz  of  International  Personal  Services,  Inc.,  Milwaukee,  Wis., 
in  February  1976,  made  the  follo^nong  findings: 

The  NCARB  eiaminatioiis  do  not  meet  the  specifications  of  ih§  American  Psycho- 
logical Association  with  regard  to  use  of  phenologies  measurement  technology  in 

•  exauK  jpreparatioh  with  respect  to  job  skills;  not  the  Equal  Employment  Opportunity 
V  Comoussion's  guidelines  for  job  relatednees;  nor  the  Uniform  Guidelines  on  Employ- . 

Selection  Procedures  of  me  Equal  Employment  ^portunity  Coordinating  Cbun- 

the  ''contentanalysi^  of  the  NCARB  examination",  exhibit  B-2, 

Erepared  for  theStato  of  Wisconsin,  Department  of  Regulation  and 
licensing,  prepared  d^^I%^.  Peter  E.  Schriber,  Mr.  Michael  Priestly, 
.  imd  Mr.  Brent  CampDell  oT  National  Evaluation  Systems,  Amherst, 
Mass.^  in  June  1979,  concluded  the  following:  « 

.  The  moBt  important  eoncluaion  is  that  the  match  between  NCARB  examination 
content  and  the  Wiaconsin  Task  List  was  less  than  5Q  percent  on  an  item-by-item 
match  basis.  Also,  the  proportionality  of  the  NCARB  examinations  differed  consider- 
ably from  that  of  the  Task  list. 

Please  note  that  ''£!EOC  guidelines  state  that  test  content  should 
be  as  close  to  100  percent  job-related  as  praf^ical  and  that  the 
further  away  from  100  percent  the       job-related  the  test  is.'' 

I  do  not  want  to  im^ply  thatlNCARB's  use  pf  its  cui^rent  exam  is 
an  intentional  act  to  restrain  trade.  However,  an  only  50  percent 
job-related  exam  may  in  effect  do  so^  The  etean"^  gfadi^  on  the 
basis  of  relative  distribution  of  scores.  The  national  pass  rate  is 
approxiiiiateW  54  percent  more  or  less  each  year. ,  - 

Per  the  1978  NCARB  Architectural  Begistratipn  Handbook,  pub; 
lished  by  the  National  Council  of  Architectural -Registration  Bdards 
and  Architectural  I{ecbrd  BookSf  1978,  page  14: 

^  of  the  score  distributions  for  the  Professional  examination  relatively 
sn^  standard  deviations,  that  is,ithe  dispersion  of  scores  is.  only  about  one-half  of 

•  what  might  be  expected  in  tests  of  this  length.  Tbia  would  suggest  that  the  examin- 
• .  eeA  who  aotuallv  tpok  the  test  tended  io  be  relativelylhomogegous,  i.e.,  qijite^  similar 

in  terms  of  both  j>ersonal  characteristics  and  itbiliW,  an  assumption  which  is  borne 
out  by  the  descnption  of  candidates  in  terms  .pf"*^^  educational  level,  et  cetera. 

Since  the  exam  is  less  than  50  percent  related  and  sbore  distribu- 
tions have  relatively  smaU  standard  deviations/ guessing  well  on 
^  exmx  questions  s^ms  to  be  the  primarjr  vehicle  into  the  profession. 
.  Another  problem  must  be  presented  concermng  $he  lack^bf  uni- 
tormitjr  in  applicant  -intern  education.  Tke  intern  period  ranges 
Irom  1  to  5  years  depending  on  coQege  degree  status,  13  vears  in 
some  States  for  nondegfee  candidates,  with.  3  years  being  the  aver- 
age for  5-year  professiontd  architectural  degree  holdeiB,  bachelor  of 
architecture.  ^ 

The  problem  concerns  the  diversity  of  architectural  practices  in 
-  both  their  size  and  the  building-^type  markets  the^  are  myolved  in^ 
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Many  intern  architects  are  only  exposed  to  work  areas  that  return 
maximum  profits  to  their  employers. 

Without  ja  uniform  intern  training  program,  incentives  will  con- 
tinue to  exist  which  motivate  employers  to  exploit  this  captive 
*'cheaper-labor  intern'*  labor  force  rather  than  providing  the  kinds 
of  training  these  employees  are  paying  for  in  reduced  wages  and,  in 
effect,  increase  their  chances,  assuming  a  Valid  ejcam  is  given,  of 
passing  their  architectural  licensing  exam.        »  ^ 

Mr.  Patrick  Clinton- s  article:  "A/E  Licensing  Under  Attack  m 
Severfil  States",  published  in  the  May  1979  issuq^  of  Building  Design 
and  Construction,  pages  14-15,  16,  provides  ari^excellent  summary 
of  current  NC ARB  validity  problenis  across  the^cbuntry. 

Proform's  article,  "Wisconsin  Architects  Balk  at  National  Exam, 
Design  Their  Own,"  published  by  the  National  Center  for  the 
Study  of  Professions,  W^hington,  D.C.,  November  1978,  gives  an 
exceUerit  account  of  activities  in  Wisconsin  leading  up  to  NCARB 
examination  elimination  and  replacement. 

Mr.  Ron  Shattil's  article:  "A  Critique  of  the  Registration  Exami- 
nation arfa  Measurement  of  Beliefs  Rather  than  Ability,"  Ameri- 
can Institute  of  Architects  Journail,  November  197b,  and  letters  to 
NCARB  from  concerned  parties  give  good  accounts  of  cofttent  prob- 
lems associated  with  the  NCARB  exam. 

Illustrations  of  recent  concerns  expressed  by  Federal  agencies 
regarding  the  negative  economic  effects  of  our  increasingly  expand- 
ing professional  cartels  are  found  in  the  following  statements: 

"An  Address  by.  A^ichael  Pertschuck,  Chairman,  Federal  Trade 
Commission,  before  the  American  Enterprise  Institute  Licensure 
Conference,"  Washington,  D.C.,  February  22,  1979;  and  "Occupa- 
tional Licensing:  Consumer  Protection  or  Cartel  Man^agement?" 
reijiarks  by  Mr.  Donald  L.  Flexner,  Deputy  Attorney  General,  Anti- 
trust Division,  Department  of  Justice,  before  the  Kentucky  Legisla- 
tive Research  Comihission's  Program  on  Occupational  Licensing, 
Lexington,  Ky.,  February  2,  1979'. 

the  statements  made  by  Mr.  Pertsehuk  and  Mr.  /Flexner  illus- 
trate pur  need  to;  be  concerned  about 'profe^ional  cartels  limiting 
competition  to  keep  prices  high.  Mr.  Pertsehuk  stdted  one  of  the  , 
I  proUems  is  the  State  licensing  of  professionals,  a  pirocesis  usually 
\doimnated  by  members  of  the  professions  who  hold  down  the  num-  : 
jber  of  entrants  to  control  competition. 

'    I  have  been  cooperating  with  the  Federal  Trade  Commission  in 
investigation  of  the  NCARB  exam  since  March  1&79.  Also,  I  have^ 
been  following,  with  much  interest,  efforts  by  professional  polincal  " 

^action  committees  aimed  at  inhibiting  the  FTC^s  regulatory  author- 
ity which  is  directed  toward  maintaining  a  competitivie  (economic 
system  that  does  not  unreasonably  constrain  private  economic 
activities.  . 

I  am  hopeful  that  this  Congress  will  carefully  analyze  the  trade- 
offs of  their  actions  toVvard  the  FTC  with  respect  toJ;he  balance^^efil 
pur  mixed  system  of  government  and  private  enterprise  as  well  as 
our  mixed  system  of  monopoly  and  ccmipetotior^  ^ 
A  m^or  'issue  to  ho  evaluated  is  tne  direction  of  our  administra- 

,  tive  legale  system.  Unlil^e  our  <;ivil  afid  criminal  systems,  which 
have  devel<i|)ed  with  us  over  ^the  centuries,  the  administrative  gys- 


teii|F  WCU9  born  e^Ar  ih  th3  century.  Unchecked,  it  could  have 
strong  n^ative  effects  on  oiir  economic  and  political  system.  * 

I  pray  that  our  American  economic  dream  of  ^owth  ana  proper- 
ty cpntmues  for  centurilb^  into  the  fViture;  Insuring  that  proiessiin- 
al  entry  is  maintained  at  reasonably  competitive  levels  in  consider- 
ation of  providing  for  the  jpublic  healfh,  safety,  and  welfare  is  but 
one  compionent  of  the  cham  of  events  that  will  insure  the  Ameri- 
ccm  dream. 

Again/  thank  you  for  this  opportunity  to  testify  before  you  today. 
[The  complete  statement  of  Sheldon.  Golds^ 
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Sheldon  R.  Goldstine  . 
25  70  Overlook  Road 
Cleveland/bhlo  44infi. 
(2^  371-0408  % 

September  24-r  1979. 
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Honorable  Carl  D.  Perkins,  Chairman 

and  Members 
-CpmmiUee-oiuEducatlon  and  tabor  ^ 
Subcommittee  on  Elementary /Secondary, 

and  Vocational  Education 
CONGRESS  OF  THE  UNITED  fticATES 
HOUSE  OP  REPWSSENTATI\^ 
B-346C  Rayburri  House  Office  BuUdlng 
Washington  D»C»  20515  i 


.Dear  Chairman  and  Member*  of  the  Subc< 
and  Vocational  EdjUcatlom  i 


mlttee  on  Elementary,  Secondary^ 


I  would  appreclati  thU  opporti^lty  to  express  my  gratitude  for  being  Invited  to 
testify  at  this  hearing  today,  September  24,  .1979,  concerning  H»R,  J564,  the  Truth 
and  Testing  Act  of  1979;  and  ri.R,  4949,  the  Educational  Tesl;lng^ct  of  1979* 

|4y  testimony  is  in  favor  of  hoxh  bills  oriented  towards  H.R,  3S64  ba^ed  on  my 
architectural  test^g  experlencef .  Ugal  Involvements jnd  research  Inta  the  architectural 
llcens^lng  process*  '   '  >  ' 

My  academic  and  professional  background  Is  as  follows:  ,  ' 

•ACAI^EMlt  '  ^        .  ' 

B,S*  Architecture,  th^  Olflo  State  University,  1972.  < 

B.S.  Business  Administration,  The  Ohio  State  University,  1972. 

MasterofBuslnebAdmlnlsfS^atlbiv  Case  Westeni  Reserve  Unlverslt^^  1974. 

Master  of  Archltecfcure,  Thd  Ohio  State  University,  197S.^ 

Th&  cOmbiirfd  business/architectural  academic  program^was  deslg^d  and 
Implement^  to  supplement  my  archltej^tural  education,  (typically^,  most 
.:archUe<iiihl  schools  throughout  the  country  are  extremely  weak  In  education  of 
basic  business  principles)  to  enable  me  to  efficiently  and  elfeotlvely  cope  with 
the  economic  demands  being  placed  pn  the  bulldlnii  industry  today.  Per  one 
of  my  applicant  references  (Exhibit  C-2),  submlttisd  to- the  Slate  Board  of 
'   ^xamlneri.  of  Architects  ^  Ohio  on  October  11,  1976,  by  a  Ibrmer  Ohio  State 
*       University  Archltectural  g^aduale  school  professor  and  former  president  of  the 
Architects  Society  Of  Ohio  (state  component  of  the  American  Institute  of 
Architects!  I  am  ^'regarded  as  one  of  the  top  student  overall  to  graduate  front  ^ 
g        Ohio  State  UnlversUy  and  ^'highly  Qualified  to  be  brl^llaht  In  the  profession" . 


■  i.  ^  ■/ 


PROFESSIONAL  '  I ; 

i  have  been  Involved  proleasionajly  in  the  architectural  field  since  1973  and  . 

ha  veWxperlenced  all  conventional /Phases  of  the|  prac^e  .  ^ 

I  and  thousands  of  other  applicant  architects  throughot^ 'the  country  have  Buffered        ^  ;\ 
arenyere  professional;  hardships  trying  to  oalii.  entry  into  the  architectural  profeission 
by  means  of  the  current  National  Oouncif'of  Architectural  Registration  Boards  (NCARB) 
professional ^xam.  Personally ^  iTiave  t^ed  three  times  unsuccessfully  to  pass  the 
NCARB  examination.  An  exam  written  entirely  by  NCARB's  Professional  Examination 
Committee  aided  by  the  Educational  Testing  Service  (l^TS)  of  Princeton,  New  Jersey/ 
in  que iBt ion  organization  and  format, 
» 

The  NCARB,  Wa^shihgCon,  D«C« ,  i$  a  non-profit,  membership  organization  established 
under  the  la^s  of  towa,  comprising  the  architectural  licensing  boards  of  all  afty  states,, 
the  District  bf  Columbia,  the  Canal  Zone,  Guam,  Puerto  Rico  and  the  Virgin  Islands.. 
It  was  established  in  1920  to  aid  in  the  interstate  practice  of  archit^ctaire .  A  certificate 
issued  by  NCARB  to  an  architect"  entitles  himAer  to  be  admitted  to  practice  in. each 
of  the  fifty-five  member  board  Jurisdictions.        •         •  . 

The  100%  multiple  bhoice  NCARB  professional  exam,  first  given  in  1973,  is  offered 
only  once  in  December  of  each  year.  .  Ohio  and  several  other  states  ^ve  required  a 
one  day  grc^phic/written  exam  in  addition  to  the  NCARB  professional  exam.  The 
ihultiple  choice  exam     currently  administered  by  all  fifty-five  NCARB  member  boards  , 
jnachlne  graded  by  ETS,  Berkeley,  California,  results  sent  to  NCARB,  Washington,  D«C. 
ior  a  national  pass -fail  "cutting -score"  determination,  and  then  forwarded  back  to  all 
fifty-five  member  boards  for  th^ir  distribution  of  results.  Several  states  have  modified 
the  NCARB  "cilt-off"  scores  slightly,  however,  all  candidates  must  meet  the  NCARB 
"cut-off"  score  guidelines  to  be  eligible,  for  NCARB  certification,  which  is.necessary 
to  ccmpete  In  thp  more  profitable  national  architectural  building  markets  Also  note, 
several  states  are  currently^aklng  definite  steps  to  eliminate  and  replace  the  current  ' 
NCARB  professional  exam.  . 

^  ■ 

Per  a  phone^  converstition  with  Mr.  Hal  Lev^,  member  of  the  California  Board  of 
'  Architectural  Examiners,  oii  September  17,  1979,  his  board  has  been  funded  by  the 
California  legislature  •to  eliminate  and  replace  the  oiirrent  NCARB  isxam  by  December, 
1980.  California  will  offer  thbir  new  exam  twice  per  year. 

Per  another  phone  conversation  with  Mr.  Cass  Hurc,. 'former  Executive  Secretary  of 
the  Wlscpftsin  Architects -Engineer  Board,  also  on  September  17,  1979,  the  Wisconsin 
Board  is  definitely'  taking  steps  to  move  away  from  the  NCARB  exam  with  pressurcjf 
from  the  Wisconsin  Legislature  derived  from  a  series  of  exam  analyses  dating  ba|k 
to  1973.  The  Wisconsin  legislature  grew  ponderried  over  the  abnormally  high  faifure 

-  rate. among  NCARB  examinees*  The  most  recent  Wisconsin  study^  bas6d|pn  a  tasjc 
analysis  by  Wis'consin  practicing,  architects  to  my  understanding,  proved  ^he^l}0ARB 
exam  invalid.  For  years,  states  throughout  the  country  requested,  without  response, 

'  that  NCARB  effectively  analyze  ltd  exam.  The  NCARB  exanri  will  be  discussed  In  mor^ 
detail  la^r  In^  this  presentation. 


In  regard  to  my  testing  and  administrative  appeal  experiences,  I  v^I  present  a  case 
documenting  the  lagk  of  basic  constitutional  {Requirements  for  due  process  of  law. 

Shortly  after  receiving  a  failing  score  on  the  December,  1976  NCARB.exam,  1^ 
appealed  in  a  meetin<r  before  the  Ohio  Board  so  that  they  could  add  a  learning  element 
to  the  testing  process.  The  Board's  coercive  authoritarian  relationsKip- maintained 
between  itself  and  applicant  ^rchlte<:ts  is  not  condusive  to  meaningful  cooperative 
negotiations  to  learn  Ifrom  past  examination  mistakes.  Test  questions  and  answers 
are  not  available  for  review  and  strodcirdized  reporting  of  scaled  percentage  score 
results  dt  not  allow  for  effective  performance  analysis .  That  particular  meeting 
between  myself  and  the  board  in  early  1977  was  to  me  intlmidatij|af  and  probably  did  ^ 
more  hanii  to  myself  than  good  since  I  questioned  the  status  quo  of  exam' and  signiflh 
cant  level  of  performance  feedback  secrecy.  ■ 

Again,  in  December  of  1977,  I  failed  the  NCARB  exam.  BtiU,  unaware  of  various 
state  attacks  against  the  validity  of  the  NCARB  exam,  I  felt  the  exam  per  se  had  many 
problems.  Therefore^  since  I  believed  the  exam  was  inadequate,  was  unable  to  get 
relevent  perfbnnance  feedback  and  f^lt  I  could  make  a  significant  contribution  to  the 
advancement  of  the  profession,  I  applied  for  licensure  without  examination  under . 
Section  4703.08  (A)  OhlaRevlsed  Code. (Section  1334-7  (A)  General  .Code) .  The 
statute  read  as  follows:  ,  .  ' 

.  Sec.  4703.08.         state  board  of  examiners  of  architects  may,  in  lieu 
of  all  examinations,  accept  satisfactory  evidence  of  any  on^  of  the 
qualifications  set  forth  under  the  divisions  of  this  isection: 

(A)  A  dllploma  of  graduation  ^om  an  accred.itisd  architectural^school  or 
college  showing  that  the  api^llcanthas  completed,  a  tdchniceil  and  professional 
course'of  not  less  that  five  years'  duration)  whigh  course  i^  approved  by 
the  board,  and,  jn  addition  thereto,  has  had  at  least  three  years  of  satisfactory 
experience  twq  years  of  which  shall  have  been  in  the  office  of  a  reputable 
■  architect  meeting  all  the  qualifications  for  practice  under  slQCtions  4703.01 
to  4703. 19  of  the  Revised  Code;  provided,  the  board  may  re|iuire  applicants  ^ 
under  this  division  to  furnish  satisfactory  evid^ce  of  knowledge  of  professional 
practice. and  8 uperyision  of  construction;  J  v 

A  hearing  was  held  before  the  State  Board  of  Examiners  on  May  18,  1^8.  The  Board 
and  myself  were  represented  by  legal  counsel.  Please  note,  prior  to  the  hearing,  my  . 
Ohio  graphic/written  design  problems,  two  failures  and  one  passing  we're  destroyed  / 
in  violation  of  Section  4743.02  Ohio  Revised  Code.  The  Boara's  Executive  Secretary  . 
stated  in  the  hearing  transcript,  that  he  wasr  not  aware  of  thay provision i  I  am  not 
calling  this  destruction  of  evidence  an  intentional  act.  Howf6ver,  I  would  like  to 
note  that  the  desi^  portion  of  the  multiple  choice  NCARB  p^fessional  exam  is  the 
only  section  that  I  have  not  passed — by  two  percentage  points.  Also,  per  Exhibit  B-3, 
Bulld^n9'  faeslqn  and  Construction.  "A/B  Licensing  Uider  Attack  in  Several  States, " 
May,  1979,  p.  15"  ...when  a  legislative  committee  had  the  (Wisconsin)  board,ask 
i  panel  of  Wisconsin  architects  to  regrade  portions  of  the  December,  1973  NCARB  exafn. 
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.)  The  results  of  that  irepradlng  qorrelated  badly  with  the  official  results,  WRIch  led  ^ 
the  itate  to  ellmlnJiterthe.  (graphic)  design  portion  from  the  state's  architectural  exam. 


jjcl 


£yldeilc&  vvas  present 
of  Architecture  degree 
regard  td  jthe  '^satlbfa< 


called  thk  Board's  fxi 
'  attomey/s  la^  clerk 
i  '        not  Vxioyr  what  would, 
dooum^ted  In  the  h( 

Th«  Board  did- not 
supervision  of  con 
^         while  a  graduate  a. 
professional  prad 
^8  hospitalized^ 
/  midterm  and  fln< 
this  course  worj 


at  the  May  18,  1978  heading  documentlrta  my  six-year  Master 
ind  satlfactory  completion  of  three'^ears  dp  experience.,  ^n 
tory'*  evidence  of  knowledge  of  professional  practice  and 


supervlslpn  of  constn ij;tlon  which  the  Board  e^t  their  discretion  could  also  require,  I 


/ 


utlve  Secretory  one  week  prior  to  the  hearing  In  front  of  my  . 
gat  directions.  The  Executive  Secretary  stated  that  he  did 
required  per  that  phone  conversation  and  this  also  vm.Bl  * 
Ihg  transcript,  / 

:ulre  any  eyldeqc||/of  knowledge  of  prof0^slohal  prictlce  and/or 
fructlon,  PfqwevaV,  we  did  present  documentation  showing,  that 
hltecturai  student,  1  did  complete  a  graduate  level  architectural 
!e  course  at  The  Ohio  State  University  when  the  reguUr  professor 
My  duties  Included  completing  the  remaining  lectures,  grading 
exams  and  detennining  final  grades,  |  would  like  to  note  that 
was  coipplated  by  myself  without  other  faculty  supervision.  In 


regard  to  kngwlfi^dga  of  supervision  of  construction,  an  affidavit  was  submitted  -by 
6n  expert  in  tne  building  industry  in  which  ha  descnribed  the  Importance  and  extra 
benefits  of  a  yoomblned  business/architectural  background  to  supervision  of  coQstructlpn 
activities  (isyj/b  Exhibits  C*-3  and  0'-%    .  $  " 

The  Board 'a' Executive  Seci'etary,  in  response  to^  their  legal  counsel's  guestioning  , 
testified  atMie  May  18,  1979  hearing,  that  to  his  knowledge,  no  one  had  ever  been 
admitted     practice  under  Section  4703.08  (A)  0,R,C,  and  that  I  was  the. first  person 
to  ever  apply  (see  Exhibit  C-1), 

Per  an  liiji^estlgatlbn  conducted  In  July,  1979,  by  Senator  M.  Mpiris  Jackson,  Ohio 
Senatf  President  Pro  Tampoje,  on  my  behalf  regarding  the  history  of  all  applications 
approved  under  section  4703,08  (A)  6iR,C, ,  a^list  of  appiroximately  350  approved 
applications  was  documented  (see  Exhibits  c4l2  thru  C-16).  Unfortunately,  the 
above  facts  could  not. enter  the  court  as  evid^ce  Since  the  Board's  denial  of 
certlfl^tlon  was  upheld  by  the  Court  of  Common  Pleas  and  was.  already  in  the  Court  of 
App^aA^s  process.  ..  >c 

'.//.•■■■../ 

The  B'bard'S  Executive  Secretary  contended  to  Senator  Jackson  that  in  1946  the  rules 
of  thij  Board  were  amended  to  permit  a  written  examination  under  the  provisions  of  , 
Sectjcjn  4703.08.(A)  O.R.C. 

Section  4703-1-02  Rules— rela^ve  to  filing  applications 

(F)  In  consideration  of  applications  for  registration  by  exemption  under ' 
Section  4703 » 08,  of  the  RevUpd  Code,  the  Board  reserves  the  right  to 
exercise  the  discretion  proWte3  therein,  by  requiring  the  applioant  to  qualify 
by  passing  th^^echnlcal  examination,'  or  in'4*leu  of  the  techiiical  examination 
the  applicant  may  submit  a  Certicate  fron\^the  National  Council  of  Architectural 
1  Registration  Boaitts  showing  satisfactory  qualifications  which,  in  the  opinion 


.'I 
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I  of  the  Joard/  arfi  equal  to  those  required  In  the  State  of  Ohio  at  the  date  of 
.  I  application. 

I  '  ■  ■     ■;  .  ;  f 

comparing  Section  4/03.08  (A)  O.R.C.  to  the  above  rule  It  becomes  clear  that 
the  rule  does  hot  give  the  board  the. discretion  to  totally  disregard  this  sectl;: 
t|ie  law.  "  ■  f ' 


The  Analysis  of  Senate  Bill  Kp.  1$,  (as  paliiBd  by  the  Senate).  Ohlo'ff  113th  General 
Assembly— Regular  Sdsslon  1^7d-198Q^  a  bill  which  added  further  restrictions  to 
Architectural  professional  entry,  'parJphrades  Section  4703.08  (A)  O.R.C.  and  states 
that  it  is  one  of  the  two  basic  methodi  of  establiahlzig  proficiency  as  specified  in  ' 
the  law  to  obtain/ architectural  certification.  How^Ver,  also  documented  in  this 
analysis  is  the  following  statement:  ''According  to  the  Board  this  method  wa^  used 
to  "grandfather"  into  th^  system  architects  practicing  at  the  time  the  law  passed,  but 
is  not  currently  used  by  the  Board  to  graint  certification. "  .  (See  Exhibit  G-7) .  By 
reviewing  exhibit  0-8  (a,b,c.and  d),  Section  1334->7  (A)  and  (C)  General  Code  and  . 
amended  forms  of  Section  47 03. OB  (A)  O.R.C.  in  1965,  1969  and  1973,  it  be<;omes 
clear  that  thi  actual  '^grandfather"  clause^  ^c.  1334<-7  (G)),  waf  repealed  in  1932 
and  that  Section  4703.08  (A)  was  still  a  viable- altomativ.e  according  to  the  Ohio 
Legislature  at  the  time  X  applied^ 

The  Board  denied  my  aPPUcalon  under  Sectiori  4703.08  (A)  O.R.C.  -  with  the 
Justification. "that  the  applloaht  did  not  provide  any  evidence  at  the  hearing  which 
woul^  show  that  he  possessed  anv^pecial  qualifications  for  licensure  without  taking 
the  examination  required  under  Section  4703.07,  Ohio  Revised  Code"  and  "that  the 
Applicant  at  the  time  of  the  hearing  had  not^passed  the  examlnati^  required  by  * 
Section  4703^07,  Ohio  RevUedCodeV"      *  ' 

In  rebutal,  the  statute  only  calls  for  "^satisfactory"  evidence  and  the. facts  presented 
strongly  indicated  that  the  Board  had  determined  prior  to  the  hearing  that  no  matter 
what  evidence  I  submitted,  their  willingness  to  license  urider  the  "license  without 
examination  9tatu»^\.  ^  sepajrate  alternative  statute  for  licensure),  would  be* 
negative. 


The  Cuyahoga  County  (!|^urt*of  Common. Pleas  in  November,  1978,  upheld  the  Bdhrd's 
order  without  justlficatl^.  Recently,  the  Cuyahoga  County  Court  o£Appeals,  Eighth 
District,  which  had  the  o^ortunity  to  review  the  Analysis  of  Senate  BlH^'^o.  IS  --* 
Ohio  113th  General  Assembly.  a}so. upheld  the  Board's  order  with  in  my  ppinion  the 
following  major  justification.  '  '  \ 

\?  '   ■  ^  I 

the  Board  did  not  abuse. its  discretion '^%  .  .with  respect  to  the  furnishing  of* 
satisfactory  evidence  oi  knowledge  of  professional  practice  and  supervision 
of  cohstruction" ,  we  find  the  Board  of  Examiners  from  the  evidence  presented 

^  in  the  matter  sub  judice  could  haVe,  and  we  believe  did  find  the  evideiice  . 
•    submitted  was  insufficient  to  demonstrate  satisfactory  evidence  of  "knowledge 
of  professional  practice  and  supervision^f  construction. "  Against  the  back- 

.  ground  of  such  a  finding,  the  issu0  of^ab^se  of  discretion  does  not  arise.  « 


AssumW  argu^ndoihat  this  presents  an  Issue  with  respect  to  abuse  of 
discretion,  we  ftole  that  the  term  "abuse  of  discretion'*  connotes  more  than  " 
an  error  of  law  (^judgements;  It  Implies  an  uiireasonable,  Arbitrary,  or 
uncon^olonabl|Vttltude»  An  action  Is  arbitrary  If  It  Is  without  some  fair  and 
""substantial  cadjpe  or  reason,  or  lf.lt  has  no  evidence  to  support  It.  '* 

The  presented  facts  Including  the  analysis  of  Ohio  Senate  BlU  No.  15  Indicate,  In  niy 
opinion,,  that'  an  abuse  of  dlsoretl^  did  occur.  It'ls  most  dd^cult  to  spend  oyer  one 
year  in  administrative  appeal  proceedings  with  the  conceptual  framework  of  the 
matter  predetermined  'before  the  presentation  of  facts  eliminating  probability  of  tnigi.. 
due  process  of  law.  One  ofray  major  justifications  for  presenting  my  personal  case 
analysis  here  Is  to  llluatiate  the  need  for  this  Congress  to  design  a  standardized  due  . 
proceed  conceptual  framework  of  proze agonal  testing  giflde lines  to  ensure  that  all 
matters  of  business  handled  by  state  iQ^nslng  boards  provide  for  a  continuous  process 
of  due  process. 

In  regard  to  the. Critiques  of  Ncl^B  jjrofesslonal  ex^im  per  se,  I  will  briefly  present  ^  j 
Information  from  relevent  research  data  accumulate di^  • 

"An  Evaluation  of  the  Examinations  Administered  by  the  Architects  Section  of  the 
Architects,  Professional  Engineers,  beslgners  and  Land  Surveyors  Examining  y 
BoartI/'  submitted  to  the  State  of  Wisconsin,  Department  of  Rdgulatlon  and  Licensing 
br4.  Glenn  E-  Tagatz  of  international  Personal  Services,  Inc. ,  Milwaukee,  Wisconsin, 
ih  Ffcruary,,.1976y  made  the  following  iflndlngs:  The  NCARB  examinations  do  not 
mee't  the  spjkplflcatlons  of  the  American  Psycologlcal  Apsbclatlon  (APA)  with  regard 
to  use  of  psycologic^measuyement  technology  In  exam  preparation  wl^  respect  to 
job  skills;  nor  Ihe  E^l  Employment  Opportunity  Commlsslons's  (EEOC)  guidelines 
for  job  relatedness;  nor  the  Uniform  Guidelines  on  Employee  Selection  Procedures  of 
the  Equal  Employment  Opportunlt^jpoordlnatlng  Cpuncll  (EEOCC)  (See.Exhlblts  B-l 
and  A-3)-..  ,       .  •      '  '  r."'- 

The  "Content  Analysis  of  the  NCARB  Examination"  (Exhibit  B-2) ,  prepared  for  the 
State  of  Wisconsin,  Department  of  Regulation  and  Licensing,  prepared  by  Dr.  Peter  E. 
Schrlber,  Mr.  Michael  Priestley  and  Mr.  Brent  Cambell  of  National  Evaluation  Systems, 
Amherst,  Massachusetts^  In  June, .1979,  concluded  the  following: 

^     "The  most  Important  conclusion  Is  that  the  match  between  NCARB  examination 
content  and  the  Wisconsin  Task  List  was  less  than  50%  on  an  item-by-ltem 
match  basis.  Also /"the  proportionality  of  the  NCARBI  examinations  differed 
considerably  from  that  of:the  Task  List. "  l>lease  note  that  "EEOC  Gtildellries. 
state  that  Isst  content  should  be  as  close  to  100%  job-related  as  practical  and 
that  the  further  away  fTQm  100%  the  less  job-relatyd  the  test  Is.  "    -    '  . 

I  do  not  want. to  Imply  tfiat  flCARB's  use  of  Its  current  exam  Is  an  Intentional  act 
to  restrain  treide.  Howfiver<  an  only  50%.  job  related  exam  m^y  In  effect  do  so.  The 
exam  is  graded  on  the  basis  6f»relatlve  distribution  of  scorfed.  The  national  pass  ^ 
rate  Is  approximately  54%^ore  or  less  each  year.  Per  the  1978  NCARB  Architectural  . 
Reoistratlon  Handbook,  National  Council  of  Architectural  Registration  Boards  and 


Arohltdttural  Record  Books,  1978,  p.  14,  "All  of  the  score  distributions  for  the 
Prjbfessional  examination  have  relatively  small'standard  deviations;  that  is,  the  . 
dispersion  of  scores  is  only  about  one-half  of  what  might  be  expeicted  in  tests  of 
tUis  length.  This  would  suggest  that  the  examinees  who  actually  took  the  test 
^nded  to  be  relatively  homogenous  (i»e,,  quite  similar  In  terms  of  both  personal 
Characteristics  and  ability) ,  an  assumption  which  is  borne  put  by  the  description  of 
candidates  In  teny  of  age,. educational  level, ^etc," 

■•  .      ,  . 

Since  the  ex^  is.  l^ss  than  S0%  jol}  related,  and  score  distributions  have  relatively 
small  stantlard  deviations,  guessing  well  on  exam  questions  seems- to  be  tHe  priihary 
vehicle  iifto  the  profession  (based  on  NCARB's.  allegatjlpn  that  test  candidates  are 
quite  slm^Uar  In  term^of  ability) ,  .  • 

Another  problem  must  be  presented  concerning  the  l^ck  of  uniformity  in  applicant 
"intern'*  education »  The  "intern"  period  iranges  from  one  to  five  years  depending  on- 
college  degree  status,  (thirteen  years  in  some  states  for  non-degree  candidates), 
witn  three  years  being  the' average  for  five-year  professional  architectural  degree 
hold  \eT9  (Bach elor^f  Architecture).  The  problem  concerns  the  diversity  of  architectural 
'practices  in  both  their  size  arid  the  building  type  markets  they  are  Involved  In.  Many 
"Intern"  architects  are  only  exposed  to  work  areas  that  return  maximum  profits  to 
their  employers ,  Without  a  required  uniform  "intern"  training  program.  Incentives 
will  continue  to  exist  which  motivate  employers  to  exploit  this  captive  "cheaper-  ' 
labor**  "intern"  labof  force  rather  than  providing  the  kinds  of  training  these  employees  ' 
are  paying  for  In  reduced  wage*  and  In  effect  Increase  their  chances  (assuming  a 
valid^xam  is  given)  of  passing  their  architectural  licensing  exam  (s) ; 

Mr.  Patrick  Clinton's. article  **A/E  licensing  under  attaek  In  several  states, " 
published  in  the  May,  1979  issue  of  Building  Design  and  Construction,  pp.  14-15/  16, 
provides  an  excellent  suj^nmary  of  current  NCARB  validity  problems  across  the  country  . 
(see  Exhibit  B-3).  >  ^ 

Profonn's  article  **Wi8consln  Architects  Balk  at  National. Exam— Deftlgn  Their  Own, " 
published  by  theiNationai  Center  for  the  Study  of  Professions,  Washington,  D.C. , 
November,  1978.,  p»  3,  gives  an  excellent  account  of  activities  In  Wisconsin  leading 
:up' to  NCARB  examination  ellm^lnation  and  replacement  (Exhibit  B-5).  ^ 

'Mr»  Rpn  Shattil's  article,  "A  Critique  of  the  Registration  Examination  as  a  Measurement 
of  Beliisfs  Rather  than  Ability,"  An|erlcan  Institute  of  Architects  Toumal/November. 

'  1976,  pp.  78-79,  100  and  letters  to  NGAKB  from |poncemed  parties  (Exhibits  B -6  and 
B -7) give  good  aocounts  of  content  problems  associated  wit>i  the. NCARB  exam. 

Illustrations  of  recent  goncema  expressed  by  Federal  Agenqies  regardliig  the  negative 
ebonomi6' effects  of  our  Increasingly  expanding  professional  cartels  ar^  found  in  the 
following  statements:  :  '  ... 

*  J 

"An  Address  by  Michael  Penschuk,  Chairman, ^Federal  Trade  Commisslotfi 
before. the  American  Enterprise  Institute  Licensure  Conference",  Washington, 
D,C,  (Exhibit  i\-l)  Feb.  22,  1979  and  /  * 


"Occupational  Licensing:  Cpn^ljper  Protection  or  Cartel  'Management? " , 
remarks  by  Mr.  Donald  L,  flfexner,  Deputy  Attorney  General ,  Antitrust 
Division,  Department  of  Justice,  before  the  Kentucky  Legislative  Research 
Cominlsslon's  Program  on  Occupational  Licensing,  Lexington,  Kentucky, 
.     February .2 ,  .  1979  CBxhlblt  A-2) , 

The  statements  made  by  Mr.  Pertschuk  and  Mr.  Fiejgier  Illustrate  our  need  to  be  . 
concerned. about  professlpnal  cartels  Umltlng  comsJetjltion  to  keep  prices  high. 
Mr.  Partschuk  stated  one  of  the  problems  is  the  state  licensing  of  professionals,  a 
process  usually  dominated  by  members  of  tfiis  professions  who  hdld  down.the  number 
of'entrants  to  control  competition. 

I  have  been  cooperating  with  the  Federal  Trade  Commission  In  an  InyestlgaUon  of 
the IJCARB  exam  since li/Iarch,  1979.  Alsb,  I  have  been  fpUowlng,  with  much 
Interest,  efforts  by  professional  political  action  committees  aimed  at  inhibiting,  the 
FTC  *  8  regulatory  authority  which  la  dicected  towards  maintaining  a  competitive 
economic  system  that  does  not  unreasonably  constrain  private  economic  activities. 
I  am  hopeful  that  this  Congress  will  carefully  analyze  the  trade  offs  of  their  actions  ; 
toward  the  FTC  with  respect  to  the  balance  of  our  mixed  system  of  government  and 
private  enterpnao  as  well  as  our  mixed  system  of  monopoly  and  competition. 

A  major.  Usue  to  be  evaluated  Is  the  direction  of  our  administrative  legal  system. 
Unlike  our  civil  and  criminal  systems,  which  have  developed  with  us  over  the 
centuries,  the  admlnlstraUve  system  was  bom  early  In.thls  century.'  Unoliecked,  It 
could  have  strontr  negative  effects  on  our  economic  and  political  system.;  I  pray  . 
that  our  American  Economic  Dream  of  growth  and  properlty  continues  for  centuries 
into  the  future.  Ensuring  that  professional  entry  Is  maintained  at  reasonably 
competitive  levels  In  cbnslderaUon  of  providing  for  the  public  health,  safety. and 
.  welfare  is  but  one  component  of  the  chain  of  events  that  will  Insure  the  American 
Dream. 

EXHIBITS 

-A  -         FEDERAL  AGENCY  CONCEllNS 

A*l:       Michael  Pertschuk,  Chairman,  Fejieral  Trade  Commission,  Wash. ,  D.C. , 
An  Address  before  the  American  Enterprls^Irtitltute  Licensure  Conference  i 
Feb.  22,  1979.  i 
"%  ■         '  '  .  . 

A-2:       Donald  L.  Plexner,  Deputy  Assistant  Attorney  General,  Antl-trua^  Division, 
Dept.  of  Justice,  Wash,,  D.C,  "OCCUPATIONAL  UCENSING:  CONSUMER 
PROrBCTION  OR  CARTEL  MANAGEMENT? "  before  the  Kentucky  LeglslaUve 
Research  Commission's  Program  on  Occupational  Licensing,  I'eb.  ,  1979. 

A-3:        "EEOC  MAY  TAKE  ANCXTHER  LOOK  AT  TITLE  vrf  JURiS£)ICTION  O^ER  LICENSING 
AQENCres ; "  Proforum ,  published  by  the  National  Center  for  the  Study  of 
Professions,  Wash.,  D,C.,  April,  1979,  pp.  1-3.  , 

-B-        CRITIQUES  OP  THE  NATIONAL  COUNCIL  OF  ARCHITECTURAL  REGISTRATION  V 
BOAKlDS  (NCARB)  EXAM  —  written/Implemented  1972  . 


Dr.  Glenn E.  Tagatz  of  Intematlpnal  Persortnel  Services,  Inc.,  Milwaukee, 
•  Wise.  <  "AN  EVALUATION  OP  THE  EXAMINATION  ADMINISTERED  BY  THE 
ARCHITECT'S  SECTIQN  OF  THE  ARGHITEGTS;  DESIGNERS  AND  LAND  SURVEYORS- 
EXAMINATION  BQ^RD,"  Submitted  to:  State  of  Wise. ,  Dept.  of  Regulation 
and  Licensing,  Madison,  Wise,  Feb.,  1976. 

*br.  Peter  E.  Schribor,  Michael  Priestley  and  Brent  Cambell  of  National 
Evaluation  Systiams  Inc. ,  Amherst,  Mass. ,  "WISCONSIN  ARCHITECTS  i 
nCENSING  PROJECT,  CONTENT  ANALYSIS  09  TOT  NCARB  EXAMINATION  —  - 
FINAL  REPORT,  "  prepared  fon  Dept.  of  Regulation  and  Licensing,  state  of 
Wise. /Madison,  Wise. ,  June,  197?.-  .  . 

Mr.  Patrick  Clinton,  Contributing  EdUor,  Building  Design  and  C9natructlon. 
"A/t  LICENSING  UNDER  ATTACK  IN  SEVERAL  STATES/"  May,  1979,  pp.  14-15, 


Mr.  Oliver  Wltte,  Editor.  Building  Design  and  Constructipn.  •'LEGISlAtUI^S 
..ASK:  WHY  LICENSE  A/£»s?'^  May,  1979,  p.- 9.  ■ 

"WISCONSIN  ARCHiTECTS  BALK  AT  NATIONAL  EXAM.  —  DESIGN  THBljL  OWN/" 
Proforum,  published  by  the  National  Center  for  the  Study  of  Professions, 
Nov., J978,  p. 3. 

•  ■     .  ■  • 

Mr.  Richard  C.  Therti,  President,  Them  Assoc. ,  Inc.,  Waupaca,  Wise, 
letter  to  Dr.  WiUiamGorth,  PH.  D.,  National  Evaluation  Systems,  Amherst, 
Mass.,  re:  NCARB  exam,  Dec.  7„  1977.  >^ 
■        ■  % 

Mr,  Thomas  Vonler,  Project  Dirpctot,  A.I.A^  Research  Corp. ,  Wash.,  D.C., 
letter  to  Mr.  Samuel  T.  B.alen,  Director,  NCARB,  re:  NCARB  exam, 
Jan.- 3,  1978. 

CASE  HISTORY  OF  MR.  SHELDQN  R.  GOLDSTINE  r- APPLICATION  TO 
PRACTICE  ARCHITECfURE. 

-ON^  ARCHTECT  IN  SEARCH  OF  A  UCENSE,  "  Rrtyforum,  published  by  ■ 
the  Natloneil  Center  for  the  Study  of  ProfesslojM,  Ve. ,  1979,  pp.  1-3. 


re:  knowledge  Professional  practice. 

Sheldon  R.  Goldstine,  under  Sec.  4704.08  (A)  O.R,C.  (1334-7  (A)  G.C.), 
re:  knowledge  Supervision  of  Construction.  . 

Mr.  Irving  Rothenberg,  letter  to  Mr.  William  N .  Wilcox,  Exec.  Sec'y.i 
State  Board  of  Examiners  of  Archlt9cts/Ohlo,  re:  Sheldon  R.  Goldstine, 
Feb.  2i2,  ^979. 
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C-6: 
.C-7: 
C-8: ' 

C-10: 

C-13: 
C-14: 

C-15: 
C-16: 

-D- 


Dr.  Barry  I.  Plreman,  Superlnteijdent,  Western  Reserve  Psychiatric 
,  Habllltatlon  Center,  letter  to  Mr.  tWllUam  N.  Wilcox,  (e:  Sheldon  R. 
Goldstlne,.Feb/  20,  1979.  § 

-Analysls.S.B.  15/ 113th  General  Assembly/  Oh^o,  proof  that  I  never  , 
received  due-process  In  my  application  before  the  Ohio  Architect'^  Board  • 
under  Sec*  4703.08  (A)' O.R.C.  .  ;  « 

History  Section  4703.08  (A)  Ohio  Revised  Code  (Sec.  1334-7  (A)  General  - 
Code) 

Actual  "GrQn(^father'8  Clause  Sec.  1334-7  (C)  G.C.  \ 
Refer  supplements  a, b, Candid  to  review  original  law  plus  amendments  In 
1965,  1969  and  1973.  %■     -  ■ 

Letter  from  Sheldon  R.  Goldstlne  tp  Ivfr.  Willlam^N.  Wilcox,  Executive 
Secretary,.  State  Board  of  Examiners  of  Architects,  State  of  Ohio,  April 
22,  1979'.  ,  '       .    .  .     ■  f        ■  • 

Letter  from  Sheldon      Goldstlne  to  Mr^  WUllam  N.  Wilcox,  April  25,  1979. 

■    ■  ■  ■  "     .\      ■  '        ■      ■  ■ 

Letter  from  Mr.  William  N  .  Wilcox  to  Sheldon  R.  Goldstlne,  April  ^7,  1979. 

Letter  from  Honorable  M.  "Morris  Jackson,  President  Pro  Tempore,  Ohfo 
State  Senate,  to  Mr.  William  N;  Wilcox',  re:  history  of  all  applications 
under  Section  4703.08  (A)  '.O.R.C.  (1334-7  (A)  G.C),  July  12,  1979. 


Letter  from  Mr%  WlUiam  N.  Wllco*x  toSena'tor  M.  Morris  Jackson,  .        .  « 
July  l.?79.  ■     '  . 

Letter  from  Mr.  William  N .  Wilcox  to  Senator  M.  Morris  jackson ,  documenting 
350  more  or  less  applications,  aplJroved  by  the  Ohio  Architect  Board  under 
Section  4703.08  (A)  O.R.C.  (1334-7  (A)  G.C),  August  7,  1979. 

Letter  from  Sena^r  M .  Morris  Jackson  to  the  Honorable  Dean  Conley, 
.Representative^  Ohio  House,  re:.  Section  4703.08  (A)  CR.C 

Letter  from  Representative  Dean  Coi;iley. to  Senator  M .  Morris  Jackson,  re| 
use  of  Section  4703.08  (A)  O.R.C..^  Ohio  Architects  approximately  twenty 
VfearS  ago.  '      ' '    ^         '  ' 

AMERIcivN  INSTrrUTE||F  ARCfMll^ECTECTS  (A.  J.A  J  DESIGNS/BUILD  TASK 
fljDRCE  I^EETINGkMARcH  il,  1974,  -ret  architectual  profession's  need  to 
becomemoce  business  oriented  If  iHs  to  survive — conslstant  with  the 
bus InefiS/aHbhltectural  a cademl^  program  Sheldon  R.  Goldstlne  began  In  .1967. 

Again,  thank  you  for  this  opportunity  to  testify  before  you  fepday. 

■  ■  « 

sectfuUy  and  very  truly  yours, 
[TeldonR.  Goldstlnb,  MBA/M.  Arch.  . 


Honorable  Sam  M.  Gibbons 
Honorable-Ted  Weiss  # 
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Mr.  Weiss.  Thank  you,  Mr.  Goldstine. 

Our  las|;  witness  is  Mr.  I.  Leon  Smith,  director.  Professional 
Examination  Service.  i 

STATEMENT  OF  I.  LEON  SMITH,  DIRECTOR,  PROFESSIONAL 

EXAMINATION  SERVICE 

'    ■  ^     '     ■  ^4 

Dr.  Smith.  Thank  you. 

M^.  Chairman,  I  am  Dr.  I.  Leon  Smith,  director  of  the  division  of 
Profession^  Examination  Service  responsible  fQr  developing  certifi- 
catioi!i  and  licensure  examinations  in  the  social  sciences,,  medical 
sciences,  environmental  health,  and  allied  health  areas. 

Professional  Examination  Service  is  a  nbt-for-pr6fit  corppration 
which  has  been  engaged  in  the  assessment  of  the  qualifications  of 
health  ^nd  health-related  professional  workers  for?  more  than  35 
years.  .  \ 

Accordingly,  PES  as  well  as  many  of  it^lients  will  be  subject  to 
the  provisions  of  H  R.  8564  that  specifically  relate  to  occupational 
testing.  It  is  our  interpretation  that  the  language  of  section  3.3  and 
section  6(a)5  and  section  6(b)4  is  sufficiently  vague  to  include  and 
require  (fsclosure  of  actual  test  items  and  answers  for  every  ad- 
ministration of  an  examination  given  for  licensure  or  certification. 

The  major  purpose  of  the.  testimony  I  wilLprovide  today  is  three- 
fold: y 

First,  I  wouja  like  to  raise  some  serious  questions  and  issues 
concerning  th^  negative  impact  that  dis(:^losure  will  bring  to  the 
crederltialinfl^field  in  general. 

Second,  rwill  discuss  the  inappropriateness  of  the  provisions  of 
section  6Cd)  regarding  the  setting  of  passing  points  for  occupational^ 
tests.  /..■".■■ 

The/^isclosure  of  items  on  a  current  examination  will  require  a 
eoni^^t  supply  of  new  items  in  order  to  provide  secure  tests.  I 
believe  there  is  a  real  issue  as  to  whether  and  to  what  degree 
UCensing  and  certifying  bodies  could  develop  new  examinations  for 
/each  aaministration.  " 

Without  these  examinations,  credentialing  agencies  will  hav^  a 
difficult  time  selecting  qualified  practitioners.  This,  in  turn,  wiU 
reduce  the  ability  of  the  agencies  to  provide-'public  protection  and 
satisfy  the  public's  demand  for  quality  health  service. 

I  have  considered  a  number  of  factors  in  making  this  stateittent. 
Over  60  percent  of  our  clients  use  their  own  unique  examinations 
as  licensing  and  credentialing  criteria  in  addition  to  the  examina- 
tions we  developed.  H,R.  3564  would  require  disclosure  df  these  test 
items  as  well,  whetl^eir  they  be  writteh,  oral,  multiple  choice,  ess£|y, 
practical,  performance  or  demonstration. 

Notwithstanding  the  obvious  difficulties  associated  with  disclos- 
ing several  types  of  thdse  examinations,  the  *item  pools  in  these 
unique  areas  tend  to  be  quite  smaU  and  would  quickly  be  depleted 
upon  disclosure. 

A  survey  pf  our  clients  indicates  that  examinations  may  be  given 
as  many  as  10  times  per  year  and  in  many  ca^es  on  an  individual 
or  small  group  basis.  There  is*  no  question  that  disclosure  would 
seriously  reduce  the  numiber  of  times  these  examinations  could  be 
administered.  1     „^  f 
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This  in  turn  would  markedly  reduce  the  opportunity  now  availa- 
ble in  certain  fields  for  multiple  State  licensing  within  a  reason- 
able time  period.  This  proce,dure  permits  candidates  to  take  all  of 
the  unique  examinations  given  by  States  in  the  same  region  of  the 
country  over  a  period  of  a  month  or  two. 

\  This  is  an  extremely  important  concept  which  presently  in- 
cir^ases  employment  opportunities  andVprovides  for  much  greater 
professional  mobility  tl|ian  would  Jbe  pdssibl^  if  the  multistage  se- 
quencing were?  eU^ 

.  .  Several  fields  employ  v«^hat  is  referred  to  as  multistage  Ufcensing 
procedure^This  means  that  a  candidate  must  piass  one  le^l  before 
going  on  toHhe  next  in  the.  sequence.  Typically,  the  sequence  is 
offered  several,  times  during  the  year.  Under  test  disclosure  condi- 
tions,, howevfer,  with  its  attendant  requiremeipt  for  new  items  and 
examinations,  it  >nay  only  be  possible  to  administer  portions  of  the 
sequence  once  during  any  given  year,  thereby!  creating  considerable 
delay4n  the  liqensihg  process.  , 

In  other  cases,  licensing  boards  may  be  hard-pr(gsse(^'  to  meet 
their  statutory  responsibiUiies  which  would  require  the  licensure 
process  to  be  implemented  twice  a  year.  I  bdi^ve  it  would  be  fair  to 
say  titet  licensing  boards  who  could  not  me^' their  statutory  re- 
sponi^ibilities  would  be  subject  to  litigation  for  Ipreventiiig,  or  at  the 
very  least,  delaying  occupational  employability. 

Disclosure  will  also  havte  a  dumber  of  adverse  effects  of  an  educa- 
tional fiature,  Primary  among  them  is^  that  it  will  encourage  in- 
structional programs  to  m  more  closely  oriented  to  the  specific 
items  contained  on  the  tests..  This  type  of  instruction. perverts  the 
intention  of  licensing  and  Wtifying  examinaitions  and  will  ulti- 
mately reduce  the  independent  Value  of  educational  criteria. 

Specifid  examination  item*  shojild  be  viewed  ,  as  merely  a  repre- 
sentative sample  of  a  competency  domain  or  .subdomain  of  the 
required  occupational  knowledge,  and  not  of  Vital  importance  in 
'their  own  right.  Disclosure  will  unavoidably  .draw  attention  to 
specific  items  and  away  fromUhe  competency-,  areas  from  which 
they  are  derived.  \  r      ^    .      .  ^ 

An  assumption  underlying  disclosure  is  'that  ^  licensing  and/or 
certifying  examipatiori  can  be  treated  as  a  learning  experience  and 
that  candidates  can  acquire  knowledge  or  competency  from  seeing 
what  they  missed  along  with  the\correct  answer,  ^his^  is  simply  not 
the  case.  \  1 

In  a  number  of  licensing  areasUnd  in  several  States  the  boards 
literally  have  no  control  over  who  actually  sits  for  the  examina 


cational  experi- 
believe  it  would 
didate  could  in 
specific  exami- 
iring  the  broad 


-tion;  Candidates  with  limited  background  and  ed 
eiice  can  and  do  take  the  licensingWaminations.  1 
be  seriously  misleading  to  suggest! that  such  a  ca 
fact  acquire  "competency^'  from  viewing'^ i^  on 
^vHation.  learning  answers  is  not  the  sanne  as  ^cqi 
base  of  knowledge  sampled  by  the  items.  - 

Since  disclosure  will  require  a  new\  examination  for  Qvery  j^dmln- 
istration,  iricre?ffied  costs  can  be  anticipated  but  at  levels  substan- 
tially higher  than  those  predicted  for  admissions  testing. 

This  is  because  the  costs  for  ^pome  of  our  client's  own  examina- 
tions will  be  spread  across  perhaps  aslfew  as  10-15  candidates  per 
I  year  as  opposed  to  thousands  as  is  tjl^e  cas6  with  large  aptitude 
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testing  programs.  Several  unfortunate  consequences  can  be  antici^ 
pated;  ^ 

While  increased  costs  could  be  minimized  by  reducing  the  length 
and/or  scope,  in  otheV  words,  reducing  the  items  or  questions  of  the 
new  examinations,  the  psychometric  quality  of  the  tests  will  suffer 
and  sampling  of  the  content  areas  so  vital  to  competency  assess- 
ment may-:be  dOmpromised. 

Perhaps,  more  unfortunate  the  level  of  increased  costs  may  force 
some  of  our  clients  to  eliminate  the  implementation  of  their  unique 
examination  criteria  which'  are  typically  oral,  written,  essay  or 
practical  in  nature,  and  rely  exclusively  on  the  PES  examination 
which  employs  a  multiplen^hoice  format.  This  would  result  in  a 
limitation  in  the  range  of  methods  and  skills  that  are  assessed  and 
through  which  liceni^ing  and  certifying  decisions  are  made. 
^     The.  occupational  provisions  of  H.R.  3564  will  be  thrust  into  an 
already  volatile  social  and  political  climate  involving  the  mixtjire 
of  sunset  legislation,  and  tjhe  uniform  guidelines  <^  employ mfent 
selection  procedures.  ISome  areas  in  the  licensure  field  are  current- 
;ly  fighting  for  survival  on  one  hand  through  the  application  of 
sunset  laws,  and  increased  demands  for  further  clarification  knd 
validation  of  procedures  and  methods  on  the  other  in  responsje  to 
the  joint  guidelines..  *  1 

While  there  ia  certainly  a  question  as  to  wljether  the  uniform 
guidelines  apply  to  licensure  and  certification  functions,  tnplt  of 
our  cliente  want  to  be  as  responsive  as  possible  to  the  validational 
issues.  9ince  the  uniform  guidelines  clearly  have  the  weight  of  law, 
it  would  appear  that  they  could  serve  as  one  form  of  "truth  in 

t^ing/'  1?  -  -  -     

I  believe  that  many  licensing  and  certifying  bodies  will  have  all 
they  can  handle  to  meet  these  guidelines  under  their  current  ex-/ 
amination  and  fee  structure.  | 

What  will  the  introduction  of  H.R.  3564  accomplish  in)  this  set- 
ting? Licensing  agencies  will  have  to  produce  sufficient  new  forms 
of  examinations  that  the  disclosure  provisions  make  necessary, j 
each  of  which  is.  responsive  to  the  validity,  requirements  of  the  jointf 
guidelines.  ' 

The  net  result  may  very  well  overwhelm  and  incaipacitate  the 
credentialing  system.  Giveq^the  current  political  situation  in  some 
States,  the  likely  failure  ofllicensing  bodies  to  meet  ttiese  consider- 
able requirements  at  a  high  standard  of  accomplish^ntr^KiU  sim- 
ply make  termination  under  existing  sunset  legMation  a  more 
attractive  alternative  in  certain  fields.  I' 

I  believe  this  would  be  unfortunate  for  those  who  are  interested 
in  maintapning  the  quality  of  excellence  in  health  and  health- 
related  services.  \  i.'  ^  ^ 
.     With  respecjt  to  the  issue  of  determii'iing  an  appropriate  passing 
kpoint  on  a  licensing  or  certifying Examination  pontinues  to  be  one 
the  most  vexing  problems  facing  the  credentiannfe  field. 
In  the  normative  approach,  a  bell-shaped  or  normal  distribution 
9f  examination  scores  is  assumed,  and  the  characteristics  i)f  the 
sqore  distribution  are  used  both  to  set  a  passing  point  and  to 
provide  a  rationale  «for  interpreting  scores.  This  approach  is  based 
on  the  assumption  that  a  specifiable  proportion  of  Qualified  candi^ 
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,  dates  can  be  expected  to  meet  min^muAi  standards  for  performance 
1  in  ^he  occupation.  '  / 

3tat 


For.,  example,  if  a  passing  point  is  set  at  1.0  standard  deviations 
below  the  mean  of  a  normal  distribution,  84  percent  of  the  popula- 
tion of  candidates  are  assumed  to  be  qualified  for  the  credential. 
The  normative  approach  is  criticize  d  because  the.  standards  set  are 
referenced  solely  to  the  distribfttijn  of  ability  in  the  normative 
sample  of  exanainees,  4nd  do  not  take  into  account  criteria  for 
acceptable  perfbrmj|nc€i  in  the  occuppatipn^  to  which  passing  exami'^ 
inees  ari^amitted.  ' 

It  is  possible  that  all  or  none  of  1;l\e  candidates  arescqmpetent  to 
practice^  but  a  normative  passing]  ^  *  "  ' 
specific,  predetermined  prbpdrtion 
nation. 

An  appropriate  decision  strategy 


point  will  always  result  in  a 
who  will  pass  or  fail  the  exami- 


_  in  credentialing  should  includje 
a  means  of  linking  decisions  to  minimum  criteria  for  acceptable, 
performance.  *  The  objectiye  is  to  set  a  standard  such  that  examin- 
ees whose  tr^e  level  of  ability  is  aboye  that  standard  are  creden- 
tialed  while  those  whose  true  level  of  ability  is  below  the  standard 
are  not  credehtialed.  \ 

.  The  criterion-referenced  approach  to  setting  a  passing  point  was 
introduced  to  Accomplish  this  objective.  The  criterion-referenced 
approach  is  characterized  by  the  use  of  an  absolute  performance 
st^dard  rather  Chan  the  relative  standard  based  on  normative 
data. 

AH  absolute  performance  standard  is  a  fixed  score  which  repre- 
sents minimal  acceptable  performance  on  the* test,  such  as  75  per-  > 
cent  of  the  items  ion  the  test  answered  correctly  which,  iivbiden tal- 
ly, is  the  legislatively  set  passing  point  used  by  several- States^  in  ; 
certain  licensure  areas.  *    .        ■       ■  m 

There  are  a  number  of  systematic  stratejgies  that  Jiave  been 
developed  in  order  to  set-  a  rational  stanaard  on  a  cril8erioi:i-refer- 


enced  test.  •The  procedure^  fall  into  three  categories  fand  cap  be 
labeledr 'judgemental",  "empirical",  and  "combination".  In  judg-/^ 
mental  methods,  data  are  collected  from  expert  judges' for  setting/H 
standards.  i  , 

Empirical  methods  require  the  collection  of  exaininee  response 
,data  to  aid  in  the  standard-setting  process.  ' 

Combination  methods  incorporate  judgmental  data  and  empipc£il 
data  into  the  standard  setting  process.  There  are  many  factors  to 
consider  in  selecting  one  of  these  methods  to  determine  cutoff 
scores,  impor|dnce  decisions,  time  availability^  and  capability  of  the 
individuals  in  applying  the  particular  method. 
*  Given  this  backiground,  what  can  be.  said  concerning  section  6(c)- 
of  H.R.  35iS4  which  specifies  that  a^  passing  score  cannot  be  set  by| 
reference  to  the  relative  distribution  of  scores  of  the  test  subjects? 
This  is  what  I  have  refeifred  to  previously  as  the  Inorpiative  * 
method.  |        /    /  ^  ;  \* 

First,  while  th^'  provision  does  correctly  assume  that  passing  j 
should  depend-^  on  the  content  of  the  examinationi  and  not  the j 
performance  of  the  indiyidual^who  happen  to  take  tn^  test^  it  doeflT 
;  not  prohibit  the  use  of  ^n  absolutely  arbitrary  and  unjustiigc^^ 
i  standard,  f 
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Second,  it  is  quite  an  easy  matter  to  get  around  thV  provision  by 
simply  converting  the  group  average,  norm,  to  an  ab«)lute  percent- 
age score  which  is  usea  as  the  passing  point.  • 

Third,  the  provision  would  prohibit  a  potentially  defensible  strat- 
egy in  which  the  passing  point  is  based  on  the  performance  of  a 
small,  but  acknQwledged-to-be<?ompetent  subgroup  of  the  popula- 
tion taking  the  examination. , 

Fourth,  and  perhaps  mosj  important,  the  provision  cannot  guar- 
antee that  the  more  rational  procedures  previously  mentioned  will 
be  utilized  or  that  the  decision  to  select  from  among  the  three 
types  is  defensibl)^.   ^      ■  - 

I  am  forced  to  conclude  that  the  passing  point  provision  in  H.R. 
3564  represents  an  honest  but  far  too  superficial  attempt  to  deal 
with  a  highly  complex  issue. 

It  is  my  contention  that  H.R.  3564,  while  well  meaning,  repre- 
sents a  cure  whbse  ultimate  consequences  may  overshadow  the 
disease  it  supposedly  addresses.  What  is  . at  stake  is  our  country's 
ability  to  provide  qualify 'health  and  health-related  services.  This  is 
why  I  aSn  concerned  that  the  full  range  of  impact  of  the  testing 
orocedure  on  oUr  quite  diveri&e  credentialing  systems  be  given  prop- 
er consideration. 

/  Toward  that  end,  I  would  strongly  encourage  thaFother  agencies 
In  the  occupation  il  testing  field  .be  igivited  to  testify  at  isubsequent 
hearings  of  this  s  ubcommittee.  In  the  final  analysis,  the  populist 
appeal  that  both  bills  have  so  clearly  enjoyed  up  to  this  point  must 
give  way  to  the  dccumentation  and  verification  of  the  benefits  to  be 
derived  from  the  passage  of  these  bills.  Until  such  data  are  availa- 


ble, enactment  of 


[The  prepared  s  iatement  of  I.  I^on  Smith  follows:]  - 


he  proposed  legislation  is  premature. 
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TO  THE  Su|bC^)HMITTEE  01^^ 


^ND  VOCATIONAL  EDUCATION 
OF  THE  COMMITTEE  ON  a)UCATION  AND'  LABOfl  '  / 


CONGRESS  OF  iHE  UNITED  STATES 

SEPTEMB^  2A,  1979; 
\ 


Kfc*  Chairman,  I  am  Dr.  I..  Leon  Smith ,  Director  6f'  the 
D'ivllslon  of  Professional  Examination  Service  responsible  for 
deviloping  certification  and  licensure  examinations  in  the' 
social! sciences »  medical  sciences,  environmental  health,  and 
all:  ed. health  areas*  ^  ....  \ 

/."■■'  ^' 

Certification  Jrefers  to-  functions  performed  by  non4 


gove 


I  mi 


conft^rs  occupational  status  on  individuals  so  designated  tut 


does 
.  these 


imental  agen^cies  and  volunteer  assQciations,    Th^  process 


not  legallyN prevent  the  practice  of  an  occupation  uding 
skills  by  peojjde  who  do  not  have  such  a  certificate. 
Licensure  requires  tne  demonstration  of  competence  based  on 
statucpry  requirements  and  anyone  who  does  not  have  a  license 


is  not\ authorized  to  practice  i-  Accordingly,  1  licensure  repre- 

^   •     ■   ^-  ' 

eenta  a  higher  level  of  credentlallng  and  is  designed  to  prc^tect  . 

\        ■  ■    .    ■    .  .      ■  ■•    '.-   "■  '     :  " 

the  pu]>li(^  against  incompetent  practitionsrs.  , 

Professional  Elxaminationv Service  is  a  not-for-profit  corpora- 
tion  Which  has  JJeen  .engaged  in  the  assessment  of  the  qualifications 


of  health  and  healith-related  .professional  workers  for  morfi  than 
35  years.    BES  has  assisted  Federal  agencies >  state  and  Ibcal 
jhealth  depatt:me;nts  and  personnel  agencies,  licens^g  boards,. 

ce^rtlfylng  bodies  and  educational  Institutions  In  examining 

I  ■  /  ■  .  • 

Indl^dual  cptnpetence  to  practice  effectively  In  health  service  . 
systems.    Accordingly,  PES  as  well  as  many  of  Its  clients  will 
•be  riiubject'td  the  provisions  of  HR  3564. th^t  specifically  relate 
to  occupational  testing*    It  is  our  Interpretation  that  the 
language  of  section  3.3  and  section  6(a)5  and  section  6(b)4  Is 
sufficiently  vague  to, Include  and  reqqlre  d^^closure  of  actual 
test  Items  and  answdrs  for  every  admlhlstratiph  of  an  examination 
given  for  licensure  or  certification* 

■  -    ■      :  [  /;  ■,;  " 

The  majo^r  purposes  of  the  testimony  I  will  provide  today  is 
threefold;  first,  I  would  like  Ito  raise 'some  serious  questions 
and  Issues  concerning  the  negative  Impact  that  disclosure  will 
bring  to^he  credentialing  field ^n  general.    Second,  I  will 
discuss  the  inappropriateness  of  the  provisions  of  section  6(c) 
regarding  the  setting  of  passlmg  points  fpr  occupational  tests, ^ 
and  finally,  I  will  point  out  some  of  the  other  more  specific 
shortcomings  of  the  provisions  as  thw  relate  to  occupational 
testing.    I 'have  attempted  to  limit  my  presentalilon  to  issues  . 
or  variations  of  issues  that  haye  not  bcten  presented  in  previdus 

■      ■  :■  i 

testimony,  I  believe  that  some  of  our  clients  will  alsq  be  ^  . 
submitting  position  papers  that  will  provide  more  specific 


•  *     .   '      ;  -649  V        .     •  $   :  •  V 

\-      f     ■  ■  ■  ■ 

examples  of  the  general  issues  tjpt  I  shajll  be  Ipentionirig, 


Potentlai^ Negative  Effects  of  Btscld^Bur^  . 

The  disclosure  of  Items  otj  a  current  examination  will  require, 
a  constant ' supply  of  new  Item?  In. order  to  provide  a  secure  test; 

bej.leve  there  Is. a  real  Issue. ^s  to  whether  and  to  what  degree 
(licensing  and  certifying  bodies  could  develop  new  examination^ 
for  each  administration.    Without  these  exiaminations^  credentialing 

agencies  will  have  a  difficult  time  ^electing  qualified  praqtitioners, 

•  •  •  ^    .  ■ 

Thls^  in  turn^.will  reduce  the  ability  of  the  agencies  to  provided  ' 
public* protection  and  satisfy  the  public's  ^e^Q^nd  for  quality  hellth  'i 
service:*  '  / 


,^  I  have  considered  a.  number  of  factors  in  making  the  above 
statement.    Over  60%  of  our  clients  use  their  own  unique  examina- 
tions as  llceilsing  and  credentialing  crlteri^a  in  addition  to  the 
^ES  examination,    HR 13564  would  require  disclosure  o^  these  test  . 
items  a9  well»  whether  they  be  written,  oral»  multiple-choiqei 


essay,  practical,  performance  or  demonstration, .  Not  withstanding 
the  obvious  difficulties  assAlated  with  disclosing  several  types 
of  these  e^aminat^ns , .  the  item  pools  in  these  ^unique  areas  ;;tend 
to  be  quite  sm^ll  and  would  quickly  be  depleted  Upon  disclosure. 
Public  disclosure,  then,  would  seriou^y  weaken  and/or  eliminate 
t^st  ^em  banj^a^an^'  would  have  a  significant  impact  on  pmall  but 
lA^  critical  areai  of  Icnowledge  where  only  a  few  items  might  be  ^ 
appropriate*      •   1^  ^  • 


f 
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A  spot  survey  of  our  clients  Indicates  that  examlaatlons 
may  be  given  as  many  as  10  times  per  year  and  In  many  cases  on  ;. 
an  Individual  or  small  group  basis.    There  Is  noi  question  that 
disclosure  wpuld  seriously  reduce  the  number  of  times  these 
examlnat^.on8  would  be  administered  •  .  This,  would  markedly  reduce 
the  opportunity  now  available  In  certain  fields  for  multiple 
state  licensing  within  a  reasonable  time  period.    This  procedure 
permits' candidates  to  take  aUL  of^the  unique  examinations  given 

by  states  In  the  same  region' of  the  country  over  a  period  of  a 

■  .  - 

roonth'or  two.    This  Is'  an  extremely  Important  concept  which 
presently  Increases  employment  opportunities  and  provides  for 
much  greater,  professional  mobility  than  ^ould  be  possible  if  > 
"  1* the  multi'«-state  spquencing  were  eliminati^d.  \ 


Several  fields  employ  what  is  referred  to. as  multi-stage 

■    ■  •-  .  it..-  ■     ■  ' 

licensing  procedures.    This  Mans  that  a  candidate  must  pass 

one  level,  before  going  on  to'  the  next  in  the  sequenc^  Typically,* 
the  sequence  is  of fered  several  timtB  during  the  yieiar.  Under 
jtest  disclosure  conditions,  howeve^,  with  it^  attendant  require- 
ment lor  new*  items  and  examinations,  it  m^y  only  be  possible  to^  • 
administer  portions  of  the  sequefce  o^e  during  any  given  year, 
thereby  creating  a  consi^rable  delay  i\  the  licensing  procefs. 
In  other  cases,  licensing  boards  may  be  ijiardpressed  to  meet      ^  .. 


their  statutory  responsibilities  which  wpuld  requite  the  licensure 
process  to  be  implemented  twice  a  year..,  I  believ«"lt*would  be.s*. 


J 


i 


||.   fair       say  thpt  licensing  boards  who  could  not  meet  their 

statutofy  iresponslbUltle?  would  be  subject  to  litigation  for 
.    .  preventing,  pr  at .thl  . very  least  delaying  occupational  employ- 
ability.'  ...... 

'Disclosure,  will  also  have  a  number  of  , adverse  effects  of 
•t.  ■  •         ■  • 

/an^  educational  nature.    Primary  among  them  Is  that  It  will 

encourage  Instructional  programs  to  be  more  closely  oriented 

"  to  the. specific  Items  ^contained  on  ^he  tests.    This  type  of 

Ip^tructlbn  perverts  the  Intention  of  licensing  and  certifying^ 

examinations  and  will  ultimately  rls.duce  the  independent  va^^ae 

ed,ucationai  t^edentials .    Specific  examination  items  should 

be  viewed  as  merely  a  representative  sample  of  a  competency 

^1    d^iii^in  or  subdomain  of  the  required  knowledge,  and  not  of  vital 

importance  in  their  own  right     Disclosure  will  unavoidable 

draw  attention       specific  items  and  away  from  the  competency  . 


»     •  ■  ^  . 

area(6)  from  which  they  were  derived. 


-An  ^assumption  underlying  disclosure  is  that  a  licensing 

and/ot  certifying  examination  can  be  treated  as  41  learning  ex- 

ft  .■-    .  * 

perlence  and  that  candidates  can  acquire  knowledge  pr  competency 
."^from  seeing^ ^hat  they  missed  along  with  the  correct  answer. 
This,  ds  simply  not  the  case r  In ^a  number  of  licensing 'arfeas  and 
in  several  states, 'the  boards  literally  have  no  control  over,  who 
actually  sits  for  the  examination;  Candidfit^s  with  limited  back- 
ground  and  educational  experience  q§n  and  do  take  the  licensing 
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exaralnatlans*,;  I  believe  it  would  be  seriously  misleading  to 
suggest  that  such  a  candidate  could  In  fact  acquire  '^competency" 
from  viewing  Items  on  a. specific  examination,    Learning' answers 

ls*not  th^  same  as  acquiring  the  broad  base  of  knowled|[e  sampled^ 

^  "... 
by  the  Items,  •  ^  V 

•  Since  disclosure  wllla require  d  new' examination  for  every 
administration,  Increased ' costs  can  be  anticipated  but  at  levels 

substantially  higher  than  those  predicted  for  admissions  testing, 

.  '  ". 

This  Is.  because  the  costs  for  some  of  our  client's  own  examlna- 
tlons  will  bespread  across  perhaps  as  few  as  10-15  candidates  , 
per  year  rather  than  200,000  or  more  as  Is  the  case  with  large 
aptitude  testing  programs.    Several  unfprtunate  consequences  can 
be  anticipated.    While  Increased  costs  could  be  minimized  by  ^ 
reducing  the  length  and/or  scope  (i.e..  Items,  questions)  of  the 
new  examinations,  the  psychometric  quality  of  the  tests  will 
suffer  and  sampling  of 'the  content  areas  so  vital  to  competency 
as^sess^Dent  may  be  compromised.    Perhaps  more  unfortunate,  the 

level  of  Increased  costs  may  force  some  of  our  clienta^to 

^  p         ■  '■ 

eliminate  theMmplementatlqn  of  their  unique  examination 

»  '*       ■  ■  t 

criteria  which  are  typically  oral,  written,  essay  or  practical 
In  nature,  and  rely*  exclusively  on  the  PES  exainln4tloti  which 
employs  a  multiple-choice  format.    This  would  result  In"^ 
limitation  In.  the -range  of  methods  and  skills  that  are  assessed 
and  through  which  JUfcenslng  and  certifying  decisions  are  made/ 
Even  thq  Issued  of.  obtaining  the  necessary  additional  financibl 
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^esourq^s  may  present  a  problem  to  licensing  boards  whose,  fee 
Structure  In  many  cases  is  set  by  the  state  legislature. 

The  occup.atlonaX^j^ovlslons  of  HR  3564^- will  be  thrust  Into 
an  already  Volatile  social  and  political  climate  Involving  the 

mixture  of  sunset  legislation*  and  the  uniform  guidelines  on  • 

■  .  '    ■  *        ■    ■*  " 

employment  selection ^rocedur^s • .   Some  areas  In  the  licensure 

field  are  currently  fighting  ^^^iPl^Hl^on  one  hand  through  y 

the  application  of  sunset  laws'"  anGH^jA^eHW    demands  for  further 

^.larifiQation'':.^13  Validation  qi  pro/x^ip8^  and  methods  on  the 

o%er  in  response  to  the  Joint^ldelines;  .  While  there  is  * 

cet^l^jnly  a  question  as  to  whether. the  uniform  guidelines  apply 

to  113^nsure  and  certification  functions^  most  of  our  clients 

want  as*  responsive  as  possible  to  the  validational  issues. 

Since  the-  uniform  guidelines  clearly  have  ^e  weight  of  law,  it 

would  appear  that  they  could  serve  as  one  form  of  "truth  in 

testing",    .1  believe  that  many  licensing  and  certifying,  bodies 

will  have  all  ttley  can  handlfB  to  meet  these  guidelines  under 

.  their  current  examination  structure,    \*/hat  will  the  inticoduction. 

of  HR  3564  accomplish  in  thip  "setting?    Licensing  agencies  will 

have^ to  produce  sufficient  new  forms  of  examinations  that  the 

discjlosure  provisions  make  necessary  gach  gf  which  is  responsive 

to  the  V^lrH4i:y  requirements  of  the  Joint  guideline^    The  net 

result  may  very  well  overwhelm  and  iiicapacitate  the*  credentialini 

system*    Given  the  curi;ent  political  situation  in^some  states, 

the  likely^  faiilure  of  licensing  bodies  to  meet  these  considerable 


*  •    ■  ..."  .• 


r^uireme||fc8  ti  ^  high  standard  ol  ^complishment  will  simply  0      .  * 
ipajip  termina^onlunder  existing  sunset  legislation  a  morp 
attractive  alternative  in  certain  fields.     I  believe  this  would 
be  unfortunate  for, those  who  are  interested  in  fliaintalnlTVg  the 
quality  of  excellence  in  ^health  and  health-related  services. 

gassing  Point  Procedures  .  . 

The. issue  of  setting,  selecting,  ojr  determining  an  appropriate  • 
pas'sipg  point  on  a  licensing  or 'certifying  examination  continues 
t9  be  one.  of  the  moat  vexing  problems  facing  the  credential^g 
*field.    Two  approaches  to  setting  passing  points  are  cjirtently  in 
wide  use.  by  boards  and  certifying  agencies.    Both  of  these  approaches 
have  shortcomings.     '  ' 

f  .  *  f      ^  *o      .     .    ^  . 

In  the  normative  approach,  a,  bell-shaped  or  normal  distribution 
of  examination  scores  is  assumed,  and  the  characteristics  of  the 
scorq  distribution  are  used  both  to  set  a  passing  point  and  to  pro- 
vide  a  rationale  for  interpretixi^A scores.    This  approach  is  based 
qn  the  assumption  that  a  specifiable  proportion  of  qiialified  candi- 
dates can  be  expected  to  meet  minimum  standards  for  performancis  in 
the  oc-cupation.    For  example,  if  a  passing  point  Is.  set  at^.O 

4  » 

Standard  deviations  below  the  mean  of  a  normal,  distribution, . 84% 
of  the  j^opulation  of  candidates  are  assumed  to  b^  qualified  for 
the  credential.*    The  normative  approach  is  crititized  because 
the  standards  set  are  referenced  solely  to  the  distribution  of 

I.-.  — ^    .  ■ 

ability* in  the  hofflatlve  sariple  of  examinees,  and  do  not  take  s 
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into  account  criteria  f6r  acceptable  p.erfotmanc^.  in  the  occupation  * 
to  which  passing  examinees  are  admitted;    It  is  possible  that  all  ^ 
or  none  of  the  Candidates  arei competent  to  practice,  but  a  norma- 
tive passing  point  will  always  result  in  a  specific,  predeterrairted .  • 
pro^prtioh  who  will  pass  or.  fail  the  examination. 


More  on  this  procedure  in  a  moment  • 

An  appropriate  d3^iaion . strategy  In  Gredentialii>g  should  include 
..  a,  means  ;0f  linking  decisions  to  minimum  criteria  for  acceptable  per- 
formance.    The  objective  is  to  set  a  standard  such  that  examinees 
whose  true  level  of  ability  is. above  that  standard  are  ctedentialed 
.while,  those  whose  true  level  of  ability  is  below  the  standard  are 
not  ;credentialed.    The  criterlon-ref erented  approach  to  setting  a 
passing  point'  was  Introduced  to  accomplish  this  objective, 
criterion-referenced  approach  is  characterized  by  the*  use  of  an 

■  .  '\       ■■  ■  r  ■■  •    ^     .    ■  . 

absolute  perfortnanpe  standard  rather  than  the  relative  standard 
bas^d  on  normative  data. 


An  absolute  performance  standard  is  a  fixed  score  which  repre- 
sents.  minimal  acceptable  performance  on  the  test,  such  as  75%  of 
t^ieUtems  on  the  test  ,  aniswer.ed  correctly,  which  incidentally  i^ 
the  le^slatively  set  passing  point  use4  by  several  stages  in 
certain  licensure  areas.  *  In*^  this  approac^,  assumptions  are  made- 
about  the  characteristic^ of  the  test  rather ^than  about  the 
characteristics:  of  the  ei^aminees..    in  setting  a  passing  point  at,  . 
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say, -755!  on  an  esjdmination,  the  inference  is  made  CR|f  an."  » 
individual  wjio  responds  correctly  to  75%  of  the  particular  items 
oil  a  given' form  of  an  examination  is  able  to  perform  at  or  above 
the  minimum  acceptable  level  in  thf  occup^tioa,  ■  " 

'Problems  in  the  use  of  absolute  performance  standards  arise 
when. they,  are  applied  to  written,  objective  examinations 'which 
'  measur^  complex  or. abstract^ domains.    Most  written  credentialing 
.    exalninatidns  measure  tlie  cognitive  asp4|iitts  of  occupationaj  perfor- 
mance.    The  examination  samples  knowledges  and  skills  across  all 
of  the  ^omains.  comprising  the  occupation  •    The  score  on  this 

.lexaminatibn  is  then  usuaMy  used  to^ake  an  inference  about  the 

•         .    >  ■  ✓  .  .  ■  * 

candidate's  overall -  pass/fail  status  vis-a-vis  entrance  int£  the 

"  ■  .  .  *-  ^_ 

Occupation,    TJhU3>  the  connection  between  the  test  and  actual  job 
.  *  '  ■ 

y  performance,  in  indirect  because  the  examination  assesses  the  k^owl' 
le  rather  than  actual  job  performance, 

'  ,   •>  In  the  absence  of  direct  sampling  of  job' behaviors,  users 
of  such  an  examination  employ  assu^hptions  about  acceptable. 

•  perfprmance  in  their  attempts  to  establish  a  defensible  passing 
point.  .  Unless  thesj?  assumptions  are  based  on  some  syatematic 
procedure  or  stratag3L4,ox.^nnecting  tfest  performance  with  job* 
perfprmance,  they  tgsnd  to       arbitrary  and  po"s8lM7^njais^ifi^ble, 

» •  f 

1^  Therfe  aife  a  number  of  systen^atic  strategies  that  have  been 

•  ■  ■  ■ 

'developed  in  order,  to  set  a  rational  s.t^dard  on  a^^iterion- 
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..referenced  test.     Die  procedures  fall  Into  three  categories  and. 
can  .be  . labelled  "judgmental*',  ^empirical",  and  "combination". 

.  In  Judgmental  meti  ods,  data  are  collected  from  judges  for  isetting 

standards,  or  judijmeat  s  are  made  about  the  presence  of  variables 

{fSr  Example,  guessing)  that  .would  affect  the  selection  of  a 

standard.    Empirical  methods  require  the  collection  of  examinee 

response  dgta  to  aid  in  the  standard-setting  prodpss.  Combination 

t  .        .  '  ■ 

methods  incorporate  judgmental  data  and  empirical  data  into  the  - 

standard  setting  process,    ^ere  are  nany  factors  to  consider  in  - 

•■  ♦   •  •  , 

V 

selecting  one  of  these  methods  to  determine  cut-off  scores. 

*  <      •  . 

1.  How  important  are  the  decisions? 

2.  :*How, much  , time  is  available?  ^  , 

3.  What  resources  are  available  to  do  the  work? 

4.  '  ^ow  capable  are  the  appropriate  indivlduala.  in  applying  a 

particular  method  suctepsf ully?     ■  ^  .  .. 
Several  of  thefse  methods  are  currently  in  use  in  the  credentialing 
field  and  have  been  supported  in  litigation. 

'  '    " .      '         •*•'./:■  ■  .      ■     '  .  ■:     ■*'■.■         ■  .  • 

'  .  .  '■ 

A  '  '  '  ■  ' 

Given  this  background,  whatvcan  hp.  said  concerning  fiectjion  6(c) 
of  HR  356.4  which*  specifies  that  \a  passing  score  can  not  be^set  by  - 

reference  to,  the  relative  disttibutron  of  scores  of  the  test  subjects?' 

-  "  / 

This  is  what;  .1  have  referred  to  previously  as  the; normative  method. 

First,  while  the  provision    d6e^  correctly  assume  that  passing 

should  depend  on  the  content  o"f  the  examination  and  not  the  perfor*- 


mahce  of  the  individuals  who  happen  to  take  the  test,  it  does. not 
prohibit  the  ji6e  of  an  absolutely  arbitrary  and  unjustified  standard. 


.7. 
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Seco^ird,  it  is  quite  an  easy  matter  to  get  around  this  provision 
by  simply  cbnve^iting  the.  grout)  average  (norm)  to  an  absolute 


3u|) 


percentage  score  which  is  used  as  the  passing  point.    Third,  it 
would  prohibit  a'  poteniially|defensible  strategy  in  which  the 
passing  point  is  based  on  the  performance  of  a  small,  but  . 
acknowledged-to-be-competent  subgroup  of  the  population  taking 
the  examination.    Fourth,  and /perhaps  most  important,  it  can  not 
guarantee  that  the  more  rational  procedures  previpusly  mentioned 
will  be  utilized  or  that  the  decision  to  select  from  among  the 
three  types  ie  defensible.    I  am  forced  to  conclude  that  the 

passing  point  provision  in  HR  3564  represents  an  honest  but  far 

*  '.  •    .  . 

too  superficial  attempt  to  deal  with  a  highly  complete  issue. 
■  '  \ 

Specific  Shortcomings  of  HR  356A 

I  have  mentionad  ^he  general  reasons  why  HR  3564  is  an 
inappropriate  means ^of  addressing  the  stated  or  implicit  obj^fitlves 
of  the  "Truth  in  Testing"  Act.    This  judgment  is  based  in  part 
oh  a  careful  study  of  the  bill's  provisions  and  the  conclusion 
.  tha\t  they  frequently  reflect  an  incomplete  understanding  of  well 
established  procedures.    The  following  comments  are  provided  on 
specific  provisions  in  tlie-  bill  npf  already  covjered  in  my  previous 
remarks . . 

Settibn  2(2)  and  Section  3(2) 

Given  the  evolution  of  the  Supreme  Court *s  interpretation  of 
thfe  Commerce  Claude,  it;  appears  likely  that  the  proposed  Truth  in 

;  ^  '  ■       •    r     ^-  ■ 


Testing  Act  would  tnost  likely^iirvive  fny  serious  constitutional 
attack  based* upon  the  Coiranerce  Clause.    However,  I  belifeve  that 
the  interstate  aspects  of  each  occupation  must  be  individually 
judged  Bftd  examined .    .  ^  . 


.Section  3.3,  ^(a)(l-4)>  6(b).(l-3)  ^ 

Except  for  .  the  disclosure  issue,  licensing  and  cer.tifying 

agencies  .currently ^ake  information  avail^le  to  candidated  that 

■  ■  '     ■  . 

would  satisfy  these  requit'i^fa^ts  •  "  ■  _  ,\ 

t  ■       .   •    ■  ' 

Conclusion 

It  is  my  contention  that  HR  3564,  while  well-meaning,  rept^s^ 
••a  cure  whose  ultimate  consequences  may  overshadow  the  disease  it  , 
I  supposedly  addresses.    What  is  at  stake  is  our  country's  ability 
to.  provide  quality  health  and  health-related  service.    This  is  why 
r  am  concerned  that  the  full  range  of  Impact  of  the  bill,  on  oux 
^  /  quite  diverse  credentialing  systems  be  given  proper  consideration* 
It  is  critical  that  additional  examination  of  llR  3564  focus  on  « 
'-  balancing  tlje  nqed  for  the;  legitelation  aa^tip  against  the  impact 
cqirtd  h^ve.    The  potential sadVerse  effects  clqarly  deserve 
m^e  study  than  can  be  provided  herei,    Toward  that;  end,  I  would 

?  V     i  .  V  ' 

stiV^gly! encourage  that  other  agencies  in  the  occupational  testing 
•flell  be  invited  to  testify  at  subsequent  hearings  of  this  Sub-j 


coimnittee^   Ip/^he  final  analysis,  the  populist  appeal  that'  both 

\\    "  i'i     \  *   

bill^  haVe  so-  clearly* enjoyed  up  to  this  point  must  give  way  to 

 -  -V   ~~~  .  ■ 

th^documehtation  and  verification  of  the  benefits  to  be  derived 
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from. th^  passage  of  these  ^Jls.    Until  such  data  are  available, 
enactment  of  the  proposed  legislation  is  premature. 


ERIC  . 


MIL  Weiss.  Thiank  you  very  much. 
Before  we  start  the  questions,  let  me  indicate  that  I  understand 
Dr;  Berendzen  'has  ^  board  of  trustees  meeting  that  he  has  to  leave 
for  very  shortly,  sp  we  will  see  if  we  can  have/ the  earlier  questions 
directed  to  ydu.  Dr.  Berendzen.      _         _  * 

Let  me  indicate  for  the  , record  that  Congresswoman  Shirldy  Chis- 
holih,  who-  is  a  cosponsor  of  H.R.  4949,  had  intended  to  be  with  the 
subcommittee  this  morning,  even  though  she  is  not  a  member  of 
the  subcommittee  or  the  full  committee,  but  her  duties  on  the 
Rules  Committee  preclude  her  being  here  with  us. 

She  did  ask  a  brief  paragraph  be  included  in  the  record,  and  I 
'  am  pleased  to  do  that,  '  ,  4 

She  says:  ^  . 

I  want  to  also  emphasize  that  I  have  no  delusions  about  what  this  legislation  can 
accomplish.  ^  . 

I  did  not  Envision  this  bill  to  be  a  placebo  for  the.  problems  .^hat  confront  minor- 
ities in  the  testing  process. 

With  that,  Mr.  Erdahl? 

Mr.  Erdahl.  I  have  no  questions  of  this  witness,  and  I  will  defer. 

Mr.  Weiss.  Mr.  Buchanan,  do  you  have  a  question  of  Dr. 
Berendzen?  •* 

Mr.  Erdahl.  I  understood  he  had  to  leave,  but  maybe  ]\:ould  ask 
a  general  question  and  he  could  respond  or  someone  else  could. 

We  .  have  had  some  very  good  testimony  today  both  from  the 
proponents  and  the  opponents  of  the  bill,  and  I  want  to  personally 
-thank  every'' member  of  the  panel  for  being  here.  It  has  been 
helpful  for  all  of  us; 

Somebody  mentioned  the  concern  of  being  excluded  from  admisr 
*sio;i.  One  of  the  points,  I  thiiik,  that  have  been  stressed  by  those 
that  are  favoring  this  bill,  is  that  the  testing  system  is  somehow 
unfair,  btfcaUse  it  could  exclude  people  from*admissions  to  a  profes- 
sion or  to  an  educational  opportunity.  We  have  had 'other  people 
who  are  the  opponents  who  have  stressed,  and  properly  so,  that 
certainly  testing  should  not  be  the  sole  criteria,  for  admission.  I  say 
this  somewhat  facetiously,  but  we  shotild  beJookihg  at  legislation 
to  say  that  testing  only  be  considered  ais  50  percent  or  10  percent 
or  9  percent.  • 

1  don't  think  we  can  really  do  that  but,  hopefully,  it  will  be 
considered  as  only  a  part  of  it. 

One  of  the  general  questions  would  be  how  much  emphasis  do 
colleges  and  universities  put  on  standardized  tests  in  their  admis- 
sions policies? 

Some  members  of  the  panel  froni  thfeir  knowledge  could  answer 
that.  ^  .  V/.^  \ 

What  really  is,  if  there a  relative  Weight  put  on  the  testing, 
standardized  testing,  what  is  it? 

Dr:  Berendzen.  I  am; Richard  Berendzen,  and  I  gather  the  ques- 
tion is  directed  to  me.  ' 

At  the  American  University,  and  also  at  some  other  institutions 
that  I  have  been  at  before,  yoii  coujd  find  it  a  fairly  common 
practice  across  the  United  States,  land  that  is,  that  the  standardized*^ 
tests  are  phe  of  perhaps  eight- to  ten  different  criteria  that  are' 
/evaluated  in  the  review  of  the  applicant,  f 


.  We  can  segregate  the  applications  inito  the  undergraduate  level 
and  those  into  the  graduate  aniiprofessional  schools,  such  as  a  law 
school,  medical  school.  In  all  of  these  situations  the  standardized 
tests  certainly  carry  weight,  because  they  provide  us  with  an  op- 
portunity to  normalize  students  from  a  diversity  of  schools,  geo- 
graphical locales,  et  cetera,  against  one  another. 

On  the  other  hand,  it  is  indeed  all  of  those  other  issues  that  taust 
be  taken  into  account  by  an  astute  admissions  committee  and 
adhiissions  office. 

It  has  been  alluded  to  earlier  today  that  students  from  different 
economic  backgrounds  score  with  different  abilities  on  those  tests, 
and  that  certainly  is  true.  .  / 

A  half  century  ago  Will  Rogers  said  much  \he  same  thing,  that 
we  Are  all  ignorant,  only  about  different  things) 

Well,  with  respect  to  the  standardized  tests,  we  are  quite  mindful 
of  that,  and  what  We  have  to  insure  is  that  an  applicant,  say,  from 
an  inner  city  school,  is  being  treated  in  a  just  and  reasonable  way, 
when  we  review  the  total  package  of  the  application  file. 

Now,  it  should  be  remembered  that  application  is  really  a  two- 
way  street.  It  ik  not  merely  for  the  exclusion  of  students.  It  is  also 
for  the  inclusion  of  appropriately  qualified  students. 

It  would  be  a  significant  disservice  to  a  student  to  be  accepted  to 
a  university  or  to  a  professional  program  if  that  applicant  were  ill- 
qualified  so,  in  summary,  the  standardized  tests  are  important. 
They  are-only  one  of  several  criteria,  and  what  concerns  me  per- 
sonally, and  I  believe  the  various  associations  that  I  am  represent- 
ing toda;^,  if  tho^e  bills  were  in  fact  enacted,  then  I  fear  that 
pragmatically  what  would  occur  is  that  universities  and  colleges 
would  be  forced  to  invent  their  6wh  admissions  criteria. 

They  would  be  forced  to  invent  their  own  testing  procedup^s  in 
addition  to  the  nationally  standardized  ones.  In  short,  we  would  be 
returriing  to  practices  that  were  extant  many  decades  ago. 

Those  kinds  of  procedures  would  lead  to  a  random  array  of 
testijflg  processes  acro&s  the  country,  and  each  instetution  would  set 
its  own  criteria  and  be  applying  its  own  tests.  T|iose  tests  would 
not  have  the  degree  of  validity  of  careful  testing  and  review  that 
the  current  Standardized  tests  nave.  i 

r  believe  in  the  long  term  that  could  turn  out  to  be  a  significant 
disservice  to  the  minorities  and  other  ones  who  are  in  fact  some- 
times speaking  in  favor  of  this  particular  legislation. 
.  Mr.  Erdahl.  Sir,  you  bring  to  mind  the  fact  that  these  tests  are 
not  only  to  exclude  people  but  also  to  include  them  in  educational 
opportunities;  I  assume  that  sonj^e  people  who  perhaps  haven't  done 
as  well  in  ^hool  with^rades  because  maybe  they  have  not  applied 
themselves  as  thej^^rfimild,  might  do  rather  well  in  some  entrance 
or  Mtitude  t<^|»r 

Mr.  BEmNmEVi:  We  must  consider"  what  was  the  high  school  or 
preparatory  school  of  the  applicant  and  how  well  did  that^correlate 
with  the  student's  score  on  the  standardized  tests;  and  the  admis- 
sions officer  must  weigh  all  of  those  considerations.  • 

Sometimes  we  find  to  our  delight  that  students  from  areas  that 
^e  would  not  have  nortnallv  eijcpected  it  have  scored  exceedingly 
well  on  these  tests  nationally,  and  we  have  , also,  found  that  the 
scores  on  the  SAT's  end  up  being  a  fairly  gj^od  predictor  of  the 


student^s' success  in  the  frestmian  year,  arid  particularly  good  pre- 
dictors from  minority  students.  Ml 

That  is  riot  to  say  ariythirig  about  how  \yell  the  person  will 
succee^d  in  life  in  general  or  succeed  by  the  time  they  are  into  their 
junior  or  senior  year,  but  we' do  get  a  fairlsf  goodindicatipn  of  the 
student's  enteringiabilities.  .  '  "  I  j  - 

It  is  not  just  for  the  exclusion  of  students  but  counsellmg  and  - 
advisement  of  thpse  students  in  their  freshman  year.  f  j, 

If  a  student  comes  in  and  is  admitted,  but  provisionally,  we  have 
some  Indication  by  means  of  these  tests  of  which  students  should 
be  channelled  into  basic  skills  programs  thereby  assisting  them  m 
the  summer  prior  to  their  freshman  year,  and  they  succeed  far 
better  because  of  it.  "       _^  ^ .    '  . 

Mr.  Erdahl.  I  believe  Ms.  Simmons  wanted  to./SSpond- 

.Mr.  Weiss.  Dr.  Berendzen  has  indicated  he  wants  to  leave. 

In  order  to  accommodate  him,  perhaps  all  of  us  ought  to  have  a^ 
chance  to  ask  hinno  oneW  two  questions.  If  he  wants  to  stay  he  is 
more  than  welcuftll.  wi  are  really  trying  to  accommodate  his 
schedule  at  this  point.,  '  • 

Dr.  BereivIdzen.  Thank  you,  Mr.  Chairman.  • 

Mr.  Weiss.  . I  have  really  only  one  question,  I  guess,  or  one  area  of 

questioning.  ,        ,    i   ,  i  i.- 

You  heard  Dr.  Loewen's  comments  about  the  lack  ot  correlation 
belw^-en  the  capacity  of  students  from  rural  and  minority  groups, 
especl-^lly  to  be  able  to  do  the  work  at  some  of  the  niajor  universi- 
ties and  the  test  scores. which  they  achieved  on  these  standardized 

tets.  '  "  u  J 

Now,  do  you  have  any  special  involvement  or  have  you  had  a 
special' background  in  the  area  of  testing?  Are  you  familiar  with 
the  literature'  in  the  field?.  Would  you  comment  on  Dr.  Loewens 
studies  and  his  testimony?  J    ,  .  • 

Dr.  Berendzen.  Well,  I  think  what  he  has  found  is  something 
which  is  understood  and  appreciated  by  most  people  in  higher 
education,  indeed,  that  there  are  reasonably  strong  correlations 
tween  the  scores  that  students  achieve  on  nationally  standardized 
tests  and  the  income  of  their  familjes. ;  , 
It  is  also  true  that' the  inconTfes  of  their  families  correlates  with 
many  other  things,  Social  deprivations  in  a  variety  of  ways,  the 
likelihood  of  that  individual  being  a  victim  of  violent  crime  in  the 

There  are  many,  many  correlatipAs  which  associate  themselves 
with  income  level  in  American  society.  What  we  basically  end  up 
proving  is  the  fairly  obvious  truism,  that  the  people  who  come  from 
reasQfiably  affluent  families .  very  often  tend  t'o  do  batter  than 
people  who  dp  not.  .    .  f        _  4.  ,  i 

/What  do  you  do  on  an  admissions  committee/ 'Ypu  must  look 
beyond  those  rudimentary  dimensions' and  ask  what.\was  in  fact  the 
geotr^hic  locale  of  the  applicant,  what  was  the  family  employ- 
ment of  the  applicant?  What  Was  the  interview  like?  What  were 
the  letters  of  reference  like?  „  ^      ^ ,    ,  1 

What  was  the  total  package  of  the  student  like,  so  we  do  not  lookj 
simply  at  one  diagnostic!  If  we  did,  it  would  all  be  simplified  ati 
looking  at  the  socioeconomiclevel. 
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iTJiis  speaks  to  thie  heai^  of  a  very  relevant  question  about  both 
of  thteebUls/AVhat  isf  the  real  issue  h^re^ 

lB*^e  real  issue  to  killthe  messenger  as  it  were  in  times  of  yore 
where  you  get  a  result] that  you  don't  like  ,  to  see  and  therefore  you 
<  don't  want  to  have  th^process?  .  -  '  * 

Is  the  teal  igwue  at^J^ 
tests  in  afay  form  are  \to  be  .Continued^  iji  t^^  States  of  if 

they  are  to  b6  modified  pr  destroyed.  >  ^ 

;  Varioua  people  who  Ibiaye  testified,  in  behalf  ibf  the  bills  ha;ve  r 
stated  that  they  ^tre  not  opposed  to  stendarilizecf  testing.rYet  in  fact 
what  they  are  proiK)Sin^  would  basically  i'ob  it  Qf  1^  current 'poteh- 
tial  so  significatatbr  lhaf  I  ani  featff^^^  up 
with,  if  these  bills  weJ^e  pasjBed,  wotUd  be  a  system  ih  l^he^nited: ; 
States  in  which  standardu^d  testiag  bagjically  wouliJ^^^ 
'  What  then  would  happen  is,  thiat  each  institution  in  4  0r  5  years 
tinte  Wpuld  be  forced  into  i^^^  the  ben<s6ts; 

that  can  be  accru^^      looking  "at  the^  I^ation  as  -^i  Wholeja 
weighing,  the*  factors  subjectively  and  objectively  -wo^^ 
■'^^^^^^^^^         I  think,  would  be  a  dissem       us  aU/an(J|^in  patticrtto^ 

-  i;he  very  people  th^t  it  pr^^^  had  been  dei^ign^  j^^ 

Mr.  "^Eiss.  In  listening  to  yqifr  testimony,  and  the  part  of  it 
;  ■  w^  suggested  that^  through  yoluntery  effpi1»  of  Ibe^^i^^^^ 

\  '^UotiB  themselves  and  of  the  academic*  communityv  -we  would  have  % 

^i^tter  wjiy  of  cprrepting  Vy^ateyer  abuses  ot  problems  exist,  I  .think 
'  >back  to'^  the  testimony  I  hflard  at  an  earlier  hearing)  the  testimony/ 
K  this  .subconlinittspe        from  Eleanor  Norton,  Chairman  of  the 
Ekjuat  BmployAent  Qppoj^  the  very  eiid  b^  July, 

^■■'■beginning  (tf;A^gujSt;"«^  '  "^■"■'"t'  'V"^  '"  ^' 

O  /  W   were  talkit^  abbut  discriml^a^tion  and  >^firmatiye  action 

!">rog^amp^in  univers^^^  WoiJld;be  stunned  if 

-  s^%ere"^to>rieyce^i-^she^ language  thtan  tbatr-^if  sbe^ 
-^/jvei^  t0^j^  and  finVasions  th^it  hei^': 
:  (5?niinis&v^  rWelVfiis  ;j§QE^^  tji;e  hlghie^lBdu6a*ic^^^^  aiTd 
v  ^  that  tHe-  corp 

^  8iffinfl(ative^^^  and'  minoritifesjpfln 

the  higher  edb^icatipn  pommjUnity  j^.'    ^--'^^'^C^^i.  ^ 
.  f  So  I  mittit  teirypu^^ 

followed  1>be  Vrecoif(l,1^i  atti  not  overly  ppliniV^i^^^ 
ness  of  the  highet  edu^^^^ 
there  is  a  probTeni  and 

'  that  there  may  bevin%e'arek^^       ^  -  r^^^ 

Are  there  further  questio^ns  of  ^e  dpctof^  ^  - '  -  .  "    ^  ^ 

If  not,  Dr.  Berehdzen,^ank  you.  vet|Jr  jtnucb  fc^  pa^ticijia^ 
tion.  We  appreciate  your  tim^  SQheduli^^  ^md  thj^^ 
justing  it  to  be  with  us.  '    ^  - : '  '  -  '  -'i^^^.  :  7     ^  5  ^ 

Dr.  Berendzen.  Thank  you  very  mutfh/  ^  .  Jj;  -  -  ( 
Mr.  Weiss.  Mr.  Erdahl?  r  \^    .  ^  : r  ^  -  ; 

Mr.  Erdahl.  Thank  you,  Mr.  Chairniati.  " 
^  I  was  G[oing  td  let  some  other  people  on  the  panel  respond  to  that 
same  question  posed  to  Dr.  Berendzen  and  respond  to  the  testimo- 
ny we  heard  in  response  to  my  question.  |  * 

Ms*  Simmpns,  you  gave  an  indication  you  wanted  to  make  a 
comment.  c  \ : 


Ms.  Simmons.  NAACP  has  been  Concerned  about  how  tests  have 
excluded  minorities  and.  based  01/ that,  working  with  the  educa- 
tional testing  service  ana  the  college  entrance  examination  board, 
th?  educational  testing  service  said  to  us  that  they  were  commis- 
sioned to^design  tests  to  exclude;  and,  based  on  that,  it  just  tended 

*  to  bolster  information  We  had  pulled  together  across  the  country  to 
show  the'^impact  of  standardized  tests,  culturally  biased  tests  on  " 
minorities.  •  ^ 

I^would  like  toj^fek'Dr.  Fjankjin  who  is  accompanying  me  if  he 
'cpuid^respopd  also^  p  -  .  . 

*  ^I&,;PrAn^  like  ^  at  leaSt  add  to  my  credehtiids  as  a 
:  corisulC^int  to;the^  nxember  of  the  National 

Gommittee^^^o^^  of  Black  Psychologists 

.and on  Expanding 
Educational  OpJJ<3Brtu^^  all  the  admissiQM 

;  of .^ra.dua^e  stude^  fdr^I  guess  responsibility  in  my 

department  as  a  Commit- 
tee/or  the  Doctoral  Progranf  irj  Clinical , Psychology. 
;  r  :  (certainly,  jon^    the'lhihgs  thafe:must  be  kept>in  mind  is  that  the  / 

^  stehxlardized  t%t;^  in  admissions  is  very  often  represented  as 

;  ' bnly  Ojp^f  sey^^^  many  of  lis  know,. when  we  get)^ 

V'down  vto  the^s^^^^  so  much  weight  is  placed 

upori'  tHe  stendahlizati^  equalizes  a 

T^Jpf  of  pther  criteria  tis^^  -    ^       ■  : 

.  Cpnsequently,  people  tend  in  the:  admissioji  process  to  relyNmore 
./^eavily  upion"  the  standardized  tepj:  score  as  "^^^  as  a 

'  .predictor^  scoye  really  only-  pfee-;- 

•edicts  a  certain  aspect  of  academic  peribrni^  and  dlbes  not  take 
./  into  coh&idert|itidn  the  jpiptivaUpn  and,  H;he  kinds  of 

support  sS'Stfrns  that  h  person'  can'^deVelop"  tO'  achiey^  suCcesg  in  :; 
"  either  school  6r  in  a  professional  occupation.       ,  :  o  r  «    .  \| 

"  •  Sp  that  if  st  pergpn  is  excludjed  frpm  a  collegte  opportunity  based  ■  <^ 
-  pn  a  .college  score,  he  is,  also  bein^^  abihty  tp' 

devielpp  resqtiiirces  ^  overcome  that  score^fso  irsLa  misrepr^^nta-^^^ 
o  lio^^^  .r  ;  .  r  .      '  a 

/  ^  Mr*  ^DAHl^.  Coald  I  tollpw  up  a  statem^t  pf  Ms.  .§immP?j!s  with  / 
»  $1  guestion?^^  V        t  •  ^  ^  v 

V    Utife^  1  jiji^understooH        yoiifeive  the  indication  that  there 
"  has  beet  a  delii)eraten^^^^     settmg  uji  a  testing  emphasis  thdt  is  ?  | 
'"\-discrijrmni^to  ■        '  •  **  i>it  t     y^'-.^  y'^ 

\s    To  my  khowledge,  this  is  the  fiiigt'tim^  tii^  ha^^ciSme  up  as  k  v 
^  ^eliber^t^e  one.  Maybe  it  was  inadvertent  becaiise  orsocipeconomic ' 

tctoi^,  exp^riencea  pr  iri.commiunities  orjrural  &rem 

at  might  not  kh^W  about  Sake  or  ChiaiHyL^ v        '^"^ml^-^k^^li  " 
.3^Jl*:^  hit  on'mom^^ 

^^?!8wi6u     a  very  serious  chafjge^;and  pne  that  ttxi^  comltilt(|ee  should 
be  ai^are  of. .  V. 
,  ^Ms.  Simmons.  I  would  be  very  pleapd  to  do  that. 

It  is  d^iiring  thOiTOurse  of  our  trying,  to  pull  together  the  persons, 
and  the  issues  tdkbe  considered  by  the  NAACP's  conference  on 
minority  testing,  aid  we  had  at  that  time  Dr.  Franklin  and  somjB 
other  psycholPgistaf  the  college  entrance  examination  people/ edu- 
cational testing  service  people  and  college  board  people. 
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We  raised  questions  with  reference  to  the  impact  that  those  tests 
would  Ivave,  and  we  specifically  mentioned,  as  I  recall  my  mention- 
ing LSAT*s  impact,  I  was  concerned  about  LSAT's  because  I  am  an 
attorney. 

I  'The  representative  from  the  educational  testing  service  said: 
•  'Look,  we  were  commissioned  to  design  an  instrument  to  exclude. 
We  did."  .    .  =1      ^     •  ^ 

Dr.  LoEWEN.  I  would  like  to  respond,  if  L  could,  to  Dr.  Berend- 
zen's  comments;  and  I  wish  he  were  still  here  so  fte  could  hear  . my 
response.  '  #  . 

He  said,  I  . believe,  that  the  standardized  testing  is  only  !  of  8  or 
10  factors  that  he  considered  and  weVit  on  to  say' that  it's  the  factor 
that  normalizes  students  from  diverse  backgrounds.  ^ 

Since  that  is  entirely  contrary  to  my  experidnc#  and  his  testimo- 
^l^y,  that  is  precisely  what  the  standardized  test  fails  to  do,  and  the 
very  fact  that  a  responsible  educator  can  state  that  it  normalizes 
students  iFrom  diverse  backgrounds  is  a  misuse  of  those  tests. 

That  statement  should  never' have  beemmade  by  a  representa-  * 
tive  of  a  testing  organization,  and  it  has  been  made  so  many  times 
it  has  now  become  a  cliclie,  and,  it  is  not  at  all  based  on  any  data 
that  I  know  of  whatsoever  and  I  would  challenge  thQ  Doctor  to  base 
it  on  some. 

He  stated  that  the  tests  are  a  good,  predictor  of  .majority  and 
\particQlarly  of^mrnority  performance  in  school.  I  don't  believe  that 
-  l^r/a  moment.  The  predictions  that,  are  published  by  the  Miller 
Analogies  test  people,  ACT,  or  the  ETS,  the  correlations  are  in  the 
neighborhood  of  0.2  to  0.4,  usually  0.3.  . 

That  means  that' the  test  relationships  are  .being  explained.  10 
percent,  because  if  you  square  that  0.33,  18  percent  of  all  the 
variations  in  first-year  grades  can  <je/^3j;i2j^ined  by  its  relationship 
^  to  the  test  score.  .  ^ — 

O    The  correlation  drops  then  for.  second-  and  thifdyand  fourth-year  .  * 
•    grades.  The  very  best  correlation.]^  with  first-year  trades. 

Furthermore,  if  you  look  from  minority  to  maWity  .you.  see  a 
vast  gap  in  test  score  differences,  standard  deviations  on*  the  tests.  • 
.  It's  135  points,  let's  say,  roughly^bn  the  SAT. 

The  black  students,  compared  to  white,  are  . not  doing  that  badty  * 
in  school.' I  have  d^ta  in  the  things  that  I  submitted  ixy  my  appeh- 
di;x  that  indicates  that  black  students  do  almost  as  well  as  white 
students,  that  they  graduate  from  medical  school -and  graduate 
from  advanced  and  difficult  undergrrfdua^  programs  at  almost 
exactly  the  same  rate  as  whites,  even  when  they  are  admitted  with 
100  to  200  points  lower.  v    ;         . '  , 

There  is  no  such  validity  of  cross  groups,  and  I  just  don't  believe 
thatothe  standardized  tests  are  valid  cross  groups.  ^ 

I  Ihink  that  he  is  overstating  the  matter  when"  he  claims  tha^. . 
this  committee  or  these  bills  are  against  testing. 
I  am  supporting  a  modification  of  4949.  which,  as  I  see  iU  can 
^  ' only  improv^  testing.  ^       '  i 

The  assertion  that  it.  would  destroy  testing  is  not  true. 

Mn  W^;iss.  OK.         /  •  /    •        >  ' 

Thank  you.  ^  \ 

Dr.-  Newsom.  Does  he  still,  want  response  to  that  qite^tiori  or 
^  are  you  thro^igh? 
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Mr.  Erdahl.  If  tlie  rest  of  the.  committee  will  yield,  I  don'f  want 
^  to  dominate  the  questions,  but  I  would  welcome  your  response. 
Dr.  Newsom.  Mine  will  be  very  short. 
»       While  I  agr6e  with,  the  doctor  who  just  left  that  we  are  opposed 
.to  the  passage  of  this  bill  at  this  time,  I  do  not-  agree  with  his 
*  reasoning^.  and  I  ^gree  with  mjT  colleague  on  the  right,  that  my 
:  concern,  and^n  disagVeem^nt  with  hirrx,'ils  that  it  is  an  execution- 
ary  technique.  .     .  .  ^  . 

I  would  hope  that  this  group  would  reconsider  this  from  the 
point  of  view  of  looking  at  it  more  icarefully  a  little  bit  longer 
before  you  pacs  this  particular  regulation.  v  ... 

Mr.  Weiss..  Yes,  Dr.  Smith? 
•  Dr.  Smith.  Thank  you.  .  ^  . 

In  a  Httl.e  different  direction,  . not  . to  muddy  the  waters  too  much> 
much  of  Ihe  discussion  is  focused,  on -the  standardized  test  in.  a  ^* 
^  sens?  because  that  is  wh^ft  affects  aptitude  testing.        ■  " 

To  broaden  4ts  base  a  bit,  since  the  Gibbons  bill  is  o.ne  of  the  hills 
being  considered,  in  my  opinion  a  standardized  test  is  much  more 
general  than  just  an  aptitude. test.  An  interview  and  an  oral  exami- 
nation in  a  s^nse  could  be  prepared  to  be  a  sort  of  standardized 
measure.       /    .  -  \  V 

In  many  of  the  health,  and  related  fiel(Jfc,  laboratory  exafnina-  ; 
tions  requiring*  the  examination  of  slides. ^nd  specimens  and  so^'on  . 
-    are  a  form  of  specific  examination  that*  many  licensure  bodies  U5e.\ 
We  don't  deal  specifically  with-  that  kind  of  test,  but  in  a  sense, 
*   tnat  is  a  standardized  test.  * 

.  So 'I  think  the  focus  ^as^'been  perhaps  a  bit  too  specific  on'tVie  . 
implication,  regarding  thp  standardized  test,  a  I9  ETS  and  sd"  on. 

In  light  oT  that,  with  respect  to  the  weight  given  Various  exami-^ 
nations,  various  standardized  tests,  in  the  licensing  area  in  a  broad 
scale  I  think  it  would  be  fair  to  say  that  the  importance*. of  practi- 
cal examination,  and.  demonsj^rations  in  many^health  allied  areas 
ardbiot  given  secondary  consideration  and  indeed  are  very,  very 
important  components  of  competency. 

The  examinations  that  we  develop  or  that  f|ny  other  firm  might 
develop  rnight  simply  tap  some  o.f  the  cognitive  knowledge,  the 
.  specific  knowledge  that  might  be  necessary^  but  these  other  exami- 
nations which  I  think  would  seriously/^e  compromised  by  the 
T^assage  of  the  bill,  those  examination^re  very  importarit  and/I 
\  /think  ave  a  very  important  part  of  tl>e  weighting  process:  They  are 
not  considered  secondary.  ^  '    ■  ■ 

Mr.  Weiss.  You  are  referring  to  3563? 
Dr;  SMITH/Yes. 

Mr.  Weiss."  Let  me  say  that  Mr.  Miller  of  California,  who  is  a  eg-  » 
"  sp«isor  of  the  legislation,  has  asked  that  the  record  include  a 
serws  of  statements  and  articles  from  various  newspapers  and 
publications  across  the  country. 

Without  objection  I  will  offer  that  for  admission. 
'  [The  statements  and  articles  referred  to  above  follow:] 

.[From  the, Chicago  Sun-Tirftes.  July  18.  1979] 

Demystify  College  Entrance  Exams 

.  College  entrance  exams  have  rep/aced  the  draft  as  perhaps  th<3  most  important  . 
ai)d  mysterious  rite  of  pasigage  for  yo.ung  people. 


"  They  can  affect  the  rest  ofl^tptudent's  life  by  determinitig  whether  he  gets  inJbo 
^.the  College  or  professional  schc^rnQf  his  choice. 

Biit  after  a  student  takes  oiieM  the  testa,  he*s  never  told  which  of  his  answers 
were  wrong.  And  he  is  asked  ^npiieve,  pretty  miich  on  faith,  that  the  tests  really 
can  predict  academic  pei'formance:  f  aV  *  . 

signed  a  ^'truth-in-testing"  bill  designed  to 
iiciat^ized  adildisdions  tes^.  The  law  allows"^ 


correct  answers,  so  thjpy  can  check  for 
their  weak,  spots.  ' 
.their  reseafcn  in^o^th^  validity  of  the 


New  York  Gov,  Hugh  Carey  rece| 
removQ  some .  of  %the  mystery  from  st! 
fitudehts  to  see  their  graded  tests  and 
scoring  errors  and,  mori^  important,  pir 

It*also  requires  testing  services  tadi-^-^T^   - —      -  i 

tests  . and  to  tell,  students  what  the  testarpfeflure,  ho>v  the  rVulti(^j|^  interpreted  . 
apd  how  to  challenge  suspected  grading  erroi^        ,  \^     .  \  *  rjs'^j  * 

This  new  law  may  increase  the  cost  of  a  tctpiv^i^  we  tl!|ik^hal  wnlW  worth  it  if 
it  makes  the  Jbests  more  fair  and  eliminates  sori^^  their^ys^ufe.  Anlkwe  hope  it 
forces  admissions  officers  to  justify  their  relianw^on  t?he 't^stS^hich  have  been 
accused  of  b^ii^  culturally  biased  and  of  failing  W^asur^sucl^  miK>rtant  traits  as 
creativity,  artistic  6ense  and  leadership.  n\  k'^  i  '^^ 

The  law,  of  course,  applies  only  to  N(Bw  York.  vJfT^  IllinoiB>jGid^  Assembly 
should  consider  passing  one%f  its  own.  ^- 


tfrom  the  Boston  Globe,  July  16,  1979]%  .     .  •  „ 

■    I  \'  '        ■  ' 

.  *-         *  Open  Test  Law  Applauded  Here 

■  ■'  ■  '  "       ■       ■' '  . 

ANRIQ  WOULD  SPONSOR  IT  IN  MASSACHUSETTS  • 

(By  Richard  E.  Gordon,  Globe  Correspondent) 

Massachusetts  Commissioner  of  EduciS5on  Gregory  Anrig  said  yesterd^  that  he  . 
'Vea\cted  very  favorably"  to  a  new  Niw  York  law  that  requires  the  rfesults  of  , 
entrance  examinations  for  college  and  graduatp  schools  to  be  opened  ro.  public 
scrutiny  for  the  Tirst  time.  '    :  . 

The  law,  signed  Friday  by  New  York  Gov.  Hugh  Carey,  requires  companies 
administering  such  tests  as  the  Scholastic  Aptitude  Test,  the  Law  School  Adhiission 
Test  and  the  Medical  College  Admission  Test  to  file  copies  of  the  tests  and  correct 
answer  sheets  with  the  New  York"  State  Department  Of  Education.  It  also  requires^ 
'  the  firms  to  give  a  graded  answer  sheet  to  any  student  who  requests  it.  \ 

"Decisions  that  affect  a  persons's  career  Or  life  can  be  made  by'^ these  tests,"  Anrig 
said  in  a  telephone  interview*/ "SucK  matters  should  be  subject  to  public^jrutiny.  * 

Anrig  said  he  would  support  similar  legislation  in  Massachusetts,  but  added  that 
it  might  not  be  necessary  because  once  the  testing  companies  devistf  procedures  to 
comply  with  the  New  York  law,  they  would  find  it  convenient  to  do  the  san^ie  in 
.other  states. 

MIT  engineering  professor  Judah  Schwartz,  director  of  Project  TORQUE,  a  New- 
ton-based research  group  tiding  to  devise  alternatives  to  standardized  tests,  agreed 
with  Anrig.  • 

'•Once  the  testing  comoahies  haye,.in  a  state  as  big  as  New  York,  devised  alterna- 
tive procedures,  they  migRt  just  as  well  do  it  eteevvhere,'V  Schwartz  said. 

The  companies  that  administer  standardized  ^ts  have  lobbied  agaihst  the  New 
York  bill  charging  that  it  would  drastidally  increase  the^cost  of  the  tests  and^limit 
the  firms*  abhity  to  offer  special  tests  to  handicapped  persons  or  those  who  prefer 
not  to  take  the  test  on  certain  days  for  religious  reasons. . 

Schwartsii  however,  said  the  New  York  law  will  have  national  impact  on  irhprov-  . 
ing^teaching,  reducing  cultural  bias  in  the  tests  and  n^aking  standardized  tests  less 
important.. 

•    "I  think  that  teste  Whose  content  cannot  be  made  public  are  a  frightening  thing 
lin  a  democratic  society,"  Schwartz  said.  "Standardized  tests  are  part  of  a  funny 
l^hnology  that  says  all  of  the  world  can  be  reduced  to  a  series  of  multiple  choice 
questions.  That*s  foolishness.  •  i  i» 

''Unless  one  makeis  the  questions  public,  there  is  no  way  to  improve  the  quality  of  • 
the  system,'*^  Schwartz  continued.   If- you  have  crappy  tests  and  no^ohe  sees  the 
»  questions,  they'll  continue  to  he  crappy." 
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V  .  (FVom  the  New  Republic,  February  5»497T]  ' 

•  ■  .  ■  ♦  . 

*      "      ^  ETS's  Star  Chamber  .      ■  .  / 

WHY  YOUR  DAUGHTER  didn't  GET  INTO  LAW  SCHOOL 

The  Educational  Testing  Service  of.  Princeton,  New  Jer^y,  rapidly  is  becoming 
the  cradle-to-grave  arbiter  of  social,  and  ^onomic  mobility  in  Aifi^rica.rlis  tests 
determine  who  will  be  admitted  to  the  nation's  prestigious  private  schools,  to  almost 
all  colleges  and  graduate  school^,  and  even 'to  the  prdcticfe  of  medicine  and  in 
many  states.  The  typical  educated  American  brieaks  the  seal  of  his  or  her  exam  book 
(using  the.  eraser  end  of  th^  numtter^tAVO  pencil)  while  still  in  eiifementary  school,  and 
still  is  filling  in  between  the  pale  bliie  lines  well,  into  middle  adulthood. 

Anyone  who*  must  deal  with  it  is  completely  at  the  mercy  of  this  private  monopo- 
ly. He  or  she  musV take  the  tests  ETS  offers,  must  supply  the  information  ETS 
requests*,  and  must  pay  the  fees  ETS  charges.   <  . 

Most  important,  individuals  whose  lives  are  crucially  affected  have  no  way  of 
checking'the  accuracy  Sf  iiYformation  ETS  supplies  to.  schools,  universities  and  state 
accreditation  boards.  ETS  has  been  treated  Ieis' exempt  from  the  requirements  of  the 
Family  Education  Rights ^nd  Privacy  Apt  of  1974,  commonly \nown  as  the  Buckley 
Amendment.  This  law  requires  schools  to  give  ^students  access  to  flies  containing 
information  about  them  and  limits  the  Use  schools  can  make  of  this  inform'^tion 
without  a  student's  permission.  The  Privacy  Acf  also  created  a  Privacy  CkimoaissiOn 
to  study  the  effects  of  the  act  and  make  recommendations  to^the  office  of  HEW  that 
administe/s  it.  Th6  Privacy  CJommission  currently  is  considering  whether  to  recom- 
mend that  ETS  lose  'it  exemption.  The  following  cautionary  tale  may  aid  the 
commissioi>  in  its  deliberations.*'  .  ^  . 

.  .  The  story  involves  the  Law.  .Scho61  Admissions  Test,  one  of  E1^*s  n^ost  popular 
offerings.  When  a  candidate  applies  to  take  the  LSAIV  the  application  form  asks 
whether  he  or  she  has  taken  the  test  before.  This  quesnon  ap^ars  among  a  series 
of  general  clerical  questions  (name,  address,  and  so  on).  Applicants  have  no  way  of 
knowing  that  failure  to  indicate  that  they  have  taken  the  test  before  (whether  b^ 
answering  the  question  incorrectly  or  merely  leaving  it  blank)  will  have  an^  signifi- 
cant effect  on  their  filial  applications. 

The  reason  for  asking  the  question  was  no^T  clerical.  Until  \ast  year,  the  test  score 
report  form  sent  to  law  schools  contained— -unbeknownst  to  the  student  who  was 
paving  to  have  this  infornmtion  serit^a  space  labeled  "unacknowledged  repeater/^ 
When  this  space  was  marked  by. an  asteri^,  it  indicated  that  a  candidate  applying 
to  take  the  test  fot  the  second  time  had  not  indicated  that  this  was  the^case.  The 
asterisk  appeared  even  if  a  candidate'  (possibly  b^  accident)  failed  to  answer  the 
question  at  all.  Ralph  Smith,  a  professor  and  adroissions  comimttee*member  at  the 
University  of  Pennsylvania  Law  School/^  explained  that  the  unacknowledged*  r^  ^ 
peater'*  designation  raised"  a^uestion  of  [the  applicant's]  integrity"  A  number  of 
other  law  school  admissions  ofricers  confirmed  that  this  was  the  constrUciidn  admis* 
sions  committees  put^oh  the  asterisk.  *  ^ 

Smith  and  several  . others  think  the  appearance  of  the.  asterisk  kept  some  appli* 
cants  out  of  law  school.  Of  course  there  are  such  a  variety  of  reasons  and  Admissions 
committee  can  give  for  denying  admission  tp^ any  one  applicant  th^t  it  is  all  but* 
impossible  to  prove  that  anyone  was  e^pluded  b^oaus^  of  beirig  designated  an 
"unacknowledged  repesiter." '       v  .  '      m  -  '  *   '  *  ) 

in  the  1975-76  applicant  year,  the  dean  of  admiseions^at  the  University  of  PfejMi^ 
sylvania  Law  School  noticed  that  more  andiil^e  Of  these  asterisks  were  appearing 
on  LSAT  score  reportsJIHe  reported  this  to  E^  and'askedk^ether^the  designation. 
Was  correct  in  all  these  cases.  Shortly  th^ei^fter  ETS  responded  with  a  memo  sent 
to  airiaw  school  admissions^deans,  which  read  jn^art:  .  '  ^  ' 

»It  has  recently  become  apparent  that  ^  problem  exists  with  regard  to  the 
flagging  of  candidates  as  "unacknowleclged  repej^ters-'  (an  asterisk  in  the  areh 
under  UnacknowleSiged  repeeter«'\iu  the  suirimary  iBtction  of  reports).  This 
problem  has  been  caused  by  several'  factors,  sofhe  of  which,  raise  policy  ques* 
tions  which  wUl  b^';  Considered  next  spring.  The  result  for  the  current  year, 
howdver  is  that  SQjthief'pandidBtes  who  are  not  "unacknowledge<d  repeaters''  have 
b0en  designate^as.eUQh.  ,    '  .  ■  '  ^  ■ 

The  mennio  warned  \hat  the  designation  shfould  be  diisregarded  and  explained  that 
"it  will  not  be  possible  t<^ identify  alt  such  candidates"  (th(^.  wrongly  identified  as 
"unacknowle^ffeed  repeaterii").  .For4976-'/7,  ETS  has  dropped  the  asterisk. 

There  ajtH^  s^eral  disturbing  things  about  this  incident.  First  of  |ill,  since  appli* 
cants  haVe  had  no  way  of  knowing  that  the  "unacknowledged  repeaters'*  designa* 
tipn  existed,  discovery  of  ^^^b  error  depended  on  the  fortuitous  curiosity  of  one 


admissions  dearij  Second^  since  applicants  are  not  permitted  to  see  the  reports  ETS 
sends  to  law  schools,  individuals  would  have  had  .no  v/ay  of  Clearing  themselves  of 
false  chdrges  even  if  theyhad  known  that  the  problem  existed.  Third,  even  aftej  the 
error  was  discovered,  ETS  kept  it  quiiat  and  apparentlv  made  no  attempt  either  to 
correct  its  past  nqistakes  of  to  infprnii  the  applicants  who  were  harmed  dv  them.  .  In  . 
short,  canaidates  who  were  perfectly  accej^table  may  have  been  denied  acce^  to 
their  chosen  profession  without  ever  suspecting  the  reason. 

ETS  avoided  anv  mention  of  the  "unacknowledged  repeater"  incident  in  testimo- 
ny at  a  Privacv  Oommission  hearing  in  November.  Robert  Solomon,  vice  president 
of  ETS,  was  asked'specifically  andrepeatedly  about  errors  that  might  be  correctable 
if^tiidents  had  access  to  their  ETo  Hies,  but  he  failed  to  mention  the  ^terisk 
eosode  and  insisted .  that  ETS  errors  were  "to  the  best  of  our  experience"  no 
problem.  Solomon  now  says  the  failure  to  mention  it  w^s  an  oversight:  "We  had  no  .. 
intention  not  to  mention' that."  Tpm  White»  an  ETS  official  who  deals  with  law 
schools,  says  the  episode  "|just  wasn't  important  enough  to  mention.  All  of  the 
discussions  at  the  commission  were  based  on  what  our  system  is  now  doing.  No 
effort  to  describe  the  svstem  as  it  has.grown  and  changed  was  made." 

El^  argues  it  should  continue  to  be  exempt  from  the  Buckley  Am^ndmpnt  be: 
cause  of  the  time  anc)  expense  that  would  be  required  to  bring  its  file^  into  compli- 
ance, and  because  the  organizations  that  contract  for  its  services  provide  sufficient 
regulation.  Of  course  far  poorer  orgaiiizations,  and  others  (such  as  state  universities) 
with  mafiy  more  people  looking  over  their  shoulders,  have  been  forced  to  comply. 
Even  apart  from  the  Buckley  Amendment,  ETS  is  far  too  immune  from  public 
regulation  and  scrutiny,  given  the  function  it  serves  and  the  power  it  ei^oys.  There 
is  no  go^,  reason  to  continiife  this  e^emption^as  well.  . 
^    Kim  Meters  is  a  Washington  education  writer. 

;  .1  .   .  Kim  Masters.  / 


[From  the  New  York  Times,  July  5t  1979] 

Issue  and  Debate'— Truth-in-Testing  Measure  Focusing  on  a  Key  Industry. 
,  .     (By  Edward  6!  Fiske,  the  New  York  Times) 

Last  month  the  New  Yorl^  Legislature  passed  a  "tr^th-in-testing'^bill  that  would 
require  concerns  that  give  such  standardized  tests  a^  the  Scholastic  Aptitude  Test  U> 
make  tjtie  questions  and  correct  answers  available  to  students  who  take  them. 

The  bill,  which  Would  apply  only  to  the  Preliminary  Scholastic  Aptitude  Test  and 
to  tests  used  for  entrance  to  college  and  to  law,  medical  and  other  graduate  schools, 
would  also  require  the  Educational  Testing  Service  and  similar  companies  to  inform 
students  about  the  purposes  of  the  tests,  what  they  purport  to  measure  and  the 
methods  used  to.  calculate  scores.  The  companies  would  also  be  obligated  to  make 

f Public  any  studied  of  the  tirats  thay  h^ve  made,  including  those  that  show  correla- 
ions  between  scores  and  Such  things  as  parental  income.  ^ 

The  issue  of  whether  and  how  to  regulate  the  itultimillion-dollar  testinfi^  industry 
is  becoming  a  familiar  one.  Bills  similar  to  the  one  passed  fn  New  York  have  been 
offered,  but  not  passed^  in  C!olorado,  Florida,  J^farylal:ld,  Ohio  and  Texas.  California 
has  a  new  law  that  reAiires  testing  companies' to  make  available  cdpis  of  complete 
tiratB!  ihAt  ar^imilar  to  iho6e  that  students  actually  take.  . 
'The  New  l^rk  bill  was  actively  lobbied  for  by  a  broad  range  of  consumer,  teacher, 

Sarent  and  olyil  rights  groupjs,  including  the  New  York  Public  Interest  Research 
froupf  the  Consumer  Protection  Board,  New  York  State  United  Teachers  and  the 
Parent  Teachers  Association.  It  was  opposed  by  college  spokesmen,  the  State  Educci* 
tion  Commieai^er,  Goirdott  M*,  Ambach,  and  'by  the  testing  industry,  which  also, 
waged  a  vigorous  lobbying.  dflTort. 

Early  this  month  the  bill  is  to  go  to  Governor  Ccmyi^ho  is  under  considerable 
pressure  to  veto  it.  |Ii8  chief  aid^  on  higher  educational  mattery,  Hetlrik  K.  Dullea, 
IB  meeting  with  proponents,  of  both  sides  to  help  the  Governor  make  a  decision, 
which  wiu  have  importanty'consequenceis  for  colfeged^  and:  universities  throughout 
the  state.  /  ^ 

Background  ^  .'^ 

The  "truth-in^te^g'^  mea«iure  was  th^'  latest  in  d-kwcieB  pf  efforts  to  apply  to  the 
iteid  of  education  tbe|pl|^e^sailer  ^o0iicept  u«ed  in  coti[mierce;    *  •  %\ 
PlaintijQb  in  96^rer^^ourt  cas€«  in*  recent  years  have  accused  sohooU  of  ^'malprac- 


tic6iH  tb^y  i^olud#a  CopiagUi^  youth  who  unsuc<^(lilly  sued  the  local 
BCho^  Bydt|m  because  he  was  gi^uuatecl  from  high  school  while  unable  to  rea^^ 


above  a  third-grade  levell  The  ^FederarTrade  Commission  has  approved  new  and 
stiCfer  regulations  for  prOpKetary  vocational  schools  that  l-equire,  among  other 
things,  pro  rata  refunds  for  students  who  drop  out. 

The  liev^  bHls  regarding  testing  are  essentially  an  extension  into  educat4'on  who 
took  them  •each  year,  it  should  be  subject  to  greater  jpublic  ^rutihy./lt  is  supposed- 
ly a  nonprofit  entierprisfe  that  is  operating  under  the  rules  of  disclosure  of  a  private . 
company,"  said  Allan  Nairn,  who  is  directing  a  study  of  the  educational  Testing 
Service  on  behalf  of  the  consumer  activist  Ralph  Nader.  While  testing  ^companies 
have  taken  steps  in  /ecent  years  to  provide  consumers  witji  more  information  about 
the  tests.  *'they  aye  publishmg  only  what  they  choose  to  disclose,"  he  said.  . 

Backers  of  the  bill  argued  that  providing  students  with  the  questions  they  got 
right  or  wrdng  would  enable  them  to  find  scoring,  errors,  as  well  as  to  gain  helpful 
information^  about  academic  ^feas  in  which  thq  students  may  be  weak.  The  Puerto 
Rican  Legal  Defense  and  Education  Fund  argued  that  the  measure  would  also  help  . 
exRpse  ''^ses"  m  tests  that  'historically  had  a  discriminatory  impact  on  Puerto 
Ricans  and  blacks."  .  i , 

A  recent  Federal  Trade  Commission  study  concluded  that  some  students  could 
improve  their  scores  on  the  S.A.T.'s  and  similar  tests  by  going  to  private  "coaching" 
schools  has  provided  another  argument.  In  testimony  on  the  bill.' Marjorie  Dunbar, 
education  ch^tirman  for  the  state  chapter  of  the  National  Association  for  the  Ad- 
vancement of  Colored  People,  declarea:  "Many  students  cannot  afford  these  expen- 
sive coaching  courses^  and  ace  therefore  denied  equal  acce^  and  opportunity.  This 
bill  would  enable  all  students  to  get  access  to  post-test  questions,  i^'ot  just,  those  who 
cdti  afford  the  courses  offered  by  cram'  schools."  \  ^ 

Finally,  the  proponents  said  that  publishing  actual  test  questions  would  improve 
the  quality  of  aptitude  testing  by 'making  them  subject  to  scrutfhy  by  experts  and 
the"^public.      '       *  .  •«  .\ 

The  supporters  rejected  arguments  that  *trath-in-testing  would  necessarily  in- 
cVaase  the  cost  of  tests  to  students.  "By  E.T.S.'s  own  figures,  they  sj>e.nd  5  percent  of 
tesPrevenues  on  «ew.  question  development  ^ut  make  22  to  27  percent  ptofTt,"  said 
Mr.  N&irn.  They  also  dismiss  the  danger  that  E.T.S.,  as  a  nonprofit  service  organiza- 
tion, would  be  able  to  difl*;rij?iinate  against  New  Yorkers  either  in  charges  or  services 
jf  requirements  here  were  more  strict  than  elsewhere..  ^ 

Agairbt  disclosure   ^  ' 

Robert  J.  Solomon,  the  e^^ecutive  vice  president  Qf  the  testing  service,  said  that  his 
company  was  "very  much  in  sympathy  in  a  general  way  with  the  obiectiyes  that  the 
originators  of  the  bill  seek  to  serve."  He  noted  that  in  recent  years  the  company  had 
substantially  increased  the  amount  of  information  given  to  students  Regarding  the 
purposes  of  the  tests,  the  margin  of  error  and  the  methods  of  scoring.  For  the  . last 
two  years,  he  said,  free  sample  copies  of  old  tests  had  been  made  ???  approved  new 
and  stiffer  regulations  fyr  proprietary  vocational  schools  that  require,  ambng  other 
things,  pro  rata  refunds  for  students  who  drop  out.  k 

The  new  bills  regarding  testing  are  essentially  an  extention  into  education  of  iSlQ 
"truth-in-packaging"  concept  that  alre^idy  applies  to  products  on  grocery  sjfere 
shelves.  "This  is  just  an  information  bill,"  said  Senator  Kenneth  P.  LaVHUe,  cHbir- 
man  of  the  Higher  Education  Committee,  one  of  the  measures  sponsors.  "We  ai*e 
asking  #)at  the  compaq^ea  that  prepare  these  tests  give  us  a  little  more  inforn:\ation 
al>out  them»"  *.  .  j 

•  The  hills  have  also  comesout  of  a  context  of  greater  public  concern  about  stand- 
ardiied  tests.  The  National  Education  Associjation;  the  country!s  larg«3t  teacher 
group,  has  been  engaged  in  a  megor  campaign  against  what  it  regards  as  undue 
relianciB  and  widespread  misuse  of  standaraized  tests  at  the  elementary  and  sec(mi^- 
ary  sdhool  levels.  Students  are  becoming  increasingly  sophisticated  about  the  mar- 
gins of  etvprs  in  testing,  and  several  instances  of  mistakes  haVe  attracted  national 
attention.Tast  spring,  for  example,  scores  on  the  Medical  College  Admission  Test 
were  reisdtied  aftfer  a  computer  error  was  found,  f . 

For  disclosure  ^  A 

Proponents  of  the  bill\egan  their  case  with  ythe  assertion  that,  since  college  and 
graduate  school  testing  was  a  msyor  industry  with  enormous  influence  over  the 
360,000  New  Yorkers  many  increased  the  amount  of  information  given  to  students 
regarding  the  purposes  8f  the  tests,  the  margin  of  error  and  the  methods  of  scoring. 
For  the  Jast  two  years,  h^  said,  free  ^am^le  copieA  of  old  tests  had  been  made 
available  to  students.  .       »  .  *  «   .  * 

A  mfi^jor  objection  to  the  bill  revojved  around  the  issue  of  "equating,  or  the 
standard  practice  of  Ufting  a  few  of  mb  same  questions  on  successive  tests  to  develop 
.  a  b?i8e  for  comparing  the  scores  of  Students  who  took  the  t^sts  dt  various  times.  On 
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the  SJV.T,  testa  the  "equating^'  questions  were  n6t  usecT  in*  calculating  a  student's 
score,  as  they  had  been  on  other^tests.  ^  *  • 

.  The  new  legislation  had  beeif  amended  to  require  disclosure  only  of  scored  itemsr 
but  Mr  Solomon  arj^ed  that,  because  on  some  tests  the  "equating"  questions  were 
£lls6  scor^,  this  would  still  require  the  testmekers  to  "totally  revise  the  system." 

This  and  other  factors,  opponents  said,  would  substantially  increase  the  •cost  of 
testing.  In  his  testimony,  Mr.  Ambach,  argued  against  the  legislation  on  the  ground 
'  that  '^publishers  will  be  unable  to  reuse  tiest  questions."  Moreover,  he  said,  test 
development  would  become  more  expensive  because  "many  questions  are  pretested 
as  part  of  the  regular  examination  procedure/' 

The  testing  service  estimated  thftt,  under  the  new  legislation,  th'e  cost  of  the 
S.A,T.  test,  now  $8'25,  would  increase  by  lis  much  as  $5.  "While  it  may  appear 
desirable  to  have  such  disclosure  for  those  who  want  to  see  their  papers  and 
results,*'  said  Mr.  Ambach,  "the  cost  to  all  of  tho»e  tested  t)ecause  of 'the  disclosure 

J>rovision  would  outweigh  the  benefits."  The  College  Entrance  Examination  Board, 
or  whom  the  service  produces  the  test,  said  that  its  an/iual  profits  were  less  than  3 
percent  a  year,  not  thp  "22  to  27  percent"  asserted  by  critics.  *  • 

Opponents  idso  argued  that  entirely  new  tests  would  reduce  "service"  to  students, 
because  the  number  of  times  the  tests  were  administered  would  have  to  be  cut  and 
the  3(klay  disclosure  period  would  jeopardize  special  service^  to  handicapp^  stu* 
dents.  Mr.  Solomon  also  said  that  this  would  affect  quality  as  well.  "There  is  a 
tremendous  dahger  of  poorer  test  questions  if  we  have  to  come  up  with  21  forms  of  a 
;  test  instead  of  the  current  seven,"  he  said. 

Proponents  also  maintained  that  the  incidence  of  scoring- errors  that,  might  be 
caught  was  minuscule.  "In  1976r77  we  had  requests  to  hand-score  1061  of  the 
120,000  law  boaitis  and  found  Only  four  errors,  all  of  them  because  students  put'  the 
answers  in  the  wrong  spaces,"  he  said/ 

Tte  huttook  ^  ,  *  .  , 

With  the  Pommissioner  of  Education  and  many  college  spokesmen  vigorously 
opposed  to  the  truth-in-testing"  bill,  it  is  ipossible  that  Governor  Carey  will  decide  to 
veto  it  once  it  renches  his  desk;  On  the  other  hand,  it  cdso  appears  that  mMy  of  the 
college  ofiicialfl  irre. misinformed  about  the  actual  con^tentof  the  legislation.. 

Whatevctr  tSe  fate  of  this  particular  piece  of  legislation,  however,  it  would  seem 
•  certain  that  the  issue  will  not  go  awawThe  problem  of  responding  to  growing 
demands  for  new  forms  of  public  accountability  is.  one  that  Wilhbe  with  the  testing 
.  .  industry  for  some  time  to'come. 


.  •  [From  the  Boston  OloBe»  July  19,  1979] 

•        '       Testing  THE  Te8t-makkr8      ,  ' 

We  don't  know  whether  anyone  has  ever  tried  to  add  up  the  number  of  tests  a 
student  who  goes  to  college  and  beyond  takes  ^  a  lifetime,  but  the  nuntf>er  is  surely 
staggering.  Ai^,  oddly»  it  is  only  the  tests  that  are  most  crucial  for  academic 
a^^cement  that  students  never  sM  after  theyl»are  corrected  and  it  is  on^y  these 
tests-^Scholastic  Aptitude  Tests,  Graduate  Record  Examinations.  Law  School  Ad- 
mission Tests,^  Medical  College  Admissions  Tests— for  which  this  ''coi*rect"  answers 
afe  never  provided  the  stiidents.   /  ^  * 

That,  however,  may  be  changing.  New  York's  Gov.  Hugh  Carey  the  other  day 
signed  legismtion  that  will  require  the  services  that  adniini^ter  those  tests  to  file 
Copies  of  them  wth  the '"correct"  answers  30  days  aftjr  'they  are  adntiiiistered  and 
to  provide*  the  graded  answer  sheets  of  any  student  who  rehuests  them.  (TeDting 
services  are  not  likely  in  ihe  end  to  boycott  New  Yprk^^lthou^  some  are  threaten- 
ing to  do  so.  And-once  they  are  set  up  to  me^t  the  requirements^of  the  New  York 
law.  they  may  well  decide  to  institute  4iimUar  polidea  nationwide* 

itf  that  does  not  ioccur,''  tjie  Massfichusetta  Ijegislature  should  consider  similar 
legislation  here  to  increase  the  p;re8Sore  for  more  openjte^tlng  practices*  We  live  m 
the  world's  most  testnuriented  society*  And  while  colleger  and  graduate  schools  ftay> 
<^aim  thut  test  results  are  but  one  meenure  they  emplpy  in  admissibns,  the!  do 
clearly  ma^r.  Students  have  a  rijgfht  to  conftrmt/if  only  to  satisfy  themselves,  %hat 
the  scores  th^shApe  their  lixesTO^'^  ,  '        \'  ' 

Further,  the  whole  nofion  of  Mucation  in  our  society  revolves,  should  revolve* 
around  an       edhanga    i<im  anci  the  accumulation  of  skiUa  and  ideas  that  can 
l#d't%>  tiriuldom.  ^e  adiministering  of  tests  (br  which  the  ''correct"  answers  ar# 
T^t  teveMed  and  the  students  wdrk  never  leturned  tends  to  -convert  education^ 


into  a  frantic  scr^ble  up  the  greii&y  pole.  It  is'  fundamentally  at. odds  with  whftt*" 
the  >yhole  process  of  education  ought  to  be  about. 

IFrom  the  NrV.  Times.  Jul;^  24/ lVr9]  -  I 

*    *       •    **  Truth.  IN  Tbstino       '    '  / 

..  The  intemperate  responses  of  some  academic  testers  to  New  York's  truth-in- 
testing  law  are  certain  to  damage  their  cause  more  than  the  faw  itself.  The  associ- 
ations that  administer  admission  ttots  for  medical  and  dental  schools  have  threat^ 
ened  to  p^U  out  of  New^York^  and  the  Educational  Testing  Service,  the  nation's 
biggest  testing  enterprise,  has  said  it  might  curtail  services.  Doubtless,  the  law  wilb 
ren^uire  more  work  on  their  part,  and  there  will  be  added  cbsts.  But  their  corhplaints  . 
are  overst&ted^  In  fact,  the  law  is  welcome;  it's  time  to  take  the  mystery  out  of 
college  testing. 

The  law  signed  recently  by  Governor  Cdrey  applies  to  such  examinations^as  the 
Scholastic  Aptitude  Test  and  the  Law  &k;hool  Aditiission  Test  that  colleges,  and 
jgraduate  schools  use  to  rank  their  applicants.  As  of  Jan.  1,  1980,  a  cppv  of  any  test 
offered  in  New  York  must  be  filed  with  the  State  Department  of- Education.  In 
addition,  datQ  on  how  a  te|t  was  constructed  and  validated  must  be  made  public. 
What  irks  the  testers  most  is  a  pro;irision  that  allows  anyone  who  .takes  an  exam  to 
receive  a  graded  cony.  Questions  used  for  research  but  not  counted  in  scores  0nd 
specialized  achievemSnt  testis  are  exempt.  I  *  ' 

The  titers  say  the  law  means  an  exam  ^ven  ih  New  York  cannot  be  used  again 
becauie  its  contents  ftrei^likely  to  be  disseminated  elsewhere.  They  contend,  too,  tha^t 
,        the  law  will  create  problems  in  "equating"  tests'-^insuring,  for  instance,  that  a  600 
^     verbal  score  achieved  in  1975  is  comparable  tp  a  600  in  1979.  The  testers  therefore 
project  drastic  increases  in  cost  tojmaintain  the' present  level  of  serviced  And  they're 
.  unhappy  that  the  law  g^oes  into  effect  so  quickly.  This  complaint  may  be  Justified.  It  . 
takes  months  to  prepare  a  .test  and  a  slight  delay  tnay  be  in  order. 

Testing  serviceeUike  ETS  have  been  more  open  about  themselves  in  tecent  years 
and  the  tests  have  improved;  today,  most  are  fairer  tp  niinprities  than  they  were  ten 
'-r-  A  years  ago.  But  the  testers  still  haven't  faced  up  to  other  exam  limitations  or  to  the 
.  ' \f  frequent  misuse  of  test  results.  Although  testers  caution  against  it,  some  schools 
^      still  rely  on  scores  as  absolute  indicators  of  ability.  ETS^  moreover,  is  surely  ekag- 
:[      gerating  wh^n  it  contends  that  the  new  law  might  drive  up  costs  by  as  much  as  m) 
.  percent  and  th&t  6ven  then  might  not  be  able  to  uphold  testing  standards.  Develop- 
1 1    ment  costs  are  only  a  small  part  of,  total  costs  passed  on  the  consumer.  And  some 
.  authoriiiel^  have  argued  convincingly  that  at  least  four  techni(]ues  already^  used  by 
\;  vthe  industry  would  pemit*  "equating"  dnd  validating  to  continue  undisturbed— at 
'    little  or  no  extra  cost.  .  ♦  -       .  * 

In  any  case,  .there  is  the  mattj^r  of  elementary  fairness.  These  academic  tests  help 
'  to  shape  the  course  of  people's  lives— their  schooling,  their  careers,  the  ver^  sense  of  . 
their  own  abilities.  Students  de^rve,  to  khow  how  they  are  being  rated  and  judged. 
V   There  are  freedom-of-infoi^raation  laws,  tfuth-in-lending  laws,  truth-in-packaging 
.  laws.  Why  i^t  truth  in  testing  as  well? 


i  *  •  ■  •  ^  *      ■  ■  \ 

•      .        ■      t  [From  the  New  Republic.  August  25,.  1979] 

.         ,  .  *  -  * 

y,  ^  Evening  the  Score  ^ 

!  •  ETS  ha9  gckKl  reason  to  fear  New  York^s  new  "Truth-in-T»Btirtg"  law; 
V\  In  1980  more  than  .  200,000  New  York  state  teenagers  will  sharpen  their  number 
t^o.penciU  and  sit  down  to  take  the  dreaded  Scholastic  Aptitude  'Test  or  SAT—  the 
t'vyorand-a-half>hour  standardized  test  that  will  determine  whether  they  are  ad* 
mitted  to  the  colleges  of  their  choice.  But  the  1980  crop  of  aspiring  students  will 
ha^f^  many  advantages  over  the  millio(is  who  haye  taken  the  tests  before  them. 
Under  a  new  New.  York  statef  law,  tecently  signed  by  GoVrnor  HuRh  Carevv  the 
stiideAts  will  be  well  informed  «about  the  validity  of  tne  tests  and  their  rights  as 
testing  consumers,  tis^.  York's  8(H:alled  ''Truth-in-Testing"  laV  will  subject  to  pub- 
lie  scrutiny  for  the  first  time  th^  testing  agencies  that  have  long  had  the  po\^r  to 
destroy  a  person's  academic  and  career  aSpilstlons  in  a  single  morning.  ■  ^ .  . 

'  Testing  a((encies,  the  virtual  gatekeepers  of  thoN  American  elite,  have  becohpte 
^i^flited  with  the  task  of  preserving  the  meritocratic  system  by  means  of^multipie- 
\  oHitce-toams.  The  undisputed  lord  of  the  nation's  testers  is  the  Educational  Testings 
iService;  a  non-profit  organization  based  In  Princetoni  New  Jersey.  ETS  puts  out  the 
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SAT,  almost  all  major  admission^,  exams  for  cpj^es,  graduate  and  professional 
.  schoois,  and  entrance  tests  for  hundreds  of  occupatmn^.  Despite  the  enormous  power 
^t  has  over  people's  lives,  and  despite  many  questioij^  that  htive  arisen  about  the 
*v&lidity  of  multiple-choice  exams  in  predicting  colleg^  and  career  performance,  and 
about  racial  and  economic  bias9Sjn  the.  tests,  ETS  has  operated  since  1947  totally 
free  from  government  scrutiny  of  supervision.  People  who  pay  \q  take  the  tests  are 
powerless  to  know  how  the  questions  were  compiled,  what  the  right  answers  were, 
or  even  if  their  scored  have  been  ad4fid-up  right:      ^    .  " 

The  ^Truth-in-Testing"  law,  whiclvgoes  into  effect  next  January  1,  applies  to  all 
tests  that  are  administered  to  more  than  5,000  persons  who  are  applying  to  college 
and  graduate  schools:  namely,  the  SATs,  the  MCATs  (medical  boards),  th^  LSATs 
(law  boards), 'and  th^  GREs  (Graduate  Record  Examinations).  The  law  contains 
three  major  provisions.  First,  test-taker^  must'^be  told  wh^n  they  register  how  their 
scores  will  be  computecj;  what  the  testers  contractual  obligation  to  them  is,  and  how 
test  scoreJuhaVe  been  found  to  correlate  with  important  background  factors  such  as 
race,  economic  class,  and  special  coaching  and  preparation  for  the  exams.  Second,  ^ 
.the  law  requires  testing  companies  to  Hie.  information  and  studies  on  the  validity,  of 
the  exams  with  the  pffice  of  the  state  education  commissioner,  where  the  material 
will  be  available  to  independent  researchers,  curious  p'arents,  teachers,  3nd  stu- 
dents.   .  ^ 

The  .most  dramatic  provision  of  the  bill  is  one  that  makes  public  the  formerly  top* 
secret  question^  ^nd  correct  answers  to  the  exams.  Thirty  clays  after  the  test's 
results  are  in,  the  tester  mu$r  file  copies  of  the  questions  and  answers  with  the 
commissioner.  Furthermore,  within*  80  days  of  receiving  the  results,  a  student  is 
entitled  to  a  copy  of  hjs  or  her  graded  answer  sheet. 

This  **surishine"provision,  as  it  is  commonly  kjiown,  provoked  ETS  to- let  loose 
.^pon  every  college  president  and  high  school  principal  in  New  York  a  torrent  of 
letters,  mailgrams,  telephone  calls,  and  memos,,  all  threatening  the  state  education- 
al system  with  cjire  consequences.  Since  the  law  will  breach  the  security  of  tlie  * 
examSt^ETS  argues,  most  questions  can't  be  reused;  many  more  versions  of  egch  teslTj 
will  have  to  be  created  at  a  considerable  cost.  Now,  ETS  is  warning  of  increases  in 
test  fees  by  as  much  as  50  percent  in  19H0.  This,  their  spokespeople  bitingly  add, 
will  penalize  poor  people  and  minorities,  ETS  is  also  preActing  that  it  AviU-hV^  to 
cut  back  on  the  number  of  testing  sessions^. throughout  the  year,  and  curtail  special 
sessions  for  the  bed^ridden  and  those  who  observe* the  Jewish  Sabbath  (most  feTS 
tests  are  on  Saturdays^.  In  shori,  ;?ays  the  testing  agency,  the  "Truth-fn-Testing"  law 
hurts  minorities,  orthodox  Jews,  the  poor,  the  sick,  and  the  handicapped.  Quite  a 
symp/ithetic^col  lection.        «    .  - 

According  to  a  recent  memo  by  the  Col lege^n trance  Examinati^  Board,  wbfch 
sponsors  the  SATs,  **tru*th-in-testing  will  only  advitntage— if  it  advantages  anybody 
at  all— aggressive  families  whose  indignation  at  low^reported  scores  will  impo^i?  a 
higher  cost  on  all  other  families^!  :     *  " 

ETS  and  the  College  Board  would  have  us  believe  that  because  a  test  like  the 
ORE  is  given  80  times  a  year  and  in  special  sessions,  there  n^ed  to  be  zu  od  more 
different  versions  of  the  test  to  comply  with  the  new  law.  But  it  takes  ETS  at  least 
30  days  to  grade  the  exams  and  the  bilT  allows  another  30  days  before  the  tjuestibps 
and  answers  must  be  released.  With  a,  lUfle  simple  arithmetic,  it  is  clear  that 
testing ^could  operate  QJi^  a  60-day  cycle  and  only  six  versions  of  a  test  meed  be 
developed  each  year.  / 

ETS  8  own  internal  studies  cast  doubt  on  the  company's  threatfc  about  the^  cost  of 
complying  with  th^law.  According  to  a  1972  breakdown  of  how  fees  are  speht,  less 
than  five  percent  goes  into  the  writing  of  the  tests.  About  25  percent  is  profit  for 
ETS  and  its. clients — certainly  enou)}h  to  absorb  some  of  the  costs  of  writing  new 
questions.  Besides,  only  a  small  percentage  of  the  test  questions  are  reused  npw. 

More  severe  intimidation  tactics  are  being  used  by  the  AssQpiation  of  American 
Medical  Colleges,  which  sponsors  the  MCATs.  This  medical  school  admission  test  is 
the  only  major  exanri  run  by  ETS's  competitor,  the  Iowa-based  American  College 
Testing  Service.  Less  than  a  week  after  "Truth-in-Testing"  was  signed  into  the 
Association  -announced  that  it  would  fitop  giving  the  MCATs  in  New  York  State  at 
the  end  of  the  year,  forcing  ^ew  York's  pre-med  students  to  travel  ojit  of  state  for 
the  e>ffim.  After  thw  threat,  jofficers  of  the  state  Education  commiBmpn  reread  the 
law  and  concluded  that  it  applies  to  tests  given  anywhere  for  admisslcxn  to  schools  in 
New  York  state.  Dismayed  Medical  College  Association  officials  may  challenge  the 
bonstitutionality  of  such  an  interpretation.  k 

The  hysterical  reaction  of  the.  admissions  boards  and  testing  services  is  actually 
quite  understandable,  in  light  of  what  is  at  stake,  Truth-in-TealHngf  is  not  sitoply  a 
piece  of  consumer  legislation.  It  is  a  challenge  to  the  entire-system  of  psychometrics. 


s 

The  real  threat  to  the  testinj^  companies  from  havipg  to  reveal  their  questions  and 
the  correct  answers  is  not  that  they  will  have  to  make  up  new  questions  each  time. 
Rather,  it  that  the  tests  will  be  subject  to  outside  scrutinly  and  evaluatfon  for  the 
first  time.  • 

Since  World  War  11^  the  notion  ol^a  hana-picked  elite  has  been  made  obsolete  by 
the  computerized  world  of  the  mul\ip]e-choi^pe  exam.  Standardized  testing  gained 
Respectability  during  the  war  whei)  the  Office  of  Strategic  Services  commissioned 
•psychometricians  to  develop  tests  thAt  could  allocate  human  cesources  as  quickly  as 
possible.  During  the  great  influx  of  college  applicants  after  the  war,  the  College 
Board,  along  with  the  Carnegie  Foundation  and  American  Council  on  Education, 
established  ETS  ask  non-profit  organization  to  administer^ the  SAT  and  defelop  new 
tests.  .    V    »  ^ 

.  Under  the  lopse  supervision  of  the  College  Board,  ETS  rode  on  top  of  a  wave  of 
testing  mania,  doubling  its  revenues  almost  every  five  years.  It  tests  everybody  from 

V  toddlers  applying  to  nurse^ry  schools  to  aspiring  CLA  agents,  stockbrokers,  Peace 
Corps  Volunteers,  actuaries,  gynecologists,  and  auto  mechanics.  During,  the  1960s, 
college-age  males  had  to  take  an  ETS  exam  to  pcove  they  were  vyprthy  of  student 
draft  deferment.  Today  the  bar  exams  in  almost  all  states  are  in  part  administered 
by  ETS.  Thriving  also  on  millions  of  dollars  of  government  and  foundation  research 

-  grants,  £TS  has  become  an  SSO-million-a-year  operation,  comfortably  seated  on  a 
400-acre  .  estate  wlth^ts  own  swimming  pOof,  hotel,  golf  course,  tennis  courts,  and 
private  lake,  fiTS  also  has  its  own  zip  coie. 

Before  the  new  law,  ETS  made  it  extremely  clear  that  what  goes  on  at  the  2000^ 
employee  Princeton  homestead  is  strictl}^  confidential,^articularly  in  regard  to  in- 
house  research  on  the  weaknesses  of  the  tests  it  gives.  The  possibility  of  racial  and 
economic  biases  in  the  tests  has  been  a  sensitive  one.  for  many  years.  A  more  recent 
controg^ersy  has  concerned  the  effects  of  coaching  on  test  scores.  ,^ 

Carl  'Bngham,  the  developer  of  the  first  SAT  and  the  man  for  whom  ETS's 
Princeton  library  is  nameiy^jwas  best  known  for  his  theoYetical  writings  on  the 
superior  intellect  of  White  Anglo-Saxon  Protestants.  Many  small-scale  studies  indi- 
cated the  SAT,  billed  as  an  ''aptitude"  test,  actually  tests  acquired  skills  and 
knowl^dg^;^  discriminating  against  the  economically  cftsadvantaged.  yet  complete 
data  on  the  problem  is  not  made  easily  ^vdilable  by  ETS.  An  ETS  study  called 
Cultural  Bias  in^  Tenting:  Challenge  and  Response— probably  the  best  stucty  of  the 
subject — has  been  withheld  from  outsiders. 

'  On  the  recent  pfoblem  of  the  effects  of  coaching,  ETS  has  taken  even  more  drastic 
efforts  to  thwart  the  disclosure  of  its  research.  ETS  still  insists  that  coaching  cannot 
significantly  alter  test  scores,  i^lthough  several  internal  studies  have  supportkl  the 
claim  made  by  the  Stanley  Kaplan  coaching  schools  that  for  $27.^j  a  student  can 
boost  his  or  her  "aptitude'  by  more  than  100  points  (out  of  600)  on  the  SAT.  Lewis 
Pike,  author  of  an  ETS  study  suggesting  that  the  SAT  is  susceptible  to  coaching, 
w^  fired  last  year  after  14  years  with  ETS  when  the  research  results  he  was 
producing  proved  too  controversial.  Obviously  the  suggestion  ^t hat  coaching  can 
improve  test  ficoroo  undormtDOB  the  thoory-that  the  SAT  is  an  "aptitude'*'  teat.  It 
also  implies  a  large  advantage  to  those  who  can  afford  coaching. 
'  The  ETS  company  line  on  the  new  law's  provisiotis  reauiring  this  kind  of  informa- 
tion to  be  made  available  to  the  public  is  that  it  is  alreaay  available,  this  is  patenily 
false.  ETS  claims  that  it  merely  limits  access  to.'*i||ponsible  researchers.'  put,  to 
cite  one  of  man v  examples  that  disprove  that  claijjflp^hen  an  attorney  at  the  FTC's 
Boston  regional  pffice  launched  an  investigation^^  tfie  Stanley  Kaplan  coaching 
schools  two  year^  ago,  the  FrC  was  forced  to  Subpoena  the. data  it  needled  from  ETS. 

To  temper,  its  image  as  an  Or\yellian  monster  of  the  computer  testing  age,«ETS 
has  come  dowh  hard  on  abuses  by  its  clients.  When  the  statd  of  South  Carolina  used 
an  ETS  test  to  set  teachefs*  salaried,  ETS  terminated  its  contract  to  administer  the 
test  in  South  Carolina.  ETS  also  tries  to  discourage  test*crazed  £ldmissions  deans 
from  setting  arbitrary  cut-off  scores  under  which  applicants  are  not  considered,  and 
from  reading  finer  distinctions  into  the  scores  than  the  tests  are  able  to  make.  ETS 
President  William  Trumbell  wrote  in  the  1978  annual  report,  "Testing  has  suffered 
more  frorn  the  excessive,  expectations  of  its  most  devoted  advocates  than  from 
attacks  ef  its  critics."  *  .  . 

Yet  ETTS  does  little  to  correct  the  many  testing  casualties  that  siudents  suffer  at 
the  hands  of  its  clients,  or  by  ETS*b  own,  errors.  A  student  who  suspects  E)TS's 
computers  have  made  a  scoring  error  can  request 4i  hand-score,  but  no  one  outside 
of  ETS  can  check  ihg  organ izations's  figures.  And  there  i?  no  real  recourse  if  ETS 
sends  inaccurate  inrorfnation  to  a  college  about  a  student,  because  most  likely  the 
student  will  never  find  out  about  it.  One  such  scandal  became  public  during  th6 
1975-76  academic  year  (".ETS's.Star  Chamber,",  TAW,  February  5,  1977).  Some,  of  the 


LSAT  score  reports  sent  to  law  schooFs  contained  an  asterisk  indicating  that  the 
applicant  was  an  ''tmacknowledged  repeater"— someone  who  had  failed  to  indicate 
on  the  test  registration  form  that  he  or  she  had  taken  the  test  before.  Applicants 
\wefe  not  told  that  overlooking  ijthe  seemingly  innocuous  question  about  past  tests 
risked  incurring  the  deadly  asterisk.  Even  worsev  the  ETS  system  accidentally 
Ifitbeled  an  unknown  number^of  test-takers  incorrectly  as  ''unacknowledged  repeat- 
erSi/*  ETS  eventually  notified  admissions  deans  to  ignore  the  asterisk.  But  it  made 
no  Vfort  to  rectify  the  damage  already  done  oi  to  inform  the  victims  of  tW  error 
why  they  may  have  been  rejected  from  law  school.  \ 

The  New  York  law  may  lead  to  similar  federal  legislation.  Last  month  Repre- 
sentative Ted  Weiss  of  New  York,  along  with  Shirley  Chisholm  of  New  Yor*k,  and 
George  Miller  of  California,  introduced  a  "Truth-in-testing"  bill  in  the  U.S.  House. 
>The  thircj^  bill  of  this  type  to  be  introduced  over  the  past  few  years,  the  Weiss  bill 
resemblesahe  New  York  state  la\y,'btft  requires  the  testing  companies  to  dfsclose 
more  financial  data  as  well  as  theyr  contracts  with  the  test  sponsors.  i 

ETS  and\he  College  Board  aror  taking  the  new  Weiss  bill  vefy  seriously,  if  their 
concern  can  be  measured  by  the/yolume  of  mail  being  sent  to  members  of  Congress. 
As  in, New  Ydrk,  ETS  and  its  p/oponents  are  repeating  their  chilling  descriptions  of 
great  hikes  in\test  fees.MimKed.  access  to  tests,  and  the  disadvantage  of  non- 
aggressive  students  and  fatnilips.  "But  far  more  costly— in  a  social  sense— would  be 
this  bill's  injeCtitm  of  the  fedpral  government  into  the  college  q,dVTi^ions  process 
*  *  *  a  process  protected  bylthe  1st  Amendment  to*  *the  Constitution,"  adds,  one 
College  Board  menro  sent  t^o  niembers  of  the  House  on  Jply  28.     *  , 

This  invocation  of\the  Bill^bf  Rights  is  hogwash.  The  Educational  Testing  Service 
has  a  far  greater  imWct  pn  the  lives  of  nnany  young  people  than  tjie  government 
t)as,  yet  it  denies  therri  the  mo^t  fundatnerfital  rights  of  equal  protection  and  due 
process  that  the  Constitution  guarantees  to  all  individuals  who  are  affected  by 
government  action. 'A  little  sunlight  on  the  nations^ most  powerful  unregulated 
monopoly  is  loKg  overdue, 

Barbara  Demick. 
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HOWARD  University  Si^^DV  Cites  Limits  vv  Standardized  Tests 

A^higher  standardized  test  score  does  not  necessarily  mean  a  professional  school 
applicant  is  more  qii^lified  for  admission,  and  schools  should  consider  many  factors 
in  Aiakirig  admissionj  decisions,  according  to  a  new  report  of  Howard  University's 
Institute  foh  the  Study  of  Educational  Policy.  '  / 

J  Colleges  and  universities  sljould  recognize  the  limitations  of  .standardized  testli 
and  use  them  accordingly,  while  also  seelting  to  improve  the  tests,  according  to  tbe 
study's  autho.r,  Sylvia  Johnson.  Johnson,  a  testing  expert*  is  associate  professoirof 
education  at  Howard  and  a  senior  vist^ing  fellow  at  the  institute.  1 

Less  dei>endence  on  tests  "will  result  in  greater  fairness  to  individiiftls,  as  wellS^ 
g^)H^,  in^the  long  run,"  Johnson  said  at  a  news  conference  yestlSrday*  to  announce^ 
jlDlication  of  the  Measurement  Mystique.     |  ' 

•  ■  »  . .  ■  / 

POLICY  DECISION  • 

•    ■  .       .  •  ■        .  " 

The  choice  of  admissions  criteria  is  a  policy  decision,  not  a  technical  one,  accord- 
ing to  the  study.  ^The  question  is,  what  is  that  important  thing  in  the  future  that 
we  want  our  selection  instruments  to  predict? 

"Is  it  'ability  to  survive  the  first  year  of  medical  school?'"  'lis  it  lifelong  involve- 
ment in  pure  research?'"  "Or  is  it  'personal  egQ  strength  and  emotional  stability 
sufficient  to  be  involved  as  a  psychotherapist  for  40  years?.'  " 

Sitnilarly,  ''if  decision-makers  feel  that  it  is  useful  arid  important  to  have  fair 
numbers  of  Black  and  female  physicians,  then  a  utility  function  would  be  chosen  for 
use  in  s^ection.  Jhis  function,  would  give  weight  to  the  minority  or  sex  status  of 
applicants,'' the  report  said.  v 

Tests  might  be.  used  to  establish  minimum' competency,  but  "after  you  get  to  a 
certain  point,  yoi\r  chances  of  success  are  not^  really  increased  by  having  a  higher 
score/'  Johnson  said  ypslerday.  After  that,  schools  should  look  at  other  factorfe»  such 
as  motivation  or  volunteer  activities,  she  said.  \  ^ 


,  J  •  BIAS  IN  TESTS  '  "  . 

Blacks  and  othOT  minority  groups  puffer  from  overdependenge  on  standardized 
test  scores  because  of  test  bias,  the  report  says.  That  isra  tiest  may  not  accurately , 
measure  a  given  ability  for  all  grou^,  and  "the  test  scores  of  Blacks,  Chicanos,  and 
other  minorities  tend  to  have  lower  reliabilities  than  those  of  whites/'  . 

Minorities  may  not  scofe  as  well  as  whites  do  on  standardized  exams  because  of 
biased  questions,  lower  socioeconQmic  status,  poorer  educational  preparation,/*co(d'' 
treatnoent  by  exaniiners  or  the  belief  that  prejudice  will  limit  th^ir  options  what- 
ever tneir  test  results,  according  to  the  study. 


test 
you 

measure  a  room." 

Johnson  praised  "truth-in-testing"  legislation,  such  as  that  enacted  in  New  York 
and  introHduoed  In  Congress  by  Rep.  Ted  Weiss,  D-N.Y.  Weiss*  bill  would  require  the 
release  of  test  questions  and  answers  and  research^on  test  validity  (HED,  July  25). 
Dissemination  of  that  infoVniation  might  "provide  greater  awareness  of  the  limita- 
tions of  testing",  and  "demystify"  it;  she  said.  % 

**An  arbitrary  test  score  does  not  have  meaning,"  Johnson  said,  pointing  out  the 
average  mechcal  school  admission  verbal  test  score  of  aoplicants  accepted  in  1955-56  ^ 
16  close  to  the  average  score  of  those  rejected  in  1975-7d.  ^  . 

Copies  of  the  report  are  Available  free  bv  writing  the  Institute  for  the  Study  of  - 
Educational  Policy,  Howard  University,  2900  Van  Ness  Street  NW,  Washington, 
D.C.  2000S. or  calling  (202)686-6686.  " 


[From  the  N.Y.  Times  Magazine,  September»2.  1979] 

?  ■  ■  ,  ■    ■     .  ■  ■ 

j  ■     '       The  American  Way  of  Testing 

■     " '   •    '  '     '  ■  .  ^ .    ■  ■  ■  V  ■ 

MANY  FORCES  HAVE  CONTRIBUTED  TO  THE  DECLINE  OF  A^ER^CAN  STUDENTS  WRITING 
ABIUTY  BUT  NONE  HAS  BEEN  MORE  EFFECTIVE  THAN  THMVIDESPREAD  USB  OF*  MULTI- 
4  PLE-^HOICE  TESTS 

(By^Thomas  C.  Wheeler) 

What  today  inhibits  the  wrjting  of  citizens,  scholars  and  ^students?.  Americans, 
long  vigorous  and  inventive  in  speech,  object  to  the  act  of  writing.  Two  out  of  three 
abilities  expected  from  education— reading  and  writing—disintegrate  as  some  insid- 
ious-influence, thought  by  many  to  be  television,  captures  succeeding  generations  of 
children.  .        .  , 

In  defense  of  literacy,'  ^ery  wordsmith  has  his  own  horror  ^tory  to  tell.  In  a 
scrawled  note,  a  bright  girl,  hot  long  out  of  high  school,  wished,  me  a  'iMary 
Christmas/VAn  editor  of^a  national  weekly  told  me  she  would  be  wary  of  hiring  a 
copy  editor  under  30,  fbr  fear  of  grammatical  incompetence.  A  doctor,  judging  me 
physically  fit  and  conHiing  a  woe  of  his,  deplored  the  inability  of  medical  students 
ne  teaches  to  express  themselves  clearly  in  writing.  An  architect  of  my  geners^tion 
tells  me  that  bright  young  architects  he  has  hired  cannot  put  together  a  coherent 
report.  Although  the  young  resent  it,  their  elders  utter  more  than  th^  usiial  conv 
plaints  of  an  older  generation  against  the  language  of  a  new.        v   .     .  ^ 

"This  generation  has  grown  up  without  learning  concentration-^you  don't  develop, 
that  by  switching  chSmiels.  What  can  teachers  do  but  pander  tf  ttie  rapid  alteration 
of  mood/and  attentioA'  this  view,  from  the  chairman  of  an  academic^commit'tee  ot\ 
literacy,  puts  the  blame  on  television,  . 

But  an  influence  as  devesting  as  television  is  the  obje«ive  test  system,  inttoduced 
by  higher  learning— and  now  used  in  secondary  educition.  Until  the  1950's,  stu-, 
dents  wrbt^  essays  in  schools  because  they  were  expected  to  write  essays  on  college 
.  entrance  exams.  But  the  university  abandoned  the  essay  requirement  by  adopting,  & 
generation,  ago,  the  ejatirety  objective  test  for  adtniapon,  the  Scholastic  Aptitude 
Test  (S.A.T.).*         .  ^' 

Before  World  War  II,  the  objective  S.A.T.  had  been  a  supplement  in  written 
achievennent  tests  in  various  subjecta.  But  when  the  S.A.T.  became  dominant  the 
dCTiievement  testa  became  objective,,  too,  and  also  optional.  When*  the  university 


•  'Most  American  colle«efl  use. the  S-AJ.;  wme,  mathly  in  the  South  and  Wefit,  uae  the 
American  College  Test  (A.CT  ),  developed  later,  modeled  after  the  S.A.T.  and  produqed  by  the 
American  College  Testing  Program  in  Iowa  City.  ^ 
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dropp^d  the  eway  requirement,  it  failed  to  reeognize'the  power  of  the  system  it 
launched.  Onc0  the  college  entrance  exams  were  objective,  secondary  schools  asked 
for  less  writing.  Urged. on  by  test  manufacturers,  high  schools  began  lo  use  objective 
*  tests  both  to  prepare  their  students  and  for  their  own  examinations.  The  university, 
by  sanctioning  the  objective  system,  beartf  a  terrible  responsibility  for  rtie  decline  of 
writing  in' the  United  States."  \  , 

.  Today,  the  test  nrianufacturers— led  by  the  Educational  Testing  Service  of  Prince- 
ton, N.J.— are  profiting  from  miseducatioq.  E.TtS.  produces  not  only  the  6.A.T.  but  a 
battery  of  tests  used  for  secondary  and  graduate  education.  Although  the  tests  have^ 
made  writing  seem  unnecessary— although  they  Have  also  damaged  reading  abili  - 
ty—-tFfey  are  too  expensive  to  throw  out  or  replace.  Harmful  though  the  tests  are, 
the  schools  have  submitted  to  a  system  ihat  runs  on  its  own  power.  Measuring 
students  means  measuring  schools^accdrding  to  the^aggregate  scores  of  the  en-  • 
rolled— and  few  schools  dare  drop  out  of  the  spiral  of  relative  standing.  Public 
schools  are  also  tied  to  the  tests  by^school  boards  demanding  measurement. 

Developed  first  for.  t^o  Army  in  World  War  I  and  widely  used  in  World  .War  II  to  . 
test  intelligence  and  aDflity,  objective  tests  are  gifts  of  war  to  civilian  life.  In  the  25 
years  the  S. A.T.  has  bpen  dominant,  American  education  has  been  revolutionized. 
The  marketplace  has  overturned  the  traditional  foundations  of  learning— reading 
and  writing^more  completely  than  the  efforts  of  any  mechanistic  theorist.  JVlost 
Americans  are  probably  tested  more  than  they  vare  taught.  QoiTipo3itions,  essiify 
questions,  term  papers— vigorous  thinking— all  have  yielded  to  one  right  answer  put 
of  four,  to  boxes  to  be  checked,  blanks  to  be  filled.  Objective  tests  not  only  carry  the 

^  prestige  of  beihg  scientifically  accurate— when  they  aren't— but  also  provide  an  easy  ^ 
way  of  handling  the  ftiasses  by  machiiwsrThe  results  might  have  been  predictable  to 
an  educational  system  that  vAlued  education.  The  national  system  that  valued 
education.  The  national  S.A.T:  verbal-aptitude  scores  have  shown  a  steady  decline 
over  a  14-year  piriodMf  the  scores  shovv  anything,  they  showihow  poor  a^teacher 
objective  tests  are.  The  American  language— aupple,  imaginative  and  alive— has  lost 
ground  to  the  pretense  of  measurement.  IJ^obody  ever  cared  a&out  giy  writing"  is  a 

•  refrain  I,  a  teacher,  have  heard' in  several  accents.  After  two  decades  of  objective 
education,  the  "educationally-digadvantaged"  are  not  merely  the  poor  and  minority 
groups,  but  the  supipwedly  well-educated  and  the  well-to-do. 

^any  colleges  now  profess  doubts  about  S. A.T.  scores  and  say  that  in  admissions 
co^aideratic/ns  high^hool  grades  and  teacher  recommendations  are  more  imporr 
tant.  One  ^istin^ished  liberal-arts  college,  Bowdoin  College  in  Maing|pfound  there 
was  no  correlation  between  high  test  scpreis  and  college  performancC^  Finding  the 
1  "predictive  value  of  standardized  tests"  Questionable  and  test  scores  misleading,  it 
.  ^-^  has  abandoned  the  test  requirement  for  admission.  > 

jk^hoing  that  point  of  view,  New- York's  Gov.  Hugh  Care>U8igned  legislation  in 
July  reiluiring  that  the  public  be  given  access  to  the  ie^.  "The  standardiTfed  tests 
are  inipc^ise  and  open  to  potential  misinterpretation,'*  the  Governor  said.  "It  must 
be  ...  a  candidate^  right  to  have  access  to  his  results." 

Beginning  Jan.  1,  New  York  State  students  will  be  able  to  Examine  both  their 
own  tests  and  the  an^nv^re.  The  testing  services  will  also  be  required  to  disclose 
their  research  on  the  AyiJidity  of  the  tests  and  to  .  describe  what  the^tests  are 
supposed  to  measure  and  hjow  to  interpret  the  scores. 

In  1978,  for  the  first  time,  responding  perhaps  to  criticism  of  the  test,  the  College 
Entrance  Examination  Board  released  a  sample  S.A.T.  exam  to  students  registering 
for  the  College  Boards.  The  test,  it  is  often  said,  favors  middle^jlass  wh}te  students^ 
^t  the  expe;w€f  of  minority  groups.  Certainly  this  is  true.  But  miodjMlass  blacks 
/v   might  do  as  well  on  it  as  their  white  counterparts.  The  S.A  T.'s  tougher  verbal 

auestions  can  be  conquered  by  inforined  guesswork,  but  often  the  correct  answer, 
epends  on  the  sheer  luck  of  the  ^student's  reading  or  experience.  In  a  verbal 
section,  the  student  Is  asked  to  "choose  the  word  or  phrase  that  is  niost  nearly  the 
oppoaiie  in  meaning  to  the  word  in  capital  letters."  One  example  ia  this: 
WHET:  (A)  expire  (B)  heat  (C)  delay  (D)  slake  (E)  revise     .  .  v 
A  student  who  didn't  know  the  meaning  of  slake,  the  righ't  answer,  could  still  do 
well  in  college.  Eveq  if  he  didn't  know  the  meaninjs  but  knew  the  precise  mining 
of  whet,  he  could  get  the  right  answer  by^nroc^  ojTelimination.  On  the  acconroany* 
ing  answer  sheeC  £.T.S.  informs  us  that  of  stuKntI  getting  a  verbal  score;aboye  the 
median  of  450  on  this  teat,  onfy  21  percent  settled  for  «/aAe  i 
.  In  an  analogies  section,  in  which  the  student  is  asked  to  "select  the  letterd  pair 
that  beet  (expresses  a  relatlQ&dhip  similar  to  that  expfessed  in  the  origin^^pair/! 
come  them  pairs:  ■  /; 

SWnjj?SWINE-(A)  roe :  fish 


(B)  coop :  poiiltry 


\ 


;  ess 


i 


(C)  mutton  :  sheep 

(D)  pesticide  :  vermin 

.       (E)  fodder :  cattle  »   .  .  ' 

If  a  student  had  read  f ural  English  novels  or  grown  up  on  a  farm,  he  would 
.  surely  know^what  swill  meant  and  make  an  instant  connection  with  fodder.  Only  2S 
'  percent  of  the  near-median  scorers  got  E,  the  right  answer.  Since  450  is  not  a  high 
S.A.T.  score,  perhaps '^n\e  poor  farm  boys  succeeded  where  urban  dr  suburban 
students  failed.  »_ 

.  To  give  the  devil  his  due,  it  must  -be  said  that  the  S.A.T.  asks  for  an  ability  to 
make  fine  distinctions,  as  in  this  analogy: 
IMPREGNABLE  :  AGGRfiSSION~ 

(A)  im^rfect :  revision  »:  '•.  V^^^  ^  " 

(B)  inyincible  :  defense  .  ^  . 

(C)  - inequitable :  Of iticism         '.^  .»7 

.  -(Dj  yidivisible :  separation  \  ^*  *  v  .         ^    •  ^*    ^  / 

(E)  irijmutable :  pffese.rvQtion-  ^  .      .    '  ^ 

•    \    Thirty  p^Brtent'  of  the  near-median  scorers  chose  the  right  answer,  D.  Just  as 
something  \b  impregnable  against  agressionS^is  something  indivisible^if  separation 
•  is  tried.*     -  •      .  ^     .    \  \  .  .  - 

S.A.T.  sentences,  wjth  their  blanks  (lUed.in  correctly,  read  well  enough  in  this  qne 
\  *  released  test;  even        reading  passages  do*not  assault  the  ear  of  the  sensitive 
readen.  But  even  though  verbal  sections  of  the  S.;^.T.  are  weH  enough  written,  the 
.    tek  is  still  obnoxious.  Its  verbal  part,  like  other  odijegtive. tests  in.  language,  does  not 
ask  for  writing;  and  because  it, doesn't,  the  act  of  writing  has  withered  in  our 
7   .'^schools.*.     :  V.      '         .     .  •  /  - 

.  '    Reading  questionsson  the  sample  SrA.T.  try,  with  cohsiderable*8ucce^^ 
&'tudentv  Here  is  a  pairb[|^raph  from  a  longer  passage  on  the  sample  test: 

The  way.  of  the^sert  and  tke  v^Tay  of  fhe.  jungle,  represent  opposite  metfiods  of 
.reaching  stability  at  two'^^tremes  of  density;  "W  the  juftgle  there  is  plenty  of 
'    everythingUife  needs  exi^pt  mere  space.  Everything  is  on  top  of  everything  else^ 
•  there  is  no  cranny  which  is  ifiot  both  occupied  and,disputed.  At  every  moment,  wa^ 
to  the  death  rages  fiecceiy.  The  place  left  vacant  by  any  creature  that  dies  is  seized 
almost  instandly  by  another,  and  life  seems  U>  gutter  from'  nothing  except  too 
,  C^YOrable  an  envirOnrtnent.  In  the  desert, -on  th#Dther  hand,  it  is  the  (Environment 
'i^^V;  itself  which  serves  as  the  limiting  factor.  To  some  extent  the  struggle  of  creature 
:  against  creature  is  mitigated,  althouRh  it  is  of  course  no^abolished  even  in,  the 
vegetable  kingdom.  For  the  plant  which  in  the  ol^e  place^ould  be  strangled  to 
.  death  by  its  neighbors  dies  :  a  thirsty,  seedling  /in  the  desert  because  that  same 
neighbor  has  drawn  the  scant  njoisture  from  it6  spot  of  earth. 
The  question  pertaining  to  this'T)aragrap.h  is:'  ^  • 

Which^  of  the  following  is  (are)  true  of  both  the  way  of  the  jungle  and  the  way  of 
the  desert?  V|5k*V-  -  ^ 

'   1;  They  are  cnarllTOrisSed  primarily  by  theisttuggle  of  creature'  against  creature. 

II.  They  are  njitfctions  to  hostile  environments.  .  ^ 

III.  They  result  in  population  control. 

(A)  II  only  ^  .  • 

(B>monly  ;  ^ 

■»     (C)  I  and  II  only    ^  ' , 

(D)  II  and  III  only 

(E)  I.irandIU  .  V  • 

What  is  a  stU(fent,  in  a  limited  time,  to  do  with  these  choices?  The  instructipns 
tell  the  student  to' kns>ver  "on  the  basis  of  what  is  stated  or  implied"  but  there  is 
both  a  statenoieht  and  an  implicatipn  to  reckon  with.  The  test  makers  undoubtedly 
intended  to* lure  many  students  to  '^I.  They  afe  characterized  primarily  by  the 
struggle  of  creature  against  creature."  For  not  only  id  the  istruggle  a  clear  character- 
istic of  both  desert  and  jungle,  it  is  also  emohasized  in  the/last  sentence.  But  strong 
as  that  temptation  may  be.  the  . student  who  yieUs  to  it  y^ill  be  wrong.  Foir  the  test 
makers  have  cleverly  inserted  the*  word  primaril^and  KnkedJ  with  the  unaccepta- 
ble possibility  of  II.  To  score  well,  the  student  must  have  his  guard  ready  and  high. 
The  right  answer  is  (B)  III  only:  "They  result  in  pofKilation  control."  Perhaps  the 
right  answer  is  got  by  process  of  elimination.  Or  p^haps  it  is  obtained,  by  finding 
the  faint  implication  in  the  phrases  "reaching  stability '  and  "limiting  factor."  To 
get  thp  answer  in.  a  short  tinrie  does  indicate  spmething  akin  to  the  skill  of  a 
detective.  But  it  does^  not  indicate  that  a,  student  could  write  a  searching  term 
.  'piiper.  Getting  the  right  answer  dq^  not  measure  the  depth  of  a  student's  m:  Ind.  Of 
those  who  scored  450,  20  percent  succeeded. 


\ 
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"Vainly,  E.T.S.  tries  to  measure  writing  |bility  objectively  in  a  80-minute  part  of 
the  S.A.T.  called  the  Test  of  Standard  Written  English  (T.S.W.E.).  The  test  asks  the 
.  student  to  spot  the  grammatical  errors  in  underhned  sections  of  sentences;  it  also 
'asks  him  to  choose  from  among  fivie  possibilities  the  best  way  to  phrase  an  under- 
lined part.  A  student  who  can  spot  an  error  in  an  underlined  section  may  still 
commit  the  same  error  iii  the.  frenzy  of  unaccustomed  composition.  Evien  if  a 
student  .has  a  sure  knowledge  of  grammer  as  shown  on  an  objective  test,  the  test 
still, won't  determine  whether  he  can  write  ail  essay.  For  writing  requires  not  only 
gramipar  but  ideas  and  the  ability  to  organize  material,  lihese  abilities  §how  up 
only  in  actual  w/iting.  The  test  is  in  many  ways  an  exercise  in  futility.  The 
stUHent's  score  is  not  counted  in  the  S.A.T.  but  sent  to  the  college,  supposedly  to 
determine  what  level  of  freshman  English  the«tudent  Should  take.  Good  colleges 
will  not  use  the  score  for  placement  purposes,  as  E.T.S.  recommends.  Most  colleges 
administer  their  own  written  essay  exams  to  determine  what  level  of  Composition 
course  a  student  needs.         -x   ~-     '  > 

E.T.S./does  ask  for  a  250TWord  essay  in  one  of  the  five  annual  offerings  of  the 
t)ptionai  Achievement  Tedts  in  English  Composition.  But  of  the  1.4  million  students 
who  took  the  S.A.T.  in  1977-78,  only  85,000  students  wrote  the  essay.  In  the 
multiple-choice  English  Achievement  Test,  the  student  marks  errors  in  "diction," 
'*U8age,'*  "idiom,"  "wordiness,"  "sentence  struct^ure"  and  "metaphor"  without  ewer  ' 
demonstrating  th^  he  can  avoid  making  such  errorfl'in  his  own  writing.  Many  go* 
writers,  students  or  not,  may  be  unsure  of  academic  terminology  but  write  well  out 
of  their  sense  of  language.  That  kind  of  talent  would  do  poorly  on  tbie  test. 

The  test  encourages  schools"  to  teach  primarily  bv  terminology,  since  the  final  test 
asks  for  it.  For  example,  the  student  must  choose  from  several  possibilities  the  r|ght 
rephrasing  of  a  Slitence  if  a  subordinate  clause  is  changed  to  a  participle,tor  if  one 
sentence  is  ch^gBd  to  a  clause.  He  is  told,  in  effect,  that  writing  is  a  juggling  act, 
without  purpose.  .  . 

The  testing  services  that  dominate  our  educational  systeni  may  be  able  to  justify 
tests  tn  mathematics,  but  they  shouldn't  be  allowed  to  sdp  the  strength  froin  our 
language  with  objective  tests  in  writing.  If  we  are  given  another  generation  of  tests, 
writing  will  become  a  rcffe  art.  The  responsibility  for  salvaging  writing  falls  .to  the 
American  university,  which  instituted  the  objective  tests  for  college.  admi^iprr25 
years  ago  and  sanctioned  their  use  throughout  the  sc^tool  svstem. 

The  antidote  is  to  resftore  writing  requirements  on  coltega  entrance  .exa.ms.  But     *  - 
the  task  is  formidable:^E.T.S.  has  a  vested  interest  in  protecting  its  contracts;  it  is  . 
marshaling  every  "social  science*'  argument  it  can  in  defense  of  existing  tests  and   .  •  ^ 
challenging  the  "scoring  reliability"  of  essay  tests.''  Justifying  the  multiple-choice  "  v 
approach,  E.T.S.  declares  that  *■  students  who  recognize  the  problems  in  the  writing 
of  others  are  likely  not  to  have  those  problems  in  their  essays,  an  assumption 
confirmed  by  careful  research."  English  teachers  know  this  is  often  not  (he  case. 
The  real  problem  se^ms  w  be  money.  BT.S.  throws  up  its  hands  at  the  cost  of 
grading  written  exams,  but  surely  a  way  exists  to  pay  readers  to  read  written 
essays.  V 

No  critic  has  defined  the  shortcomings  of  the  S.A.T.  betteY  than  Ralph  Nader.  . 
"E.T.S.  has  us  all  locked  into  a  test  that  doesn't  look  for  creativity,  stamina, 
motivation  or  ethics— which  are  the  four  qualities  on  which  man's  ^eatest'achieve- 
ments  are  based."  Our  mania  for  measurement,  our  naive  assumption  that  we  will 
discover  a  true  meritocracy  through  objective  standards,  contradicts  the  original 
American  idea.  When  Jefferson  wrote  of  a  "natural  aristocracy"  emerging  from  an 
elementery  and  then  a  "higher  degree"  of  education  in  preparation  for  the  universi- 
ty, he 'thought  that  "worth,  and  genius  would  thus  have  been  sought  from  every 
condlition  of  life."  "Virtue  and  telerit"  were  to  be  releritlessly  encouraged  and  sought 
in  schoqls  at  all  levels.  What  worth,  what  telent,  what  virtue,  does  objective  testing 
measure?  Rather  than  rewarding  visible  intellectual  work  done  in  the  classroom, 
the  tests  reward  a  clevern^  that  even  the  clever  can  doubt. 

Though  E.T:S.*announcefl  that  the  S.A.T.  is  not ''designed  to  judge  the  "worth  of 
anyone,  the  tests  set  implicit  standards  of  worth  by  becoming  a  passport  to  educa- 
tion, income  and  social  status.  An  S,A.T.  score— the  scOre  on  a  single  test— can  set 
the  direction  of  a  lifetime.  Though  there  is  increasing  skepticism  about  the  S.A.T., 
the  score  can  still  weigl^  heavily,  E.T.S.  admits  that  a  GO-pojint  difference  in  verbal 
scores  is  stetistically  meaningless.'  Yet  a  60-point  difference  between' two  students 
can  mean  that  one  will  get  into  a  particular  college  while  the  other  will  be  denied 


*  Could  graces  given  by  inHivW^al  readers  be  any  less  reliable  than  scores  giveri  by  E  T.S.? 
Hbrdly .  B.T.S.  admiU  to  a  "gtarrakrd  eitor"  of  82  to  60  points  on  its  S.A.T.  scoresT  V 

■The  6d-poiht  difference  is  meaningless  because  60  points  could  have  been  attained  by  sueh 
e%i0tneA  factors  as  guesswork.      \         '  r 
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admission.  To. /learn"  to  tak^  tlie  test,  students  spend  valviable  hours  in  cram 
schools  and  crash  courses— and \eVen  attend  summer  school.  Though  the  coaching 
sessions  can  be  helpful,  they  al$p  teach  an  appropriate  cynicism'' toward  "thiB- sys- 
tem." Substantial  education— the  history  of  man  or  nationi— is  set  aside  in  order  to 
beat  the  test.  The  t6st  is  "the  system,"  to  be  overcome  by  studying  vocabulary  lists, 
by  taking  practice  tests,  by  learniit^  Jthe  technique  o(  test  taking.  Resentment  and 
cynicism  are  two  lessons  taught  by  the  American  way  of  testing. 
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[From  the  N.Y.  lyijiies.  September  9,  1979) 
Test-Coachino:  Is  It.  Worth  It? 

(By  Nancy  Rubin)    *  ^ 

Frank  Carmona  sat  intently  in  a  makeshift  classroom  at  Manhattan's  Barbizon 
Plaza  Hotel  as  a  Columbia  Test  Pi:pparation  Institute  teacher,  Steven  Stumpf, 
outTkMjd  strategy  for  taking  the  business  .section  of  the  Graduate  Management 
.  Admission  Test.  "Don't  think  any  more  Chan  you  have  to,"  advised  Mr.  Stumpf, 
"The  be§t-«pDroach  is  to  eliminate  thie  bad  Wswers  first,  theii  concentrate  on  the 
remaining  choices."  ^, 

Several  blocks  south,  Charles  Barrett  emei;ged  from  a  tapr^  drill  session  at  the 
Stanley  H.  Kaplan  Educational  Center.  "My  whole  life  depends  upoii  passing  this 
test/'  said  Mr.  Barrett,  an  American  studyirfg  medicine  at  the  University  of  Nor- 
este,  Mexico,  who  is  pf^eparing  for  the  first  part  of  of  the  National  Medical  Boards. 
"I'm  hoping  to  pass  the  test  and  transfer  back  to  an-Anierican  scTlbol,  and  Kaplan's 
course  has  been  a  godsend."     .  * 

Test-preparation  schools  are  experiencing^  unprecedented  growth  ainong  studenfe 
of  many  age  levels  with  a  wide  variety  of  speciaHntere^ta,  despite  attempts  by  some 
educational  groups.  Federal  agencies  and  tHe  standardized-test  industry  to  destroy 
their  credibility.  While  the. twin  controversies  of  the  testing  issue— the  rationale  for 
standardized  examinations  and  the  belief  that  tKose  examinations  s);ioul(|^be  public- 
ly accountabte-;-have  divided  the  educational  coftimunity  and  led  to  demands  for  a 
Federal  "truth-in-testing"  law,  many  students  haVe  embraced  the  concept  oif  stand- 
ardized-test preparation  as  a  necessary,  even  rightful,  addendum  to  the  educafional 
system.        •       •         .  ^  .     .  ' 

The  issue  flared,  into  national  attention  this  sunirner  when  the  New  York  State 
Leffislature  passed  a  "trutfi-i*!-tpst1%"  measure  thfit  calls  fqn  the  public  release  of 
test  questions  and  answers  as  well  as  an^'^xplanatioxi  of  ^how  those  answers  are 
scored.  The  measure  was  enacted  in  the  hopfe  that  it  would  "eqtialize"  the  testing 
experience  for  all  students— NAACP  had  argued  that  '!many  students  cannot  afford 
these  expensive  coaching  courses  and  are  therefore  denied  equal  access  and  opportu- 
nity'-—and  provide  t-hem  with  better  gyides  on  their  academic  strengths  and  weak- 
nesses. '  .        *      •    s     *         .  ; 

In  the  last  decade,  test  preparation  has  developed  into"  ^  $60  million  industry, 
resulting  in  a  proliferation  of  test  booklets,  courses  and  institutions! 

The  nation's  largest  test-preparation  school,  which  is  owned  by  Stanley  H.  Kaplan 
and  has  branches  in  88  cities,  experienced  an  annual  sales  growth  of  more  than  25 
percent  in  one  year,  from  $7  million  in  1977  to  $9  million  1978.  Smaller ^school^,  like 
the  John  Sexton  Test  Preparation  Ce^terf  which  served  about  6,500  students  and 
had' sales  of  $650,000  last  year,  and  the  Amity  Testing  Institute,  which  offers  test 
preparation  in  40  cities  and  grossed  more  than  $550,000  last  year,  have  also  begun 
to  offer  new  courses  and  expand  their  locations.  At  the  same  time,  many  corporate, 
private  and  nonprofit  educational. institutions  Rave. expanded  test-preparation  activ- 
ities. .        .  X 

Citibank,  for  instance,  recently  engaged  the  Sexton  School  to  teach  courses  in  the 
Graduate  Mana^emenfAdmissions  Test  (GMAT)  and  the  Law  School  Admissidns 
Test  (LSAT)  to  its  employees.  "We  perceived  test  preparation  as  a  need  and  are 
hoping  it  will  enable  our  employees  to  do  better  on  standardized  tests,"  said  Eileen 
Sini,  program  manager  for  the  Foundation  Center  for  Adult  Studies  at  Citibank. 

Formal  efforts  to  evaluate  the  test-coachinc  indu&trv  have  yielded  few  clear-cut 
answers.  Several  studies  conducted  by  researcners  at  the  Educational  Testing  Serv- 
ice (ETS),  the  nonprofit  testing  corporation  th^t  administers  standardized  coUege- 
and  graduate-school  admissions  tests  to  more  than  two  million  students  antiually, 
have  found  little  evidence  that  test-preparation  courses  raised  atudent  scores  by 
more  tl^an  10  points,  a  minimal  gain,  the  testmakers  say,  compared  against  the  cost 
of  a  course,  some  $200  to  r""" 
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*  A  . 1972  survey  conducted  in  12  high  ^hools  by  two  ETS  paychoinetricians,  Lewis 

Pike  {Old  Franklin  Evans,  found  thaVa  21-hour  coaching  program  <  did  have  a 
•  positive  effect  on  test  scores  for  students  on  cdrtain  parts  of  the  mathematics  section 
oftheSAT.  ^ 

A  1978  review  by  Mr.  Pike  ^so  concluded  that  short-term  instruction  produced 
meaningful  improvement  in  test  scores,  for  the  mathematicr  part  of  the  SAT, 
although  the  effect  of  short-term  instruction  on  verbal  SAT  scores  was  still  i^nclear.. 
.  '  .  This,  sprii^g  the  Federal  Trade  Ck)mmiB8ion'rdea8ed  a  report  examining  the  eiT^ 
of  coaching  schools  upon  standardized-test  scores.  It  found  that  "students  who  are 
cpached  fo^  th^  SAT  have,  on  average,,  higher  grades  than  students  who  are  not . 
coached.''  The.  reix)rt  which  used  previous  data  gathered  by  the  Boston  ofGce  of  the 
F.T.C.  to  examine  the  validity  of  coaching,  school  claims  indicated  that  coaching  was 
^especially  helpful  for  ''underachievers,"  often  raising  their  scores  bv  25  points  On 
,    both  the  math  and  verbal  parts  of  the  SAT.  Underachievers  were  defmed  in  that 
report  as  those  withohigh  grade-point  averages  but  low  standardized-test  scores. 

However,  the  final  report  M^as  disclaimed  by  the  F.T.C's  Bureau  of  Ck)n8umer 
Protection  being  statistically  invalid  and  failing  to  control  for  idifTerences  in 
piersonal  and  demographic  characteristics  of  the  students. 

V  According  to  Mr.  Pike,  who  is  no  longer  employed  bv^TS  and  was  recently  hired 
by  the  National  Institute  of  Edvication  to  conduct  e^Blonal  testing  research,  the 
initial  findings  of  the  F.T.C.  study  are  j|Dt  sm^^fg,  because  he  believes  that 
students  often  do  not  do  their  best  becauie  of  ^^^Kat  of  the  test  itself.  He  savs 
that  test  anxiety,  unfamiliarity  with  the  questioHPmat  and  the  artificiality  of  the 
(potion .  types  themselves  are  powerful  obstac^  to  valid  test  results.  For  this 
'  reason,  he  asserts,  test  preparation  can  indeed  prove  useful.  **l  don't  think  a  student 
can  artificially  raise  his  test  scores  above  his  ability  through  test  preparation,"  Mr. 
Pike  said,  "but  he  might  bring  his  scores  up  to  where  his  ability  really  is." 

It  is  precisely  in  this  area»  where  students  exhibit  a  marked  discrepancy  between 
their  academic  perforblance  and  their  test  scores,  that  ^he  test-preparation  schools 
seem  effective.^  According  to  Ellen  Kurtz  of  the  Livingston  College  Bpard  Review,  in 
Livingston,  N.J.,  for  instance,  students  who  have  high  gradi^point  averages  but  are 
scoring  between  450  ancTGOO  on  each  section  of  the  test  are  more  likely  to  .be  helped 
by  t^t  prepariatioh  while  students  who  have  scores  above  600  seem  to  show  less 
dramatic  improvement.  i 

''A  very  bright  student  with  scores  already  over  600Tnay  not  be  someone  we  can 
help  because  he^s.  already  picking  up  intuitively  what  to  do  from  the  types  of 
questions  being  asked,"  Mrs.  Kurtz  said,  "but  our  course  really  is  more  effective  for 
the  average  student  who  is  more  apt  to  be  thrown  by  the  nature  of  the  test  itself." 

Other  test-preparation  educators  ipaintain  that  their  .Courses  are  particularly 
helpful  wlMn  students  are*  apprehensive,  or        to  "freeze"  on  standardized  tests. 
..  "By  increasing  the  st\identa  academic  knowleoge,  showing  them  ^examples  of  old 
question  types  found  oh 'previous  tests,  their  fears  are  often  greatly  nenduced  and 
they  lust  naturally  perforin  better  on  the  n^xt  test/'  explained  R*  C.  Matthew^  of 
.  .  the  Matthews  School  in  Manhatten. 

In  recognition  of  these  subtleties,  some  schools,  such  as  the  Kaplan  institution^, 
while  seeking  to  improve  studcftit  test  scor^Tdiscatr^a^  students  with  poor  grade* 
point  averages  from  applying  to  prestige  schools,  reasoning  that  their  past  academic 
V    performance  will  impede  their  acceptence.  At  the  same  time,  most  test-preparation* 
schools  are  cfirefiil  to  make  few  claims  a)x>ut  score  gains,  although  they^  often  say 
.  privately  that  increases  of  50  to  100  points  are  not  unusud. 

According  to  the  College  B6lird,.  wnich  employs  the  Educational  Testing  Service  to 
design  and  administer  the  SAT,  LSAT,  the  Graduate  Record  Exaniination  (GRE) 
and  other  standardized  tests,  the  scores  ^re  not  nearly  so  important  a  factor  in 
:  school  admissions  as  meet  aitudents  believe.  "I  know  of  no  school  that  selects  or 
rejects  studente  on  the  basis  of  test  scores  ailone,"  said  Fred  Hargadbn,  chairman  of 
the  board  of  trustees  of  the  College  Board  and  dean  of  admissions  at  Stenford. 

On  the  other  hand,  Allan  Nairn  of  the  Public  Interest  Research  Group,  a  Ralph 
Nader  organization  that  is  investigating  the  E.T.S.,  said:  "The  fbct  is  that  the*  tests 
.   are  important  and  are  used  in  a  vaHety  ot  rnffs  by  schools  to  determine  entry.  And 
at  iMit  20  percent  of  the  colleger  still  ufe  them  as  automaticr  ^cutoff  points." 

Whether  (^lieges  are  lining  stendardized  tats  as  a  primary  gauge  for  admissions 
or  not»  Btudente  evidently  believe  m  their  eigmficance,  and  it  is  to  tnfs  need  that  the 
coaching  schools  address  themselves  so  succ^ifl^ 
The  sohools  vary  widely  in  the  technique  a&d  approaches  to  stendardized  exami- 
f        nationSi  but  virtuaUy  all  indicate  thkt  -  testmanisim^^  or  specific  test-teking  skills^ 
^  ftre  importettt  curriculum  components.  "Schools  often  donT  teach  studente  how  to 
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take  tests  because  they  have  so  much  basid  subject  matter  to  get  acrosj,"  .said  Joel 
Piagenz,  co^iirector  fdr  the  New  Haven-ljased  Amity  Testing  Institute. 

Many  school$  incorporate  test-taking  techniques  witl^^n  their  teaqhirfg  of  the  basic 
subject  matter}  stressing  such  skills  as  when  to  guess,  how  to  recogniz^  verbal 
mistakes,  how  .to.  use  mathematical  short-cuts,  and  when  to  implement  precision 
reading.  At  thfe  Columbia  Tost  Preparation  Institute,  for  instance,  students  are 
drilled,  in  the  analogy  questions  commonly  found  on  standardized  tests.  Within  the 
verbal  portiorf  of  their  classroom  instruction,  students  are  briefed  on  the  "traps" 
that  analogy/ (juestions  often  contain,  such  as  the  "reverse  meaning"  choice,  the 
"word  assocmtion". choice,  and  the  "urtgrammatical  answer"  choice.  Havings  learned 
4o  recogniafe  and  eUnjinate  those  inappropriate  choices,  the  student  is  in.  a.  better, 
position  ta  determine  the  correct  answer.         .  / 

One  oKhe  most  valuable  aspects  of  the  test-coaching  schools,  their  aidvocates  say, 
is  the  way  they  reduce  anxiety.  "After  all  the  rumors  I've  heard  about  tlie  difficulty 
of  the  test,  this  course  has  made  me  feel  much  better,"  said  Lynn  Goss,  a  student  at 
the  Columbia  Test  Preparation  Institute,  whO/ was  preparing  for  the  G.M.A.T.  exam- 
ination. "The  instruction  was  a  logical  presentation  of  the  material  covered  on  the 
test,  and  once  it  provided  me  with/explanations  about  how  to  find  the  answers,  I 
was  no  lor^er  nervous." 

"A  time-pressure  test  seems  to  rattle  many  student^  ahd  destroys  their  ability  to 
do  their  best,"  said  the  coordinator  of  the  L.S.A.T..  test-preparation  center  at 
Rutgers  University,  Janet  Finklestein.  In  the 'Hungers  program,  as  in  many,  other 
programs,  thie  instructors  try  to  overcome  that  anxieiy  by  offering  the  student 
intel|ive  work  on  the  subject  matter  as  well  as  expressions  of  encouragement. 

Tordispel  student  anxiety,  some  schools,  such  as  the  Sexton  Center,  provide 
remedial  mathematics  courses  in  addition  to  the  staadard  program.  Others,  suth  as 
the  Dulac  School  in' Manhattan  and  the  Guidance  ^Center  in  6anta  Monica,  Calif., 
offer  individualized  counseling  and  psychological  reassurance.  At  the  Ouidance  Cen- 
ter,  for  instance,  the  director,  Anne  Salzman,  attenipts  to  reduce  worries  by  coqnsel- 
ing  her  clients  and  discussing  their  anxieties  with  parents.  In  ^addition  ^he  often 
diagnoses  her  students'  academic  weaknesses  and  outlines  a  program  of  6tudy  for 
them  in  needed  areas.  *  r  l  • 

Most  test-preparation  schools  also  offer  students  a  strenuous  review  of  basic 
academic  subject  matter.  At  the  Test  Prep  Inc.  school  io  Chicago,  for  instance, 
students  have  34  hours  of  classes  to  review  basic  mathematical  and  verbal  skills. 

At  the  Kaplan  schools,  where  students  get  up  to  10  hours  of  live  instruction  but 
are  encouraged  to  participate  in  200  hours  of  taped  drill  exercises,  a  wide  variety  of 
practice  material  is  presented.  \  ' .  j 

Mr.  Kaplan  maintains  that  his  students  not  only  do  better  on  standardised 
examinations  but  also  increase  their  basic  skills  permanently.  "Ijjhav'en't  just  imr 
proved  their  test  scores,"rve  made  them  better  students'"  said  Mr.  Kaplan,  who 
asserts  that  his  courses  are^ffective  because  they  teach  students  basic  concepts  oyer 
an  extended  period  of  tini^. 

The  cost  for  test  preparatioJn  varies  widely.  As  a  rule,  SAT  preparation  it  lesa 
expensive  than  other  types  of  graduate  preparation,  ranging  from  $80  . at  siiiall 
schools  like  the  Livingston*  College  Board  Review  to  $275  at  the  Kaplan  schools. 
Feeg'for  professional  license  examination  courses,  such  as  the  Education  Committee 
foifPoreign  Medical  Graduates  test,  which  clears  foreign  doctors  for  practice  in  the 
.Urnted  States,  come  to  $800  at  the  Kaplan  schdols.   .      4.  .  ' 

TIPS  FROM  THE  POACHING  SCHOOLS 

;  1,  Pfan  yout  time.carefuUy^  Spending  too  much  time •  on  a  questidn/can  be  as 
detrimental  as  a  wrong  answer.     .  ♦  —^J.  • 

2.  Ansvyer  the  questions  you  know  first  .  Then,  If  you  have  time  len;,^return  to  the 
unanswered  questions.  , 

3.  There  is  only  one  ri^ht  /inswer.^  If  you  identify  it,  do  not  waste  time  working 
through  the  other  possibilities.  Go  on  to  the  next  question.  \; 

4.  Guess  shrewdly  on  answers  you  do  not  know.  Wrong  answers  carry  a  larger 
penalty  than  unanswered  ones,  but  your  chances  for  a  higher  score  will  be  improved 
if  you  guess — provide^  you  cjtti  first  eliminate  at  least  one  choice. 

5.  In  readinK-comprehenfln  passages,  underline  important  information  as  you 
read  through  tlife  test.  TheWPis  no  penalty  for  marking  the  worksheets,  and  it  will 
help  you  recall  important  information.  Likewise,  in  jfhathematlcal  sections  use  the 
whit^space  as  a  worksh^t  . 

6.  Pay  particular  attention  to  words  Jike  "but,"  "not,"  "however,"  and  "therefore. 
They  are  key  words  that  often  signal  Ae^ior  thoughts  of  a  passage.       .        .  * 
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7.  Use  mathematical  shortcuts— cancellation  of  fractions,  estimatiori,  removal  of 
decimal  point^^emd  so  forth— wherever  possible. 

8.  Memorize  math  formulas.  Formulas  such  as  A=lxw  for  the  area  of  a.rectangle 
are  often^ven  at  the  beginning  of  the  test  section,  but  it  is  quicker  to  have  them  in 
your  iyad, 

9.  ^1^  think  any  more  th^  you  have  to.  Don't  be  sidetracked  by  secondary 
answCTs  or  answers  thai  are  true  but  not  directly  Irelated  to  the  central  question. 

10.  Get  a  ^ood  night's  sleep  and  bring  candy  and  a  sweater  to  the  te&t,  .The  . 
examination  is  tiring  and  such  means  can  help  you  conserve  energy. 

.   Because  of  the  cost  of  testrcoaching  schools  and :  the  widely  held  belief  that 
coaching  works,  Ihe  Department  of  Health,  Education  and  Welfare  has  allotted 
fiinds  to  the  Health  Resources  Administration  Office  of  Health  Resoui^ces  Opportu- 
nity to  enable  disadvantaged  students,  interested  in  the  health  professions  to  take  * 
extra  coiirses  and  test  preparation.*This  year  the  department  awarded  more  than  $3 
million  to  disadvantaged  students  for  coaching  at  ^1  universities  through  the  Health  . 
Resources  Administration.  It  was  the  largest  amount  of  money  ever  granted  to  those  . 
programs.  ,    ^  . 

In  one  program,  at  the  University  of  Texas  Health  Science  Center  in.San  Antonio, 
50  minority  students  with  hi^h  academic  averages  studied  and  received  preparation 
for  the'^Medical  College  Admission  Test  and  the  Dental  Admission  Test  through  the 
Kaplan  schools.  ** 

While  some  advocates  of  the  ''truth-in-testing''  legislation  pending  in  Congress 
maintain  that  it  Wbuld  make  the  testing  industry  more  accouhtable  and  would  allow 
the  answers  and  techniques  used  on  standardized  tests  to  become  more  accessible  to 
all  students,  not  just  those  able  tp  afford  a  preparation  course  or  commercial 
preparation  materials,  directors  of  test-preparation  schools.  hav«f^  expressed  little 
concern  about  the  bill.  »  .    '  . 

"Whether  they  impose  a  Federal  "truth-in-tegting"  bill  or  even  abandon  standard- 
ized tesp  altogether  will  make  little  impact  ibon  us,"  said  Emanuel  Federbush, 
directonof  the  Columbia  Test  Preparation  Institnte.  "We  may  have  to  make  adtjust^ 
ment8,jl)ut  no  matter  how  schools  decide  tp  judge  theix^  applicants,  students,  will 
alwaysibe  looking  for  a  little  extra.help." 


Testimony  of  Dr.  Lewis  W.  Pike  Beforet^he  New  York  State  Senate  and 
Assembly  Higher  Education  CommiiteSs,  May  9,  1979,  Albany,  N.Y. 

I  am  Dr.  Lewis  Pike,,  an  educational  researcher  currently  employed  as  a  Senior 
A8s<iciate  at  the  National  Institute  of^  Education.  I  wish  to  thank  you  for  the 
opportunity  to  express  my  views  regarding  proposed  legislation  on  standardized 
testing.  The  testimony  I  am  presenting  is  in  a  private  capacity.  No  oiYicial  support* 
or  en^orscjjnent  by  the.  National  Institute  of  Education  is  intended  or  should  be 
inferred. 

My  professional,  b^ck^ound  for  providing  this  testimony  includes  the  following.  I 
received  a  Ph.D.  in  educational  pejfchblogy  from  Teachers  College,  Columbia  Univer- 
sity/in a  program  that  emphasizecl  educational  testing  and.  measurement.  My 
professional  work  experience  includes  14  years  at  Educational  Testing  Service,  two 
i|i  test  development  and  twelve  in  research.  While  in  test  development,  I  was  in 
charge  o(  developing  all  verbal  aptitude  test  materials  for  th^  Scholastic  Aptitude 
Test,  the' Graduate  ttecoi^d  Examination,  and  several  other  tests.  My  work  in  the 
research  division  waA  directed  primarily  to  various  properties  of  such  tests  as  the 
SAT  and  the  GRE,  udlially  involving  such  questions  as  test  fairn^,  test  ,  validity, 
And  possible  coachability  of  tests. 

I  have  long  been,  and  continue  to  be,  am  adv<^te  for  the  use  of  standardized  tests 
for  a[>propriate  purposes.  In  particular,  I  beheve  they  can  provide  aiv  important 
,  service  both  to  collies  and  to  students  seeking  admission,  to  them.  However,  the 
very  importance  of  suoti  testing  suggests  *to^e  that  no  reSoUKinable  effort  should  be 
spared  to  en9ure  that  both  constituencies,  colleges  and  students,  are  well  served. 

My  comjtnents  on  the*drait  legislation  under  consideration  will  be  addressed 
specmciLlly  to  Section  842,  "Ofdclibeure  of  Ttot  Contents."  Essentially,  this  section 
would  require  that  t^t  (^ny  be  made  available  bo  the  public  within  BO  days  of  the 
release  or  test  jcores,  aila  that  students  be  provided,  \Sp6h  request,  their  answer 
sheett.  *     *  ^  '    .     ■   ^  '    .  . 

I  strongly  favor  this  provigicfh  fdr  ''open 'testing^',  as  Ofipoeed  to  "secure  testing", 
fbi*  three  reasons:  .  '        ^  *  * 

first:  'ttxe  aslumption  that  students  and  otibers  wanung  to  see  test  copy  (after 
test  a^misttatioh)  must  demonstrate  "the  needL  to  know"  ^is  inappropriate, 
because  It  puts  tiie  burden  of  proof  on  tho6e  miucijrig  the  case  for  openness.  In 
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our  society,'  the  burden  of  proof  raore  "properly.  rests  ;?wth  those  advocating  * 
s^recy,  particularly  where  a  critic^  public  trust,  suoh'  as  college  admissions 
testing,  is  involved. 

Second:  Arguments  that  I  have  seen  thus  far  . for  maintaining  blanket  test 
security  after  test  administration  are  not  convincing.  Of  six  specific  objections 
to  open  testing  raised  recently  by  Educational  Testing  Service,  four  boiled  down 
'  to  a  matter  of  added  cost,  and  the  other  two  (test-equating  and  item^tfre testing 
needs),  are  readily  met  by  exempting  items  in  . those  categories  from  being  made 
public.  . 

*     Third:  Given  the  importance  of  standardized  tests  in  college  admissions  deci- 
8ions,.it  is  essential  that  the  tests  be  as  open  as  possible  to  public  scrutiny.  For. 
.  such  cjfitical  review  there  is  no  effective  substitute  for  access  to  test  copy  and 

associdted  test  data.  a 
Let  me  briefly  expand  upon  those  three  points.  In  doing  so,*  shall  refer  to  twb 
documents.  One  is  a  paper  by  John  Fremer  and  Alice  Irby,  of  Educational  Testing 
Service,  entitled,  "Why  Should  Tests  be  Secure."  It  was  distributed  just  last  week'  ats 
a  conference  of  the  National  Consortium  on  Testing,  at  a  ps^nel  discussion  of  "Open 
versus  Secure  Testing".  The  other  i?  a  College  Board  publication,  ''Report  of  the 
Commission  on  Tests:  I;  Righting  the  Balance,'  issued  in  197.0. 

The  first  ploint:  The  burden  of  proof  should  rest  with  those  advocating  the  mainte- 
nance W  test  security. 

Notimg  ETS's.  multiple  constituencies,  the  Question  is  phrased. by  Fremer  and  Irby 
as  follows:  "How  can  test  publishers  meet  what  may  appear  to  be  conflicting  needs 
of  institutions  and  associations  ^n^  the  one  hand,  and  the  public's  need  to,  knbw?'*^ 
Now,  the  concept  of  "the  need  to  know"  is  more  typically  heard  in  reference  to  such 
items  as  classified  military  information,  and  its  use  assumes  an  understanding  that 
the  burden  bf  proof  for  gaining  access  to  the  information  rests  on  those  wishing  to 
see  it.  I  wowd  maihtain  that  when  the  public's  access  to  test  information  is  con- 
cerned, and*  scores  of  great*  personal  significance  to  the  tested  individuals  are  in- 
volved, the  opposite  assumption  must  prevail.  A  provision  for  "open  testing",  such 
as  that  given  in  the  proposed  legislation,  is  consistent  with  shifting  the  burden  of 
proof  to  those,  claiming  that  extended  test  security  is  necessary.  ^  ^ 
I  feel  this  is  particularly  true  for  an  pftfin-overlooked  constituency,  the  students 
required  to  take  standardized  test§  in  order  to  gain  admission  to  college.  A  ctincern 
for  this  conistituency  has  bften  strongly  expressed  to  the  College  Board  by  a  Board- 
sponsoVed  Commission  on  'rfests  in  Volume  I  of  their  report.  Righting  the  Balance. 
This  report  included  the  following  commentsi 

As  the  Commission's  work  proceeded,  it  became  apparent  that,  in  its  mem- 
bers' opinion,  the  Board's*  traditional  services  reflected  primarily  and' purpose- 
fully the  interests  of  the  Board's  member  Colleges;  and  that,  while  thele  were 
not  necessarily  inconsistent  with  the' interests  of  students,  the  latter,  being 
served  secondarily  and' "incidentally,  were  beings^rved  less  well.  (Page  XV J 
While  in  reality  no  cari  solve  anyone  else's  prom^rne  of  choice,  the  College 
Board  can  giver  the  students  faced  with  the  difficult  omsions  surrounding  the 
transition  tfut  of  high  school  support  equal  to  that  which  colleges  receive.  In'' 
short,  the  Commi^ion  thinks'  that «  symmetry  or  balance  should  obtain  be- 
tween the  services  that  the  Board  offers  tor  potential  entrants  arid  those  that  it 
offers  to  coUegea.  ^ust  as  individual  schools  and  individual  colleges  ric^htfully 
regard  their  students  as  clients,  so  should  the  member  ,  schools  and  colleges  of 
the  College  Board  have  the  Board  regard  all  potential  ientrants  in  programs 
offering  opportunities  for  postsecondary  education  as  a  clientele  whose  iriterests 
and  needs  are  to  be  served  and  met  as  ^lly  as  are  those  of  the  Board's 
institutional  clientele.  (Page  57.) 
In  making  specific  recommendations/ the  Commission  on  Tests  suggested  that 
students  should  be  provided  much  more  information  that  would  allow  them  to 
evaluate  prospective  colleges.  The  present  legislation  calls  for  a  natural  extension  of 
this  concept  in  which  the  students  would  also  be  alfowed  a  mdre  adequate  basis  for 
evaluating  tne  admissions  tests  that  so  directly  influence  their  lives.  ^ 

The  second  jpoint:  Present  arguments  for  maintaining  blanket  test  security  long 
after  test  administration  are  not  convincing.*  f  ' 

Fremer  and  Irby  listed  six  reasons  why  test  security  practices  should  be  contin- 
ued. One  was  "Reuse  of  Test  Questions/' ^with  cost  noted  as  a  mcgor  objection  to 
limiting  the  lise  of  test  questions  to  ajiinjj^le  ro^d  of  testing.  Three  of  the  other 
reasons,  given  £l8  "Fairness."  "Meaningfmness  oftJ^st  Result,"  and  ^'Discourage 
Teaching  to  the  TPest"  are  all  based  on  the  premise  tlrftt  test  items  would  have  to  be 
reused,  after  ha^dhg  revealed  to  thespublic.  But  that  Remise  holds  pnly  if  it  is^ 
inde^  demonstrate.  tHat/using  all  new  questions  for  tests  nowjtreated  as  secure 


^    would  be  prohibitively  expensive.  Thus  alt  four  reasons  may  be  reduced  to  a  single 
consideration,  cost.  "With  the  niany  cost  factors  other  than  the  devielopment  of  test  - 
items  that  must  be  covered  by  test  fees,  and  the  likelihood  th^t  a  substantilal  part  of 
most  secure  testa  already  consists  of  new  Items,  I  would  expect  that  the  claim  of 
excessive  cost  for  developirxg  all  new  items  would  be^ery  difficult  to  support.. 

The  other  two  reason^  given  for  insisting  on  test  securi^  are  "Continuity  of  Test 
ScOfes"  andvTre^nting  of  new  Test  Questions."  As  I  noted  earlier,  these  objections 
a^e  r^adi^y  met  by  exempting  items  in  those  categories  from  being  made  public. 
The  third  point:  It  is  essential  that  tests  be  as  operv  as  possible  to  public  scrutmA 
*  for  thi^,  there  is  no  substitute  for  direct  access  to  test  copy.  ^ 
Two  substitute  for  direct  access  to  test  cop/ and  data  hav^  been  suggested.  One  is 
"  the  use  of  external  test  committees  to  ensure  the  quality  and  appropriateness  of 
resulting  tests.  While  this  is  a  commendable  practice,  it  is  primarily  a  process 
consideration.  The  product  of  interest  is  the  final  test  itsflT.  Further,  such  commit- 
tees do  not  directly  represent  the  stud^  as  consumer.  More  strongly  emphasized  as 
4     a  substitute  is  the  availability  of  expensive  descrip.tivip  information  about  secure 
•  tests.  Thi&  toO;  is  good  to  have,  but  again  it  simply  .'cannot  replace  seeing  the  test 
itself.  As  a  re8e|rcher,  I  hav^onsistentl>  found  that  my  work  with  tests  such  as 
the  SAT,  6RE,  and  the  Test  of  Ene;li8h     a  Foreign  Language  eould  be  fruitful  only 
after  I  had  spent  considerable  time  reviewing  an4  reacting  to  direct  test  copy, 
interacting  with  individual  test  items,  relating  these  to  one  another  and  to  test 
directions,  and  so  on.  If  I  were  a  consumer  (test-taker>  or  a  legislator  charged  with 
representing  consumers,  . I  would  not  willingly  settle  for  less. 

I  shall  conclude  by  citing  another  of  the  Cf^mission  on  Tests'  statements,  which 
reads:  *  *  *  the  tedts  and  associated  service^  intervening  between  high  school  and 
college,  especially  those  of  the  College  Board  that-  touch  directly  as  they  do  the  lives 
of  over  a  quarter  of  the  nation's  young  people,  are  a  matter  of  some  importance,  not 
just  to  the  Board,  those  young  people,  and  the  institutions  "they  attend,  but  also  to 
society  at  large.  So  .lapge  and  pervasive  an  enterprise  should,  as  should  the  educa- 
tional system  it  supports,  be  managed  in  the  public  interes^t.  The'  bh^lenge  for  the 
College  Board  is  to  discern  that  interest  and  effectively  s^e  it  (Righting  the 
BalaRce,  Page  32.)  * 

This  char^e^  of  course,  could  apply  to  the  testin^hterprise  at  lar^e,  It  is  my 
belief  thattb^-piiblic  interest  referred  to  in  the  stat^ent  can  be  best  served  if  open 
testing-i^factices  are  followed,  "allowing  Ihe  public  direct  acc^  to  test  content.  I 
^      believe  the  legislation  before  you,  particularly  Section  342,  is  an  extrenriely  i^por- 
^^Amt  step  in  brftiging  h\So6t  such  open  testing. 
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Mr.  Weiss.  I  think  that  Dr.  Bereridzen  has  iB&|{8seiTce.  raised  the; 

-  very  clearcu]t  argument  of  those  who  are  opj[>psis3?w)  H.R.  4949,  and 
I  would  like  to  see  if  we  could  in  the  course'^f  thd.  time  that  is  left 
^to  us  discuss  or  address  ourselves  to  some  of  the  questions  ^at  he 
has  raised  and  perhaps  we  have  not  specifically  focused  m  oh. 
At  has  been  suggested  by  many,  it  has  b^en  suggested  by  others 
in  the  course  of  .the  hearings  trait  we'h^ve  held  up  to  this  point, 
indeed  it  has  been  suggested  by  #n  editorial  in  the  Washington 
Post  by  some  others,  that  the  standardized  tests  hav^  in  fact  been 
responsible  for  bringing  into  higher  education  minorities  and  otfi- 

j  en  who  up  to  that  poiitt  had  bfeeh;  excluded,  and  therefore  the 
suge^ion  had  been  made  tliat  v/heri  we  seek  to  open  the  prqcess 

.  J)y  Siclosure,  because  that  is  all  that  H.R.  4949  does,  ills  a  disclo- 
sure. 

The  piece  of  legislation  mandates  nothing  beyond  disclosure, , that 
Vhat.we  are  domg  then,  at  least;  tfte  suggestion  is,  is  working 
against  ihe  ^efforts  q£  minorities  ^and  jothers  who  had  found  it 


'  y    \  .       .  ■  ,  ■■  ,  ■  • 

difficult  to  gain  entrance  into  institutions  of  higher  learning 

previously.       i  V  '  r 

^  I  would  like  ta|See  if      could  gef^ome  response  to  both  parts  of 

•   '  that,  (a)  wheflnel' in  fact  it  i^  the  standardized  test,  standardized 
tests  which  havfbeen  responsible  for  bringing  minorities  into  the 
^  higher  education  systiem,  into  the  colleges,  and  universities  and,  \ 
"    .    second,  whether  the  adoption  of  H.R.  4949  would  have  the  effect  of 
'    now  turning  the  clock  back  and  excluding  those  people. 

Do  you  have  any  comments  on  that,^Dr:-De Winter?  ^ 
Dr.  DeWinter.  Yes,  sir.  I  really  do  not  see  how  these  tests  would 
have  all  by  themselvep  brought  about  the  change  in  the  higher 
education  in  bringing  additional  minority  students  to  the  colleges. 
One  thing  that  concerns  me  very  much  about  the  tests  is  the 
^  extent  of  our  knowledge  of  them  and  the  relationship  betweeri  the 
knowledge  of  the  tests  and  wh^t  they  do,  whether  it  be  for  any  t 
student  from  ari^  area,  and  then  how  that  affects  our  judgment  of  — ^ 
A      .  the  decision  of  the  .admissions  office. 

It  seetrts  to  me  that  disclosure,  as  proposed  in  H.R;  4949,  would 
i^imply  incre^e  our  own  understanding  of  it,  but  it  would  still  not 
-    substitute  for  the  kind  of  judgment  that  we  would  have  to  exercise 
in  ir^erpretiiig.the  indiyidual  candidates. 

So  I  really  do  not  believe  that  it  would  act  in  a  way  to  exclude 
any*  individuals,  and  panicularly  minority  students,  from  higher 

education..  ,  »     *    ,  o 

Mr.  Weiss.  Would  some  of  the  others  like  to  comment  on  that? 
?        ^    Dr.  Franklin?^  *  '  ' 

Dr.  Frankun.  Yes; 

In  response  to  your  question  about  test  scores -improving  the 
admission  of  minprities  in  schools,  i  find  tha^  a  little  hard  to 
.    bej^ieve  because  we  already  have  testimony  that  ijiinorities  have 
scored  one  standard  deviation  below  and  there  has  not  been  any 
i  admissions  ^f  students  because  of  these  test  scores  alone. 

It  ia  becau^  the  te^'  scores  are  low  and  because  there  are  other 
V  tactors  involved  that  minorities  have  been  admitte'd  to  programs 
and  just  a  general  awareness  of  the  inequality  in  educatiork  • 
\   So  that  test  scores  haviS  not  been  the  savior  or  deliverer  of 
f  minorities  into'  the  arms  of  higher  education.  There  have  been  a 

host  of  other  political  and  educatibnal  issue%  that  have  delivered 
minorities  into  higher  education. ySo  test  scores  certainly  are  not 
the  messiah  in  that  regard.  ' 
Second,  the  disclosure  tff  test /questions  certainly  raise  psycho- 
-'.  ^  metric  issues,  but  it  i&  interesting  that  all  we  have  h^rd  is  what 

^        /  harm  it  is  gOii)g  to  do.  We  nevefr  hear  that  the  industry  is  going  to 
mobilize  to  try  to  handle  the /particular  issue  of  what  disclosure 
^     .         may  do,  to  develop  the  necessary  techniques  &nd  necessary  tests. 

Al  seems  to  me  that  disclosiire  will  allow  students  to  learn  their 
strengths  and  weaknesses.  It  should  contribute. to  qCiality  educa-  . 
tion.  It  should  contribute  to  the  developtrient  of  better  curriculum.  ♦ 
It  should  allow  us  to  know  as  ii^ependent  researchers  and  inde-  y 
pendent  educators  from  the  festi^lfe  agency  exactly  what. areas  of 
*  .         knowledge  people,  students,  are  n(rt^>beiiiK 

and  what  processes  are  necessary  to  ^fwp  students  to  learn^etter.  . 
It  should  improve  the  whole  pedagogic  process.  ' 

ERiC  .         /  \ 
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It  is  a  shame  that  very  often  the  tests  are  represented  as  a 
m^isJi,  as  a  deliverer,  as  a  panacea.  They  arefiot  r  think  what 
we  are  trjdng  to  do  .is  to  improve  testing  to  the  point  where  it 
becomes  an  integral  part  of  quality  education! ' 

Mi5i  Weiss.  Dr.  Loewen? 

Dr.  Lojiwil^l  think  we  also  have  to  recognize  that  there  is 
already  a  great  deal  of  knowledge  about  tests  available  in  society. 
The  student  who,  let*s  say,  locally  goes  to  Walt  Whitman  High 
School  has  all  kinds  of  knowledge  about  the  tests  offered  him  or 
her  as  part  of  their  curriculum  in  tKe  scHool.  The  same  is  true  of 
the  person  who  goes  to  Phillips  Exeter.  /    •  1 

There  are  coaching  schools  which  ETS  is  now^retreating  on  and 
is  aware  that  thejr  improve  scores.  Where  is  tlm  knowledge  about 
how  tests  are,  their  fotm,  how  to  take  them^  wnete  is  this  knowl- 
edge located?  It  is  located  in  the  upper  middle. class  in  urbane  and 
urban  areas. 

The  Unction  of  H.R.  4949  is  to  increase  the  knowledge  about  the 
tests  available  to  all  Americans.  I  cannbt  see  How  that  would 
decrease  the  opportunity  of  rural  or  regionally  dispossessed  Ameri- 
cans, if  yoti  will,  1(0  take  tl|e  test  > 

I  think  it  will  only  amphfylhe  opportunity  that  the  tests  purport 
to  make  available.^ 

•  Mt.  Weiss.  Ms.  Simmons?  '  r 

/  Ms.  Simmons.  I  believe,  based  on  my  contacts  with  students 
across  the  country,  that  as  a  matter  of  fact  the  standardized  tests 
have  not  served  to  bring  more  people  into  institutions  of  higher 
education.  It  has  served  to  keep  a  lot  of  persons  out,  als^out  of 
professional  schools.  ^ 

One  of  the  things  we  must  also  look  at,  as  I  mentioned  in  my 
testimony^  th^t  the.  bill  appears  to  be  directed  toward  postsecon- 
dary.  However,  there  has  to/bfe  some  attfftntion  to  elementary, 
secondary,  in  order  to  get, the  youngsters  up  tolwhere  they  can  go 
into  pestsecondary. '  ^  r  \ 

One  of  the  things  we  have  found  out  in  segregated  schoola  that 
we  do  still  have  across  this  country  is  that  in  the  school^  that  are 
in  Ihe  upper  middle  income  white  areas,  that  a  number  of  times 
youngsters  get  an  opportunity  to  take  standardized  tedts  early  on 
80  that  by^  the  time  they  reach  UtR  or  12th  grade  they  have  a 
facility  for 'taking  those  tests. 

That  is  not  true  in  ahe  Bedford-Stuyvesant  and  Harlem  ar^ 
other  areas  that  ar^  so-called  gh^ttoized  areas.  We  do  believe  that 
Qtandardiized  tests  are  used  to  exclude.  They  impact  disproportion- . 
ately  on  low*inbome  persons  regardless  of  whether  they  are  black, 
white,  or  broWp.  The  overemphasis  that  is  being  placeid  on  stand- 
ardised tests  does  impact  1^ 

May  I  make  a  comment\  about  some  of  this  in  my  testimony?  We 
hav^nad  occasion  a  few  vears  ago  to  look  at  a  school  syl^m  in 
Virginia -wh^re  our  branck  hc(d  collected  for  me  about  75  feporlj 
caros.  On  those  report  caMs  they  had  passing  scores  of  students 
and  yet  these  studente  were  partially  pi^moted.  • 
When  we  went  to  the  school  f^stem,  there ^as  a  public  forum 
which  we  had  called  for.  ^Ve  showed  report  cards,  the  local  pajper 
ihowed  copies ^of  report  cards  of  a  person  who  had  passing  scores 
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The  school  system  s&id  <hat  the  standardized  test  was  not  the 
sole  criterion.  However,  they  could  not  respond  when  they  were 
shown  report  cardp  of  persons  who  made  B's  and  Cs  on -report 
cards  and  who  were  not  promoted.  ^  '  u  u 

So  we  are  consciously  aware  of  the  fact  that  ev^n  though  we 
were  told  that  ttfe  score  itself  was  not  the  determining  factor,  it 
was,  and  >^  4iad  just  a  fistful  of  report  cards  to  validate  that. 

Dr.  Newsom;  Mr.  Chairman  and  members  of  the  committee,  this 
is  a  very  difficult  situation  for  me,|)ne  as  a  minority  and  as  an 
editor,  and  particularly  as  one  who^has  some  understanding  of  the 
cultural  backgroiind  from  which  these  te^ts  are  developed. 

These  tests  are  not  without  bias.  There  is  no  test  made  without 

bias.  So  these  tests  are  obviously  biased  in  favor  of  the  majority 
group,  in  favor  of  the  high  socioeconomic  group,  in  favor  of  those 
who  live  in  a  certain  part  of  this  Nation.  Therefore,  minorities  for 
the  most  part  suffer  and  ar€  excluded.  • 

My  concern  is  that  there  must  be  some  development  more  and 
more  working  toward  reducing  the  bias  that  appears  in  thteSe  tests. 
>  What  we  have  said  here,  that  we  should  hiodify  in  some  respects, 
we  should  augment,  expand  others,  and  change  these  in  order  that 
they  will  be'^more  meaningful  and. do  what  I  think  the  Congress 
wants  to  do.  We  ftannot  do  it  the  way  it  is  presented  at  this  tinie. 

Mr.  Weiss.  But,  Dr.  Neavsorii,  the  hx)pe  is  and  the  expectation  is 
«hat  if  the  mystery  is  tal^n  out  of  the  tests,  if  the  tests  become  a 
matter  of  open  and  publib  knowledge,  , if  the  student  himself  and 
herself  has  access  not  just  ;to  the  questions  but  also  to  the  answers 
on  request,  if  researchers,  sociologists  have"  a  chance  to  really 
exaniine  the  tests  and  what  went  into  the  process  of  makmg  them 
up  and  evaluate  some  of  ihe  in-house* studies  that  are  made  and  ^ 
undertaken  by'some  (rf  the  testing  services,  that  just  that  process  of 
opening  it  up,  disclosing  it,  will  in  fact  allow  sufficient  critiquing, 
information  if  you  will,  from  outside  sources  to  be  borne  in-upon  ' 
those  who  provide  flie  tests  now  and  who  make  them  up  and%^< 
compose  them  so  that  in  fact  the  tests  will  more  accurately  test  the 
abilities  "and  the  capacities  of  students  across  the  country  rather 
than  particular  regions.  ,  j-  i 

That  is  why  the  test  really  focuses  on  openness  and  disclosure 
rather  than  mandating  any  specific  action.  ,  ■  ■  ,  . 
"fiSo  I  am  a  little' perplexed  as  to  why  you  think  thfere  should  be 
gresoter  study  of  that  process  unless  what  you  are  suggesting  really 
Js  th$t  the  legislation  oyght  to  do  more  than  what  it  does  and  we 
have  deliberately  held  off  from  doing  more  because  we  think  that 
would  subject  us  perhap^ to  valid  criticism  that  we  Were  trying  to 
interfere  with  the  educational  process  in  some. fashiow.       '  ,  .  . 

Dr.  Newsom.  Well,  b^ically  now  you  are,  but  I  think  this^is 
good,  I  think  what  we  are  asking  is  that  it  be  stttdied  more  by  the 
social  scientists  with  the  Congre*  in  orjier  to  provide  a  technique, 
'  a  law  -or  'a,  rule  bt  regulation  tftat  will  do  what,  you  say  you  are 

trying  to  do.  /  '   .  '     .       .    ,     ,  ^ 

We  don't  believe  this  will  do(that:  This  wJIl  continue  to  do  what 
it  has  done.  That*  is  our  belief 
Ms.  Simmons.  Mr.  Chairman,  I  certainly  ^annot  endorse  or  call  ^ 
■  for  an  additional  study.  I.  would  have  wished  the  A)iU  ,  would  have 
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gone  Airther.  I  know  it  is  absolutely  mandatory  that  we  have  truth 
in  testing  legislation  with  disclosurVT 

I  want  to  sav  for  the  record  that  I  hope  in  the  future  that  we  will 
have  a  bill  before  the  Congress,  that  will  establish  a  Federal  regula- 
tory agency  for  the  testing  industry  similar  to  the  Federal  Commu- 
Indications  Ck)ni^^  Food  and  Dru^  Amninistration,  EnviUn- 
mental  Protection  Agency,  for  the  protection  of  consumers  of  tests, 
and  evaluative  assessment  instruments. 

Becaui«bke  and  more,  if  you  will  recall,  the  Congress  is  calling 
for  mord4l||Pnment»  particularly  in  the  elementary  and  secondary 
education.  , 

'  I  believe  that  with  a  call  for  more  and  more  assessment,  there  is 
also  responsibilities  to  regulate.  . 

Mr.  Weiss.  *Did  you  receive  in  the  course  of  thAhearings,  espe- 
cially from  the  testing  companies,  the^assurance^hat  any  social 
scientist  wh6  wants  toUio  research  in  the  area  of  tJlting  has  all  the 
materials  that  they»  the  testing  companies,  have  available  for  their 
use?  •       '  ^  , 

We  have  had  indications  from  some  of  our  witnesses  who  at- 
tempted to  receive  or  gain  access  to  some  of  thdse  materials  that  at 
the  least  that  is  an  overstatement  on  the  part  of  the  test  industry; 

I  wonder  if  yoii  have  had  any  experience  in  attempting  ta  i:eceive 
VaterialSy  access  to  materials,  and  what  that  experience  is? 

Dr.  LoEWEN.  Yetf*  I  have  had  particularly  disappointing^  experi- 
ence in  dealing  with  the  Educational  Testing  Service  and  the  C!oK 
.  lege  Entrance  Examination  *Board. that  oversees  some  aspects  of. 
ETS.        X  .  t  f 

Last  fall l^uas  attempting  to  do  research  on  testing.  I  contacted 
•  people  at  ETS  about  the  potential  availal>ility  of  what  they  call 
ethnic  data  by  which  they  mean  data  by  race,  perhaps  Hispanic- 
Americans' included  as  against  Anglo-Americans  and  black  Ameri- 
.  cans,  and  also  ^taavfiilable  by  State.  , 

I  was  referred  by  ETS  to  Greorge  Hanford  who  was  then  senior 
vice  president  and  now  I  understai^  is  acting  president  of  the 
college  board.  ^  ^ .  .  • 

I  wrote  Dr.  Hanford  on  October  28,  1978,  and  asked  hifli  about 
that  availability.  I  explained  to^hini  that  I  was  a  social  scientist- 
and  what  the  Center  for  National  Policv  Review  was  and  that  I 
was  coming  &om  a  proaffirmative  action  background.     /  <■ 

His  rej^ly  November  10, 1978,  was:  *  '  / 

Data  relating,  to  the  PSAT  and  S At  do  come  under  college  board  aufhority  and 
^  are  BubJect  to  a  policy  adminiatered  by  me.  which  doee  not  permit  tpe  regular 
aggregation  and  reporting  <if  data  reganiing  the  test  performance  of  minority  8tu« 

So  he  blaimed,  in  other  words,  |j|iat  they  do  «ot  even  aggregate 
data  oib  the  l^asis  of  minorities  anaShey  do  not  permit  the  report- 
ing oht.  >  .     ^  , 

It  waiB  th<^n  claimed  to  me  just  this  last  week  that  that  policy  had 
chafed.  So  last  Friday,  8  days  ago,  I  phon$d  the  college  board  to 
dee  if  it|||t  fact  had  changed.  I  was  assured  by  DarryUGreer,  t^e 
polK^  planhihg^fficer  at  the  ofifice  of  thd  jprissident,  that  the  pojiifiy 
hadqptch^fsf.,  ^  • 

Hd^aaid  we  were  in  a  i>rocess,  then,  of  revie^g  that  policy  and 
^.  %  revietm^s  sifcfll  ongolog.  • 


H$  said,  "The.  board  has  asked  for  years  whemer  it  should  aggre- 
gate  such  data,  and  if  so,  what  its  resppnsibility\should  be'to  any 
differences  we  might  find"  K 

In  other  words,  he  is  claiming  that  the  board  do^'t  even  know 
that  there  are  differences.  How  then  can.  ETS  or  the\college  board 
assure  us  that  there  is  no  test  bias,  if  they  claim  tnfey  have-not 
aggregated  data  and  they  have  not  set  up- what  the  response  should 
^#  be  to  any  ratings  or  other  differences  that  they  might  tinc^ 

But  in  my  case  the  answer  to  your  question  is  that  ak  of  last 
Friday  it  is  impossible  to  get  this  kind  of  data,  at  least  for  me,  and 
don  t  think  there  is  anything  wj-ong  with  my  creaentialsNThey 
explained  this  to  nie  a$  their  policy.  \ ' 

Ms,  Summons/ May  I  respond  t9  that,  too,  \. 
"    I  talked  with  five  psychologists  across  the  country  when  I  fornifed 
the  national  task  force.  Dr.  Robin  Williams,  who  is  a  psychometrlx^ 
cian  felt  there  was  a  need  that  section  42(b)  in  H.R.  4949  was\ 
probably  the  best  section  in  the  b^ill.  He  fell  there  was  a  need  for  a 
mandate  for  the  commissioner  to  get  relevlnt  data  over  the  period 
pf  time  to  see  what  was  going  on.  \ 
He  said  he  was  reliably  informed  that  thfe  data  was  available  in 
^       the  computers,  but  there  is  a  feeling  among  the  professionals  in 
trying  to  get  this  informaticfc  from  the  companies  that  they  will 
'   *  not  releiase  the  information  unless  there  is  A  congressional  man- 

•        date,  and  that  .if  the  commissioner  had  information  on  what  Was  »■ 
happening  through  the  use  of  the  test,  the  commissioner  woifld 
^  then  be  in  a  position  to  report  tp  the  CongrfeSB  and  to  make  a 

determination  if  further  action  was  needed. 

So  that  in  talking  ,  with  various  persons  who  have  credentials, 
who  need  access  to  this  information,  they  have  not  been  able  to 
obtain  it..  ▼ 
♦         Mr.  Weiss.  Thank  you.  \ 

Dr.  De Winter,  I  am  sure  that  you  have  had  occ^ion  in  the 
•  •    i      course  of  ypur  work,  in  discussing  this  particular  area^lhat  is  your 
.  aV^  of  specialization,  and  that  is  admissions  generally  and  stand- 
.  *      '  arqbed  testing  specifically,  with  others  in  the  field,  other  admis- 
*  sions  officeri^. 

Generally,  can  you  dte^ibe  as  to  where  we  seem  to  be  in  general 
attitudes?  Does  there  seem  to  be  a  stronger  commitment  today  on 
\ '  • .     the  part  of  admissions  officers  to  the  standardized  test  than  th^e 
Was  10  years  ago  or*a  lessening?  What  is  happening?  Is  there  any 
g    ' »  kind  of  fluctuation  that  is  going  on? 

'  Dr.  DeWinter.  Congressman  Weiss,  Won't  really  see  any  signifi- 

cant fluctuations  in  the  iniipprtance  given  ip  the  standardized  tests. 
It  seemj^to  me  th^t  admissions  officers  throughout  the  country,  I 
would  say  with  whom  I  hkve  been  associated,  really  do  try  tojtake 
t         all  of  these  factors  into  consideration,  tncluding  the  SAT's. 

'  So  in  that  respect  I  don't  find  that  yiere  is  an  increase.  1  think  » 

,  ,  what  is  happening,  thoughi  and  this  is  why  I  am  endorsing  the 
legislation,  is  that  in  th^e  public's  mind  they  definitely  take  on  a 
tremendous  amount  of  (Significance.  There  is  almost  no  way  that 
,  ^  you  can  really  deal  entirely  with  the  question  in  explaining  a  \ 
particular  decision  to  an  applipant.  It  always  comes  back  to  those 
scores.     y  v  I 
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So  in  that  respect  thw  really  have  a^  tremendous  imt)act,  at  least  . 
as  perceived  by  the  puflic.:!  believe  that  with  an  increased  under-  . 
standing  of  the^ores,  that  is  through  the  disclosure,  that  actually^ ' 
-  we  can  Tesseii  that  impact  oirthe  public.  '  ^         ^  ^ 
:  I  think,  also,  it  would  make  us  be  very  careful  so  that  no  abuses 
are  made  of  these  tests.        '  ^ 

Mr.  Wei^.  Yttu  have  come  to  your  judgment,  obviously,  quite  \  - 
independently  and  you  are  not  speaking  on  behalif  of  your  universi- 
ty or  anyone  else  but  yourself? 

Dr.  DfjWiNTER,  If  I  may  add  something,  on  the  question  of  valid- 
ity and  the  use  of  it,  we  have  talked  a  great  deal  about  t^ts  in  ^ 
relation  to  the  prejiictive  ability  of  the  students.  /  • 

I  think  there  h^  to  be  a  hemthy  caution  about  that  also  because  ^ 
it  is  just  not  *vei^  clear  to  what  extent  those  scores  really  have 
be^n  valid  in  predicting  the  success  of  a  student.  , 
•Just  before  I  came  down  I  asked  a  question  at  my  coUegd  I  said:  • 
'   What  would  be  the  scores,  for  example,  of  the  top  10  percent  of  the 

students?        ^  :       >  *  '  ^ 

It  was  quite  clear  that  there  were  variations  in  all  of  thesie 
scores.  There  were  as  many,  say,*  among  our  Phi  Beta  Kappas, 
there  were  as  many  who.  were  sporing.  between  500  and  600  as  ^ 
there  were  between  700  and  800.  ,  '  ^ 

r  Sk)  I  thipk  we  have  to  be  very  careful  with  the  predictive  validity, 
^  saying  tiftat  the  higher  the  s^res,  therefore  the  higher  predictive 
walue  of  thei?e  scores.  f  - 

Mr.  Weiss.  The  interesting  thing  thatU  noted  in  the  course  of  the 
hearing  is  that  for  the.  most  part,  people  ^ho  directly  deal  with  ^ 
admissions  and,  therefore,  with  all  aspects  of*  the  admissions  crite- 
.ria,  and  people  whd  deal  direct^  witti  tests,  standard  4;e8ts,  tend 
generally  to  be  supportive  of  opening  the  process*  up,  except  for 
those  who  are  in  the  business  of  creating  the  tests,  and  for  those 
who  organizationally  hire  or  contract  with  those  who  are  in  the 
business  of  m^ing  tests.  /  .  ^" 

.  .  why  dp  y6u  think  there  is  that  dichotomy  between  the  estab- 
lished prganiiatipnal  entities  aild  the  individualB  who  deal  ,within 
the  field?     ^  ^      .  ^  .  - 

'  Dr.  DeWinter.  It  is  an  organiaatiptL  that  has  existed  for  nearly 
V76  years  and  I  thiB^k  h^  undertaken  man^r  studies  ?ind  developed  a 
whole  series  of  t^ts  ^ind  patterns.x  I  thmk  there  is  a  danger  of  : 
booming  too  conviqg^  about  our  research  and  becon^ng  too  figid 
in  the  way  we  view  the  results  that  we  have;  This  is  something 
which  we  are  asking  to  take  another  look  at'  iaiid  so  perhaps  it  is  a 
,  normal  resistance,  I  would  say,  in  anything  that  has  existed  fpr  •  ^ 
any  number  of  years.     .  /        -  \ 

When  something  has  reportedly  been  very  successful  and  anyone 
ch^dlehgea  thaC  or  course  there  js  a  certain  amount  of  resistance  to 

My  orv(r<^'f^^     would  be  that  it  should  stand  the  scrutiny  and  ^ 
other  people  ought  to  be  able  to  take  a  look.  In  ^me  cases  it  may  , 
prove  to  ao  somQ  things  for  certain  groups  of  people  and  we  ought, 
to  know  that:  '       \  * 

Mir.  1||iss.  Dr,  J/m/en,  I  ym  impressed  by  jthe  testimony  you 
4  gftVfe  thaf  l^ke^proble^^  of  the  bias  that  is  built  ii»o  the  tests  affects 
iQ  a  great  extent  Ttot  just  minoijities  byt  rural  students. 
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Could  you  expand  on  that? 

Dr.  LoEWEN.  It' i$i  certainly  very  much  the  case  in  Mississippi, 
white  or  black,  and-not  just  because  of  its  socioeconomic  disadvan- 
taged but  also  because  of  the  rurality  of  Ihe  State, 

In  Vermont  I  experienced  the  fact  that— and-  Vermont  releases, 
this  d^ta  within  its  owr  confines— rural  Vermonters,  which  means/ 
almost  all,  score  much  worse  on  the  SAT  exam  than  do  thosd 
University  of  Vermont  students  who  come  from  the  suburbs  at 
Boston,  New  York  and  Philadelphia,  which  make  up  half  the  stu- 
dent body.  So  we  have  a  student  body,  half  of  whom  make  scores  in 
\^the  500's  and  600's,  and  the  other  half  of  whom  make  scopes  of  400, 
that  come  from  Vermont.  By  the  tftne  they  graduate  they  do  the 
same  quality  work  as  those  out-of-state  students.  . 

Mr.  Weiss.  Mr.  Buch&nan.   

Mr.  Buchanan.  Thank  yoii,  Mr.  Chairman.  Th^  is  a  very  diffi- 
cult subject  for  me;  I  am  glad  there  is  an  agreement  amoiig  us  that 
there  is  an  illness  with  the  testing  situation.  ' 

What  I  am  upt  sure  about  is  the  instrument  to  deal  With  the 
illness.  I  am  jusf  not  sure  it  is  not  good. 

Let  me  be  the  devil's  advocate  arid  raise  sonje  .questions  some 
otherj  people  have  raised  for  your  response.  For  example,  William 
Raspberry,  in  his  usual  namby-pamby  way,  said  that  this  bill  was 
strong,  bitter  stuff  that  doesn't  secure,  anything,  and  he  went  on  to 
quote,  in  his  article  in  the  Washington  Post  on  September  10, 
Diane  Ravage  of  Teachers  College,  Columbia  University ^  who  has 
thi3  to  say:  Sft*  . 

It  will  create  a  bonanza  for  private  tutoring  services  which  would  ha^  j^ctual 
tests  for  teaching  students,  not  just  their,  own  inventions.  This  will  increase  Jhe 
.   advantage  of  those  who  can  afford  to  pay  C5r  coaching. 

What  would  you  respond  to  that?  - 

Dr.  Franklin.  J  don't  agre^  with  that,  obviously,  because  in  bur 
testimony  we  indiCjgited  that  there  should  be  some  regulating- guide- 
lines for  coaching  agencies,  in  and  of  themselves.  But- ther^  is  also 
another  issue  involved  which  is  that  if  coaching  is  effectiVeAand  I 
think  that  is  a  debatable  issue  that  suddenly  has  been  uncovered, 
that  it  is  more  effective  than  previously  thought— then  the  kind  of 
disclosure  that  this  bill  will  afford  will  let  the  information,  the 
principles  and  the  general  content  of  coaching,  become  available  to. 
a  broader  pQ^lation  than  just  coaching  agencies. 

Unless  1  arti  misunderstanding,  all  of  a  sudden  we  will  have  a 
new  Monopoly  called  testing  coaching  agencies.  P feel  that  the  bill 
will  also  have  the  effect  of  disclosing  the  general  process  of  helping 
students  to  do  better  on  tests  and  it  will  not  become  the  excijasive 
•  rigH/;  of  exclusive  coaching  agencies. 

Dr.  NeWsom.  1  am  in  total  disagreement.  I  believe  it  will  create 
coaching  schools.  Lfind  it  is  done  in  cities  and  universities  now. 
Sororities  and  fraternities  do  the  whole  business  of  coaching  on 
tests.  All  of 'us  know  they  do  this.  We  used  to  have  all  the  tests  and 
,  get  them  to  our  friends,  t  T 

Sure,  they  will  be  using  these*  tests.  If  you  know  what  the  an^ 
.  swers  are  going  to  be  on  the  tests,  you  are  going  to  teach  if  and 
Work  with  it.  If  Raspberry  said  that  I  would  agrfee  with  him  com- 
pletely. If  you  see  the  testimony  ypu  will  see. 


•  .  69s 


It  happened  when  I  was  teaching  at  Southern  University  in 
Baton  Rouge.  We  were  behind  in  terms  of  the  RQTG,  we  were 
making  the  lowest  scores  of  all  the  schools  basically  in  the  South; 
We  took  Sie  psycholpgist  and  the  sociologist^nd  we  began  to  work 
on  thc>9e  things  we  knew  were  going  to  appear  on  those  tests,  and 
our  scores  were  raised  decidedly.  So  it  is. true.  ' 

Br.  LoEWEN.  There  seems  to  be  the  assumption  underlying  your 
question  and  underlying  some  of  the  testimony  by  Dr.  Berendzen  in 
particular,  that  to  disclose  a  test  would  make  it  almost  valiipless 
and  would  raise  the  problem  of  just  learning  those  questions. 
It  is  the  practice  of  ACT,  'I  believe,  and  it  is  alleged  to  be  the 
r  practice  of  ETS,  to  have  a  multiplicity  of  iteiAs  on  any  test.  Other- 
wise, my  own  teenage  stepdaiighter,  who  halb  taken  the  SAT  last 
year,  would  score  decidedly  bi^er  this  year  teerely  by  remember- 
ing some  of  the  questions  ske  missed  the  first  time  and  getting 
those  answers  right  thife  time. 

It  is  certainly  ckimed  there'  are  thousands  of  items  on  the  SAT. 
It  would  seem  obwious  what  you  would  disclose  would  be  the  test 
lliat  is  gi^en  next  November  and  only  thpse^tems  that  in  fact  went 

V into  the  scoKe  as  I  understand  the  legislation. 
;  Any»  testmaker^which  I  am  and  several  of  the  rest  of  us— can 
'  make  up  a  test  which  is  a  random  selection  or  a  specifically  desig- 
nated selection  searched  by  the  computer  from  the  thousands  of 
items  you  already  have  a\tttilable  and  pull  out  some  for  the  next 
•  exam.- It  will  include  som«  overlap  with  the  items  and  it  is  per- 
fectly easy  to  tell  your  coni'puter  in  scoring  to  check  the  old  versus 
the  new.  '  ■  ■, 

If  you  have  son^e  student  getting  100  percent  of  the  old  rate  and. 
2.3  percent  of  the  new,  you  (lag  that  to  sompbody's  attention  or 
base  the  score  primarily  on  the  new  items.  It  is  no  problem. 

The  gentleman  from  occupational  testing  where  it  may  be  a  very 
specific  test  related  to  a  specific  field  m^iy  have  a  reasonable  dis- 
agreement to  make  to  what  I  am  spying.  I  am  only  saying  this  with 
regard  to  general  aptitude  testing  of  the  type  used  for  professional 
and  graduate  and  baccalaureate  schools. 

Mr.  Buchanan.  Did  you  wish  to  comment?  ' 
.  Dr.  DeWinter.  I  would  agree  with  the  gentleman  on  the  right. 
We  seem  to  approach  tests  as  if  knowledge  were  an  entirely  finite 
sort  of  thing,  that  if  you  had  a  particular  ai^a  there  were  only  so 
%  many  ^questions  you  could  ask  and  if  you  knew  that,  that  would  be 
all  there  is  to  it.  • 

Wp  all  know  as  teachers,  too,  we  could  give  a  test  to  a  classroom 
and  then  after  that  say  there  were  a  few  students  who  were  absent, 
and  somehow  We  can  still  mt^e  a  yalid  test  for  those  by  asking  the 
same  Driiicipl«9  under  differelit  circumstances. 
••  Weill  remember  those  exams  where  you  had  t^  prqye  a  theorem 
'  or  an  equation  or  an  aspect  in  foreign  language  or  anything  like 
that,  and  y6u  can  give  a  very  yalid  test  and  yftt  change  the  particu- 
lars of  that  particular  test. 
Sd  I  don't  think  it  is  that  cut  and  dried.  .  ^ 

Mr.  Weiss.  Jf  you  woul^"  j^eld  for  just  one  second,  A  couple  of 
weeks  ago,  tlie  New  York  Tim®f  in  their  mftga2me  section  of  their 
SundayTiewspa^,  carried  aieltuje  story  devoted  to  the  coachittg 
sdhools.  I  have  a  copy  of  thls^andy.  They  indicate  that  one  of  ^e 


schools,  for  example,  has  branches  for  courses  giv^h  in  88  cities 
across  the  country.  That  is  just  one  of  many.  There ^e  a  number 
of  them  across  the  country  now.  X 
'  i  It  is  not  a  questioji  of.  coaching  schools  developi||.  I  think  th 
issue  is  they  exist  right  now  and  perhaps  if  in  fact  we  open  th 
system  up,  those |who  learn  from  prior  testing  will  riot  be  just  those 
who  can  afford  it,  too,  for  those  coacHes.  * 
Thank  you. 

Dr.  Smith,  I  would  say  in  the  occupational  area,  as  1  mentioned 
in  my  testimony,  there  are  many  licensing  and  certifying  agencies 
who  give  their  own  tests  in  addition  to  the  examin^ftion.  y/e  might 
provide.  I  think  we  would  be  hard  pressed  under  disclosure  condi- 
tions to  develop  the  necegsary.  examination  in  the  pool  of  items 
that  would  be  required. 

I  think  under  those  conditions  they  would  not  be  able  to  meet 
their  obligations.  It  would  be  of  coricern,  obviously,  to  us  as  well, 
but  it  would  probably  be  of  lesser  concern.  But  even  so,  as  I 
mentioned  in  my  testimony,  a  number  of  our  clients  have  test 
candidates  that  number  30,  40,  50  candidates  every  year,  and  if  we 
are  talking  abo^  the  development  of  a  multiple-choice  examina- 
tion of  100  items  V  or  200,  which  is  about  what  we  might  use, 
the  cross  would  be  spread  over  many  fewer  candidates  and,  there- 
fore, I  think  we  are  talking  abdut  some  financial  considerations 
here  that  are  much  greater  tlian  what  wdUld  be  anticipated  in  the 
aptitude  area. 

Aliso,  if  I  may  say,  regardless  of  which  bill  one  professes  to 
support  or  reject,  with  respect  to  the  credentialing  systems  ip  this 
country,  they  are  extremely  diverse  and  varied.  I  would  caution, 
before  the  occupational  cla||Be  in  the  GibbonS  bill  be  considered  in 
any  other  way  for  inclusion  under  whatever  conditions,  that  there 
be  much  greater  concern  given  to  the  mature  of  those  systems 
before  one  passes  that  bill  on  to  £he  social  system. 

Dr.  Franklin.  May  I  give  an  example  of  how  the  process  can 
work  as  quicklv  as  possible.  In  terms  of  coaching,  we  talk  about 
I  coaching  schools  and  how  that  is  going  to  exclude  more  students, 
\particularly  minority  students.  We  also  have  the  problem  in  profes- 
/4ional  licensing  of  trying  to  give  minorities  licenses.  I  am  involved 
with  that.  ^  *  ^ 

There  are  professional  schools  to  help  professionals  get  their 
professional  license.  We  have  had  black  professionals  that  go  to 
thesfe  professional  schools  and  learn  something  about  the  system  of 
coaching  in  order  to  tiake  the  examination.  As  a  consequence,  we 
have  developed  pur  own  system  of  coaching  and  try  to  Collect  more 
information  abSut  the  coaching  process  and  the  coaching  game. 
That  can  happen  on  a  student  level  at  an  undergraduate  school. 
You  can  dilute  the  inipact  that  coaching  agencies  can  have  as  more 
and  more  agencies  begin  to  learn  this  is  at  their  disposal.  I  think 
the  NAACP  would  immediately  gat  involved  in  helping  its  mem- 
bership to  learn  hdw  to  help  their  students  get  coach^  on  SAT  and 
mother  examinations.  ' 

other  issue  iij.  terms  of  professional  examinaticmsj  in  New 
Yojrk  State  persons  who  do  not  pass  the  professional  licensing 
examination  in  psychology — unless  they  have  changed  it  since  1 
took  the  examination— have  the  right  to  examine  those  questions 

V 


they  fail  in  th6  presence  of  an  examin^.  That  was  for  both  the 
objective  part  of  the  examination  as  well  as  for  the  essay  part  of 
the  examination.  r 

Ti)at  may  not  be  the  best  system  but  it  is  a  way  in  which  you  can 
provide  feedback  for  a  professional  or  any  person  on  their  perform- 
ance in  a  given  testing  situation.  I  think' there  are  ways  in  which 
these  systems  can  be  devised  and  thid  bill  helps  to  open  up  these 
kinds  of  options.  /  ( 

Mr.  Buchanan.  One  more  area  of  questioning.  The  Weiss  bill 
would  exempt  admissions  tests  developed  and  administered  by^an 
individual  school  for  its  own  purposes. 

I  wonder  if  such  tests  are  likely  to  be  more  or  less  valid,  reliable 
and  subject  to  bias  than  the  standaf dizejl,  test.  Would  anyone  com- 
ment oh  that? 

Dr.  FRiyNKUN.  I  don't  think  we  understjbod  the  question. 
Mr.  Buchanan.  The  Weiss  bill  exempts  those  tests  given  by  an 
individual  institution  for  its  own  purposes  from  the  requirements 
that  it  lays  down  for  standardized  tests.  I  just  wondered  if  there 
was  a  basis  to  assume  those  tests  would  be  more  yalid,  less  biased, 
more  reliable  thail  the  standard  tests? 

Dr.  Newsom.  I  don't  know  if  I  understand  completely  what  your 
question  is.  Let  me  see  if  I  understand  it  at  all. 

Qne,  I  think  you  are  asking  would  the  •staridardized^sts  be  more 
valid  and  reliable  than  would  the  test  be  thait  tMjinstitutions 
provide;  or  vice  versa?  ^  . 

Mi*.  Buchanan.  We  are  putting  them  in  two  categories,  saying  to 
the  indiividual  institution,  you  may  continue  to  do  your  own  testing 
and  you  are  not  required  to  .disclose.  I  am  asking  if  there  lis  some 
basis  for  a  double  standard  here  so  one  step  should  be  considered 
more  biased,  more  reliable,  more  valid? 

You  see,  we  have  two  jcategories  now:  Individual  school  tests  that 
jdo  their  thing  anfl  thery  donT  have  to  disclose  anything,  and  then 
we  haye  the  standardized  test  upon  which  we  fay  these  require- 
ments. • 
I  am  asking  about  t\)e  basis  for  this  double  standard. 
Dr.  Newsom.  r  would  think  that  a  standardized  test  that  is  used 
to  exclude  should  be  exposed  to  show  the  biases  of  that  test.  If  th$ 
standardized  teiit  is  used  to  exclude  by  a  particular  institution  or 
occupation,  I  believe  that  should  be  exported  to  the  person— basical- 
Iv  what  was  said  a  moment  ago-^btit  if  it  is  a  test  that  is  used  in 
the  matter  of  showing  progress  or  improvement  ^r  development, 
which  is  a  different  typf  test,  achievement,  then  that  kind  of 
testing  sl}iould  not  b^.  i 
In  other  words,  if  it  would  cause  a  lot  of  confusion. 
I  dofi'f  knovifn  l*  really  understand  your  question.  I  cum  probably 
not  ansvil^ring  it  very  well.       ^  t  • 


Mr.  BudHANAN.  Let  mi  see  if  ntaxi  ask  it  a  different  way.  Is 
there  somehing  to  the  idea  that  the ''^dividual  sch^l  tests  are 
likely  to  bid  less  bias^,  more  valid  tlmi  the  standardized  tests? 

Dh  Franklin.  If  that  i#th^  assumptil|ri|  then  it  is  an  incorrect 
assumptioii.  / 
Mj^  Buchanan*  They  are  excluded       '        i  t 
Df.  PiiANiCLii*.  I  imderstand  that.  *  X 
^Mjr.  Buchanan.  Tttlit  is  what  I  am  asking.  #  : 


Dr.  Franklin.  There  is  always  a  problem  of  standardization  arid 
how  valid  ^nd  rigliable  a  test  is  whether  it  is  devised  by  individual 
institutions  or  by  a  nationwide  testing  agency;  That  is  always  a 
fundamental  psychometric  issue.  That  may  be  ah  area  in  which  the 
bill  might  have  to  be  reexamined.  But  I  do  know  that  in  a  larger 
system  such  as  City  University  of  New  York,  there  is  a  combina- 
tion—let  me  put  it  this  way— using  standardized  tests  With  hornet 
made  individual  tests.  By  that.  I  mean  for  such  areas  as  writing, 
competency, ,  there  is  more  a  tendency  to  try  to  evaluate  written 
essays,  and  in  the  area  of  evaluating  mathematical  competency 
there  is  more  tendency  to  rely  on  those  standardized  tests  that 
measure  mathematics.  ; 

But  in  either'way  there  can  be  inherent  biases*  in  the  assessment 
process. 

Mr.  Buchanan.  Mr.  Chairman,  I  will  not  press  this  further 
except  to  say  I  am  really  going  to  study  all  your  testimony  and  the' 
material  from  NAACP  that  is  provided  today,  because  I  •honestly 
don't  know  what  we  ought  to  do  about  this  bill.  . 

I  know  there  is.  a  problem,  but  one  of  the  things  that  troubles  me 
the  most  is  the  extent  to  which  the  tests  may  be  accurate  rather 
than  inlaccurate.  If  a  child  from  age  zero  through  six  is  allowed  too 
much  malnutrition,  that  child  can  be  permanently  handicapped  for 
all  of  life.  Perhaps  not  as  dramatically  but  just  as  truly,  if  a  child 
is  subjected  to  too  much  discrimination  in  education  and  inad- 
equate education  in  elementary  and  secondary  school,  that  child 
can  be  educationally  Handicapped  to  the  ejftent  the  child  does  not  . 
dp  as  well  on  tests.  '  . 

I.  just  have  to  say,  J  grew  up  in  a  part  of  the  country  where  I 
know  that  inadequate  education  was  a  problem  for  many  years  and 
still  is  a  problem.  .There  Were  some  schools  that  were  not  good 
enoiigb  ' to' teach  high- school  students  what^they  had  to  know  in 
order  to  pass  a  test  to  enter  a  good  college  or  pursue  some  other 
line.  '  ' 

[  I  know  there  is  a  problem  with  testing.  I  am  ju&t  saying  that  I 
am  concerned  about  the  extent  to  which  these  tests  may  be  accu- 
rate rather  than  inaccurate.  V| 

*  Mr.  Steinbach.  I  would  like  to  address  the  questions.  One,  why 
the  individual  school  tests.  There  are  a  number  of  reasons  for  this.  * 
One  has  to  do  with^the  number  of  students  affected  by  any  one 
examination.  Second',  the  fact  that  predominantly  exaniinations 
given  by  individual  schools  are  only  of  aj)lacement  or  achievement 
variety.  A  very  small  percent  are  of  the  SAT  type. 

A  third  reason  has  to  do  with  the  fact  as  I  read  the  bill  it  seems 
not  to  deal  with  regulation  of  the  conduct  of  colleges,  their  admis- 
sions offices  or  anything  like  that,  and  to  move  into  the  realm  of 
the  individual  school  would  be  to  perhaps  make  that  line  somewhat 
snady.  / 

I  think  they  are  all  perfectly  good  reasons.  You  can^  only  legislate 
so  much  at  a  time.  # 

•  response  to  the  question -posed  that  you  q[re  worried  about  the 
tests  being  right,  I  guess  the  answer  is  we  can't  really  tell  unless  > 
something  like  the  disclosure  legislation  comes  about.  I  couldn't 
tell.  From  what  I  can  tell  we  kno^y  that  even  when  you  don^t  qse 
any  sophistication  at  all  in  terms  of  grade  point  average  there  is. 


fi|piiie  objective  on  admidsiofis  applications.  We  know  al  these 
tiiingg  have  greater  p^ictiVe  validity  as*  to  how  well  a  i  tudent 
will  do  in  schboli  at  least  insofar  as  we  have  infbrmationft  at  all 
than  do  SAT  score99  for  Example.  •  , 

But  the  SAT  scores  mij^t  do  Very  well  for  some  sets  into  sDme 
majors,  Bav  going  into  engineering.  We  don't  know.  We  can't  get 
access  to  thQ  information.  ' 

Furthermore,  if  ft  does  have;  high  validity,  it  has  to  have  it  for 
the  ri^t  reasons. 

I  WtU  give  you  an  eHeunple  of  wrong  reasons.  This  was  given  to 
me  by  a  law  professor.  What  if  w^  found  out  that  students  who 
iik^d  Btrawberries  mak|^  better  lawyers?  Is  the  queatipn  getting  at 
that  permissible  On  a  S^T?  My  ansjif^er  is  "No."  It  has  to  have  face 
validity.  \  j  * 

How  do  students  writ^  that -go  w  law  schools?  Do  people  who  Jike 
strawberries  come  from  ^n  environment  where  they  have  learned 
to  write  and  be  able  to  alCford  strawberries?  Obviously,  I  can  make 
this  into  a  case  of  accidental  bias.  It  is  slightly  predictable  for  the 
wrong  reai^ii.  We  don't  know. 

Mr.  Bud^AN.  Thank  you  very  much. 

Ms.  Sirpimons  said  she  iust  wanted  to  say  amen  to  what  some- 
body else  said.  It- was  such  a  resounding  amen  that  the  amen  was 
stronger  than  the  original  statement.  ,  . 

I  will  have  to  take  a  very  hard  look  at  the  testimony  of  the 
panel.  I  just  hope  vou  iare  right.  I  am  afraid  you  are  going  to  find 
there  is  a  good  deal  else  wrong.  •  n  ^ 

Mr.  GoLDBTiNE.  I  woula  like  to  comment,  if  I  may.  I  came  here 
today  to  illustrate  how  invalid  tests  can  affect  an  entire  industry. 
'   The  question  has  come  up  regarding  the  inability  to  determine 
whether  or  not  ait'  exam  is  valid.  I  oo  know  that  States  around  th^ 
country  have  been  questioning  the  NCARB,  which  is  the  National 
C!ouncil  of  Architects  Registering  Board,  since  the  implementation 
of  its  new  exams  back  in  1978.  NCARB  has  not  responded  and  has 
only  said  its  exam  through  its  analysis  is  a  valid  exam.  \ 
^  |n  Wisconsin,  a  number  of  students  questioned  the  current  exam- 
ination and^ey  went  to  their  legislature  and  thev  asked  that  this 
examinationbe  validatjed;  There  was  an  abnormally  high  failure  in 
that  State  as  is  around 'the  countiVv  Approximately  50  percent  of 
th^  examinees^people  who  h^ve  5  year  degrees  with  3  or  more 
years  of  experiehce  in  the  field. 

'Hiey  are  now  going  into  this  with  a  background  in  the  field  arid 
education  before  they  sit  for  their  examination.  There  is  a  prereq- 
uisite to  have  your  internship  and  your  education  before  you  sit  for 
the  exam,  and  then  there  is  a  50  percent  failure  rate. 

The  first  study  which  was  conducted  by  Dr.  Gleiui  Taggetts  from 
International  Personnel  Services,  came  out  and  said  it  doesn't  seem 
as  though  this  examination  meets  the  guidelines  of  the  APA  o^the 
EOC  or^he  EE20C  becacuse  a  validation  has  never  been  conducted 
on  this  ^examination.  Tttey  don't  know  whether  or  not  it  is  valid. 

Then  ther#  wa4,»^a  second  studv  in  which  a  group^jof  architects 
was  assembled  in  WiiK^onsin  and  71  tasks  were  determinefl  and 
there  Was  a  6Q|;relat|gn  done.  There  were  a  thousand  questions  on 
the  exam  ancT  they  ibund  out  the  exam  was  approximately  50 
^Dercent  related  to  the  tasks  that  architects  are  doing  in  ofnces. 


I  think  it  is  important  that  examinations,  especially  of  this  na- 
ture and  of  an  academic^  nature,  both  be  valid.  People  are  putting 
numbers  of  years  into  decisions  regarding  professional  entry  to. 
either  the  academic  institutions  or  into  their  actual  professions/ 

I  think' there  are  two  Issues  here.  There  is  the  issue  of  minority 
discrinxinatibn  which  must  be  dealt, with  effectively  but  there  is 
also  the  issue  of  overall  professional  discrimination  against  an 
entire  group  of  applicants  where  Ian  exam  is  designed  to  restrict 
entry  into  that  profession  not  only  because  of  nUnority  reasons, 
which  seems  to  be  taking  the  brunt  of  these  exams  today,  but  also 
because  of  economic  conditions  in  the  country.  T 

Architecture  being, a  profession  that  closely  relates  to  the  econ- 
omy at  the  time,  it  was  one  of  the  professions  hard  hit  by  the 
economic  recessions  of  this  decade.  Their  examinations  seem  to 
reflect  that.  I  think  that  is^  an,  issue  that  really  needs  to  be  dealt 
with. 

Mr.  Weiss.  Thank  you  very  much.  Mr.  Erdahl. 
Mr.  Erdahl.  Thank  you. 

Mr.  Goldstine,  I  thinjt  you  have  already  partially  answeijed  part 
of  my  questions  and  I  appreciate  your  coming  forth  with  a  personal 
example.  If  sofne  of  my  questions  seem  personal,  I  don  t  mean 
them  that  way.  ^ 

How  many  people  took  that  test  and  how  many  failed?  Is  this  a 
problem  nationwide?  Is  this  similar  to  a  bar  examination? 

Evidently  you  are  indicating  that  the  architectural  profession 
wants  to  keep  its  group  relatively  small;  Should  the  Government 
get  involved  in  determining  how  many  architects  we  should  have 
or  how  many  lawyers  we  should  have? 

You  raise  sonje  very  fundamental  questions  on  who  should  be 
setting  the  criteria  for  getting  into  the  profession.  Should  it  be  a 
group  other  than  the  profession  itself?  Is  your  case  somewhat 
unique? 

You  say  half  the  people  who  take  the  tests  flunk  it. 
Mr.  G6LDSTINE.  The  failure  rate  is  approximately  46  percent  each 
year. 

^  I  brought  this  example  up  because  I  have  done  a  great  deal  of 
research  regarding  this  matter.  I  think  the  problem  is  that  outsid- 
ers cannotj-egulate  a  profession.  I  believe  that  regulation  should  be 
left  up  to  that  profession  itself.  The  issue  is:  If  guidelines  are  not 
established  bjr which  these  professions  will  test  an^  allow  for  entry 
that  will  be  on  a  fair  basis,  rather  than  to  restrict  entry— the  trade 
offs  here  are  to  provide  for  public  health  safety  apd  welfare  and  to 
allow  for  competition  at  a  reasonable  level  that  does  not  unreason^ 
ably  constrain  private  enterprise.  * 

The  facts  seem  to  indicate  that  a  restraint  of  trade  may  be 
occurring.  '  •  ^ 

I  believe  that  a  further  investigation  which  is  currently  in  proc- 
ess at  this  time  will  Eventually  ^come  to  a  conclusion  regarding 
these  facts  but,  yes,  it  is  a  national  concern,  and  States  around  the 
country  have  beeiire<luesting  that  NCARB  respond. 

Finally,  after  the  exam  was  proved  invfilid  in  one  State,  and 
California  is  now  being  funded  to  replace  the  examination,  1  be- 
lieve NCARB  is  beginning  to  respond. 


What  t  question  is  unless  some  kind  of  specific  guidelines  are 
established,  and  evaluation  can  lead  to  proving  an  invalid  exam 
valid  belied  on  the  criteria  for  evaluation,  I  think  it  is  time  that 
jguidelines  be  established,  that  proCessionals  regulate  themselves  in 
a  manner  that  is  consistent  with  the  overall  objective  of  the  Nation 
to  allow  the  American  di^am  to  continue. 

thcmk  you.    '  V 
.  .©r.  Weiss.  Dr.  Smith/  » 

Dt.  SMrm.  Since  one  of  the  basic  issues  has  to  do  with  the 
qiiesnon  of  test  validation^and  it  has  also  been  raised  with  resp6ct 
to  the  aptitude  test  as  well--I  think  it  should  be  stated  that  test 
validation  ii  not  necessarily  an  inherent  part  of  a  set  of  items.  It  is 
built  into  tne  procedures  that  ar^  used  to  look  at  the  itemS;  So  it  is 
a  process*  It  is  a  cohcept.  And  thele  is  nothing  inherent  about  one 
test  that  makes  it  necessarily  valid  versus  another  set  of  items. 

tt  has  to  do  with  the  conditions  under  which  they  are  adminis^ 
tered,  taken,  constructed,  and  so  on. 

This  is  why  the  standards  for  constructing  psychological  tests, 
the  EO  guidelines  which  currently  exist  covering  the  issue  of  test 
validity  are  not  a  cookbook  procedure.  It  doesn't  say  ta|^6  10  items, 
crank  them  through  formula  3  and  come  up  with  a  test  that  is  or  is  • 
not  valid.  Validity  is  not  a  categorical  decision.  Data  that  are 
product  through  the  exieunination  of  a  test  need  to  be  interpreted* 
Data  do  hot  spe^.  They  need  to  be  examined  and  clarified  under 
the  conditions  ui:||der  which  the  data  wete  collected. 

Therefore,  I  would  say  in  response  to  the  question,  we  need  to 
look  more  carefidly  at  the  full  range  of  validational  procedures.  I 
can't  pass  in  judgment  as  to  whether  the  test  is  or  is  not  valid.  This 
is  9  complex  issu^.  But  it  is  yet  an  issue  that  ycm  are  going  to  have 
;  to  deal  with  iii  making  the  deterjtnination  as  io  whether  the  bill 
has  any  worth. 

^  What  I  am  suggesling  is  that  it  is  not  a  simple  question.  It  is  it 
fomplex  pi^chometiic  question  that  needs  to  be  examined  here. 
1  Mr.  Erdahl.  If  I  co^ld  ask  Dr.  Lbewen  to  respond^  to  an  area  of 
concern.  You  mentioned  that  educationally  you  are  hot  opposed  to 
testa  but  we  need  to  ht^ve  better  tests.  You  niention  the  dmiculty' 
we*  sometimes  find  because  of  a  localized  situation,  a  rural  situa- 
tion* Qr  the  poverty  area^\  that  those  people  should  perhaps  have  a 
different  test:  \ 

Ijsiii^t  there  a  dancer  in\doing  that  to  further  isolate  people  or 
eliminate  some  chal^»ng^  from  them?  For  example,  I 

grew  up  and  w«nt  to  a  counti^  school  «in  Bush  Cre^k  Tdwnship  in 
Minnesota.  Maybcni  wotdd  db^ell  in  a  test  oriented  in  an  area  like 
Jibat  but  it  1/irouldn't  give  me\an  opportunity  where  I  might  not  do 
as  well  in  a  t^/that  had  a  brOader  ur^ers^  of  concern. 

Maybe  1  |}0uld  have  stayed  w  Bush  Creek  Township-^but  mi^ht 
you  not  alw/oe  eitpandiog^ou  the  poesibillity  that  people  are  g&mg 
to  be  r^maming  in  Tougaloo  when  they  could  go  some  other  place 
or  remain  m  a  situation  when  thev  could  do  oetter  if  they  went 
Into  some  other  typo  of  activity  dr  situation? 

Pt.  wmm.  I  wi^t'to  say  I  mnt  to  ccflpgo  in  a  small  town  In 
Hhmesota  so  if  they  develop  a  Minnesot^^  test^  I  want  to  take  it 
along  with  you.  \  * 
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I  think  the  point  of  my^mment  is  hot  to  suggest  that  we  have 
alternate  tests  made  up, ^people  from  rural  areas  or  from  the 
south  or  north.  Rather,  as  PCgee  the  bill  H.R.  4949,  it  requests  that 
the  testing  agencies  make  availa:ble  to  the  Commissioner,  also  ulti- 
mately to  the  Congress,  data  as  to  the  regional  variation.  Actually, 
J  suggest  in  that  passage  where  it  says  race,  age,  sex  and  so  on, 
that  region  be  added.  I  think  that  region  is  a  very  important  one 
,  and  that  rural  status  be  added  to  the  criteria  of  possible  .things 
that  might  correlate  with  test  scores. 

If  thos6  correlations  were  added  so  that  we  knew  how  blacks,  and 
whites  scored,  how  people  fidm  rural  Minnesota  versus  rural  Texas 
scored,  then  one  who  is  from  Mississippi  who  takes  the  test  and 
scores  365  on  a  200  to  800  scale  v^uld  have  a  possibility  of  scoring 
^00,  would  have  the  score  interpreted  iK  a  little  more  broad  con- 
text. In  a  sense  a  little  more  specific -context,  so  it  would  be  clear  to' 
anyone  from  Cornell  Admissions  thSl  this  student  has  done  a  dyna- 
mite job  compared  to  other  students  from  rural  Mississippi.  I  don't 
know  how  CJdrnell  knows  that. 

Jt  is  a  very  sophisticated  school  and  maybe  it  does.  Most  schools 
cannot  piossibly  put  scores  into  context  right  now  because  the  data 
is  not  available  from  ETS  or  from  other  testing  agencies.  There- 
fore, all  they  really  know  is  the  data  of  past  people  who  hiave 
applied  to  other  schools  and  they  have  a  problem  with  the  entire 
State  of  Mississippi.  You  see  my  point.  I  would  just  make  this 
information  available.  i 

Mr.  ErdahL.  If  I  could  follow  up  on  that  a  bit,  Mr.  Weiss. 

You  are  suggesting  that  some  other  information  be  added'*  to  the 
test  scores  use  for  admissions,  pertaining  to  rural/urban  regions  of 
the  country,  That  is  in  addition  to  the  testing  process,  quite  inde- 
pendent of  the  bill  before  us  today? 

Dr.  LoEWEN.  I  would  suggest  that  the  Weiss  bill  have  added  to  it, 
and  I  make  that  suggestion  specific;  I  think  it-s  a  very  short  phrase 
that  would  have  to  be  added. 

There  is  the  phrase  that  the  section  requires  "report  to  Congress 
the  relationship  between  the  test  scores  of  tesi  subjects  and.  in- 
come, race,  sex,  ethryc,  and  handicap  status.*'  , 

I  would  suggest  you  simply  add  regional  and  rural/urban''  be- 
tweefa  the  test  scores  and  tiesl^  subjects  and  income,  race,  sex,  eth- 
nic, rural/urban,  and  handicfip  status. 

If  that  were  not  done,  noh'etheliBss,  I  still  favor  the  bill,  because  it 
certainly  requires  much  more  opienness  and  release  of  data  than 
the  test  agencies  purport  to  have  in  many  cases. 

Region  and  rural/urban  are  major  concerns  of  mine. 

Mr.  Erdahl.  One  comment  and  then  I  will  yield  back  my  time. 

It  seems  some  of  that  information  would  have  been  included  on 
the  application  from  the  school.  That  information  tnight.  be  of 
interest  to  a  sociologist  doing  some  studies  on  the  testing.  All  of 
that  is  pretty  well  included  in  the  standardized  application  to  afh 
institution. .  * 

Dr.  LoEWEN.  Of  course,  the  studentSvho  applies  from  Hollandale, 
Mo. — r-'     .  ^ 

Mr.  ErdahL  Hollandale/ Minn* 


,  Dr.  LoBWEN.  OK;  that  student.  Cornell  or  Yale  or  whatever, 
awaire  (Jt^his  redidence  and  is  pr ooably  at  le^st  vaguely  aware  that 
that  is  a  rural  area  and  it's  in  the  South. 
Mr.  Erdahl.  1  would  hope  so. 

Dr.  LoEWE^i.  The  point  is  that  this  section  requires  that  ave^lige 
scores  be  released  not  only  on  the  basis  of  race,  on  i^e  basib  of  sex, 
and  so  on,  but  on  the  basis  of  region  and  rural  ethnic  composition. 

That  ^  would  be  ^a  very  light  burden  because  they  already  are 
corrected  that  way!  They  know  where  a  test  center  is  and  if  they 
would  siniply  release  the  median  score  for  Mississippi  centers,  then 
that  would  give  Y$ile,  as  an  admissions  officer,  or  me  as  a  sociolo- 
^t,  what  a  student  who  got  a  385  and  kind  of  wonders,  am  I 
stupid,  that 'would  give  them  a  context  to  put  their  score  within 
ana  a*  student  from  rural  Mississippi'  would  realize,  knowing  in 
their  context  they  are  doing  pretty  well  and  so  would  the  school. 

Mr.  ERDAm;.  I  understand  what  you  mean.    ;  . 

No  further  questions,  Mr.  Chairman.  ^ 

Mr.  Weiss.  Before  we  terjpnihate  the  hearing  for  this  morning,  is 
there  anyone  who  wants  to  submit  additional  written  information? 

If  not,  we  express  our  appreciation. 

Ms.  Simmons.  I  would  like  to  say  NAACP  ;iVould  like,  if  you  need 
additional  information,  we  would  be  happy  to  try  to  provide  some 
for  the  committee.  "  ^ 

Mr.  Weiss.  We  will  probably  take  you  up  on  your  offer,  but  if 
anyone  wants  to  submit  additionQl  written  informatiftn  for  the 
record,  we  welcome  that  as  well.  ^ 

In  closing  I  want  to  thank  all  of  ybu  for  taking  the  time  and 
trouble  tp  come  ,  and  ispend  a  long  and  diilicult  m6ming  with  us. 

Thank  you  very  much. 

[Whereupon,  at  1;50  the  Subcommittee  on  Elementary,  Second- 
ary,tand  Vocational  Education  of  the  Ck)mmittee  on  Education  and 
Labor  adijoumedO   ^  i. 


•TRUTH  IN  TESTING  ACT  OF  1979; 
THE  EDUCATIONAL  TESTmG  ACT  OF  1979 

•  ■      ■    *  ■    ■      '    -  ^  —  ) .  ■ 

WEDNESDAY,  OCTOBER  10,  1979 

House  OF  Representatives, 
Subcommittee  on  Elementary,  Secoijpary, 
^  AND  Vocational  Education, 

Coi^MiTTEE  ON  Educat;on  akd  Labor,* 
.  ^  Washington,  RC 

The  subcommittee  met,  pursuant  to  notice,  at  9:30  a.m.,  in  room 
2175,  Raybum  House  Office  Building,  the  Hon.  Carl  D.  Berkins 
(chairman  of  the  subcommittee)  presiding.  •  /  . 

Members  present:  jRepresentatives  Perkins,  Kildee,^  Weifts,  Bu-^ 
chanan,  and  Erdahl.  T   .  '  ' 

Staff  present:  John  F.  Jennings,  counsel;  Jeffrey  W.  «Brennan, 
staff  intern;  and  Richard  DiEugenio,  minority  legislative  associate. 
^  Chairman  Perkins.  The  contmittee  will  come  to  order. 
^The  Subcommittee  on .  Elementary,  Secondaiy,  and  Vocational 
Education  is  continuing  hearings  today  on  H.R-  3^64  and  H.R. 
4949,  two  bills  relating  to  standardized  testing. 

Today,  in^dditioii  to  hearing  general  "testimony  on  these  two 
bills,  we  wiifDe  focusing  on  two  specific  issues. 

The  first  issue,  which  the  General  Accounting  Office  repreagnta? 
tives  will  addre^,  is  vifhether  the  concepts;  of  these  two  bills  qught 
,to  be  extended  to  cover  tests  administered  by  the  Federal 
Government.  . 

The  second  issue,  which  the  National  Education  Association  wit- 
nesses y^l  address,  is  whether  these  "truth-in-testing"  concepts 
should  be  extended  to  cover  standardized  tests  g^ven  at  the  elemen- 
tary and  secondary  levels  and  tests  developed  by  teachers. 

We  have  with  us  toda|^  Mr.  Clifford  Gould,  Deputv  Director, 
Federal  Personnel  and  Compensation  Division,  U.S.  General  Ac- 
counting Office,  and  ]^Ir.  Donald  Cameron,  Assistant  Executive 
Director  for  Program%  National  Educational  Association,  accompa- 
nied by  Mr;  Frank  Kovacs,  Director  of  Research. 

Now,  come  around,  those  gentlemen  whose  names  I  mentioned; 
We  will  hear  the  gepond  panel  at  a  later  hour.  ^ 

Cbme  aroutmTMr.  Gould  and  Mr.  Cameron,  and  we  will  hear 
from  you  first/ Mr.  Gould.  . 

We  are  delighted  to  welcome  you  here  and  you  may  commence. 

Without /objection,  your  entire  testimony  will  be  inserted  in  the 
record,  and  if  you  want  to  summarize  it,  fine,  go  ahead. 

.       •        ,  (708)  * 
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STATEMENT  OF  CLIFFORD  GOULD,  DEPUTY  DIRECTOR,  FEDER- 
AL PERSONNEL  AND  COMPENSATION  DIVISION,  U.S.  GENER- 
AL ACCOUNTING  OFFICE,  ACCOMPANIED  BY  JOHN  HARPER, 
PROJECT  MANAGER;  DONALD  CAMERON,  ASSISTANT  EXECU- 

,  TIVE  DIRECTOR  FOR  PROGRAMS,  NATIONAL  EDUCATION  AS- 
SOCIATION, ACCOMPANIED  BY  PRANK  KOV ACS,  DIRECTOR 
OF  RESEARCH 

STATEMENT  OF  CLIFFORD  GOULD,  DEPUTY  DIRECTOR,  FEDER- 
AL PERSONNEL  AND  COMPENSATION  DIVISI0r4,  U.S.  GENER- 
AL ACCOUNTWG  OFFICE 


.    .  —   ^  ^  —  —  :  ~  -  — ■  , 

I  would  like  to  introduce  Mr.  John  Harper,  who  is  a  personnel 
psychologist  who  heads  our  Management  Science  Group  within  the 
Division. 

We  appreciate  the  opportunity  to  appear  before  you  today  to 
discuss  the  potential  impact  of  extending  concepts  contaii^d  in 
H.R.  3564  and  H.R.  4949,  to  tests  administered  by  th6  Federal 
GovernmenL 

You  asked  that  W(e  focus  <  on  our  report,  "Federal  Employment 
Examinations:  Do  They  Achieve  Equal  Opportunity  and  Merit 
Principle  Goals/' 

Our  report,  released  on  May  15  of  this  year,  highlighted  prob- 
lems confronting  those  responsible  fpr  insuring  that  the  Federal 
work  force  is  competent,  productive,  and  to  the  extent  possible,, 
reflectivfe  of  all  segments  of  our  Nation's  society.  The  goal  of  Feder- 
al employment!  programs  is  to  hire  qualified  individuals  based  on 
merit  pnnciples  givmg  everyone  an  equal  opportunity  to  compete 
for  a  job. 

To  achieve  this  goal  the  Civil  Service  (Commission,  ,the  predeces- 
sor agency  to  the  Office  of  Personnel  Management,  designed  var- 
ious examining  procedures  to  help  assure  that  the  niost  competent 
and  productive  people  are  employed.  '  \ 

We  found  that  black  job  applicants  were  screenea\  out  of  the 
competition  aj;  a  much  higher  rate  than  white  applicants  on  two 
m^jor  written  teste  used  by  0PM  to  develop  hiring  regnsters.  The 
implications  of  this  are  presented  in  detail  in  our  report  where  we 
recommended  that  0PM  further  investigate  the  use  of  valid  alter- 
natives to  written  testis.  '  ^  \ 

Mr.  Chairman,  I  would  like  to  include  for  the  record  those  rec- 
ommendations. A 

Chairman  Perkins.  Without  objection,^it  is  agreed  to.  \ 

Go  right  ahead.  \ 
.  Mr.  Gould.  I  would  like  to  be^n  my  comments  on  H.R.  3564  aivi 
H,R.  4949  with  a  caveat.  In  the  time  available  to  prepare  this^ 
testimony,  we  were  upable  to  pe|^orm  a  detailed  legal  analysis  of 
these  two  bills.  We  were  also  unable  to  audit  cost  and  workload 
estimates  provided  to  us  by  0PM.  HVe  cain  provide  additional  infor- 
mation for  the  record  at  a  later  date  or  the  subcommittee  may 
want  to  obtain  that  information  directly. 

WhileJ^e  support  the  intent  of  both  H.R.  3564*  and  H.R.  4949 
yi\iYi  r^^pect  to  improving  the  quality  and  availability  of  informa- 
tion about  tests,  we  do  have  reservations  about  the  potential  cost 


I 


0. 


and  feasib|yity  of  extending  certain  provisions  to  Federal  examin- 
■••ing.  ■  •  •  ■■. 

f     The  Federal  Government  may  well  be  at  the  forefront  in  provid- 
ing information  and  preparatory  assistance  to  those  taking  stand- 
ardized written  tests.  For  instance,  in  1971  it  published  a  GQ^page 
booklet  desigi^ied  to  provide  teachers^  students,  aivd  other  interested 
persons  with  luunpl^  of  the  types  of  items  used  in  Government 
1  tests  for  filUni^  vacancies  in  a  wide  variety  of  ofRce  occupations. 
This  booklet  has  undergone  five  revisions  oyef  the  years  and 
each  time  it  b)^  been  revised  OPM  produced  10,000  copies  for 
ditftribution  to  those  who  might  be  interested.      addition,  it  has 
\  been  available  through  the  Superintendent  of  Documents* 

In  1974,  th0  Government  published  a  i2-page  booklet  containing 
samples  of  the  types  of  items  used  In  the  PACE  written  test.  This 
booklet  was  attached  fo  the  basic  PACE  qualifications  announce- 
ment in  1975  and  has  been  distributed  to  every  applicant  since 
then. 

The  most  important  reservations  we  have  about  th^  bills  relate 
to  section  5  of  H.R.  4949,  requiring  the  public^  disclosuroi  of  all  test 
items,  and  to  that  part  of  section  6  in  H,R-  3564  which  prohibits 
the  assignments  of  scores  to  knowledge  and  achievement  tests  on 
the  basis  of  rank  orders 

My  statement  contains  a  rather  detailed  discussion  as  to  why  we 
have  objections  to 'those,  and  I  will  not  go  into  thein  here.  In 
addition  to  the  comment  we^  have  provided  on  rank  ordering,  we 
would  like  to  point  out  ^ijhe  veterans^  preference  legislation  does 
4^equire  a  rank  ordering  of  appUcante'  and  some  modification  of 
that  legislation  would  be  necessary  if  this  bill  Were  to  be  enacted  as 
it  now  stands. 

I  would  like  to  conclude  by  repeating  tlfat  we  support  the  intent 
of  these  bills  to  ilnjirove  and  make  public  the  processes  and  infor- 
mation so  important  in  enjoying  an  equal  chance  for  achieveiment 
in  our.society. 

The  hearings  of  this  subcommittee  and  the  legislation  it  is  con-^ 
sidering  have  a<|ded  materially  to  public  scrutiny  and  accountabil- 
ity in  this  area.  With  respect  to  those  provisions  about  which  we 
have  some  concern,  we  beUeve  that  their  enactment  might  well 
curtail  testing  :in  t¥e  Federal  Government.  As  I  mentioned  earlier, 
we  have  recommeimed  that  OPM  further  inyestigate  the  use  of 
valid  alternative  to  written  teste.  ^  ' 

This  completes  my  prepaid  stetement.  We  will  be  happy  to 
answer  any  questions  you  ma^  have. 

[Prepared  stetement  of  Clifford  1.  Gould  follows:] 
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We  apprl(Ciate  this  opportunity  to  appear  before  you 

today  to  dlscura  our  recent  rej^rt  on  Federal  emplbyment  •  ; 

examining  and  toXcommeiit  on  the  potential  impact  of  ex- 

,  tending  concepts  obtained  in  H.R.  3564,  the  Trutl>  in 

i  Testing  Act  of  1979Xand  H.R.  4949,  the  Educationi^l 

Testing  Act  of  1979,  id  t<^sts  administered  by  the  Fedetal 

\  ■     '  ■  ■  ^  ■   '  • 

government.    You  asked  ^hat  we  focus  on  our  report,  'Federal 

.eiBloyilient  Examine t^ionst  \>o  They  Achieve  t^utkl  Opportunity 

jmd  Me^it  ^^f'^ciP^®  ^^A'^^.'A 
..         Our  report,  released  oh  Nay  J,5th  of  this,  year,  high& 
lighted  problems  confronting  those  responsible  for  ensuring 
that  the  Federal  work  force  is  opmpetent,  productive,  and 
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to  the  ext,ent  pos8ible#  fe£lecttve,  of  all  segments  o£  our 
Nation's  tfa6iety«    Tlie  goal  of  Federal  employme^  prograite  » 
is  to  hire  qualified  individuals  based  on  nerit  principles  ' 
giving  everyone  an  equal  opportunity  to  compete  for  a  job. 
To. achieve  this  goal  the  Civil  Service  Conunissionf  the  ptede- 
cesso^r  agency  to  the, Off  ice  of  Personnel  Management »  desigir^ed  . 
various  examiivin^  procedures  to  help  assure  that  the  most  . 
competent  and  productive  people  are  employed.  * 

We  found  that  black  job  applicants  "were  screened  ^out 
.  of  -the- competition  at  a  much  iiigher.  rate  than  white  appli-  f 
cants  on  two  major  written  tests  used  by  OPH^o  develop  ^ 
hiring  registers.    The  inpliaatioas  of  this  are  presented  in 
detail  in  our.  report  wh^t'*-*^  recommended  that  0PM  futther 
Investigate  th^  use  of  valid  alternatives  to  written  tests.^  . 

The  written  tes^H  for' the  Professional  and  Administrative 
dareer  Exaiminiition  ^PACE)  is  the  m6st  thoroughly  researched 
test  in  the  Jiistocy  of  Federal  civil  service  examining. 
According  to  0PM  the  test  has  been  fully  validated  and  its 
research  shows  a  clear  relationship  between  performance  qn 
the  tffit  and  subsequent  performance  on  the  job.  OPM  says 
that  not  only  does  the  test  result  in  hiring  individuals^ 
who  perform  better  on  the  j6b#  but  its  Use  enhances  overall 
(Sovejrnment  productivity*  . 

The  PACE  is  gparticularily  important  because- it  is  the 
entry  ^pute  into  Federal  serJ^ce  for  more  college  graduates 
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than  any  other  single  methQd  and  because  the  type  of  jobs 
cpivarad      the  test  often  leads  to  a  higher  level  career 
^^MiCion.    -For  thjst  reasonf  it  is  important  that  the  Sub-  . 
committed  explore  the  potential  impact  of  the  bills  it  is 

considering  on/this  examination* 

1  / 

1  would  like >  first,  to  put  PACE  in  perspective  in 

terms  of^^s  place  in  obtaining  a  Federal  job*    PACE  is 

used  id  hire  new  employees  for  entry  level  jobs  in  118 

different  occupations*    According  to  0PM,  the  most  common  ' 

feature  of  PACE  occupations  is  their  information  burden — 

that  is,  all  of  the  occupations  r^equire  individuals  who  can 

read,  understand  and.  interpret  a  large  body  of  written  l^aws 

and  regulations  or  a  large  body  of  knowledge  related  to  a 

specific  profession  or  specialty  area.    OPN  determined  that 

five  abilities  were  important  to  successful  performance  ih 

,  these  occupations  and  could  be  measured  with  a  written  te'st* 
These  were:      inductive  and.  deductive  reasoning,  verbal 

-comprehension,  judgment,  and  quantitative  reasoning*  . 

Individuals  ffho  :pads  the  test  and  receive  a  rating  of 
70  or  more  are  listed  on  a  PACE  job  register  according  to 
their  final  rating-^te9t  score  plVs  points  for  Veterans* 
preference  or  ^or  being  an  outstanding  scholar,  when  appli- 
cable*   When  entry  level  jobs,  become  available  in  one  of 
the  118  occupations,  agencies  request  0PM  to  send  them  ^ 
list  of  names  from  the  PACE  register.    "^In  response,  QPM 


s«nds  the  agency  the  three  naMi  With  the  highest  ratings* 
Jkfencies  gtoeirally  nust  selept  one.  of  the  three  individuals 
on  the  list,  and  if  one  of  the  individuals  on  the  list  is 
an  eligible  Veteran,  the  Veteran  Bust  |)e.  selected.    The  . 
proce98  is  sonewhat  more  ^onplex  than  what  I  have  just 
described  and  substantial  changes  are  contenplated  as  a 

part  of  the  authority  delegations  under  the  Civil  Service 

■ ; .  r  ■    .  ■  ■  V  ...     .  ■     ■         ■  ■  ■ 

Reform  Act.    But  this  should  help  explain  what. has  been 

required  of  an  individual  seeking  an  entry  level  PACE  posi- 
tion and  who  has  hot  had  a  Governaent  job.  .  .. 

e       During  fiical  year  197a,  OPH  pifocessed  1.6  Billion  job 
applicfations  for  all  types  of/coapetitive  civil  service 
jobs,  and  about  152,000  people  were  hired.    These  nuabers 
includi^  kll  conpetitive  jobs,  both  whge  grade  and  general  . 
schedule.    During,  that  saaeyeat  135,000  individuals  took 
the  PACE,  77,000  Mssed  with  a  score  of  70  or  above,  and 


7,600  were  hired  fron  PA^E  registers. 

COMMENTS  ON  BXTEWDIHG  CONCEPTS 
IN  H>R.  1564  AHD  H.R.  4949  t5~ 

FEDERAL  EXAMIHIIIG  , 

X  would  like  to  begin  my  coments  on         3564  and 

H.R.  4949  With  a  Wveat.      In^the  tine  available  to  prepare 
■■;/'■.        •     ■  '       >  , 

(his  testinony,  we  were  unable  to  perform  a  detailed  legal 

■  (  \         ■      ^    ■'  r 
^  analysis  of  these  two  bills^   MI6  were  also  unable  to  audit 

cost  and  workload  estimates  provided- to  Us  by  OPH«    He  can 

provide  additional  informtioh  for  the  record  at  a  later 


date  or  the  Subcbiomittee  jnay  want  to^btain  that  informa'-  \ 
ti<m  directly «         *  t 

While  ife  support  the  intent  o{  both  3564  and 

Ji.Rf  4949  with  respect  to  improving  the  quality  and  availa-^ 
bility  Of  iAforniationoabout  tests,  we  do  have  teiervations 
about  the  potential  cost  and  feasibility  of  extending  certain 
provisions  to  federal  examinii^lg. 

The  Federal  government  maiy  well  be  at  the\  forefront  in 
ptoviding  information  and  preparatory -assistance  , to  those ^ 
taking  standardized,  written  tests.    Fo^  inetancilef  in.  1971  it 
published  a  60«>page  booklet  designed  to  provide  teachers, 
students r  and  other  interested  persons  with  samples  of  the 
types  of  items  us.fd  in  government  tests  for  filling  vacancies 
in  a* wide  variety  of  office  occupations.  ,  This  booklet  has 

undergone  five  revision^  over  the  years  and  ei|f:h  time  it  has 

.  l'    .  •*     ■  ■  ' 

been  revised  0PM  produced  10,000  copies^  for  disti^ibution  |o 

those  who  might  b^interested.    In  addition,  it  has  been  av^^i li- 
able ^throug)il  the  Superintendent  of  Documents*  ^*  - 

Again,    in  1974  th^  government  published  a  !l2^age 
booklet  containing  sampled  of  the  types  of  items  used  j|^n 
the^ACE  written  test*     |hi8  booklet  was  attached  to  the 
bi»ic  PACB  qualificieitiohs' announcement  in  1975  and  has  Jbe%|f) 
distributed  to  every  applicant  f ince  then*  - 

The  Jiost  important  reseiirvations  We  Have  about  these  bills 
relafi  to  Section  5  of  H*R^  4949,  requiting  the  public  dleclosure 


of  all  tMtr  lt«M>  «nd  to  that  part  ot  Sactlon  6  in       '  ^  ■ 
■7j(«r  3964  ^hich  prohi1i>its  tht^asslghMnt  of  scoras  to  knoir-  . 
'•:|^a  and^ohiavaMiit  taita  on  tha  baala.of  rank  ordar* 

•  Via  argraa  With  tlia  varloua  arguMnta  which  hava  baan 
Mda  to  tha  affact  that  tha  fadaral  govarnnant  would 
.  axparlancf|^a  aubatantlal  acononlc  burdan  if  it  vara  raqulrad 
to  provldai  coplaa  of  tast  quaatlona  and  corract  anawara  to 
aMnlnaas*  /  Such  a  procadura  would  pracluda  rauaa  of  any 
Itams*     So  naw  onas  would  haya  to  ba  praparad  aach  tlM  a 
taat  la  gi'vtn*    This  has  anoraoua  cost  and  tachnical  ipipli*- 
cationa*  *  ;■  '  . 

Tha  cost  iaplicationa  ara  illuitratad  in  an  axaapla 
praparad  by  l$|PN*    Tha  govariiaant'a  clarical  axan  ia,  adainla* 
tarad  nationwide  a vsry  wo]6i:ihg  day*    If  taat  itaiui  wara  dia* 
.Closad/  250  aapsratt  and  uniqiia  axan  booklata  would  ba 
n^adad  aach  yaar*     Xt.talcas  abput  ona' staff  yaarf  at  an 
•  avaraga  aalary  of  $20#000t  to  prapara  a  clarical  axam  book-* 
lat  using  axiating  quastions*    OPN  astimatad  that  at  laast 
thrfa  staff  yaars  ^ujd  ba  raquirad  to  prapara  a  bpoklat 
'  aaing  totally  naw  quastions*    This  doaa  not  inoluda  addi** 
tional  administrativa  costs  raquirad  to  inaura  that  tha 
mjim  tast  iiftgivan  nationwida  on  aach  day  so  that,  applicanta 
in  bna  araa  do  not  banaf it  fron  disclosura  in  ai^thar  araa« 

Tha  adainistrativa.problamSf  .bud^tf  and  staff  ^a^ira- 
Mnta  ara  aultipllad rsuiny  tiMa  whah  Mora  coaplicatad, 


/ 


higher  Itvel  exams  are  used.      To  develop  the  current  pool 
of'  iteme  for  the  pace #  £or  instance,  required  a  total  S2 
Bta££  years  o£  e££ort  over  a  5-y^r  period. 

...    It  should  be  noted  that^the  cpst  and  workload  estimates 
I  have  just  provided  are  £or  test  development  only*    They  do 
not  cover  the  vety  time-consuming  i^d  costly  process  o£ 
v^alidating  the  test  once  it  is  developed.  /  * 

The  technical  implications  are  no  less  severe.      In  the 
£irst  place,  there  is  a  £inite  limit  to  the  number  o£  new 
questions  that  can  be  developed  in  any  subject  matter  area 
without  quality  deteriorating  to  if  level  that  the  exam  would 
no  longer  be  an  e££ective  meanis  6£  evaluating  people  £or  ^ 
employment.    In  the  second  place,  a  group  o£  common  ques-* 
tions  is  needed  in  each  versipn  o£  a  test  so  that  adjust- 
ments can  be  made  £or  di££erences  among  the  versions  in 
average  di££iculty.    Only  in  this  way  can  a  score  have 
the  same  meaning  on  one  version  as  it  has  on  another. 
Disclosure  wquld  make  it  impossible  to  have  a  common  group 
o£  questions.    The(re£ore  di££erent  versions  of  the  same  test 
could  not  be.  equated  and  changes  over  time  in  test  per*-. 
£ormanCe-»->such  as  the  decline  in  SAT  scores--could  not  be 
identified.  * 

The,  concern  we  have  wit^  H.R.  3564  is  with  the  dis** 
tinction  made  in  Section  6(c)  between  aptitude  test  and 
achievement  test  and  the  prohibition  against  grading  the 

♦    ■  ... 


liittfr  on  the^  basis  of/the  rslatlvs  distribution  of  scorss 
ol^thsr^tsst  subjsct^.  \ 

Ths  aistlnction/^  and  aohlevtMnt  tasts 

la.  a  point  of  $raat  x:ont|rovar8y  ai^n  among  axperts  in  the 
I  field  of  testing  and  aij'ses^nent.   ll^tiRll^s  the  distinction 
'     is  made  on  the  basiS|of  the  way  the  test  scores  are  usedt 

/     if  they  are  used  to  assess  Someone's  current   level  of  p^r- 

■         ■    .  /         ^  '        •  •  ■   '  ' 

^     formancer  the  test  might  be  considered  an  achievement  testy 

if  the  scores  arc/  used  to  predict  hoy  well  someone  might 

^  perform  in  the  future r  the  test  might  be  called  an  aptitude 

t^tw    By  this  distlfictionr  the  clerical  exam  I  mentioned 

earlier  Would  seWm  to  be  an  achievement  test,  while  the  PACE 


would  seem  to  b< 
Whether  or 


^as  desc 


d  In 


an  aptitude  test •  :  / 

not  this  type  of  distinction  la  madsr  . we 


would  be.  concerriisd  about  tbe  extension  of  ^a  prohibition  slich 


Section  6(c)  to  Federal  examining •  We 


eJifm 


would  be  particuarly  concerned  about  extending  the  pro* 
bibitibn  to  aptiltude  tests  like  PACBy  but  we  would  also 


be  concerned 


-aboja 


t  extendtog  it  to  achievement  tests  like 
the  clerical  exak  where  rank  order 'on  the  exa^may  be  ' 
related  to  relative  per^ormanqe  on  the  jobt    The  reason  for 
qiar  concern  can  b|e  seen  an  data  on  the  value  of  PApE  reported 


in  our  study. 


As  Soon  as  tt^e  >ACE*  i^ritttn  test  Was  developed r  \OPN 
started  research  d^iigned  to  deterniine  its  value  in  terms 


Id " 


yyiB- 


of  th^  extent  to  iHiich  scores  on  it  jvere  related  to  job-  . 
ptrfotMnpe  in  a  number  o£  occupatioQis.    The  first  study 
WAS 'conducted  on  social  security  claims  isxaminers.  The 
written  portion  of  PACE  ilas  given  to  250  examiners  and 

I  mea^^ures  of  their  Work  effectiveness  were  collected.  These 
measjares  were  specially  designed  for  the  study.    They  in- 
cluded a  wbrk  fample  consisting  of  a. standardized  claim  to' 
be  a<|ljudicated  by  the  examiner  and  scored,  for  {correctness. 

iOPN's  analysis,  of  the  relationships  be'tween  test 
.  scorei^  and  the  various  job  performance  measures  showed  that'  - 
those^who  scored  higher^ on  the  test  tended  to  be  the  ones 
who  aiso  scored  higher  on  the  measuresjo/ job  performance.  ^ 
The  gr^ph  OQthe  following  page  gives  some  indication  of 
these  relationships.    It  shows  that  those  who  scored  in  the 

.  t^op  thitd  on  PACE  did  almost  twice  as  well  on.  the  work  sample 
(averag^.  score  of  64)  as  those  who  scored  in  the^ottom  third^ 

.  on  PACE  Uaverage  score  of  33). 


Average  Work  8a)fq>le  Scores  at 
ISach  Range  of  MC£  Scores 


( 


SCOHES  36< 


I 


ipmn  RMDOU  rbf 

THino   THIRD  THIRD 
f  ACT  SCORES 


■  What  the  chart  shows  is  that  the  average  Work  Sample. 
Score  for  all  three  ranges  of  PACE  scores  combined  is  52. 
That  is  the  Score  you  would  expect  a  large  group  of  peopSb 
to  obtain  on  average  if  they  were  selected  on  some  basis  un« 
related  to  their  relative  performance  on  PAC|^    However # 
there  is  a  relationship  between  performance  oh  PACE  and 
ftrformance  on  the  Work  Sample.    So  if  you  want  to  maximiM 
ctivity  you  would  select  only  those  who  f core  in  the 


highest  third  on  PAee*.  Their  work  Sample,  scores  average 
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out  tp.  64«»an  inproveisent  of  12  points  <^er  selection  among 

r^jroup  wl^ich  has  not  ^een  rank^brdered. 
Another  Way  to  look  at  this  is  in  terms  of  how  much 
,  productivity  is  increased  by  selecting  on  the  basis  of 
relative  rank  order  as  opposed  to  delecting  on  some  other 
basis.     OPN  researchers,  have  constructed  ecpnoroic  lilodels 
which  show  that  for  PACE  the  increase  in  productivity  is 
over  twice  as  high  for  selection  done  in  a  strict  rank- 
order  based  on  test  scores  as  it^is  for  selection'  done  on 
a  randon*-order  basis  from  among  those  who  pass  the  test.  % 

In  addition  to  these  productivity  cons  iller  at  ions  #  it 
should  bie  noted  that  Veteran's  t^r^ference  legislation  does 
require  a  rank  ordering  of  applicants. 

^    ;  Hr.  Chairman  and  Members  of  the*  Subcommittee  #  I  irou^ 
I'ike  to  conclude  by  repeating  that  we  support  the    intent  o£ 
.  these  bills  to  improve  and  make  public  the  processes  and  in- 
formatipn  so  important  to  enjoy^'ng  an  equal  chance  for  ' 
aohiev^mlnt  in;  our  society.    The  hearings  of  this  subcom- 
mittiee  and  the  legislation  it  is  considering  have  added 
materially  to  public  scrutiny  and  acoountabjLlity.  in  this  area. 

However,  with  respect  to  those  i^tov is iorts  about  which  we 
>    -  * ;     "  •  '    .       •        '      *        "       .  " 

have  some  concern #  we  believe  that  their  enactment  cpuld 


\  bring  ebout  tbi  fnd  of  testing  in  the  federal  governmei^t. 

■\ 

tp  answer  any  questions  you. nay  have.  ^. 


This. completes  my  prepared  statement 


He  will  be  happy 


-I 


\ 
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LLER  GENERAL'S 
THE  CQNGRESS 


TO.  Tt 
CD-79-46 


FEDERAL  EMPLOYMENT  EXAMINA- 
TIONS:    DO  THEY  ACHIEVE  EQUAL 
OPPORTUNITY  AND  MERIT  PRIN- 
CIPLE GOALS? 


RECOMMENDATIONS  TO  THE  DIRECTOR, 
OFFICE  OF  PERSONNEL  MANAGEMENT 

A  comprehensive  review  of  the  Fedfral  poli- 
cies and  practices  a££ected  by  the  new  Uni- 
form Guidelines  is  being  planned  by  the 
..Office  of  Personnel  Management.  .This  review 
will  include  job  qualification  standards/ 
examinations,  performance  appraisals,  and 
promotion  policies. 

GAO  endorses  this  review*    However,  actioi/6 
are. .needed  which  cannot  await  the  oittcome 
of  the  planned  review*    The  Director^  Of^^ice 
of  Personnel  Management,  should: 

-r Increase  efforts  to  comply  with  the  Uniform 
Guidelines  requirement  for  collecting ; and 
maintaining  records  which  will  disclose  the 
impact  of  te&tl  and  other  selection  ptpce-? 
dures  on  the  employment  opportunities  of 
minority  group  members  ary^  females.    As  a 
part  of'the  recordkeeping  system  required 
by  the  Uniform  Guidelines,  the  Office  should 
design  ei  system  to  track,  over  a  period  of 
time,  the  job  performance  of  groups  of.  peo^ 
pie  selected  from  job  registers  and\those 

,  sheeted  usivp  other  methods*     If  the  track- 
xrm  system  shows  a  selection  procedure  that 
hal  less  impact  on  minorities  and  results 
in  selecting  employees  who  perform  as  well 

^  or' better  than  th^se  selected  from  the  reg- 
isters, then  the  use  of  that  procedure  . 
should  be  expanded f     If  th^  tracking  system 
shows  that  employees  selected  by  an  alter- 

.  native  method'^ perform  less  well  than  those 
selected  frotti  registers,  then  the.alter- 
native  shoula  be  reexamined  and  a  decision  • 
made  concerning  itsicontin.ued  use.. 

;^-]Reevaluate  the  PACE  validation  strategy  to 
'  .^ssute  that  it  conforms  with  the  l^niform 
Guidelines.     In  the  interimr  assure,  that 
the  planned  comprehensive  job  analyses  of 
the  remaining  occupations  are;  completed. 

.If  further  validity  studies  are  necessebry, 

GAO  recommends  that  the  Directors    '.      \  •" 

.  *  '    '  \ 

-^-Recons^ider  using  the  predj^ctive  design  oi^ 
consider  peiMorming  a  research  study  in 
which  all  applicants  #6lected  for  a  PACE  ^ 

f  occupation       dome  other  merit  procedure 
are  administered  the  test  ^nd  followed 
at  a  latep  date* 

— Assurer  to  the.  extent  possible,  th/at:  re- 
search piarticipants  are  representative  of 
the'relevant  labpr  mar^t.  .  9 


up. 


-Investigate  the  fairness  of  the  test  fot 
race^  sex,  and  ^tjinic  subsamples.  * 


.  718 


Chairman  Perkins,  Thank  you. 
We  will  now  hear  from  you,  Mr.  Cameron.  Go  right  aheadl 

STATEMENT  OF  DONALD  CAMERON*,  ASSISTANT  EXECUTIVE  DI- 
RECTOR FOR  PROGRAMS,  NATIONAL  EDUCATION  ASSOCI- 
AT^ON 

Mr.  Cameron.  l  am  Don  Cameron,  assistant  executive  director  of 
the  National  Education  Association/ 

With  me  is  Mr.  Prank  Kovacs,  wMb  is  the  director  of  research  for 
the  NEA  and  available  to  help  if  anybody  has  any  questions. 

;The  National  Education  Association  is  pleased  to  have  neen  in- 
.vit6d  to  discuss  the  Truth  in  Testing  Act  of  1979,  H.R.  3564,  and 
the  Bklucational  Testing  Act  of  1979,  H.^.  4949^which  would  be 
-extended  to  include  standardized  tests  given  at  the  elemental^  and 
.  secondary  level,  and  also  teacher-prepared  tests. 

On  August  1,  1979,  when  NEA  presented  testimony  on  H;R.  4949 
before  the  Committee  on  Educatujn  and  Labor,  it  supported  the  bill 
and  urged  the  Congress  to  prod^d  and  to  expedite  the  passagelof 
H.R.  4949.  ^  1 

At  this  time  NEA  reconfirms  its  endorsement  of  H^R.  4949. 
The  Association  believes  passage  of  this  legislation  will  Insure 
that  standardized  tests  will  not  continue  to  deny  equal  eduoat 
opportunity  for  alj  people.       ^  I 

Soih  H.R.  3564  and  H.R.  4949  represent  notice-and-disclosure 
legislatjion;  however,  they  differ  substantially  on  the  types  of  tesrt^s 
covered,  the  extent  of  involvement  of  the  Commissioner  of  Educa  * 
tion,  and  the  type  of  enforcement  provisions. 
^  Fi^hermore,  for  the  most  part,  the  disclosure  requirements  of 
,H.R,  3564  require  the  same  type  of  information  currently  being 
provided  voluntarily  by  testing  agencies.  j 

Because  H.R.  3564  does  not  require  disclosure  of|t^derlying  data 
on  the  examinations,  it  would  not  enable  professionals,  outside  the 
testing  industry,  incluiding  teachers,  to  ancdyze,  or  comment  on  test 
construction  and  validity. 

Moreover,  H.R.  3564  fails  to  provide  for  the  disclosure  of  scoring 
data  in  addition  to  the  disclosure  of  test  scores  that  may  be  given, 
to  educational  institutions.  *  , 

NEA  encourages  the  committee  to  upe  H.R.  4949  as 'the  bal^s  for 
the  proposed  testing  legislation  and  incorporate  H.R,  3564  la  part 
of  the  proposed  legislation  where  it  is  deiemed  appropriate. 

In  relation  to  the  questipna  cowderniftg  the  impact  pf  the  pro- 
posed legislation  at  the  elemejidary  and  Secondary  level  and  to 
teacher  preparedness  tests,  jjhfe  NEA  dops  \ot  recommend  the  ex- 
^tepsion  of  H.R.  4949  to  thieS^elementery  aind  secondary  level  at  this 
time.  y  .  \  , 

The  proposed  leripfetion  currently  addresse^  teste  used  at  the 
9toecondary  leV^f(B.  admission  selection.  Te8^ng  experte  gener- 
classify  thjs^tvp^of  test  as  an  aptitude  t6sts.  ExampleslOf^ 
tude  teste^e  the  American  college  testing  program,  scholastic 
aptitude  teat;  law  school  admifiysions  test,  medicajx  college  admis- 
sions ^sylentel  admissions  teste,  ar^  the  Miller  Ennalogies  test. 

The  Wmilon  elCTient  here  is,  that  these  tests  are  u6ed*to  predict 
futureyiS^cc^  in«iCollege  course  work.  Aptitude  teste  usually  are 


:^  not  designed  to  predict  a  student's  future  success  in  a  chosen  field, 
nor  do  tne  developers  of  these  te^tamake  such  a  claim. 

The  NEA  believes  that,  the  estimated  2.5  million  test  taketd  at 
the  pbstse^ndary  level  alreyidy  constitute  a  large  enough  group  to 
determine  how  well  the  Federal  legislation  will  work  with  aptitude 

•  teste.  ' 

BV  extendii|g  the  legislation  to  include  elementanr  and  secondarv 
Btudehtoi  the  number  of  test  takers  afTected  would  exceed  47  mil-  . 
4ion,  aiidj;he  additional  typ^s  of  tests  included  would  be  achieve- 
ment, ability,  and  IQ  teste.  ^ 

The  implieations  of  the  increase  in  both  the  number  of  test  i 
takers  tfmd  the^sty^  of  teste  cannot  be  adequate^  assessed  at  this  ' 
time.  In  additioriKl^  the  implications  for  testing  companies,  school 
district  costs  for  reding  the  logistics  of  admin^tration,  leg^islation 
enforcement  cannot  0e  accurately  determined. 

The  association  fur^r  believes  that  the  state  of  the  art  within 
the  testing  industry  is\ui  need  of  a  major  overhaul.  In  NEA's 
^August  1,  1979,  testimoiiV  before  this  cominittee,  a  segment  of  a 
speech  made  by  Oscar  Buros  was  quoted/regarding  problems  and 
^neieded  changes  in  tesjting.  \ 

In  that  same  speech,  Buros\iutlined  a  program  for  improving 
te^iyg  practices.  JSurOs'  program\has  been  available  to  test  pulK. 
lishers  for  over  30  years.  Umortui^tely,  they  helve  not  tiaicen  his 
sound  expert  adivce  about  how  to  improve  test  meaisurement. 

The  association  believe/ that  the  Bu]X)8jbrop<Mlal  for  improving 
tests  a^  tlleir  use  should  be  implemented.  His  proposal  would  help 
realize  T^A's  position  on  achievement  testing.  We  strongly  support^ 
the  us^  of  student  achievement  testing  to  diamose  learning  need^ 
to  prescribe  inftructional  activities,  and  measure  student  progireBs 
in  .the  curriculum  content  taught  by  the  cliEissrocmi  teacher. 

The  association  belieyes  that  such  achievement  testing  is  the 
responsibility  x)f  the  lockMchool  district  and^teachers  at  the  build- 
ing level.  \ 

Moreover,  NBA  opposes  the  use  of  standardized  achievement  ^ 
testing  for  the  purpose  of  evaluating  school  j)rograms  because  of 
.  the  belief  that  the  National  Assessment  of  Educational  Progress, 
N4E)P«  provides  a  more  appropriate  approaph  to  assessing  school 
pr(M^ams. 

NEA  believes"  that  the  state  of  the  art  in  the  field  of  testing 
needs  to  be  totally  assessed  at  all  levels.  The  proposed  legislation, 
H.R.  4949^  as  currently  structured,  bemns-this  process  at  the  post- 
s^QUOa^  level.  The  extension  of  the  legii^lation  to  the  elementary 
at^d  lecotlda^r  school  level  should  be  postponed  at  this  time. 
^  ^Finally,  Mr.  Chairman,  NEA  respecte  and  values  the  time  of  the  / 
members  of  this  committee.  Therefore,  NEA  research/has  prepared 
a  technical  supI4eI^^nt  t^  this  testimony  for  ^se  by  the  qommittee. 

This  suppl^eor^  defines  and  develops  technical  conoepte  and 
issues  whlcn^EA  believes  must  be  recognized  before  further  .ac- 
tion to  extend  this  Wtal  legislation  beyond  the  postsecondary  l^el 
is  iioplemented.  ^         J  > 

NeA  Research  wotfld  like  to  extend  any  needed  technical  assist- 
ance^ or  provide  additidial  information  that  th|s  committee  may 
deem  appmpriate. 

#  Thank  you  very  much.     '  ^ 

l!Bhe  prepared  statement  of  Donald  Qppieron  follows:] 

o  .  ...    .    .  ■  ■■■ 


PlUEfPAREO  STATiSMfeNT  OF  DON  CAMBRON,  ASSISTANT  EXECUTIVE  DiRECTOA;.* 

.  ^  •  National  Education  AssociATipN 

FdREWORDy 

*  .  •  •        '       .  * 

•  The  Natipnal  Education  Association  has  presented  testimony  on  the  Truth-in-Testihg 
Act  of  1979  (H.R.  3564)  and  the  Educational  Testing  Act  of  1979  (H.R.  4949)  on  two 

/occasions,  August  1,  1979^  and  today,  October  10,  1979.  The  Association  supports  the  . 
co'hpepi  of  this  typ$  of  le^atiqn  primarily  because  the  testing  hidustiry  is  in  need  of  a 

^  insjor  overhaul.  # 

The  NBA  proposes  a  course  of  action  which  would  malce  testing  and  human  measure- 
inent  in  this  country  consistent  with  the^deas  proposed  by  Oscar  Buros  and  Ralph  Tyler. 
The  National  Assessment  ^f  Educational  Progress  (NAEP)  and  other  criterion-reference 
measures  4ire  models  for  the  testing  industry.  The  NAEP  approach,  if  property  designed, 
implemented,  and  used,  would  move  the  testing  hidustiy  from  perpetrators  of  a  diffe^ 
entiation-type  of  measurement  to  a  model  of  measurement  that  would  provide  information 
about  course  and  leamhig  objectives. 

This  techiiical  supplement  provides  selected  hifonhation  about  testing  and  measurement 
related  to  the  proposed  legislation. 

NEA  Research  is  in  the  process  of  preparing  a  research  memorandum  on  testing  and 
measurement.  The  memorandum  is  designed  to  address  systematically  many  of  the  concepts 
.discussed  in  this  technical  supplement.  The  three  sections  to  this  supplement  are  (1)  the 
text,  (2)  Appendix  A:  NEA's  Analysis  of  H.R.  3564  and  H.R.  4949«  and  (3)  Appendix  B: 
NEA*&  letter  of  support  for  the  National  Assessment  of  Educational  Progress. 

■  ,  ■  .:(  ->." 

^ 


NEA't  TECHNICAL  SUPPLEMENT  FOR  THE  STATEMENT  ' 
ON  THE  EDUCATIONAL  TESTINd  ACT  OF  1979  ,v 


October  10,^979 


V' 


Tbe  National  Education  Aasociation  is  pletied  to  have  been  invited  to*  difcus^the 
Truth  in  Testing  Act  of  1979  (ILIt  3564)  and  the  Educational  Testing  Act  Of  1979  (H.R. 
4949),  JLch  would  be  extended  to  include  standardized  tests  pven  ^t  the  elementary  and^ 
secondary  level  and  also  teache^p^epared  tests*  * 

^n  NBA  presented  testimony  on  H.R.  4949  before  the  Committee  on  Education 
and  Labor  'on  August  U  1979,  it  supported  the  bill  and  urged  the  Congress  to  proceed  and 
;  expedite  the  passage  of  H.R.  4949.  At  this  time  NEA  reconfirms  its  endorsement  of  H.R. 
4949.  The  Association  believi^s  passage  of  the  legislation  will  ensure  that  standardized  tests 
•and/or  the  inappiopriate  use  of 
tional  opjportimity  for  all  people. 


•and/or  the  inappiopriate  use  of  standardized  tests  do  not  continue  to  deny  cKlual  educa- 


Both  H.R.  3564  and  H.R.  4949  represent  notice-and-dlsclosure  legl8l9tion;  however, 
they  differ  substantially  on  the  type  of  tests  covered,  the  extent  of  .  involvement  pf  the 
Cbnmiissione^  of  Education,  and  the  ty'pt  of  enforcement  provisions.  Furthermore,  for  the 
m6st  part,  the  disclosure  requirements  ofER.  3564  require  the  same  type  of  information 
currently  beinp  provided  voluntarily  by  testing  ^ncie^  Because  H.R.  3564  does  not 
require  disclosure  of  underlying  data.on  the  examinations,  it  would  not  enable  p^fessionals 
'outside  the  testing  industry,  including  teachers,  to  analyze  6r  c^omment  on  test  (instruction 
and  'Validity.  Moreover,  H.R.  3564  fails  toi  provide  for  the  disclosure  of  scoring  data  in 
addition  to  the  dlsgloAire  of  test  scores  that  may  be  given  to  educational  institutions.       ^  . 

•  ■  ■  ■  ■  .    /*  .  ■  . 

'  NEA  toiild  encQunge  the  9>nimittee  to  use  H.R.  4949  as  the  bi^tox  the  proposed 
■  ■  / 

testing  legtslatibn  and  Incorporate  H.R.  3564  as  part  of  the  proposed  les^latlon  wher^it  \s% 

deemed  appropriate.^ 


ndix  A  foi  NBA'i  inityiis  of  HJL  3564  and  Hit  4949* 


Impact  of  H.R.  4949  at  the  Ekmeniaiy  and  Speondary  Level . 
.  andonTeacher^PreiMred^testj  - 

'  In  relation  fo  the  questions  concerning  the  impact  of  the  proposed  legislation  at  the 
elementary  and  secondary  level  and  to  teacher-prepared  teats,  th0  NEA  does  not  recommend 
.  ^the  extension  ofH,R\  4949  to  the  elementary  and  secondary  level  at  this  time. 

'  ■  •    ■  '  .  ♦        ,  '  ■  .■  ." 

The  proposed  le^slatlon  currently  addresses  tests  used  at  the  post-secondary  level  for 
admission  selection.  Testing  experts  (psychometrlcians)  generally  classify  this  type  of  test  as 
an  aptitude  test.  Examples  of  aptitude  *  t^ts  are  the  American  College  Testing  Progr2(hi 
(ACD»  Scholastic  Aptitude  Test  (SAT)^  l^\^School  Admission  Test  (LSAT),  Medical  Col- 

'    lege  ''/lamission  Test  (MCAT),  Dental  Admission  Test  (DAT),'  and  the  Miller  Analogies  Test 

"^(MAT).  .  •    '    '..   [  \ 

\     .  The  common  element  hi  all  is  that  these  tests  are  used  to  predict  future  success  in 
.  college  coursework.  Aptitude  tests  usually  are  not  designed  to  predict  a  student's  future 
success  hi  a  chosen  field  (nor  do  the  developer^  of  these  tests  make  such  a  claim). 

•     ■  ^.  ■  .  ■ 

*  *  the  NEA  believes  that  the  estimated  2.5  million  test  takers  at  the  post-secondary  level 

■  J' 

constitute  a  large  enough  group  to  determine  how  well'the  federal  legislation  will  work  with 
ap^titude  tests.  By  extending  tli^  legislation  to  hiclude  elementary  and  j^condary  students 
tlte^'number  of  test  takers  affected  would  exceed  47  million  and  theo^dditional  fypes  of  tests 
included  would  be  achievement,  ability,  and  IQ  tests.  The  implications  of  the  increase  hi  the 
.^nfber  of  test  takers  and  types  of  tests  cannot  be  adequately  assessed  at  this  tinie.  In 
addition  to  the  impliCajtions  for  testing  companies,  school  district  costs  for  testing  and  the 
logistics  of  administration  and  legislation  enforcement  cannot  be  accurately  determhied. 

*  ■  ^  .  ■  ■ 

'    .     «The  Assbdatioh  further  believes  that  the  state  of  the  Art  withui  the  testhig  hidustry  is 
in  need  of  a  mfior  overhaul.  In  NEA's  August  I,  1979  testimonyVfprc  this  committee  a 
;  segment  of  a  speech  made  by  Oscar  Buros  was  quoted  regaiding  problems  and  needed 
changes  in  testing.  In  that  same  spiech  Buros  outlhied  a  program  for  improvhig  testing 
.  practfees.  Butos^  progranfi  has  been  available  to  test  publid|^r8  for  over  30  years.  Unfortu- 
nately,they  have  not  taken  his  sound  expert  advice  about  how  to  hnprover  test  measurement. 

.•  ■         '.y       ^  ■■'  V    ■  •.  ■ 

.  .  .     •  > 


Th0  Association  believes  that  the  Buroi  ph>po8al  for  improving  tests  and  their  use  shcmld  be^ 
implemented,  ills  proposal  would  hel^ realize ^A's  position  on  achievement  testing.  He 
proposed  the  following: .  % 


I  suggest  that  acMevenlent  test  bafter|^  be  of  two  types:  tests 
assessing  the  perRftmance  of  groups  and  tests  for  assessing  the  pe^ 
formance  of  individiiids.  \  shall  refer  to  these  two  pate|;ories  as  group 
tests  and  individual  testa  where  the  words  "group"  and  "individual" 
prefer  to  the  taigets  bein^  evaluated. 

The  group  tests  shouM  be  designed  to  measure  the  achievement  of 
8cho<rfs,  sdiool  systems,  or  other  groups  havtog  common  objectives  and 
leanOng  environments.  Sinqp  our  interest  ii  in  groups  tath^r  than  indi- 
viduals, ea^^h  test  could  be  quite  short,  requiring  very-llttle  ti^^  . 
minister.  In  situations  where  the  groups  are  fairly  large,  ihe  tests  could 
be  subdivided  into  much  shorter  subtwts  with  no  student  taking  more 
\      than  one  subtest.  The  time  no|y  required  to  admhiister  an  achievement 
>v    battery,  sometimes  as  much  as  sieven  hours,  could  be  reduced  to  thirty 
minutes;  With  group  tests  such  as  these,  schools  would  be  able  to  com- 
pare their  performance  on  item,  part,  and  total  scorps  as  well  as  their 
frequency  distributions  >vith  those  of  normative  groups.  In  addition  to 
covering  objectives  common  to  most  school  systems,  thc^  group  tests 
could  be  supplemented  by  subtests  covering  objectives  nbt  now  iftdudcd 
in  standardized  tests.  The  use  of  short  group  tests,  each  takien  by  only 
a  fraction  (say,  one-fifth)  of  the  students  will  grcajly  reduce  the  cqsts 
in  time  and  money  of  testing.  It  will  stimulate  test  publishers  tp  give 
greater  attention  to  problems,  involving  group  measurement  and  the 
interpretation  of  group  results.  A  i^ch  wider  range  of  objectives  and 
ciirticular'ajnalyses  could  be  covered.  Relatively  simple  norms,  raw 
scores  means,  ftequeiicy  distributions  of  raw  score  means,  both  for  total 
scores  tod  item  scores,  would  replace  the  complicated  systems  of  norms 
now  provided  for  individuals;  \  woiUd  not,  however,  limilt  the  n(»matWe 
-data  to  the  particular  grade  for  which  the  test  was  designed.  The  same 
normative  data  should  bc^resented  for  the  grades  immediately  below 
and  above  the  target  grade.;/-The  presentation  of  this  comparative  in- 
formation for  adjacent  grades  is  especially  important  in  the  interpreta- 
.    tion  of  tests  built  for  measurement  rather  than  for  differentiation. 

As  is  true  of  all  achievement  tests,  scores  on  the  group  test^  would  be 
not  only  ji  function  df  ^ivhat  a  stu((ent  has  learned,  but  also  a  function 
of  the  closeness  with  which  the  test  covers  ihe  instnictional  objectives 
and  curricular  offerings  or»a  local  school  system.  Alttiough  these  learn* 
ing  and  <5urricular  effects  arc  confounded,  I  would  like. to  experiment 
with  ways  of  considering  each  of  the  effects  separately.  Let  me  suggest 
one  way  in  which  this  might  be  done.  .  / 


-         Let  all  nqnmative  groups  lurAide  infonnatiQii  on  the  extent  to  which 

the  test  specificationB  and  tfte  test  items  aie  appropriate  lofeally^  dieck- 
lists  could  be  provided  reqmring  school  ofBdalt  or  committees  of  ' 
teachers  to  dytilV  eaph  objective  and  eadi  Item  into  four  categories 
for  each  grade:  (1)  taught  in  an  earlier  grade.  (2)  Uu^t  hi  the  target 
grade.  O)  taught  in  later  grades,  and  (4)  not  taught  hi  any  grade.  Item 
score  hoTim  nillpit  be  presented  for^ta(A  of  a  O^er 
questions  might  wril  be  directed  to  th^  hnportance  of  an  objective  or 
_  \jttem.  The  normative  «roups  might  also  be  asked  to  indicate  local  objeo- 
■ves  not  covered  by  the  group  tests.  Statistics  such  as  these  would 
^able  school  systems  to  compare  both  the  performance  pf  their  stu- 
.  dents  and  the  extent  to  which  the  objectives  and  content  of  the  tests 
'  coincided  with  thehr  local  objective  and  Instructional  programs. 

The  use  of  different  tests  for  measuring  groups  and  hidividuals  would 
'    .       permit  jchool  systems  to  abandon  national  .norms  altogether  fix  hidi- 
.  vidual^^uiftl  to  adapt  and  supplement  commercially  pmchased  tests  and 
proccsshil  seivices  to  better  meet  local  needs.  Cocal  norms  would  be  far 
more  meaiihigful  than  national  norms;  I  would  use  compound  scores  con- 
.    sisthig  of  a  percentile  ran|c  withfai  grade  and  the  raw  score  (corrected  for 
I    guesshg)  as  a  percentage  of  the  possible  score.  Purchased  tests  could  be 
/    supplemented  by  locally  prepaitd  examinations  and  hitegrated  hito  the 
^      /      testing  program.  ^  ...^ 

jttnce  there  would  be  no  national  norms  and  «tatisticat  procedures  for 
selectfng  items  would  not  be  used,  the  coats  of  final  tryouts  and  norma- 
tive testing  would  be  eUmhiatcd.  Local  schod  systams  would  be  free  to 
adapt  the  tests  hi  various  ways  to  better  meet  their  needs.  Items  could 
•be  dropped  by  not  scoijng  and  new  items  added,  in  locally  constructed 
tests.  Olme  Umfts  and  administration  procedures  could  be  changed  if 
deshed.  School  systefti^.  would  become  more  actively  hivotfed  hi  the 
Choice,  study,  adaptatfon,  atfd  supplementation  of  commercially  pur^ 
*  chased  tests  and  procMng  services.  Test  authors  and  publishers  should 
give  local  school  systems  assistance  hi  formulating  testhig  programs  which 
are  adapted  to4^e  local  situation.  — 

By  better  meeting  local  needs,  publishers  are  likely  to  sell  more  testa  to 
serve  a?  a  flexible  core  of  tiie  local  testhig  program.  Shice  computers 
^  would  be  necessary  to  provide  local  norms  and  repprts  for  botii  studenta 
and  test  items,  the  data  processhig  services  of  publishers  would  be  heeded 
jnoie  thamever.    .  ' 

.  I  shall  not  take  tite  tune  to  enumerate  further  the  advantages  of  usmg 

national  nqrms  for  group  measurement  and  local  norms  for  hidividual  < 
^measurement.  If  a  schod  system  were  forced  to  choose  only  one  of 
^these  two  khids  of  testa,  Iwogld  have  no  hesitation  hiiecommendmg 
*     the  locally,  adapted  and  supplemented  test  with  local  norms.^ 

Euros'  program  of  impiovement  for  test  construction  and  use  has  been  available  to  test 
publishers  for  over  30  years.  There  has  been  little  Improvement  hi  the  dkection  he  pnh 
posed.  >  ;  .  •     .   ^        ■  N  ■ 


test  publisheis  onid  the  indusmat  laige  ||int&iue  to  cling  to  the  1920s  Mncept  of  testing. 

Prior  to  NEA's  examination  of  Buros*  concepts  and  testing  at  the  elementary  and 
8Qcohlfi|iy  levll  the  Associatijn  would  like  to  discus  briefly  the  following:  ^ 


•  '^Type  of  test  addre^d  by  the  proposed  legislation  (H.R.  4949) 

j  •     .  ■  . 

•  Types  of  tests  .  / 

•  Use  of  tests 

•  NEA's  position  on  the  types  of  tests 
Use  of  tests  in  reacMng,  decisions 

•  Criteria  for  evaluation'of  testi 


\ 


/flVpe  of  Test  Addressed  by  the' Proposed  Legi8latioii(II.R.  4949) 


^   Section  10  qf  H.R.  4949  deflnes  the  term  standdj^dlzed  test  or  test  as  menping: 

Any  test  that  is  Used,  or  is  required;  for  the\proce^  of  selection  for  " 
admission  to  postsecondary  educational  institutions  or  their  programs, 

•   '■■ ■  ■  ■■  ■.  •  • 

Any  test  used  for  preliminary  preparation  for  any  test  that  is  used/or 
;  '  J ,     required,  for  the  process  of  selection  for  admission  to  po^tsecondary  , 
^     .  '    edflcatiQnal  institutions  or  their  programs;  which  affects  or  is  conducted 
orpstributed  through  any  medium  of  interstate  commerce,  but  such 
te|m  does  not  include  any  test  desij^ed  solely  for  rionadmission.  placement 
or  credit'by-examination  Or  any  test  developed  and  administered  by  an  ^ 
.    •    individual  school  or  institution  for  its  own  purposes  only.  (Emphasis 
added.)     '  ^     -  .  . 

■  '     ■  l^- 

The  critical  concept  embraced  by  the  proposed  legislation  as  previo^Iy  stated  is  on 

'  ''selection  for  admissip||||'  and  is.  considered  to  be"  an  aptitude  test.  IX  \i  usetTto  forecast 
or  predict  success,  ' .      .         \  ' 

Unfortunately,  the  lack  of  forecasting  ability  (predictive  validity)/of  the  t^sls  Wfth 
regard  to  on-the  job  success  does  not  prevent  admissions  offlces  from/using  tms  type  of 
test  as  part  of  the  pre-servij^  selection  proce^  for  various  occupatio|(s.  Thi/ not  only 


■    726   ■  . 

raises  the  question  bf^ting  for  f^i^Castiiu  or  predicting  iesultsjt  also  moves  the  focus  . 
tirom'use  of  inmlequate  aptitude  tests  to  the  inappropriate  use  of  test  results;  namely,. a 
student's  admission  to^  a  college  or  a  graduate  program. 

^  In  summaiy/the  type  of  teatt  that  the  Edupatiional  Testing  Act  of  1979  (H.R.  4949) 
addresses  are  Aptitude  Tests.  This  type  of  test  has  been  used  for  classifying  students, 
assigning  students  for  instruction  (ability  grouping)  and  in  some  instances  as  a  substitute 
for  IQ  tests.  The  principal  use  of  the  aptitude  test  Is  to  predict  future  performance 
(e.g.,  first  sehiester  college  grades).  -      ^  ^ 

lypei  of  Tests  - 

Moet  psychometricians  classify  tests  into  two  categories,  Nfaximum  and  Typical  per-/ 
formanc^ests. 


•  Maximum  Performance  Tests  are  designed  to  measufc  a  person's  best  perfomiance. 

.  -   ■  J  .■ 

Intelligence,  Aptitude  and  Achievement  tests  are  classiiie^Uas  Maximum  Perform- 
ance Tests.     •    '  \  »  . . 
.   .  -Intelligence  Tests  generally  are  designed  to  measure  verbal,  nonverbal, 

memory  and  problem  solving.  Some  psychometricians  defme  intelligence 

*  ♦      •  'i 

as  what  the  test  measures.  Intelligence  tests  are  for  most  purposes  thought 
.  '     ■       ■  I  ■ 

of  as  general  or  scholastic,  aptitude?  /  -      -  >  ^ 

t 

,  -Aptitude  Tests  are  theoretically  designed  to  measure  mental  operations  that 
improve  little  with  practice  and  provide  the  basis  tor  predicting  future  level 
of  performance.  „  *  ? 

-Achievement  Tests  bx^  designed  to  measure^akills;  knowledge  and  compe- 
tence. This  type  of  test  measures  the  degree  of  acpomplishiiiehts  in  a 
training  or  Educational  experience. 

•  ^  7>p/ca/  Performance  Tejts  are  designed  to  rnieasure  how  a  i)erson  reacts,  feels  .or  v 
behaves.  Personality  tests,  interest  inventories,  situational  tests  and  projective 
techniques  ye  illustrations  of  Typicatfer^ormaiictf  Testa.  .        '  ' 

The  purpose  In  measuring  typical  performance  iS'-to  determine,  how  a  person  behaves  in 
'   dally  activities.  These  types  of  tests  are  designed  to  measure  how  a  person  would  normally  . 
behave*  react  or  feel  in  a  giver)  situation,  The  assumption  underiying  this  type  of  measure- 
ment  is  that  the  test  taker  is  responding  honestiy  to  questions  about  behavictr  arid/or  feelings. 
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Tests  ire  usedjh  cclii»^atJdn  for  research,'  prognosis,'  alid<diil0iQsis.  Prognosis  or  predio- ' 
,  tion  and  diigno^  are  the  two  mo«U  frequent  uses  of  tests.  In  pf^diQHon,  the  emphasis  is 
on  differences  between  an  individuals  perfomuuhce  and  that  of  o^er  Individuals  or  a 
standard.  Diagnosis,  oh  the  other  hand,  focuses  ori  flie  analysis  and^^es^ption  of  an  * 
individual's  performance  from  taslc  to  task.  ^'  i         .  - 


Aptitude  tests  and  l.Q.  tests  are  e?camples  of  tests  that  are  used  fiO' prediction.  They 
are.  used  to  differentiate  among  peoj^e  taking  the  tests  and  to  predict  futuice  perfdhnanoe. 
Achievement, tests  when  used  to  measure  a  person's  skills  or  knowledge  (no^  competence). ' 
are  diagnostic  and  provide  a  means  to  isdate  those  characteristics  which  need  to  be  cor- 
rected (e.g.  Jdifficul^  in  comprehending  complex  sentences).  \ 

 ■■■■■  ■  ^  1 V- .  ■ 

NEA's  Position  on  Achievement  and  Aptitude  Tests 

NBA  strongfy  supports  student  achievement  testing  to  iMagnose  learning  needs,  pre- 
scribe  instructional  activities,  and  measure  student  progress  in  the  curriculum  content 
taught  by  the  classroom  teacher.  The  Association  believes  that  siidh.  achiev^ent  testing  ' 
is^a  responsibility  of  the  local  school  district  and  teachers  at  the  school  building  level. 

Furttrer,  the  Association  believes  that  the  Natiolkal  Assessment  of  Educatidnal  Progress 
(NAEP)  provides  a  more  appropriate  approach  to  assessing  school  programs  and  student  com- 
petencies. The  NAEP  program,  in  operation  since  1964,  has  emerged  as  an  accej^ted  method 
to  asses^. educational  programs  by  bothl^teachers  and  adfhi^istrators. '  NEA  supports  the  N/^P 
projtfam  as  the  most  appropriate  approach  for  assessing  educational  programs.  (See  Appcn- 
di?(  i  lett||^  of  support  to  NAEP.) 

,    Aptitude  tests  ^ply  prediction  and  are  used  to  forecast  future  performance  levels.  They 

have  been  used  for  selecting  or  excluding  individuals  for  admission  to  college,  graduate  school, 

\  ■   ■  '  •     *  ■■ 

and  jobs;  ..  ;  :  ' 


NBA  opposes  the  use  of  tests  that  deny  students  full  access  to  equal  educational  oppor- 
tunities, !  ^ 
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Aptitude  tests  and  thpie  achievement  tetti  which  are  designed  toVeasu^  competence 
and  are  used  to  deny  students  full  access  to  an  education  or  future  employmei^^re  the 
type  of  tests  that  NBA  would  like  to  s^  ^minated  from  use.  '  -  ^ 

Uae  of  Tests  in  Reachfaig  Decisions  . 


are  used  for  two  types  of  decisions,  institutional  and  indiyidml  Institutional 
decisions  m  decisions  made  on  behalf  of  an  institution  such  as  a  college  or  school  in 
selecting  or  n!|ecting  an  applicant  A  bad  decision  about  an  individual  tenc^  to  have  little 
if  any  adverse  effect  on  the  institution.  Furthermore,  tests  predict  group  j^rformance 
better  than  indivioUal  performance.  ' 

Individual  decisions  are  decidons  about  a  particular  person  (^g.,  daughter/son).  The  em- 
phasis fiAhis  type  of  dei:ision  making  is  on  the  individual  and  not  on  the  ca^gory  of  people 
with  the  same  or  similar  cnaracteristics.  An  incbnect^^cision  may  have  a  life-long  effect. 

f  •  ■ 

Institutional  decisions  generally  are  made  In'^a  centralized  setting  while  individual  deci- 
sions tend  to  be  made  in  a  decentralized  setting.  For  example,  an  admissions  officer  at  a 
university  makes  institutional  decismts  i^out  hundreds  of  applicants  with  the  confidence 
that  idthough  an  institutional  decisiptkmay  have  an  adverse  effect  on  an  individual  appli- 
cant,  the  collective  good  of  the  institution  is  being  protected  in  the  decision  making  process. 
In  additiim,  group;  performance  can  be  predicted  better  than,  individual  performance. 


Individual  decisions,  on  the  Qther  hand  generally  are  made  in  a  decentralized  situation 
which  is  unique  to  the.  individual.  Examples  of  such  decisions  are  whether  one  should  apply  . 
^or  a  job  of  admission  to  a  highly  regarded  university.  It  may  be  helpful  to  examine  other 
people's  choices  and  success  rates;  however,|l  still  comes  do^  to  the  individual's  decision 
and  the  related  consequences.  It  is  the  idea  of  individual  choice  and  the  right  of  the  individuals 
to  have  an  opportunity  to  make  decisions  about  their  educational  and  occupa^onal  futures. 

CHteria  for  Evaluation  of  Tests  i  ' 

\  ■  y  ^  \  ■    .  ■  y 

The  classical  criteria  forievaluating  a  test  are  standardization,  objectivity,  reliabilif(ft 
and  validity.  These  four  categories,  which  are  t^icaBy  used  to  judge  a  test,  are  sup/lemented 
by  a  prio^t  of  common  sense  considerations;  it|unety,  the  purpose  for  which  the  test  is  to 
be  used^  the  feasibility  of  use,  the  ease  of  administration  and  scoi^g,.  and. finally,  the  cost 
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'.the  teit  Tenui  the  wailable  fiin<if .  Once  theae  factors  h4ve  beeji  assessed,  the  more  ^  <> 
(edkidcal  avects  aa^pdated  with  the  criteria  are  used  to  evilate  the  test.  - 

.    \//      ■  ;■■         •    ■     ^  •■  ■.■  ■■;  ,  •,.  ,.  .  ,/ 

.  f  .     '  Stauhirditatlon  means  that  a  tdt  has  been  i^en  to  a  well  defined  population  (Le., 
f  ooOete  freriuneii*  auto  mechanics)  an^  that  «n  i^^pirate  lecoid  has  beea  kept  of  the  scores, 

whidi  aie  then  developed  into  iionns.i  The  process  of  standardization  ifeduces  enors  of 
^    interpietatioii  about  test  scoies.  It^^i  help  reduce  misundentandings  about  tiie  group 

with  whidi  an  individual  is  being  (^^ared  and  the  manner  in  which  the  individual  and 

■      •     "  A  1  '     ■ '  * 

group  perfonnance]|  expiesied  (e.g.,  percentiles,  Jandard  score^^^ 


Obleciivity  means  fre^  of  personal|bias  in  the  scoring  of  the  test;  that  is,  the  degree  by 
wkdi  ^fleitnt  people  seeing  the  test  j)btain  the  same  results.  The  error  in  scoring  refers 
to  personal  errors  made  by  the  rater  in  ^ring  the  test.  All 'other  things  being  equal,  the 

greater  the  otjectivity  of  a-  test  the  greaier  the  reliability. 

*    ■         '      '  \  •    i  •    '  .  . 

Reliabifitx^  is  the  metture  of  consbtency  of  a  test  or  measuring  instrume;it.  Reliability  ^ 
,  relates  to  the  extent  that  a  test  is  free  of  variable  errors  when  a  person  is  nieasured  twic^  by  { 
the  sante  hiatium^t  or  when  one  administration  of  a  test  yields  small  enors  from  persc/n  to 
person  taking  the  test!  A  test  witb^high  tteliability  is  one  that  will  yield  veiy  much  thef  saime 
score  results  for  a  sroup  of  people  under idlffei(ent  conditions  or  /  ^ 

Validiiy  is  tlie  single  most  important  C^terion  in  the  evaluation  of  a  test.  A  test  must   *  / 
accurately  measure  what  it  reports  t6  measure  for  it  to  be  valid.  There  are"  three  typesyof 
validity:  content,  eiopiricaff'Cconcurrent,  predictive),  and  construct.  ^T^ 
type,  of  vali^ty  in  apti^^  testing  is  empiriaal  (p^icth^e). 

■^^^  V  •■  . 

^     The  three  types  of  validity  are  involved  with  the  need  to  gather  evidence  and/or  data 
about  what  the  test  measures.  Two  types  of  methods  are  generally  used  to  gather  evidence 

. .  and  daU  about  the  test.  Logical  analysis  Of  tl^e  test-takhig  situation,  test  content  or  behavior 
and  the  test  itself  is  invdved  in  detennini^g  content  ^vdidity.  An  empirical  method  (colleo  ^ 
tiO|i  inAiialysb  of  data)  Is  Used  to  establish  emphical  validity.  This  approach  is  liestricted 
t0  thie>stabllshment  of  a  relationship  (conelation  coe|ficient)  beitween  test  perf ordnance  or 
behavior      a  criterion  performance  or  behavior.  Construct  validity  re]at<»  t^  the  gathering 

(|pfevidende^iising  both  logical  and  empiri(i|  methods.  To  establish  construct  validity  it  is 
neceasaiy  to  test  hypotheses  a^d  demonstinte  the  theoretical  test  behavior  is  verifiable 


f 
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ex^iimenttUy.  <^^||pquentty,  ^eiy  validttiQn  process  becomes  an  evaluation  of  the  te|t, 
thMiVi  and  concept  beiiig  measiued,  Finally,  it  should  pc  kept  in  niigd  that  a  test  is  v|lid 
only\for  a  particular  ptedeflned  situation.        I  ^/^  *  \  ' 


QuesHpns  To  Be  Askf  d  about,  the  (^teria  fdr 
Evaluation  of  Tfsts 

•  Staitdaidlzfttion 


x 


1.  How  was  the  sample  selected  for  the  norming  population? 

2.  Who  was  included  in  ttie  norming  population?  \ 

3.  What  are  the  Uimit^tions  of  the  derived  score  used?  — - 

Objectivity 

^  1.    Is  the  scoring  system  free  of  error  (e.g.,  sam^  score  arrived  ^  no  matter 

>.  who  scores  the  test)? 
2.    What  is  the  method  of  scoring 

ReUabiUty^ 

.  1..   How  was  the  ibliability  determined?  '  . 

2.    What  is  the  estimate  of  reliability  for  the  measure?  (test) 
.  3.    What  is  the  standard  error  of  el||imate  for  the  test? 

Validity  / 


1.  ^Does  the  test  have  validity  for  the  situation  in  which  it  is  bei^  used? 

2.  Does  the  test  measure  the  information  and/or  perform^Q^^^  an  important 
set  of  tasks?  ' 

3.  Does  the  test  measure  current  performance  when  compared  to  &  standard 
or  criterion  measure?  '  / 


h  ■ 


4.  Does  the  test  measure  future  performance  when  compared  to  a  standard  pr  . 
criterion  measure? 

5.  Do^  the  test  measure  a  trait  or  set  of^characteri^tics  and  can  an  experimental 
V     ccmdition  be  created  to  test  the  hypotheses?  ^ 


Qfilerioii-iRei^nce  Measurement  \  ♦  ^  iv 

o   '  •     ■■  .      ■  .  "  ■  ■• 

NEA  supports  the  use  of  criterion-feferencc  measurement,  which  is  generally  concerned 

with  the  assessment  within  an  individual's  personal  gr6>vth  and,  specifically,  with  what  a  . 

K^non  can  do  rigKt  now!  This  type  of  measurement  is  concerned  with  the  entire  ^ducationot 

prog^  and  not  just  sample  ftems  that  have  differentiation  ability  and  meet  other  psycho-  ; 

\nietric  criteria*  ,  .     / 1 


The  National  Assessment  of  Educational  Progress  measurement  techniqiies  qualify  as.  a 
criterion-reference  approach  and  also  incorporate  many  of  the  iieas  proposed  by  Oscar  Biiros. 
For  example,  an  exeerpt  from  a  National  Assessment  of  Educational  Progress  report  states  that: 


V 


Methodology  \ 

To  measure  the  nat^n's  educational  prpgress.  National  Assessment  esti- 
mates the  percentage  of  respondents  (at  any  of  four  age  levels)  who  are 
able  to  acceptably  answer  a  question  or  perforjn  a  task.  Each  question 
or  task  (called  an  exerpise)  reflects  an  educational  goal  or  objective .  The 
exercises  are  administcreid  to  sciphtifically  selected  samples  which'take 
tJ]ito  account  such  variables  as^ sine  and  type  of  community,  race  and  geo- 
graphic region.  Students  are  sampled  at  three  age  levels  that  represent 
educational  milestones  attained  by  most  students:  age  9,  when  nlost 
.  students  have  been  exposed  to  die  basic  program  of  primary  education; 
age  13,  when  most  students  have  finished  their  elementary,  schod  educa-  . 
tion;  and  age  17,  when  most  students  are  near  completing  their  sfecondary 
education.  To  accurately  reflect  the'skills.  knowledge,  and  attitudes  of 
the  17-year-olds,  National  Assessment  also  samples  17-ycar-old$/not  en- 
rolle'd  in  school.  Adults  (ages  26  to  35)  are  assessed  to  determine  the  skills^ 
knowledge  and  attitudes  of  those  who  have  completed  their  formal  edu- 
cation and  have  probably  been  away  from  school  for  a  numbey  of  years. 
The^samples  are  designed  so  that  valid  inferences  can  be  made/about  the 
populations  from  which  the  samples  were  selected. 

,  National  Assessment  does  not  use  total  performance  scores/or  individual 
respondent*  because  its  main  concern  is  how  various  groups  of  individuals 
perform  on  specific  :exercises.  Thus,  it  is  not  nece^ary  for  each  respon- 
dent to  take  every  exercise.  The  exerdses  are  sorted  into  booklets,  and 
each  in-school  respondent  takes  only  one  booklet  The  vafious  booklets 
are  administered  to  statistically  equivalent  samples  $p  that  group  com- 
parisons can  be  made  across  booklets/  This  technique  allows  National 
Assessment  to  asfess  performance  on  far  more  exercises  than  woul41)e 
possible  in  the  usual  one-hour  testing  situation  and  provides  broader 
coverage  of  t^^e  assessment  objectives  for  eacl]^eaming  area; 

Since  individuals  are  hot  raftke^xaccording  fo  th^r  performance  on  the  | 
assessment  materials.  National  Ak^ssment  does  not  emphasize  the  use  of  » 
exercises  with  hi^  discrimination  power.  Ihe  aim  of  ^e  project  irto 
d^ribe  attainment;  this  is  best  accomplished  if  the  exercises  used  cover 
the  entire  spectrum  (Of  difficulty,  frorh  very  easy  tasks  to  the  mpst  difficult 


1^  multiple-choice  exercises  predomi 
ffngonywhef^  from  a  few  vyords 


cluqitd  in  each  assessment.  Exercise  write: 
dse 
five! 
the 
A 


te,  m^ny  open-ended  exercises 
essay  as  an  answer  ^  in- 


in^pted'toiise  the  exer- 
fjormat  th^t  provides  the  best  and  most  direcMeasure    the  f>bjec- 
being  assessed.  They  are  encouraged  to  develop  exerc&es  that  ^employ 
jpe  of  pictures,  tapes,  filing  or  practical,  everyday  items  as  stimuli.  In 
assessi;nent$,  individual  interviews  and  observations  of  the  respon- 


*  problem-solving  techniques  supplement  thd^^usual  data-collecting 
fedifres.  For  exaipple,  in  Music,  respondents  were  asked  to  sihg*a  song 
ferform  on  an  instrument;  in  Science,  respondentewere/isked  to  con-  ' 
a  small  experimdlt;  in  Social  Studies,je$pon^teiftr%ere  asked  to 
rpret  an  electiofi  Fallot.  -{ 

ational  Assessment  regards  positive  attitudes  toward  or  opinions  about 
various  learning  areas  as  important  educational  attainments.  There- 
^'ore,  affective  exercises  and  attitude  suijyey  questions  a^  also  included 
/in  most  assessments. 

Assessment  exercises  are  administered  either  to  individual  or  to  small 
groups  (generally  le4  than  .25)  by  specially  trained  personnel.  Exercises 
are  adrhinisteied  to^l  out-of-school  respondents^  a  one-to-one  situation. 
Some  of  the  in-school  respondents  are  assessed  iJm  one:to-one  situation. 
This  proportion  varies  according  to  age  level,  learning  ^a  and.  assessment 
year.  Exerqses  specifically  designed  for  in^ividu^l  administration  include 
those  having  unusual  stimuli  or  requiring  something  other  than  a  writteii 
r^ponse.  In  group  administrations,  instructions  and  the  exercises  tiiem- 
selves  are  presented  to  the  respondents  on  paced  tap«  recordings  to  assure 
complete  and  uniform  presentation  of  instruction  and  to  give  those  who 
have  a.  reading  problem  a  chai\ce  to  hear  the  exercise  as  they  are  reading 
it.  ' 

To  report^  the  nation^s  educational  progr<|ss,  the  project  release's  up  to 
one-half  of  the  exercises  administered  in  a  teaming  area.  Released  ex- 
erdses.aUow  the  public  to  evaluate  the  exercised      the  accompanying  .  ( 
\  data.  The  other  exercises  are  kept  confidential  and  arq  used  to  assess 
A  performance  changes  over  time.  .  '» 

now  do  NAEP  test  booklbts  dinner  from  standardized  achievement  test$?  \ 
Standardized  achievemeht  tests  are  norm-referenced;  National  Assessment 
•teste  are  content  or  wjective-referenced.  On  a  standardized  ac&levement 
tes^  each  respondent  rakes  every  exercise,  receives  a  scpre  for  his  pe^ 
.fbrmance,  ar(d  is  ranked  on  the  basis  of  that  «core  with, respect  to  a' 
reference  group.^vt^Vspondent  takes  all  of  the  exerciles  National  Assess- 
ment uses  to'assessa  teaming  areK/no  respondent  receives  a  score,  and 
em^asis  is  placed  oh  the  perfQ|mahce  of  groups  of  respondents  6n 
specific  exercises.  Standaidized  achievement  test  items  are  usually  limited 
to  a  multiple^hoice  format;  National  Assessment  employs  a  wide  variety 
of  exercise  formats.  Standardized  tests  usually  focus  on  the  cognitive 
'  domain;  National'Asaessrhent  usually  indudes  exercises  relating  to  the 
Affective  domain  as  well.  A  respondent  is  required  to  read  the  items  him- 
self when  taking  most  standardized  tests;  Assetement  exercises  are  read  to 
respondents  by  a  paced  tape  or  jtfie  exercise^admiilUtrator  in  an  interview  . 
situation  excep^during  the  Reaqing  Assessment.  Tlie  items  oh  a  stundard- 
ized  aciiievement  test  are  rarely»  if  ever,  made  public;  the  Assessment  re- 
jie<^.  up  to  half  of  the  exercises  used  in  an  ass^ment  to  accompany  the 
da^a.  ^  - 


% 
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NBA  bcUcvcs  that  aU-not  just  hal£-of  the  cxerdscs  ahou^^  . 
foct  mtt  ^AE?  Uiurided  \>y  fcdcr^  contracted  (JoUars.  Actually,  t^c  proposed  FY  1980^^ 
Usibflice  of  Education  budget  had  the  following  testing  and  evaluation  fundsprpposed; 

•  ESEA  Title  I,  Sec.  183,  $16,5  million,  to  improve  state  .andiocal  evaluation^ftpassist- 
:  ing  districts  in  revising  their  polluter  program5,^in  selec^^^ 

ment  tests,  and  in  preparing  repoi^  for  local  s^ool  boards. 

.  ■  ■        ■  ■ ' .  .   .  • 

•  bilingual  Education,  ESEA  VII,  $6  million,  for  studies  and  evaluation,  including^ 
testing.  ,  ^ 

'  ESEA  Title  IX,  Sec.  922,  $2  million,  achievement  testing  assistance. 

•  ESEA  TiUe  IV,  D,  Guidance,  Counseling,  and  Testing,  $18  million,  for  assistance 


to^state  and  local  eduction  agencies. 

Educjfrtion  of  the  Handicapped,  Regional  Resource  Centers,  $7  million,  to  improve 
, .  the  use  of  testing  in  diagnosis  and  prognosis.     '  .  . 

Women's  Education  Equity  Act^amoynt  not  determined;  however,  justification 
for  ttie.vS  10  million  includes  fun^s  for  testing. 


NEA  believes  tiiar^  tests  or  evaluation^  measures  funded  from  federal  dollars  should  be 
made^ailable  to  tiie  indKidual  test  taker.  More<iver,  no  contracts  should  be  given  to  any 
company  that  .does  not  agr((K  to  provide  test  items,''studie8,*  or  use  information  to  the  test 
taker.  NEA  strongly  encourages  the>use  of  Euros*  concepts,  and  the  Nation^  Assessment 
of  Educational  Progress  d&  the  models  for  assessment  pQ)g|j^8  in  education. 

^Finally,  ike  NEA  refers  those  interehed  in  testing  reform  to    statement  nfade  by 
kobert  L  Thomdike.  In  tiie  first  chapter  of  Educational  Measurement,  Thomdike  ^amihes 
the  **8tate  of  the  art"  (1971)  of , testing.  Among  the  .topics  discussed  are  sequential  testing 
(tailoring  testing  to  each  specific  individual  being  tested)  and  itein  banks  and  compifter-  • 
generated  tests.  The  item  banks  concept  is  very  important  in  light  pf  the  proposed  legisla- 

tion  (H.R.  4949).  Thomdike  states:  y  /:  ■  . 

■      ^   '  '  '  ' 

Th6  large  meniory  storag^  available  in  nfbdem  computers  makes  it  p<>ssiblcr 
^         for  testing  organizationsTO  prepare  files  classified  by  content  and  levelm  ^ 
'  ,  whiph  larib  numbers  of  test  items  can  be  stored.  Stored  with  each  item  can  ^ 


.  '  *  V  be  aJl  tli^slimmMy  statistics  dew^^ 

crinUpttion;  When  a  test  is  then  de(di^ 

contSnt  coverage  and  difficulty  level,  an  appropriate  inquiry  can  be  ad- 
•  '  40f^  to  the  computer,  and  it  will  select  and  display  items  that  meet  the 

V^Sirications.  Final  assembly  of  the  test  from  among  the  items  offered 
'  *  froni  tile  library  of  items  in  the  computer's  memory  storage  can  be  made 
by  the  test  editoit  The  time,  however,  may  c|ne  when,  for  large-scale  ^ 
tes^g  progtams  wtth  frequent  admlnistrationrof  alternate 
test,  the  assembly  of  complete  test  forms  will  be  left  ahnost  entirely  to 
'  the' computer.  The  obvious  application  of  this  technology  is  to  large- 

scale  testing  programs  with  frequent  test  administratfons,  such  as  those  ^ 
of  the  College  Entrince  Examination  B(kxd  and  the  American  College  y 
.  Tcisting  Prognam.^  • 

In  conclusion,  NEA  strongly  ui%es  the  Congress  to  pass  this  vital  legislation  beCafise  it 
will  help  ensure  that  standardized  tests  will  hot'deny  equal  educational  opportunity  t6  all 
people.  ^  ^^  \^   •  '  'l 

^•^llibmdike,  Ro^en    tdiiox.  Educatio/ia! Measurement.  Second  cation.  WaiJilngton,D4C;:  American 
Couflcil  on  Educition,  1971.p.-6.  .  .  . 
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APPENDIXES 


A.     />J^A*8  Analysis  of  H.R.  3564  and  H.R.  4949 

^^NEA's  Letter  of  Support  to  the  Education  Commission  of  the  States 
regarding  the-  National  Assessment  of  Educational  Pr^ss 


Appendix  A 


Two  legislative  proposals  concerning  educational  testing 
are  before  the  Committee  on  Education  and  Labor.    The  first  ' 
proposal^ referred  to.  as  "Truth-in-Testing  Act  of  1979" 

(H.R<  3564)  ^  was^ntroduced  by 'Rep.  Gibbons,    The  second 

t  ^  ■ 

proposal:,  the  "Educational  Testing- Apt*  of  1979"  (H*R.  4949), 

was  introduced  by  Rep.  Weiss.    The  latter  proposal  (H.R..  4949) 

iA.Jxised  on  Ne^  York  legislation  proposed  and  passed- during  ' 

thq  suxnmer  of  1979,     .  > 

H.R.  3564  and  H.R.  iS^S  concern  the  use  of  standardized, 
tests,  a  subject  about. which  NEA  has  raised  questions  and 
.expressed  concerns.    Because  of  the- NEA ' cpncern  with  the  use 
of  stdndatdized  tests/  both  proposals  have  been  analyzed  in 
terms  ot  their  similarities,  thei|r  differences,  and  their 
responisivenes^  to  NEA  6oncerns;  /  *  -  ' 

'  ^   In  general,  NEA  believes  that  the  two  proposals  represent 
somewhat' different  approaches  to  the  use  of  standardized  tests, 
to  the^extent  that  H«R.  3564  . ^nd  H.R|  4949  are  responsive 
to  NEA. concerns/  both  proposals  should  be  supported.  The. 
Gibbons .^^Truth-in-festing  Act'^  (£[.R.  3564),  however,  is  ekpected 
to  generate  more  o{^ositic|n  in  Congress  and  could,  if  passed, 
prove  to  be.  a  less  successful  vehicle  for  meeting  the  concerns 
expressed  by  NEA,  .  ^ 

Both  H.R.  3564  and  H.R.  4949  represent  notice  and.'  '| 
disclosure  legislation.    They  differ  ifsubstantially  as  to  the 


/ 


'^40  I 


^n6. 

type  of  tests  covered^  the  extent  of  involvement  of  the  , 
Conmiissioner  of  Education  and  the  type  of  enforcement  p^ovisiqris. 
H,R«  3564  would  cover  the  National  Teacher  Exeunination  which 
i3  a  concern  of  NEA,    The  bill  would  also  cover  other  occupa- 
tional tests,  . which  will  .^ngender  opposition,  and  tests  other 
than  standardized  tests,  regulation  o£  which  would  probably^ 
prove  unworkable.     For  the  most  part,  the  disclo^re  require- 
ments of\Hr^t^3564  require' the  type  of  information  currently 
provided  voluntarily  by  testing- agencies  such  as  ETS.  Because 
H.R.  3564  does  not  require  disclosure  of  underlying  data  on 
'the  examinations,  it  would  not  enable  prof essionals coutside  the 
testing  industry,  including  teachers,  to  analyze  or. comment  on. 
test  construction  and  validity.    In' addition,  JJ. R.  3564 
^ails  to  provide  for  disclosure  of  Scoring  data  in  addition 
to  test  scores  which  may  be  given  to  educational  institutions. 
Groups  favoring  testing  disclosure  laws  have  stated  that 
testing  agencies'  provide  information  such  as  suspicions  of 
cheating,  unacknowledged  repetvtfQn  of  a  test  and  factors 
based  on  current  school  attended  to  be  used  in  evaluating . the 
score.    Studentis  have  not  been  informed  of  this  type  of 
information  where  it  is  incorrect.     In  addJLtion^  students  have 
not  been  provided  with  their  test  answers  and  the  correct 
answets.    Thus,  students  have  been  unable  to  learn  of  or  . 
correct  computer  grading*  errors.    The  Gibbons  bill  does  not  . 
^  address  this  i^roblem  either,  .\ 


In  contraist,  each  one  of  the  Instances  nottd  above  is 
addressed  in  the  Weiss  bill  with  the  exception  of  occupational  ' 
testing*    Various  portions  of  the  Keiss  bill  could  use.  clearer 
and  better  language.    In  addition^  some*  consideration  should   .  ^ 
be  given  to  the  viability  of  including  financial  reguiation 
of  the  testing  companies  in  this,  legislation. 

In  addition  to  standardized  tests,  H.Rjp3564  covers 
"oral" .  tests  r  "practical"  tests  and  "dejpon'btration"  examina- 
tions.. Sec.  2(3).    The  bill  apparently  reaches  practical  or 
demonstration  examinations  usfed  in  occupational  licensing, 
such  as  barbering,  oral  examinations  such  as  the  foreign 

service  exaininations,  and  practical  or  demonstration  examiha- 
tions  usied  in  educational  admissions  such  as  submission  of  a 
portfolio .  to  .an  art  school  or  a  stage  performMce  required  for 
&  drama  school.    Regulation  of  such  tests  would  probably  be 
^workable.  .  , 

.  H.R;  3564  contain?  both  pre-test  (S^.  6(a))  and  post- 

te6t  (Sec.  6(bj)  disclosure  requirements  which  require  informa-^ 
'       ■■'  ■  ^ 
tion  to  be  provided  to  test  tetkers.    Prior  to  administration 

;  of  the  test/  each  applicant:  must  be  provided  with  a  written 

^|U>tice  containing  essentially  the  types  of  information  currently 

provided  voluntarily  by  the  .testing  companies: 

(1)  .  a*  detailed  deiscription  of  the  area  of 

J  ^  ^  knowledge  or  the  type  of  aptitude  thajb  the 

;  test  atteiq>t8  to  analyze^ 
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(2)  '  in  Ihd  case  of  .  a  t^st  of  I^now^edgei  ^a  detailed 
dedorlptipn  of  the  sub^^ts  to  be  tested; 

(3)  the  mai^gin  of  error  or  the  extent  of  reliability 
Of  the  testi  determined  on  the  basis  of  iexperimental 
uses  of  the  test  and,  v/here  available^  actual  usage ^ 

(4)  the  manner- .in  which  the  test  resultJS  will  be         .  -  • 
distributeif  by  the  testing  entity  to  the  applicant 
«md  t a  other  persons;  and 

.  tS)  •  a  statement  of  thbi  applicant ' s  6)08t-test  .notification) 

rights,             "     '    .                  .      '  f 
The  post-test  notification  provision  requires,  that ^  ^ 
promptly  upon  completion,  of  scoring"  the  test  taker  must  be 
notified  of:  /  ■  *  — ^^^^^^ —  -^^ 

(1)  the  individual's  specific  performance  in  each  of  • 
the  subject  or  aptitude  aree^s  tested;  '  *. 

(2)  ho^  that  specific  performemce  remked  in  relation 
to  the  other  individuals  and  how  the  individual  . 
ranked  on  total  test  per fprmanpe;  I 

^  <      (3)    the  eoore  requin^d  to  pass  the  test  for  admission  to 

I      duch  o^upai^il^  or^  the  score  which  ie  generally  required 
^      ;       for  admission  to  institutions  of  htgher  education; 
(4)    any  further  information  v;hich  may  be  obtained  by  the 
Individual  Oh  request. 
^'      Sectioh  6(c),  the  f:rihal  substantive  provision  of  the  ^ 
bill,  prohibits  the  scoring  of  achievement  tests  on  the  basis  | 

b£  k  e^arvef  •       ■      '    ■■    *  -i  \ 

•>  V;.     r    ;  , ,   .  ■.;  ^    \  : 


.4^  . 


t 
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(c)    Ho  (fiduc^tlonal  otj  occupational  admissions  test  which 
tests  Knowledge  qr  achievement  (rather  than  aptitude)  ; 
shall  be  graded  (for  purposes  of  determining  the 
.       score  required  tc|  pass  the^est  for  admission)  on  the 
.  »    basis  of  the  relative  distribution  of  scores  of  other 

I  •  test  subjects. 

Il        '  the  enforcement  j^jfovijs 4.0ns  of  H.R.  3S64  (Sec« 

authorize  private  causes  c^f  action,  by .  aiN^^rieved  individual 
**Whenever  any  person  has  adngdhistered  or  there  are  reasonable 
gxaunds  to  believe  that /any  person  is,  about  to  administer  any 

test  in^^olation yof  this,  act."    The  bill  specifically  ' 
provildes  f qr  "preventive  relief  **;  including  a  permanent  or        f  , 
.  ten^orary  injunctipn  and  restraining  orders  and  for  appoihtnent 

of  counsel  "in  sjiiqh.  circumstances  as  the  cqurt  may  deem  just«" 
^|Che  bil^  autho^^       attorney *s  fees  (Sep.  7(b))  and  provides  fpr 
&deral  court,  proceedings  without  regard  to .  exhaustion  of 
remedies  y^Seb.  7(c)*  ^ 

jii^  enforcement  procedures  af  injunction  or  restraining 
'Ordeaf  Represent  onerous  temedies»and  it  seems  doubtful  that 
.'  f^eral  courts  will  be  inclined  to  enjoin  the  administration 
of  standardized  tests  such  as  the.  SAT«    For  this,  reason,  the 
remedies  pjpvlded  byv^e  bill  appear  to  be  ineffective!  Since 
i  the  bill  specifically  authorizes  "a  civil  action  fpx  prSvjentive,  _ ! 
.  Mlleff  courts  may  fin(|  thai:  such  relief  is  the  exclusive 


senary  for  violations  o^ 


the  Act. 


! 


■^^   .    ^  --i-. 


The  "Educational  Testing  Act  of:  197;9V  (H.R.  4949)  identifies' 
three  legislative  .pUrpo;ses  (Sec,  2(b))  t. 

(1)     to  ensure  that  test  subjects  and  persons  who  use 
•  .  test  results  are  fully,  aware  of  the;characteristics , 
uses,  an^  limitations  of)  staridardized  tests  in 
'  .  postsecohdary  education  admissions;  y  . 

to  make  available  to  the  pfublic  appropriatjte  informa- 
/Vtion  regarding  the  procedures^  development,  eind 
.administration  of  standaVdizec^  tests;  and  '  ^.; 
(3)     to  protect  the  public  interest  by  promoting  ^re 

depend^able  knov/ledge.  about,  thej  limits  of  appropriate 
usage  o€  standardized  test  re^lults  and  by  promcting 


greater  i^ccuracy,  validity,  an^  reliability  in  the 
development,  administration,  a^d  interpretation  of 


«  .        standardize^  tests. 

This  bill  requir^  more  extensive  pre-test  disclosure 
,to  test  takers  than  H.fL  3(564  and,  unlike' H.R-'  2564,  specifi- 
calljr  requires  that  the\prei-\test  notice  be  provided,  contempo- 
raneously with  the  test,  ](registration  form.l  Sec.  3(a)  ^  The 
legislation  specil>ically  Addresses  the  coachabiiity  issue  and 
requires  testing  agencies  vto  inform  individuals  of  the  ektent 
to  which  their  scpres  may  be  improved  by  taKing  a  preparation 
course.    Pre-test  notice  must  include  the  fallowing  information: 

(1)    The.  puinposes.  for  which  the  test  i^  constructed 
and  is  intended  toibe  used. 
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(2)  The  subject  matters  Included  on  such  test  and  the  / 
kncywledge  and  skills  which  the  teist  purports  to 

. .  •    measure*  ■ 

(3)  *  Statements  designed  to  provide  information  for  * 

interpreting,  the  test  results i  including  explanations 
*o£  the  tes^#  and  the  correlation  betx<;een  test  scores 
and  future  ^success  in  schools  and^  in  the  case  of 
tests  used  for  post  baccalaureate  admisslops^  the 
correlation  between  test  scores  and  success  in  the 

career  for  which  admission- is  sought. 

i  t 

(4)  Statements  concerning  the  Effects  on  .and  uses  of 

test  scores,  including  *— 

(A)  ',  if  the  test  score  is  used  by  itself  or  with 

other  information  to  predict  future  grade  point 
*      average,  the  extent,  exprejssed  as  a  percentage\  Jto 
which  the  use  of  this  test  score  improves  the^ 
accuracy  of  predicting  future  grade  point  averagei^ 
over  and  above  all  other  information  used;  and 

(B)  a  comparison  of  the  average  score  and  percentile  s  . 

of  test  subjects  by  major  income  groupjs;  an^ 
■  ■  "     •      ■     ■      ■  ■    ■  ■    ■     '      "      '  ' 

(C)  the  extent,  if  available  to  the  test  agency,  to 

which  test  preparation  courses  Improve  test 
subjedts*  scores  on  average,  exptesse^d  ^  ^ 
percentage^  * | 

(9)    A  description  of  the  form  in  which  test  sisores  will  be 
reported,  whether  the  raw  test  scores  will  be  altered 
in  any  way  before  being  reported  to  the  test  subject. 


i 
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and  the  manner,  i£  a^y^,  trfe  test /agency  \fiXl  u^e  the 
test  score  (In  raw  or 


transfo];ine4  form)  by  itself  or 
er  information  about  the  test 
any  way  the  subject *s  future 
for  any  po^tseconcSary  educationail 


together  with  any  otl" 
subject  tcl  predict  ir. 
aciiden^c  performance 
institution, 

i 

(6)    A  complete  descriptidn  of  .emy  prcnnises  or  covenants, 
that  the:  test,  agency  madces  to  the  test  subject  with 

'   N   regard  to  accuracy  of  scoring/  timely  fomrarding  or  - 

I        ■  ■      ■  ■  "  .     ■  ■ 

"score  reporting i  and  privaoy  of  information  (including 
..test  scores  eu\d' other  inform?ition*)  ,  relating- to  the 
test  subjects,  ' 
(7.)    The  property  rights  of  the  test  subject,  to  the  test 
results,  if  any,  the  duration  for  which  such  results 
will  be  retained  by  the  test  agenoy,  and  policies  \- 
regarding  storage,  disposal,  anpj*  futUre  use.of  test  ./ 
scores, 

(8)  The  date  by  which  the  test  subject  's  test  jiore  will  jte 
^  cpmpleted  and  mailed  to  the  test  subjecW 

(9)  A  description  of  special  services  to  accbmmodatll 

phys.ioally  handicapped  test  ^subjects. 

■    I  . 


Ins^itutiohs 


The  phras^  "^and  other  information**  was  added  by  V/eiss*  staffs 
subsequent  to  conversations  with  NfiA;  Significant  questions 
®?       2l  ^^^^       ^'^^  °^  personal  data  obtained  on 

Jhe^tei^  or  test  application.    ETS  i^ells  student*  lists  to 

■•■■<»    .      ,  ■  ■  ■ 


\. 

\ 


In.  addition  to  providing  notice  to  test  subjects,  Ithe  bill 
r^quitM  tbe  testing  agency  to  provide  the  aamV  information  to 
the  riftcipient  institution  prTor  to  or  coincident  with  the  *]^epor ting 
o£  teit  scores.  •    ;    ■         .  ■• 

The  major  area  covered  b^^.the  Weiss  bill  is  reporting  to 
governmental  educational  agencies.    Two  types  of  information  must  . 

■  .■  ■■       ■  . .   ■  •  ■      ■■  •  •  ■  •  ■;• 

be  disclosed  to  the  government,    Fir&t,  this  reporting  require- 
nent  concerns  the  studies  and  evaluations  of  the  tests  them- 
selves and  is  designed  to  allow  professionals  outside  the  testing 
industry,  including  teachers,  .a'cjcess  to  such  studies  t6.  allow 
independjenl^  analysis  of .  the  construction,  validity  and  use  of  the 
teai^s.    The  secbt^  pype  of  informatipn  to  be  J^splosed  includes 


th#  test^^stiohs^d  answers  an^. soring  rules,  ^his  is 


accomplished  by  croiss-reference  tg  th'e^  Freedpm  of  Information 
Act,  5' U^S.C.  S  ?52 [a)  (3) ,  whidh  authorizes  relea^se  of  records .j 
The.  test  agency.  ls,]required  to  provide  to  th^  Commissioner  of  . 


Education: 

.    ;  -  (A)    Wiy  ''  study 
pertaini^^ 
causes  to 
Nothing  in 


eveduation,  I  or  statistical  repoxrt 

>   ■  ■      ■  • 

tp  a  test,  which  a  test  agency  prepares  or 

be  prepared,  or  for  which  it  provides  data. 

this  paragraph  shaM  require  8ubmissi9n  of 


any  reportis  or  documents  containing  information 
identifiable  with  any  individual  test  subject. '  Buch 
'  information\  shall  be  deleted  or  obliterated  prior  to 
submission' tip  the' Commi.ssiclner,  [and] 
(1)  shall,  wiVhin  30  days  ^^,ter  ^the  results  of  any 
standardize^  test  are  xeleased,  file  or  cause  to 
be  filbd  in        office  of  the.  Commissioner 


uc 


(a)  a  ^opy  b£  all^o^^^^ps^^pns  used  In 
oa^cutatrng  th^  J:est  sulj^ject's  raw'  score; 

(b)  th€|  carrespondiii^  accepte^Cle  cinswers  to  those 
•  !/                           que'ationis;  and/      \     '■  ■  .  ' 

j  .  .  .  to)    alll  ijules  for  transf erring. *raw  sc^es  into 

tho^e  scores  reported  to  the  t^st'subject  arid 
.    >  porfts^econdary  educational  institutions  together 
with\^an  explanation  o£  such  icules. 
This,  data-in  addition  to  being  made  available/ pursuant  to 
the  Freedom  of  Information  Actf  mudt  be  made  available  by  the 
Commissioner  of  Education  to  state  educational  agencies  and 
commissions.  *  V 

The  testing  agency  must  also  provide  the  questions/,  the  *  « 
correct  answers^,  and  the  test  taker^s  answBrs/<as  well  as  scoring y 
information^  to  the  test  subject  qh  reqv;est  for\  a  ninety-day  period 
subsequent  to  ^release  of  the  tqst  scores. 

Furthermpre^  the  legislation  requi^^res  the  Cpmmissioner  of 
Sducatioh  to/ pre pare  for  Congressvem  evaluati(^  p£  the  data  on 
these  tests,  both  wi&  regar^  to  coachability  and  . cultural 

(b)    The  fcomraissioners.  [sic]  shall  report  to  Congrass  ^ 
wlthift.one  year  of  the  effective  date  of  this  Act 
concerning  the  relationship  between  the^test  scores 
of  test  subjects  and  income/  race,  SGK^  ethnic,  and 
hai^dicapped  status*    Such  report  shall  include  an  i 
V        evaluation  of  available  data  concemihg  th^  reiji^ation-* 


-I 


shit  between  test  scores  ^nd  the  completion 
6^  test  prepax^tipn  courses.      .  ^   _ 


The.  major  difference  between  the  Weiss  draf/and  the  New  York 


.  law  \upon  which  it  is  based  is  an  attempt  in  the  federal  legislation 
y  to^  rlpg^late  thl  costs,  t^  test  subjects  of  i^hetests  and  tp  requira 
\  ^    financial  disclosures  by  the  testing  companies .    During  the  New  '  I 
York  Kearingfif ,  the  testing  companies  argued  that  costs  would  sky4 
rocke^    .  Protonents  of  the  New  York  legislation,  New  York  Public,' 
Interest  Reseai;ch  Grou^  and^  Nader  in  particular,  questioned  these, 
predictions  using,  whatever  data  they,  could ||pbtain  from  the  testing 
companies,  e^ecially  ^TS.    Section  7  of  thAbill  entitled 
.  "Testing  Costs  and  Fees  to  Studehts"  provides  as  follows; 

■  ■   ■  ■■■■   ■  ■■■■■    '  \  '  ■ 

In  order  to  ensure  thatt  tests  are  being  offered 
at  a  reasonable  cost  to  tc^  subjects,  each 
test  agency  shall  report  tHe.  f olldv/ing  informa- 
tion to  the^^fonunissioner:- 

'  ,    (1)  •BLfore  March  31,  11981,  or  within  90 

days  after' it  first' becoraels  a  test,  ^agency ,  v/hich- 
.  ever  is  later,;  the  test  agency  shall  report  the 

.         closina  date  of  its  testing  year.    Each  test  agency 
shall  Jteport  any^  change  in  the  closing  data  of  its 
testiftg  year. within  90  days  after  the  change  is 
made.  I 

(2)    For  each  test  program,  within  120  days  after 
the  close  of  the  testing  year  the  test  agency  shall 
report-*-  r   •  .  ^ 


(A)  the  total  nimber  of  times  the  test  was 
-  —  taken  du2#ng"i:he- testing  year;  • 

(B)  t^^e  number  of  test  mjibjects  who  have  taken 

r      tte  test  once,*  who  Wve  taken  it  tv/ice,  and 

who^ave  ta>;en  it  more  than  twice  during         .  ^ 
the  testing  year;  ^ 

♦      ♦  .  .  •  ■ 

(C)  the  number  of  refunds  given  to  individuals 

who  have  registered  for,  but  did  not  take,  J|ie  test; 


(D)  the  nuinbei  of  test' subjects  for  whom  the  teat 
fee  was  wSived  A: [reduced;  y 

(E)  the  total,  amount  .'of  feei  received  from  the  test 
subjects  by  jfcha  tost  agency  for  each  test 
program  ^or  that^test  year; 

(P)  the  tot^l  amount  of  revenue  received  from  each 
test  prbgram;  and  v  .   '  * 

(G)  the  expenses  to  the  4:est  agency  of  the  tests, 
including  —  ' 

(i)  expenses  incurred  by  the  test  Mency  for 
each  test  program?  J 

(ii)  Expenses  incurred  for  test  development  by 
the  test  agency  for  each  test  program;  and 

(iii)  all  expenses  which  are  fixed  or  can  be 
regarded  as  overhead  expanses  and  not 
associated  V7ith  any  test  program  or  with 
test  development; 


(3)    If  a  separate  fee  is  charged  test  subjects  Ror 

admissions  data  assembly,  services  or  score  Treporting 
services,  within  120  days  aft et  the  close  of  the  ,  i 
teating  year/  the  test  agency  shall  report  — • . 

(A)  the  number  of  individuals  registering  for  each 
.1      admissions  datai  assembly  sexjvice  during  the* 

testing  ydar;  ,  » 

•* 

(B)  the  number  of  individuals  registering  for  each 
score  reporting  service  during. the  testing  ♦ear; 


\ 


1 


(Ca    the  total  amount  o|  revenue  received  frpm  the 

individuals  by  .the  test  agency  for  jeach  admissions 
data  assembly  service  or  sjcore  reporting  se'rvice 
during  the.  testing  year;  and 


(D)    the  expenses  to  the  test  ag'ency  for  each  ; 

admissions  data  assembly  service  or  score  reporting 
service  during. the  testing  year.  . 

\  .■   ■    ■  '  ■'-■/• 

The^li^eiss  bill^  like  the  New  York  legislation;  uses  a 

civil  penalty  as  its  remedy,    l^ile  the  New  York  law  establishes 

a. $500  penalty  per  violation!  the  . federal  law  establishes  a 

$2^000  fine;    This  would  represent  a  small  penalty  where  the 

testlluiihcy  failed  to  properly  report  to  the  Commission  of  f 

■  *  ■    :  L  ^ 

Education  since  this  would  probably  constitute    a  single  *. 
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violation.    With  regard 'to  violations  of.  the  notice  to  ^tudents 
the  penalties  could  be  substsmtial  since  presumably  failure  to 
provide  the  required  notices  to  students  would  result  in  multiple 
.violations  reflecting  the  nurtber  of  students  involve<^..  One 
■potential  difficulty  in  enforcement  may  be  in  determining  v/hi.ch- 
and  hov/  many  -individuals  were  not  given  proper  notice  or  timely 
reporting.    The  Commissioner  is  authorized  by  the  draft  to 

promulgate  regulations  to  implement  the  legislation  ^nd 

•  •  •      .  ■.;  •  ^■ 

.  enf orcem&nt  would  be  one  area  wjiere^  regulations  might  fill  in  the 

•■*■-■  n 
sketch  created  by  the  .draft  legislation. 

The.^eiss  bill  would  require  disclosure . to  students  of 

.  covenants  and  promises  madi^  by  the  testing  agencies.  Private. 


causes  of  action  by  test  takers  could  be  based  on  breaches  of 
these  contractual  warranties.  / 
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NATIONAL  EDUCATION  ASSOCIATION  •  laohethSt.N.w., vyi»hingiort.DC  20036 

JOMNBYOR,PrwW.n»  Tf  HHT  MMNOON. - 

WILIAUD  M.  MCGUWE,  Vtet^MiWtrt  ■  • 

JOHN  T.  MCOARI^.  8KrM«ry-TrM«urtr ....  , 

Jiille  8,  1979 

?    ■    .  •  *; 

Dr.  Warren  G»  Hill 
Executive  Director  v.  - 

Education  Commission  of  tl^e  States  .  ' 

I860  Lincoln  Street  .  ■  , 

Denver,  Coldi^^do    80203    ^   '.  ' 

pear  Dr  ,  .  Hill  :        *  /  . 

The  National  Education  Association  strongly  suppo^s  the 
Education  Commission  of  ihe  States^  application  .to  continue 
as  the  organization  responsible  for  the  National  Assessment 
of  Educitional  Progress.    The  National  Assessment  has  gained 
resp«|ct  from  teachers ,  administrators ,  and  educational  policy 
makers  at  all  levels  of  .  tlie  education  community  , over  the  last 
fifteen  years  >  ^  '  ' 

N^A  advocates  .measurement  techniques  and  approaches  which 
help*  policy  makers  formulate  intelligent  decisions  about 
school  programs.    The  NatiorfesTT^sessment  has  j>rovided  this 
inionliation  in  the  past  and  it  is^ipped  that  the  program  can 
be  extiBndod  down  into  the  local  scm^  districts  to  replace 
the  c^urrent  fad  ot  competency  testing. 

NBA  strongly  supports  the  makeup  of  the  National  Assessment  . 
.  Policy  Committee  which  includes  teaieher  representation  on 
the  ^committee  •    The  Association  would  urge  that  the  Federal 
Government  continue  this  practice  and  require  that  teachers 
be  represented  on  the  National  Assessment  Policy  Committee  \ 
'in  direct  proportion  to  their  national  membership.    The  four 
.    teachers  on  the  committee  should  be  deii^gnated  by  the  majority 
Organization^ or,  if  |thj.s  is  not  possible,  allocated  to  teacher 
-    oraanitations  accQraxng  to  membership.    Adminietjpixb):  and 

Bchool.  board  orgjpiza.tions.  should  designate  their  representatives. 


The/llEA  recommends  that  the  ECS  be  granted  the  funds  to  contJipue 
thcrHAEP. 


Sincerely I  * 


Terry^ejq^don 
Executive  Director  ^ 
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Chairman  Perkins.  Mr.  Gould,  the  maih  point  of  controversy 
regarding  th^  Weiss  bill  is  over  the  requirement  for  disclosure  of 
the.  tests  themselves  and  of  all  ot  the  corrected  answer  sheets. 

Could  you  tell  us  again  precisely  why  the  General  Accounting 
Office  opposes  the  imposition  of  this  requirement  on  the  Federal 
Government?  - 

Mr.  •Gould.  One  of  the  primary  reasons  is  that  there  firould  be  $i 
substantial  economic  burden  if  the  Federal  Government  were  re- 
^  quired  to  provide  copies  of  test  questions  and  te9t  answers 'to  all 
examinees.  Such  procedure  would  also  preclude  the  reuse  of  any  of 
those  test  items..  • 

New  ones  would  have  to  be  prepared  each  time  a  test  is  given, 
and  this  has  technical  implications.  The  cost  implications  ,  are  illus- 
trated in  an  example  prepared  by  0PM.  The  government's  clerical 
exam  is  administered  nationwide  every  working  day.  If  test  items 
were  disclosed,  250  separate  and  unique  exam  booklets  >yould  be 
needed  each  year. 

:  It  takes  about  one  staff  year,  at  an;average  salarj^  of  $20,000,  to 
prepare  a  clerical  exam  booklet  using  existing  questions.  This  does 
not  include  additional  administrative  costs  required  to  insure  that 
the  same  test  is  given  nationwide  on  each  day  so  that  applicants  iii 
one  area  do  hot  benefit  from  disclosure  in  another  area.  . 

The  administrative  problems,  budget,  and  staff  requirements  are 
mult^lied  mtany  times  when  more  complicated,  higher  level  exams 
are  us^.  To  develop  the  current  pool  of  items  for  the  PACE,  for 
insfanc^  required  a  total  of  52  staff-years  of  effort  over  a  five-year 
period,  ^d  the  cost  and  workload  estimates  I  have  just  provided 
are  for  test  development  only.  They  do  not  cover  the  very  time- 
consuming  and  costly  process  of  validating  the  test  once  it  is  devel- 
oped. ^  ^ 

From  the  technicarstandpoint  there  is  finite  limit  to  the  number 
of  new  questions  that  can  be  developed  in  any  su^ect  matter  area 
without  quality  deteriorating  to  a  level  that  thf  exam  would  no 
longer  be  ajti  effective  means  of  evaluating  people  for  ^ployment. 

In  the  second. place,  a  group  of  common t questions  is  needed  in 
each  version  of  a  test^so  that  adjustments  can  be  made  for  differ- 
ences among  the  versions  in  average  difficulty.  Only  in  this  way 
cfui  a  score  have  the  same  meaning  on  one'  version  as  it  has-on 
another  Disclosure  would  m^ike  it  impossible  to  Ijiave  a  common 
group  of  questions.      ^  >  S 

Chairman  Perkins.  Now,  what  in  your  judgment  would  be  the . 
'additional  cost  required  under  the  Weiss  bill,  assuming  that  it  were 
adopted?  ^  . 

Mr.  Gould.  There  would  have  to  be  a  .test  prepared  each  time 
those  questiorts  aiiil  jrfiswers*were  provided  to  the  test  applicants, 
and  we  are  talldng  about^aHest  that  135,000  individuals  topk  in. 
1^78;  of  which  11,060  p^3B^d  mfh  scores  of  ?0  or  abov^;  and^ 7,600 
were  hired.  Thk  test  is  given  four«times  a  year,  so^you  would  need  . 
four  separate  tests.  ^  This  test  '^tooK  an  average  of  5  year*  jiist^o 
.develop  the  test  and'  there  has  b^n  extensive  research  going  on  to 
show  the  vdidity  of  this  test  wjueh  is  also  a  very  costly T)rocedure; 

Ea6i^6f  thepe  teSts  would  hav«  to  ba.showfl  to  be  j^b-related  to  be 
able  to  use  it.  If  you  didn't  havl  gooa  validation  you^  would  end  up 

.1       ■•■  v,v    -  . 


with  miany  of  these  tests  in  the  courts  trying  to  determine  whether 
they  were  or  were  npt  job-related.  » 

Chair Perkws.  Sticking  to  the  Weiss  bill,  could  you  give  us  a 
figure  of  tne  additional  cost  in  your  judgment  that  would  be  in- 
volved if  it  were  adopted?       •  * 

Mr.  Gould.  Perhaps  we  ought^tb  consult  with  the  0PM  people 
that  provided  the  validation.  It  took  $2  million  to  develop  the 
PAGE  test,  not  including  the  validation  costs,  so  it  would  be"^ 
substantial  amount  of  nioney  for ^aqh  test. 
Ghairmaii  Perkins.  Mr.  Erdahf? 

Mr.  Erdahl.  Mr.  Gould,  I  have  before  me  here  a  report  from  the 
Comptroller 4  General*,  a  report  to  the  Congress  involving  testing 
that  game  out  .on  May  15j^^9. 

Are  other  studies  likeiH^P|||ng  prepared  at  the  present  time,  or 
has  there  been  one  sUbsSm 

Mr.  Gould.  No,  sirf  thelyfeth^  that  we  have  made  in 

that  area.  We  have  i^ecpmHH  that  0PM  collect  data  on  the 
race  and  sex  of  the'appU'c1^PS?Taking  the  tests  so  that  they  can 
come  up  with  comparaWe  kinds  of  information  in  the  future. 

You  may  note  from  th^t  particular  report  that  it  was  very  diffi- 
cult for  Ais  to  ^et  information  on  the  race  arid  sex  of  individuals. 
\    We  had  to  db  it  by,  taking  social  security  numbers  of  the  indiyid- 
•  S  uals  who  sat  for  the  examination,  asking  .Social  Security  Adminis- 
"  tration  to  identify  in  gross  numbers  fbf  us  the  race  and  sex  of  those 
individuals. 

•It  is  a  very  difficult  and  time  consuming  review  which  took  in 
the  neighborhood  of  about  2  year^  of  our  time  to  do. 

Mr.  'Erdahl.  You  said  there  is  another  study  that  involves  more 
about  race  and  sex,  how  people  do  in  the  *i8t.  Is  that  what  it 
applied  to?  :      ■  ■        .  ' 

Mr.  Gould.  0PM  now  is  collecting  that  kind  of  information  on  a 
routine 'basis  so  they  can  prpvide  you  that  kind  of  information  on 
current  tests. 

Mr.  Erdahl.  Your^  main  concern,  to  echo,  I  guess,  the  ^estioh 
that  the  chairman  dsked  and  you  responded  to,  is  that  really  it 
would  be  a  cost  burden.  I  have  the  assumption  from  what  your 
statement  said  that  you  still  were  going  to  have  to  do  some  type  of 
a  selection  process  to  try  to  pick  the  tjualified  employees  for  ,the 
'  Federgil  Government.  t 
'  ^;^J8[rrGoULD.  That  is  correct,  sir/  We  are  very  concerned  that  the 
test  itself  does  screen  out  a  large  proporti^  of  minorities  Compared 
with  nonminprities.  V 

We  Jiave  asked  0PM  to  look  at  alternative  procedutes  that  are 
equally  valid  in  terms '  of  selecting  qualified  people,  vfa  do  not^ 
'  know  of  any  ialternative  at  this  point  in  time  which  would  allow 
ypu  to  screen  the  large  number  of  individuals,  that  haye  to  be 
screened  for  FederaLemployment.  j 
^  We  believe  that  some  sort  of  screening  }^  necessary,  ^at  least  until 
a  suitable  alternative^  is  found. .  .  ^ 

Mr.  Erdahl.  Maybe  ybu  were  at  some  of  the  other  hearings  on 
this  subiect,  but  several  of  us  talked  about  the-concern  over  this  so^ 
called  triith  in  1;esting,  because  certain  groups  of  peopje  do  poorly 
in  the  tests:  V  • 
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We  ^adt  tt^  cpmp^ison^  we  are  shooting  the  messenger  becatifie 
"id  Tnews;  What  really  concer  A  us  is  that  there  are  some 


he  bri^9  bad^ews;  What  really  concerA  us  is  that  there  are  so] 
'■'  flaws  ingthe  eduj^tiolaL system  it^lf  that  people  are  not  receiving 
the  prdper  edacalion|i  oppoi^unities  to  do  well  in  the  tesr,  and  if 
that  )s  the  case,  we  Bfe  putting  our  emphasis  in  the  wrong  area 
and  taking  after  the  test,  when  maybe  we  should^  talking  after 
thfe  system.  %  •  ^ 

Mr.  Chairman,  I  have  no  further  questions  at  this  time. 
v»  jMr.  Weiss.  Let  me  apologise  for  arriving  late.  I  am^not  in  the 
hesA  of  shape,  as  you  can  tell  from  my  voice.  That  may  hk  of  benefit 
J^Bveryone,  Wause  r  will  limit  » 
^  I  understand,  Mr.  Gpuld>  in,  you^  prepared  testimony  you  had 
■M    indicated  that  there  would  be  a  problem  of  costs  in  the  develop- 
^    ment  of  new  test  questions  if  H.R.  4949.  wep  to  be  adopted;  is  that 
correct?       "  ; 

iMr.  Gould.  Not  only  in  term6  of  costs  but  the  feasibility  of 
coming  up  with  continually  neW  items  for  the  test.  There  is  n^an 
unlimited  supply  of  que$tions  that,  would  be  valid.  We  also  ported 
out  that  with  the  new  test  you  would  still  have  the  extensive 
validation  process  that  you  have  to  go  through  to  ishow  jdb-related- 
ness,  so  it's  more  than  just  the  cost  aspect. 

Mr.  Weiss.  Perhaps  you  testified  to  this  in  your  earlier  testimo- 
ny; would  ypu  give  me  spme  baokground  as  to  your  crederitialp  in  > 
the  testing  field?  J 

Mr.  Gould.  I  personally  have  none,$ir.  Dr.  John  Harper  is  me 
personnel  psychologist  who  spent  quite  a  bit  of  time  in  that  area, 
and  let  me  give  you  his  qualifications^  if  I  may. 

Mr.  Weiss.  You  personally  are  not.  testifying  on  the  basis  of  your 
own  knowledge  or  expertise,  but  on  the  basis  of  Dr.  Cameron's? 

Mr.  GouiiD.<No;  oh  the  basis  of  Dr.  Harper  and  the  other  experts 
within  th6  General  Accounting  Office.  I  am  not  the  expert  in  the 
General  Accounting  Officii.  Dr.  Harper  who  sits  on  my  right  here 
"    .  is.  •..  ■  . 

j  Mr.  JVeiss.  Perhaps  we  ought  to  get  his  credentials  in  the  record. 
/  Dr.  Hari^er.  I  have  a  doctorate  in  industrial  and  organizational 
jpsychology.  Is  this  the  type  of  mform^tion  you  ai;e  looking  for? 

Mr.  Weiss.  Sure.  ' 
^    Dr.  Har'per.!  I  received  ^y  masters  degree-  and  did  training  iftider 
4  Ted  CuretonrWho  was  one  of  the  leaders  in  the  f^eld'of  psychomet- 
ilcs,  one  of  Ahe  earn  ^  ^ 

I  haye  beimi  wOFking  in  the  General  Accounting  Office  for  the 
last  3  [or  4  yeatjKin  the  arfea  of  survey  research  and  evaluation 
research,  ana  particularly  looking  at  the  evidence  on  the  validity  of.  • 
the  PACENlev6loped  by  the  £!iv4|lJ^rvice  Commission  and  how  that 
fits  with  professional  pfiacticeSi  ^d  also  with  the  uniform  guideline 
requirement  of  the  Feoerieil  Government.  ^  • 

,  Mr.  Weiss.  Have  ^oiPhad  occasion  to  follow  any  of  the  testimony 
that  we  have  had  in  the  coutoe  of  the  series  of  hearinga  oA  H.R. 
4949?  o  . 

Dr.  Habper.  I  Bfn  not  familiar  with  411  df  thfi  testimonjr  that  you 
havQ  hem  devel^ing  on  these  two  bills/ but  I  am  familiar  with  • 
some  of  the  testitnotiy.  •   #  * 

Mr.  Weiss.  You  are^^familiar  " with  testimony- from  experts  who 
testified  here;  that  is,  people  wh^  ar|  involved  in  the  field  of 
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testing  although  not  associated^  with\  the  testing  industry  as  such, 
.  wbp  have  testified  as  to  the  problems  thiat  they  saw  in  the  tests 
themselves,  as  far  as  the  inherent,  although  probably  unintentionial 
biases  that  have  crept  in  on  the  basis  of  geography,  seic,  and  sp  on? 
Are'you  familiar  .with  that  aspect  of  the  testimony?  V 
Dr.  Harper.  Not  particularly  with  respect  to  the  testimonj^you 
,  have  been  taking  during  those  herfrijigs,  but  certainly  with  nfesBgct 
to  what  has  been  appearing  in  both  the  professional  and^umfc. 
•       literature  in  this  area. 

Mr.  Weiss.  Do  ;^ou  generally  share  that  sentiment  that  ind^ 
there  is  unintentional  bias  in  those  tests? 

Dr.  Harper.-  As  we  testified  before  Congresswoman  Schroeder's 
subcommittee,  the  question  of  bias  in  testing  is  a  very  complicated 
question;  and  it  nequires,  I  think,  a  definition  of  bias  on  the  part  of 
those  who  are  discussing  this  issue,  so  that  ilJPyou  were  to  talk 
~  about  bias  \i  terms  of  whether  or  not  a  testr  is  related  to  job  N 
performance  or  academic  achievement,  then  the  conclusion  with 
respect  to  what  is  appejiring  in  the  professional  literature  is  clearly 
tests  are  not  biased. 

If  you  were  to  talk  about  bias  in  terms  of  bow  different  groups^f 
people  perform  on  the  tests,  if  that  is  your  definition  of  bias;  lhat 
is,  that  some  groups  of  people  score  higher  on  tests  than  other 
groups  of  people  do,  then  tests  for  the  most  part  are  biased. 
Those  are  the  two  most  popular  definitions;  There  are  others. 
Mr.  Weiss.  Using  that  last  definition,  that  is,  of  different  groups 
of  people  doing  differently  on  the  examinations^^  again,  just  so  we 
agreej  as  to  Vhat  our  ground  rules  arenas  to  what  we  are  talking 
*       '  abputl  not  on  the  basis  of  some  people  scoring  higher  at  random  or 
lower]  ati  random,  but  entire  groups  on  thfi-'basis  of  sex,jor  geogra- 
^  phy  or  race.  Is  that  what  you  mean  by  saying  that  different  groups 

of  people  score  differently? 
V         Dr.  Harper.  Yes;  that  is  the  second  definition  of  bias  that  1 
would  use,  and  I  would' just  mention,  to  my  knowledge, ,  there  are  V 
.  ^  very  little  sex  differences  in  test  performance.  '  / 

Males  and  females  generally  perform  about  the  same  generally, 
although  thera  are  some  differenced.  *  - 
Mr.  Weiss,  Do  you  agree  as  to  that  second  definition  of  bias? 
J      .  There  is  validity  to  the  complaint  that  probably  unintentional  but 
nonetheless  there  is  in  fact  bias  in  those  tests? 
*     Dr.  Harper.  I  personally  and  professionally  wouldn't  because  I 
would  ask  the  next  question:  That  is,  are  these  differences  in  test 
score  performance  reflected  in  performance  oh  the  job  or  in  the 
educational  pichievement?  ^ 

Based  on  the  answer  to  that  next  question,  I  would  make  my 
decision  about  whether  the  tests  are  biased. 

Mr!  Weiss.  Again,  if  you  haven't  heard  the  testiniony,  it's  very  . 
difficult  or  unfair  for  me  to  press  you  on  it. 

*  if  you  reread  some  of  the  testimony,  read  some  of  the  testimony 
^.v    we  have  had,  you  will  in  fact  note  that  there  has  been  ^testimony 
before  us  from  people  who  are  expert  in  the  field  of  testing  who 
y  *-      /  have  testified  very  clearly  and  unequivocally^that  there  is  bias  in 
the  test  basis,  geography,  on  the  basis  of  race,  sex,  and  so  forth- 
Dr.  Harpb^R*  OK;  thkt  is  using  the  secohd  definition.  • 


Weiss.  Using  the  slbohd  definition.  Let  me  ask  you  as  to  the 
teBtimony  which  Mr.  Goum  gave  on  the  b^aisis  of  your  advice  and  on 
the  advice  of  yojir  experts  with  G AO.  #     "     '  , 

On  what  basis  do  you  come  to  J^he  conclusion  that  there  is  a  . 
,  finite  Tiumber  of  questions  that  could  be  asked  in  any  of  those 
'  various  areas  that  are  tested  by  the  standardized  tests*  and|,two^pn 
*whai  basis  did  you  come  to  the  conclusion  as  to  the  additional 
expense  involved  in  developing  additional  questions,  if  in  fact  H;R. 
4949  were  to  be  passed?  * 
Dr.  Harper.  On  our  first  question  relating  to  the^fittiteness  of  the 
univlerse  of  the  test  queStionSi  I  think  if  you  consider  for  a  moment 
particulariy  the  trades  test  area^  it  would  appear  intuitively  rea- 
sonable that  after  some  point  you  cainnot  generate  anything  otheV 
than  di£fereht>ways  of  asking  the  same  question;  that  is,  ydu  can 
only  generate  new  ways  of  asking  what  is  essentially  the  same 
question,  i 

Mr.  Weiss.  Assuming  for  oiir  purpose  that  is  true,  althotigh  not 
accepting  it  as  true,  H.R.  4949  does  not  in  any  way  address  itself  to 
trade  professional  testing.  It  simply  addresses  itself  to  admissionis 
to  institutions  of  postsecondary  education. 

Mr.  GouiD.  Our  tiestimonv  y^as  directed  at  extending  those  two 
bills  to  Federal  testing  which  wpuld^encpmpass  those  two  areas 
that  you  said  were  excluded  :from  the  legislation. 

As  it  is  now  written,  it  would  have  no  impact  on  the  Federal 
'sector,  but  we  were  asked  to  testify  on  the^ impact  it  might  have  on 
,  the  Federal  sector. 

Mr.  Weiss. 'Your  testimony  in  no  way  addresses  itself  to  or  ap^^ 
pli6s  to  H.R.  4949  as:  presently  written?  ^ 

-    Mr.  'GouCD.  Not  as  presently  written,  only  as  they  would  be 
extended  to  the  Federal  sectoi^. 

Mf.  W?I18S.  Thank  you  very  much. 

I  have  no  further  questions  ^  that  basis. 
I  Mi*.  Erdahi..  If  I  might  resi;^nd  to  your  line  of  questioning  to^the 
x^witnesses  h^e,  it  seemS'  to  me  there  is  a  certain  relevance  to  it, 
b^aiise  if  we  s^t^  this  applies  to  people  that  are  seeking^entrance 
to  higher  education,  but  that  the  same  principled  shouldn't  appl^  to 
the  many  thousands  of  people,  that  apply,  and  those  that  are  hired 
by  the  Oovernmen|i,  there  is  ^  definite  correlation,  b6cause  the 
Jtests  are  obviously  used  as  an  indication  of  the  person's  ability  to 
peHbrmr'm  an^  academic  or  occupational  gituaticln,  so  I  think  that 
their  testimony  is  relevant.— — -^-^^   l 

If  tl^ere  is  no  objection,  Mr.  Chairman,  i  would^like  to  have 
inserted^  into  the  record  an  amicle  that  appeared  in  the  NeW 
Times  oa  OctolKAp^S  of  tMs  month,  entitled  ''Test  Publishers  See 
Droppifig*bf  Exans,'^  and  the  second 'one  is ''Most  Entrance  Tests 
RfovMinState^^^^  .  , 

we  understand  that  this  bill  is  patterned  after  the  New  York, 
law,  and  author  of  that  law,  Seniitor  LaValle,  acknowledged,  that 
the  economic  codt  of  gpecial  administrations  type  of  tests  posed 
legitimate  problems,  ne  said  he  planne<}  to  convenl^  the  State 
Higher*  Education  Committee  to  discuss  possible  changes  in  tlfe 
legislation.  i  .  v  v 

Such  changes  could  be  made  when  the  legislapure  convenei  prob- 
ably in  November^      a  date  for  pritnary  elections.  It  seems  tb^ 
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me  that  even  in  New  York  where  this  conce]|)t  is  being  implement- 
ed there  are  already  questions  about  it;  so  I  hope  that  we,  on  this 
committee,  would  also  be  willing  to  investigate  those  questions. 

Mr.  Weiss.  Without  objection,  that  will  be  entered  into  the  rec- 
ord.|> 

[The  newspaper  article  referred  to  follows:] 

(From  the  New  York  Times,  Oct.  8,  1979]  .  ' 

Test  Pubushers  See  Dropping  qf  Exams 

.  SAY  NEW  YOHK's  "tRUTH"  LAW  WIU.  CUT  MOST  IN  ADMISSIONS  USE 

.  (By  Edward  B.  Fiske) 

*  *  ■  ' 

Three-quarters  of  the  standardized  college  and.  graduate  school  admission  tests 
covered  by  the  so-called  ''truth  in  testing"  law  in  New  York  State  will  probably  not  * 
be  given  in  the  state  after  the  lawrgoes  into  effect  Jan.  1,  according  to  the  State 
Education  Department.  . 

Sponsors  and  publishers  of  20  of  the  26  tests  covered  by  the  law  have  concluded 
that  it  is  economically  impossible  to  comply  with  the  requirement  to  publish  ques- 
tions within  30  davs  of  reporting  students'  scores,  according  to  David  R.  Bower, 
administrator  of  the  office  of  post-secondary  assessment  and  testing  of  the  Educa- 
tion Department.  >  .  .  / 
\  "The  law  is  havirtg  the  greatest  impact  on  tests  with  low  volumes,"  he  said. 
Students  will  still  be  able  to  take  the  Scholastic  Aptitude  Tests  and  other  rpajor* 
examinations  that  are  given  to  l£^rge  numbers  of  students. 

UNABLE  TO  REUSE  OLD  "fORMs" 

The  tests  expected  to  be  withdrawn  include  those  routinely  used  for  admission  to 
professional  schools  of'medicine,  dentistry,  pharmacy,  optometry  and  nursing,  and 
the  Miller  Analogies  Test,  which  is  used  in  a  variety  of  graduate  fields.  Citing  the  ' 
disclosure  requirement,  publishers  and  sponsors  of  the  tests,  say  they  will  not  be 
able  to  reuse  old  forms  of  their  tests. 

With  regulations  for  impl^enting  the  law  still  in  the  drafting  stage,  officials  of 
the  State  Education  Department  and  others  are  still  unclear,  about  the  ultimate 
impact  of  the  new  law  on  both  individuals  and  institutions: 

I  suppose  some  schopls  vdll  have  to  simply  drop  the  use  of  test  scores  and  rely  on 
other  kinds  of  information,"  Mr!'  Bower  said,  "But  then  college's  say  that  they  never 
rely  only  on  test  scored'  in  making  their  decisions  anyway.  For  students  with  good 
grades,  this  will  probably  Ji)e  all  right,  but  for  others  it  could  cause  serious  prob- 
lems/'     •  \' 

Some  test  makers  expect  somejstud^nts  simply  to  cross  state  lines  to  take  the 
tests.  The  State  Education  Depatfment,  howeVer,  had  taken  the  view  that  the  Jaw 
applies  to  any  test  whose  results  are  sent  to  an  institijtion  in  NewjVork  State.  If 
this  interpretation  holds,  crossing  state  lines  would  be  of  no  ben/fit  to  students, 
planning  to  aitJtnd  institutions  in  New  York  State.  New  York  is  the  Only  state  to 
nave  such  a  msclosure  law.  ' .         .  ^ 

"As  we  ais^ss  the' situatipn  todlay,  we  don't  s^  how  we  can  continue  in  the 
business  in  New  Yoi*k  State"  said  Roger  Lennon,  associate  to  the  chairman  of 
HarCourt  Brace  Jovanovioh  Inc.,  owner  of  the  Psychological  Corporation,  which  is 
planning  to  withdraw  n  dozen  examinations. 

^We*t:an  continue  to  provide  the  programs  and  services  in  the  pther  49  states,  and 
not  New  Yiork,  orget  out  of  the  busmess  entirely."  .  ■ 

Althouf^  no  formal  policy  has  yet  be^n  announced,  the  College  Entrance  Exami- 
nation Boards  which  sponsors  the  Scholastic  Aptitude  Test  and  the  Graduate  Record 
Examination,  is  expected  to'contihue  operating  in  New  York  on  a  reduced  l^vel.  The 
Arherican  College  Testing  Service,  th6  other  large  college  admission*  testing  agency, 
and  thelLaw  School  Admissions  Council,  which  gives  the  Law  School  A-ptUude  Test> 
hav^jnaiciited  that  they  will  follow  similar  policies.  .  / 

"some  long-term  proble'Sis" 

The  Graduate  Management  Admission  Council,  which  sponisots  ihe  Management 
..Admissions  Test,  has  announced  that  it  wiir  continue' to  opetlate  in  the  state.  "The 
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law  pofies  some  long-term  technical  ^oblems,  but  we  hope  to  continue  our  present 
,  level  of  service,"  said  William  Broes#ile,  the  council  chairman. 

Sponsors  and  publishers  of  the  tests  smd  in  interviews  that  the  new  law  constitut- 
ed an  enormouBr—and  in  some  cases  prombitivief^but^en.  .  ' 
''Each  new  form  of  the  Entrance  mamination  for  Scholols  of  Nursing  costs 
^  $25»000/*-^said  Mr.  I^nnoh  of  HarcourtlBrace  Jovanovich,  who  noted  that  most  of 
the  tests  being  withdrawn  by  the  Psycltoloffical  Corporation  were  ^ven  to  no  more 
than  several  liundred  New  Yorkers  anQuaUy.  "If  we  were  to  continue  ^ving  it  19 
times  in  New  York  to  1,500  cdbdidate^,  the  cost  would  be  $475,000,  or  $^7  per 
student."  T  ^    T  •    •  . 

The  principal  sponsor  of  the  'Hruth  m  testing"  bill.  Senator  Kenneth  P.  LaVaile, 
RejiUbhcan  of  Port  Jefferson,  L.I.,  said  the  decisions  to  withdraw  from  the  state 
.  were  **ha8ty"  and  premature. 

"They're  not  even  giving  the  law  a  chance,"  he  said. 

PROBLEM  ON  SPECIAL  EXAMS 

George  Hanford,  the  new  president  the  College  doaVd,  said  that  with  250)000 
New  Yotkers  taking  S.A.T,  examinations  feach  year  the  cost  of  additional  forms  for 
the  seven  regular  administrations  each  yeeir  could  probably  be  absorbed  with  a 
moidest  surcharge  above  the  regular  $8.25  fee  for  New  York  students.  But  he  added 
that  the  board  faced  a  "m^jor  problem"  with  special  examinations. 

"We  give  examinations  on  Sundays  for  students  who  for  religious  reasons  cannot 
take  them  on  Suturdays,  and  we  make,  arrangements  witti  handicapped  students  to 
administer  them  virtually  any  day  of  the  year,"  he  said.  "There's  hX)  way  we  carv 
continue  this  level  of  service  if  we  h&ve  to  reveal  the  questions  every  timie'we  use  a 
new  form."  ' 

The  College  Board  is  expected  to  announce  its  plans  shortly.  It  has  already' 
indicated,  however,  that  it  will  probably  withdraw  the  Pruebas  de  Aptitud  Acade^ 
mica,  the  Spanish  version  of  the  S.A.T.,  which  is  produced  in  Pueirto  Rico  and  used 
on  a  limited  basis  in  New  York.  /  ,  '  . 

The  Admissions  testing  Law  Of  1979  wa«  passM  bv  the  Legislature  and  signed  by 
Governor  Carey  in  July  m  response  to  vigorous  lobbying  by  idtiident  and  consumer 
groups.  These  argued  that  the  testing  industry  operated  in  too  much  secrecy  and 
that  students  had  a  right  to  see  antd  undenrtand  the  examinations  that  pay  an 
important  part  in  their  academic  and  professional  careers. 

(  .  ARGUMENT  OF  OPPONENtS  .  ^ 

The  legislation  was  oppos^  by  Gordon  M.  Ambach,  the  State  Commissioner  of 
Education,  and  by  the  testing  industry.  Thej;  contended  that  the  additional  costs 
would  far  outweigh  any  education  or  other  benefits  and  that  there  were  other  ways 
to  bring  pbout  naore  "accountability"  on  the  part  of  test  makers. 
^  The  laW  requires  man ufkcturers  of  college  and  graduate  school  admission  tests  to 
publish  tedt  questions  witmn  30  days  of  reporting  scores  and,  upon  request,  to  give 
students  .copies  ,  of  their  4nswer6.  It  also  requires  test  publisners  to  supply  the 
Commissioner  with  reports  of  research  done  in  cOiyunction  with  these  tests  and  to 
take  certain  stem  to  assure  confidentiality. 

In  recent  weeks,  sponsors  and  publishers  of  the  tests  covered  by  the  law  have  held  . 
a  series  of  meetings  with  Senator  La V^le  to  explore  problems  posed  by  the  legisla- 
tion. Some  have  asked  for  a  six-month  delay  in  the  implementation  date,  and  othe^ 
have  asked  to  have  tests  exempted. 

Sponsors  of  the  New  Medical  College  Admissions  Test,  for  example,  argue  that 
the  specialized  nature  of  their  subject  matter  limita  the  number  of  questions—and 
thiis  new  forms— that  they  could  come  up  with* 

"Unimpressed"  BY  .  ARGUMENTS 
f       '  •     .  .  ■  ^\ 

James  W.  Graham,  associate  secretai^  of  the  Council  on  Dental  Education  of  the 
American  Dental  Association  said  that  there  yf$B  a  similar  problem  with  the  "per- ; 
ceptual  ability"  section  of  the  Dental  Admission  Testing  Program.  "There  are  only  ' 
so  many  ways  vqu  can  draw  pictures  of  boxes,"  he  said. 


.     .  _    .  „         „   ^ ,  IS 

Jtio  way  you  can  avoid  a  little  chaos  m'^the  first  six  months."  ' 

He  acknowledged,  however,  that  the  economic  cost  of  "special  administrations" 
posed  a  legitimiate  problem  and  said  he  planned  to  convene  the  Sen^  Higher 
Edu^at|on  Ck)mmittee  to  discuss  jpossible  changei^in  the  legislation.  Su^  changes 
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coiild  be  m»de  ^hen  the'li^lature  convense,  probably  in  Novimber,  to  set  a  (Jate 
for  pritnary  elections.       \  x.  t±  ' 

'  ^  Therp-  ia  alyeady  a  precede^xt  for 'excluding  low-volume  tests  because  the  mw 
specifically  exempts  the  achievementrtest  sections  of  the  S.A.T.  and  the  G.RE. 
examinations.  "There  is  too  small  a>population  taking  these,"  said  Senator  LaValle; 
.^There  wds  input  from  Educat®nal  Testing  Service,  and  it  make  sense.  Th&  testmg 
service  develops  the  tests  for  the  College  Board.  • 

^  POUTICAL  MISCALCULATION 

AskW  why  other  tests,  such  as  the  Aptitude  Test  ifor  Allied  Health  Programs, 
which  is  given  to  only  200  New  Yorkers  every  year,  were  not  excluded  on  the  eame 
ground,  Senator  LaValle  replied:  "They  never  came  and  told  us  about  the  problem: 
They  just  assumed  that  the  bill  Avould  nev    pass."        /  ^ 

Mr.  Lennon  of  Harcourt  Brace  Jo vanovich  conceded  that,  in  riot  testuying  at 
hearings  on  the  bill,  ,  he  and  others  at  the  Psychological  Corporation  had  made  a 
.  political  miscalculation.  "Had  I  felt  it  was  more  likely  to  pass,  I  might  have  urged 
us  to  be  more  active,"  he  said.  §  ;  ^ 

A  m^jor  issue  is  whether  the  new  s&te  law  is,  for  all  practical^  purposes,  a 

"national"  law.  .      r»  .    kt     v  "  i 

♦Mr.  Lennon  said  that,  in  accordance  with  the  interpretation  of  the  New  York 
State  Education  Department,  the  Psychological  Corporation  would  not  only  stop, 
administering  tests  ir^ew  York,  but  would  also  mstitutions  and  individual  counsel- 
ors using  the  Miller  Analogies  and  two  other  locally  administered  tests  not  to 
forward  the  results  to  any  New  York  colleges  and  universities. 

The  Law  School  Admissions  Council  indicated  that  it  would  prob^ly  ac^just  ite 
entire  Law  School  Admissions  Test  Program  to  the  requirements  of  the  New  York 
lawf  * 

"The  principle  of  uniformity  is  impprtant,"  said  L.  Orin  Slagle,  president  of  the 
council.  "We  want  to  keep  conditions  forjeveryone  as  comparable  as  possible* 

Other  test  sponsors,  however,  argue  that  the  State  Education  Department  s  inter- 
pretation is  not  warranted  by  the  language  of  the  law  and  that,  even  if  it  is,  it  is 
unenforceable.  •    r  •  *u 

Whether  the  law  is,  in  fact,  a  national  ojie  has  impprtant  ^onsequences  tor  the 
cost  of  future  tests  to  New  York  residents.  *  . 
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Tests  Now  Given  in  New  York 

J  ■•        ■    .    '  *      '  •  •  ' 

Hie  following  tests  ore  expected  to  be  discontinued  in  ffew  York  State 
after  JwLlMfhenth^Mfdisclosurelaw  goes  Into  effect: 

Americiui  College  Testing  Assess^  Law  School  Admlsslon9  Test 

mentPninun  :PreUinihaiy  Scholastic  ^Utude 

Graduate  Management  Admlsslohs      Test/  National  Merit  Scholarship 

Test  ,  ^  QualifVlngTest 

Gtaduate  Record  Exanodnaticm  Scholastic  ^tltude  Tests 

The  fdlowlng  tests  are  expected  to  be  d&CMtinued  in  New  York  State  after 

Jan.i  when  the  new  disclosure  law  goes  tntoeffect: 

'        '  '   '  . 

Allied  Health  Entrance  Examination  New  Medical  GMlege  Admissions 

Allied  Health  Professions  Admission  Test 

Test  MUlerAnalqdeiiTest   

Aptitude  for   Practical   Nursing  ;  Minnesota  engineering  Analogies 

pxaminatioii    >  Test 

A^tude  Test  for  Allied  Health  Pro>  Nunlng  School  Aptitude  Ezamlna- 

^  gleams    ...  tipn 

DratalAdmlsslmiTest  Optometty  College  Admission^  Test 

DropelcP  Mathematical  >  Reasoning  iriiarma^  College  Admissions  Tests 

Test      •  Pre-Admisslon    Assessment  lor 

Entrance  ExamlnatioA  for  Schools  of  Practical  Nursing 

Health-Related  Tech|KriQgies  Pre-Nursing  and  Guidance  Examl* 

Entrance  EXam!natlon  for  Schools  of  nation 

Nursing  Pruebas  de  i>^titud  Academics 

Entrance  Examination  for  Schools  of  (SpanbhSj<tT*) 

Practical/ Vocational  Nursing  Veterinary  Aptitude  Test 
'  Health  Occupations  Aptitude  Examl* 

Mtlon                            I  ..^'.^ 


Mr.  Weiss.  Mr.  Erdahl,  you  might  also  be  intet^sted  in  having 
entered  into,  the  record  a  series  .of  questions  aixa  answers  that 
appears  in  relation  to  testing  legislation;  and  it  jSappears  in  this 
morning's  frpnt  page  of  the  New  York  Times  and  carries  over  and, 
again,  primarily  addresses  the  New  York  law^,  although  it^mentions 
in  passing  that  Congress  is  considering  it. 

Mr.  Erdahl.  I  would  hope  that  that  could  be  part  of  the  record, 
too.  •  • 

Mr.  Weiss.  It  should  also  bfe  noted  by  way  of  clarification  that 
many' of  the  problems  th^it  are  inherent  in  the  New  York  legisla- 
tion primarily  because  we  had  the  benefit  of  the  work  product  that 
they  had  .completed  would  be  cured  by  H.R.  4949  and  would  never 
come  up  as  a  problem,  because  We  automatically  exclude  those 
*  testa/which  are  given  to  fewer  than  5,000  pedple  during  the  course 

of  tneyear.  ,    /        ,        ,  .  i  n 

The  tests  that  they  are  talking  aboujk  are  those  which  are  small 
volume  tests  based  by  the  small  manufacturers,  and  again  many  of 
those  are  tests  which  apply  beyond  just  admissions  to  institutions 

Vpf  postsecondary  education,  so  I  think  that  some  of  the  problems 
that  they  are  now  discovering  in  the  New  York  legislation  have 
already  been  anticipated  or  seen  by  us  and  cqrrected. 

have  some  questiona,for  the  record  which  I  would  like  to  ask 
.    for  the  recorHi  r 

'       Mtf  Cameron,  in  order  to  maintiiatinj  a  balance  al  the  heating,  and 
O  *so  wcause  it's  nice'to  heat  sui^rt  for  the  legislation -from' that 
FRIC  ^  -   .  .  i 
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side  of  the  table  as  well  as  from  this  side  of  the  table,  would  you 
just  in  brief  comment  on  wharin  fact  what  Mr.  Erdahl  had  raised 
about  a  story  appearing  in^the  New  Ygrk  Times  about  the  conduct- 
or behavior,  or  I  don't  know  how  you  would  characterize  it  as  to 
what  the  testing  companies,  as  to  what  their  role  has  to  be  if  we 
^dopt  legislaition  of  this  kind? 
Do  you  have  any  view  on  that  at  all?  ;  < 

Mr.  Cameron.  I  don't.  Mr.  Kovacs,  our  director  of  research, 
/.  might.  \. 

^  Mr.  Kovacs.  I  think  it's  important  to  make  a  distinction  between 
the  kinds  of  tests  that  H.R.  4949  addresses  and  the  material  stand- 
ardized tests  which  go  all  over  the  field  to  include  tests  of  mechani- 
cal ability  or  tests  of  typing  skill  or  what  have  you. 

M.R.  4949  addresses  aptitude  type  tests,  and  those  tests  are  de- 
signed to  predict  future  success,  generally  the  first  semester  in 
rCollege.  The  other  side  of  the  question  is  not  how  well  they  are 
doing  but  what  they  do.  not  measure.  Maybe  the  system  is  wrong, 
and  these  youngsters  aren't  doing  well  on  those  tests  because  the 
system  isn't  producing  quality  students. 

The  truth  of  the  matter  is  about  75  percent  of  what  works, 
motivation,  desire,  interest  in  succeeding  is  what  makes  the  differ- 
ence in  terms  of  higher  education  or  law  school  graduate,  and  we 
all  know  that  once  they  get  out  into  the  work  field  that  we  may' 
,         have  another  differeht  criterion  for  predicting  success. 

None  of  these  characteristics  are  really  addressed  ][)y  the  so- 
calUed  aptitude  tests.  They  principally  focus  on  the  first  semester  in 
.  school  and  help  admissions  officers  sort  out  and  include  or  exclude 
based  on  3ome  criteria. 

Most  admissions  officers  use  more  than  just  the  test,  however. 
The  test  is  used  as  part  of  the  decisionmaking  process^  rand  depend- 
*    /  ing  upon  the -institutions,  it  may  make  a  difference  on  whether  or 
/  Jiot  the  youngster  is  admitted  or  not, 

I  don't*  know  if  that  directly  relates  to  your  question,  but  I  will 
/be  happy  to  try  and  clarify  it. 

/  Mr.  Weiss.  Again,  for  either  Dr.  Harper  or  you,  anybody  at  the 
panel,  one  of  the  areas  ,  that  we  had  inquired  into  when  we  had 
some  of  the  testing  companies  here  before  us  was  the  additional 
burden  thrown  upon  them  in  the  preparation  of  additional  test 
.  questions,  and  also  the  cost  implicit,  and  again  you  might  want  to 

doublecheck  for  yourselves  the  testimony  that  was  ^ven  to  us  by 
the  American  Cbllege  Testing  Service  representative  ^ho  opposed 
the  legislation,  fbr  the  record^I  want  to  make  that  clear— stated 
to  us  that  in  their  inst^ce  four  out  of  five  of  the  test  portions  of 
any  particular  t^  is  new  material  on  every  single  test  that  they 
_  ,  aciprninister,  and  that,  therefore,  overall  80  percent  of  the  test  ques- 
tions on  any  form  and  generally  across  the  board  are  new  quesr 
tiong.  ^  \ 

He  said  in  totally  unequivocal  terrtis  that  cost  is  absolutely  no 
factor,  as  far  as  they  are  concerned,  since  they  right  now  develop 
so/many  new  questioi^s.  In  any  event,  that  the  additional  burden 
would  be  so  miniscule,  so  slight,  that  it  woijld  not  imp^act  upon 
them  from  a  cost  point  of  view.  ^  ^ 

I  make  that  comment  only  because  J  understand  that  Mf  rtSoIild 
and  Dr.  Harper  were  really  referring  |to  ah  extensiop  of  H.R.  4949 


beyond  its  present  scope;  but  since  there  has  been  a  peat  deal  of 
cost  argument  in  this  whole  discussion^  indeed  today  s.  New  York 
Timciq'  story  quotes  Educational  Testing  Service  as  saying  that  they 
might  have  to  increase  the  cost  of  •their  testd  thS  $8.25  for  the 
r  I  scholastic  aptitude  test  by-as  much  as  $5  pfer  'applicant. 
^  '  That  kind  of  conclifsionTias  to  go  really  beyontt  tfte  actual  cost  of 
test  development,  and  I  think  has  another  motivation  which  is  to 
scare  people  into  oppo^g  our  efforts<'to  take  the  mystery  and 
,  mystification  out  of  the  test. 

I  want  you  to  bear  that  in  miiid;  I  have  to  go  answer  a  quorum 
call  at  this  point,  and  I  will  be  back  in  3  or  5  minutes,  and  then  if 
you  would  like  to  comment  on  that,  you  may.  v 
_   .  (A  brief  recess  wais  taken.]  r^' 

  M?:  Weiss,  The  committee  will  come  to  order  again. , 

If  anyone  can  remember  the  question  that  I  posed  and  if  anyone 

'  wants  to  respond  to  it,  now  would  be  theJime^  

Dr.  Harper.  I  will  start.  ; 

Mr.  Weiss.  Dr.  Harper.  ^  ^ 
Dr.  Harper.  I  don't  think  it  /wpuld  be  appropriate  for  us  to 
comment  on  what  the  representative  from  the  American  college 
testing  program  said  here  withoiit  examining  the  full  record  of 
whit  he  had  to  say,  the  context  he  was  saying  it  in,  et  cetera. 
But  I  thhjik  in  terms  of  what  we  have  been  asked  to  address,  that 
f  is,  extension  to  Federal  testing  and  particularly  the  PACE,  I  would 
say  tnat  clearly  the  writing  of  new  items  is  a  difficult  problem; 
\  .  We  have  been  told  by  representatives  at  the  office  of  p^onhel 
\maiiagement  how  long  it  took  to  put  that  series  of  exams  together, 
the  written  test  for  the  PACE,  and  I  have  talked  to  sonie  of  the 
p^ple  that  were  involved  in  thie  item  writing;       ^  ^ 

The  item  writing  in  some  parts  of  that  examination  was  a  very 
excruciatip^  process  because  the  professional  irequirements  for  a 
gotoid  item  in  terms  of  what  kind  of  differentia|ion  it  givjes  you  in 
relation  to  all  the  other  items  are  quite  stringent  '  . 

So  the  process  of  writing  high  level  items  |uch  as  appear  in 
PACE  is  a  long  and  protracted  exercise.  .  ^     ;  ^ 
Mr.  <Weiss.  Does  anyone  els6  want  to  (!i5mment  on  it? 
Let  me  ask  you  in  passing,^  didn't  GAO  dp  an  audit  of  the  civil 
service  examinations  and  come  to  the.  conclusion  that  you  were  not 
altogether  happy  with  the  makeup  of  tho86  examinations?  * 
Jjir.  Gould,  Yes.  We  issued  a  report  on  Mdy  15  of  this  last  year. 
.  If  you  would  like— oh,  I  see  you  have  it  there.  There  are  a  number 
cf  que;3tions  that  have  been  raised  primarily  toward  the  validity  of 
that  tfest  and^he  job  relatedness,  of  it.  We^  felt  that  for  the  te«t  W 
be  in  compliance  with  tlie  uniform.guldelines  that  th«e  were  some 
.  additional^  validation  that  the  OPM  could  do  to  improve  that  exam- 
inationv        :  ^  V 

We  have  gS^de  recommendations  on  some  things  that  we  thought 
they  ought  to  do  to  help  improve  the  validity.  We  also  suggested 
and  recommended  to  them  that  they  look  for  some  o^her  alterna- 
tives, selection  devices,  because  of  the  discriminatory  effect  that 
the  exam  Lad  on  particularly  blacks  who  were  screened  out  at  a 
^  much  higher  proportion  than  othBrToHS'^o  took  the  examina- 
tion. ^  ;^ 
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We  have  a  very  perplexing  problem  there.  This  test  is  probably 
the  most  validated  test  in  the  history  of  the  Federal  Government 
It*  has  been  shown  by  the  researchers  to  be  job  related.  Yet,  blacks 
do  not  do  as  well  on,  that  examination  as  whites  do.  It  is  a  very 
difficult  problem. 

*  We  feelif'tRere  are  other  alternatii^e^,. which  will  give     a  better 
'representatidh  .pf  minorities  in  the  work  force*  that  we  ought  to 
everything  we  can  to  try  to  find  what  those' alternative  Bel^U 
devices  might  b^.    •  7  .  /  '       "  *^ 

*  Mr.' Weiss.  I  appreciate  that.  That  was  my  tecpllection.     ?    -  ^  c 
Now,  staff  has  g;ven  me  the  Report  that  you  have  just  referred  ' 

to.  I  find  that  on  the  very  fronV  eOver  owthe  "report,  the  second  ^ 
paragraph  states;  that  GAO  found  that  i^ACE  and  the  Junior  Fed^ 
eral  Assistant  Examination  screeji  but  black  applic^ts  at  a  much  . 
higher  rate  t;han  whites  and  tljat  few  blacks  score  high  enough  fbji? 
a  realistic  job  opportunity.  "  ;  \.       .  * 

In  a  sense/ 1  assume  thht  on  the  ba?is  of  your  comment  just  now 
that  you  are  not  suggesting  that  the  bias  was  d^Uberate  ba,^unia^ 
tentiohal.  There,  is  something  the  matter  obviously  with.whatvthQ^.^ 
tests  are  testing  at  this  point.  -  iv  :  .      ?  ^ 

Given  thgit  kind  of  conclusion  on  the  l^AQE  w^t, .  I  find, :  D^^ 
{iarper,  your  daintiness  iq  approaching  the  question  of  discrimifta- . 
'tion  oh  the  noh-PACE  test,  in  the  scholastic  .aptitude  test,^."^^ 
example,  sort  of  uhexplainable  to  riie..         "    -  o 

*  It  seem&  to  me  that  yoiir  own  people  have  found  the  same  kind  of 
•^questions  arid  prdhlems  ,in,j:elatiori  to  the  PACE  test '  that  the 
critics  of  the  SAT's  and  the  qther  standardized  tegfcs  have  found  in 
-relation  £o  i£.         .  y  '  — 

■  All  that  we  dre  suggesting,  aliJj  I  assume  that  you  are  not  going 
to  take  the  position  " that  siniplj^  because  It  is  going  to  cost  more  to  : 
develop  new  tests  or  that  it  wpl  be  a  burdenvpn  . the;  people  that 
prepar^di  the^old  ie^ts  th^  imfact  the'current  situatioii  Jbjpf allois^ed " 

;^pnti*%C  -  .  ;  / --^^y  ^  ^.^y  I.;      \.        /  '  ^  "  ^  \       "  ^ \ 

^    Fasguifte  th^fe  ypAi  ^re*  gbifig  to  W  recbmmetiding  a  tot^l  rey^ 
.  h!§w  te^te  to  bft  desvelfip^d,  ajfl^d- -rfe^g^^^  thf  curfent: 

validation;seepfis  to  be  M  W;^s  the  irifhouse  |)e6ple  ai^  ^)ncerned, 
;U^hat:  you  are  nb£  gm%  to'  W  of  th/§iiuat|^oii 

-that  pr.ey^aflsih^the'lJ'edOTal^  -  Cs 

Now  in  >ssettc|l;  without  lelliiig  "p|eciple  what  kifid;  of  qXiestiqii^ 
^they  ought  tp  T^e^asking  or  how'thei?  questions  ought  to  bet  posed, 
all^that  H.R.  4949  s^jis^to.  open^^^^  in 
and  out  of      fidd,  m  additipti  1^  e^m^  teli 

where  they  wete  njarked  wrong^i^^         in  fact  is  gdn^.  pp  with'" 
those  tests  so  that:  in  fact  we  Cap  develop  more  "aCcur^^ 
people  in  the  field  Can  develotrinore  accurate  tests.^   \       ^ .  C 

I  dpn't  see  why  ^hat  should  be  objectiOnaible 
subject  to  the  argument;  that,  ye?,  maybe,  it  W5u),d  dd  ^.thaV^^^^^ 
because  it  would  cost  something  additional  by  w^jr  of  itiQ^^^  i$ 
something  not  worth  doing.      \    ,r  - 
You  are  not  suggesting  that  it  iis  not  worth  doing,  are  you? 
•Dr.  Harper.  Let  me  just  say  in  termsjof  my  definition  of  discrim- 
ination and  the  daintiness  with  whidTyoja  say  I  walk  around  that, 
I  believe  that  nry  interpretation  if  consistent  with  title  Vil  of  the 
1964  Civil  Rights  Act  and  wifth  a  long  list  of  Supreme  Court  deci- 
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sions  going  back  to  Griggs  v.  Duke  Power  and  Albemarle  v.  Moody 
W  and  Washington  v.  Davis  and  the  more  recent  decisior^.  .  . 

I  recognize  this  as  a  serious  problem.  L  share  the  concern  Mr. 
Gould  has  expressed  ?uid-  the  concern  we  pit  forward  in  this  report 
about  what  is  to  us  a  perplexing  problem  that  has  not  an  easy 
solution,  and  one.  I  think  hearings  such  as  you  are  havjng  today 
'  and  other' comimttees  have  had  will,  hopefully  shed  some  light  on 
this  concern  and  provide  all  of  us  with  a  better  understanding  of 
issues  involved  i«  the  area  of  testing,  abilitiy  measurement,  per- 
i      formanciB  both  in  scHool  arid  on  the  job. 

-  F^r  thafreason  we  thii^  that  these  types  of  hearings  are  very 
»  '  worttiwhiliff.     ,•         ■    •  • .    •     ,     ,  .  ,     ,  .    ^  ,  . 

iJi-.TlARfsnlYes,  I  was.ihvplJvfea;in^  tliat.stiidy  and  also  a  studpr 

•  i  which  .prei^ed  this  6ne  by  «bciut  0  or  :8  jntionths  which  was  GAO  s 
.   aisalvMs  c^^^  a>™d  act*vitie$  of  the  Equal  . 

"    Employment  , 
A    amehdmeltit?  to  tKe  Cmt  Rig^J^^  Apt  wfflch  produced  the  Uniforhi 

•  ^  ^  I  was  involved  iii  \mti|ig  thai  earliet  ifeijort -which  providedN 
"1' the.contfext  fpr,  eyaluating^f^ACE  in  terms  of  what  the  Govern-  J 
^/:jney*a're<iuirterits  are^f^^^  PACE  \M 
;■^''■■■^;Bep6^t^*^<.;^  ■  "^ll^                                         ■    -'-^  '\  ' 

•  -'^  Mr/ Weiss;  report  as  set 
-:forth:ontK6:ft&ti<«of^t^^                               ,  „    -  :  -  - 
:  .  m  .sHASRPERi  Yea;  the  f|c^  a^^                    There  is  v^ry  , 

■r  V  little  arguments  lliifere  is  lomie  larg^ment -w^^  tibie  iinplica'' 

■.  ■'  ':''*tidiiS'<rfth0'ta<2;ts ark., ,        ,  "■„■         '  I  ' z-*' "  '  ■  ■  "-■    '  ]_  ''^ 

V   1  «hirik  the  questioijs  that  are  raised  jfre'questions  about  what     . , 

-  ■•ar^  il^^  based  -W  the  f$cts  arid  what  are  the  courses  of,  :" .  " 
?   actions  that  migltt  fcdtow.  ■  \.  '  r_  .  .  X; 
^    .  I-thitik  '  if  we  i(oJ»ack  to  the  eaHiw  intej*^^  ■ 

about  the  defiriitio^f  discrimination,  so  long  as  you  can  say^hat  •  >  ^ 
of;  whenever  there lare  group  differences  in  perform^ce  on  ^  feest.° 
J  tbere  is  automatically  diwsrtminationj  when  you  hold,  that  defini^  •  •  ,, 
!  tton  arid  l  ean  hold  V  definition  of  discrimiriatfon  whic^says  that  If 
L those..  t€st^dtffwen<;e^  J^^^^^  not  reflected  in  dlffe^iices  ipf  job  per-  y  ;,  ^ 
'  /lAformarice^or  Jeducatioiifel  ftchi?^^        then  uryiettAie  cut-fent  sit^-  - 
.  ,  1^^^       arfe  gbing'^td  have  tome  disagreement  over  what  might  be-^  ^ 

?  -   fc^MS^eil  perhaps,>Afhere  we'wentw  was  iri  my  use  <?»f  the    J  . 
; '  word  %ias"^wBc|L  is  Wljatul.sl^rfced  to  use  and  then,  y^u  gave^me  a  ■  , 
•  double  definitiionyirfe^  of  bias,  IjoW  bias  cojfld  be  defined.  ,| 

V  -  ^~-You^  Jave  me  two  i^pO^^      and  I  thought  thatj  there  w^  a  i, 
^^^'■^^^^         i)0  youK  attitude  as  to  those  tv#,  but  .1  am  not?  s/ire 
'  "/P^rhaji  we^^^  clarify  it^  ■  ^ 


^    Is  it  your  view  on  thg  TS^ifM^^  yoUj^^^jniUarl^Mt^^ 
<aiitf'(dWibe#^u^^^  thtf/same  conclusions;ofkr'|p^lar 

cdnclusiotis  can  accurately  be  dra\#>{to  v^,_  that  the  ^^ts  tendiilto, 
.  if  not  sgeeih.out,  to  demonstrate  lower  scores  on  the  basis  of  racial, 
sexual/ieographic,  or  simMar  kinds  of  differences?  ^  ], 

'     Dr.  Harper/ Yes,  I  #Duid— without  reference  to  a  number  of 
specific  studies  in  the  aKa— I  would  say  it  is  my  general  impres- 

^erJc  6.^3.0- 90 -\9 '  70€    ■      ■ . 
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sion  of  the  literature  that  that  in  fact  is  the  case,  that  is,  there  are 
group  differences  in  the  educational  area  as  well  as  in  the  occupa- 
tional area.  And  I  don't  find  that  surprising. 
/.       Mr.  Weiss.  And  further,  do  you  then  believe  that  by  opening  that 
prcScess  up  as  you  say  you  find  these  hearings  in  relation  to  the 
testing  process  to  be  important  and  to  be  helpful,  do  you  find  that 
•    .  £he  similar  kinds  of  opening  up  of  the  process!  for  exaniination 
I    *  purposes  would  be  helpful  and  beneficial  in  relation  t(!)  tjBsts  in  the 
postsecondary  education  field? 

Well,  let  me  rephrase  it.  I  may  haVe  confused  you  with  my 
verbiage.  •You  had  said  Just  a  few  minutes  "^o  that  you  felt  that 
these  kinds  of  hearings  and  similar  kinds  of  hearings  conducted  by 
other  committees  werfe  very  helpful  in  trying  to  get  a  clear  under- 
standing as  to  why  the  PACE  examinations,^  for  example,  seemed  to 
be  biased  against  certain  groups  or  show  result^indicating  that 
/    certain  grottp?-do  not  do  as  well  as  other  groups. 

You  §aid  that  you  found  that  that  was  nelpful  to  have  these 
hearings  in  relation  to  that  particular  area.  My  question  is,  then, 
Do  you  find  these  hearings  also  to  be  helpful  in  relation  to  the 
testiiig  processes  in  the  postsecondary  education  field? 

Dt-!^  Harper.  Tthink  I  would  defer  to'the  experts  in  that  area.  I 
think  it  would  be  presumptuous  of  me  to  speak  for  those  who 
either  represent  the  area  or  are  experts  in  that  area. 

Our  area  of  work  and  expertise  is  in  the  occupational  field,  the 
employment  field,  and  particularly  the  Federal  personnel  and  com-  / 
pensation.  '    -  ( 

Mr.  Weiss.  Are  there  any  further  questions? 

Mr.  Buchanan?  ' 

Mr.  BucHAi^JAN.  Thank  you,  Mr.  Chairman. 

This  is  as  good  a  time  as  any  for  me  to  reiterate  a^xontinuing 
concern  of  mine,  and  that  is  the  need  fgr  the  physician  to  heal 
/     himself.  * 

L^-^^Legislation  before  us  does  not  deal  with  the  problem  of  the 
^■^'T^deral  Establishment,  though  thfe  Federal  Government  is  the  r^a- 
tion's  largest  employer.  It  is  a  white  male  egfti^blishment  in  i£s 
,  uppfer  echelons,  with  the  exception  of  EEOC  which  may  approach 
\-       being  a  black  male  establishment,  except  at  leadership  y vel  at  this^ 
^^    point  in  history.  ^  ; 

I  wonder,  in  light  of  your  testimony,  if  we  are  going  to  deaj  with 
the  problem  of  what  role  testin^'Tilay  play  in  discrimination  on  an 
e1;hnic  basis,  should  we  .not  do  s^«IBthing  in  the  Federal  Establish- 
'     ment  as  well,  rather  than  deal  only  outeide  the  .Federal  Establish- 
ment, as  is  the  case  with  this  legisl^itionJ?'^^^ 

Mr.  Gould.  Ope  of  the  problems  I  am  having  i^  that  the  legisla- 
tion d^als  with  postsecondary  education  and  excludes  all  occupa- 
tional testing.  In  the  Federal  sector  We  are  talking  about  basically 
.   occupational  testing.  V  ^ 

I  am  having  difficulty  drawing  the  analogy  .))et ween  the  two, 
asking  us  in  the  Federal  .'sector  to  abide  by  something  that  w6  are 
not  trying  to  apply  to  the  private  sector'  • 

Mr.  Buchanan.  Well,*  the  Gibbons  bil|,  which  is  also  under  con- 
sideration before  this  subcpmmittee  does  incliide  it.  Mr.  Weiss'  bill 
does,  not  deal  with  occupational  testing  but  the  Gibbons  bill,  which 
is  formally  before  us  as  a  part  of  these  hegfrings,  ^pec. 
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The  point  I  m  making  is  that  we  seem  to  make  a  consistent 
exception  foi*  the  Federal  Establishment.  We  lay  requirements  on 
the  private  sector,  whether  it  is  within  >the  area  of  safety  and 
health,  distrimination,  "or„  women's  rights,  while  we  tend  to  make 
consistent  exceptions  for  the  Federal  Establishment  tinder  some,  I 
assume,  theory  that  somehow  the  j'ederal  Government  iS  goin^  to 
do  right  even  when  others  do  wtohg.  r.  .  . 

It  seems  to  nie  thatl  your  testimony  has  indicated  that  if  there  is 
a  problem  in  the,  area  of  testing,.,  that  problem  certainly  exists  in 
the  Federal  Establishment.  /  / 

Mr.  Gould.  I  think  thaj/is  a  fair  statement.  Yes,  there  is  a 
problem  with  testing  in  th)6  Federal  Establishment  in  the  qjuestions 
of  whether  the  tests  are^job  related  and  valid  and  that  will  be 
decided  in  the  court  under  an  existing  qase,  We  ^id"  find  that  the 
test  does  screen  out  large  numbers  of  minorities. 

I  don't  know  what  the  problem  is— it  does  not  appear  to  be  the 
test.  It  appears  the  p<^pie  coming  to  that  test  have  been  deprived 
for  one  reason  or^i^Other,  of  the  o^wrtunity  to  come  to. that  test 

as  equals.  '  .  •  . 

Dr.  HARPBR.  Mr.  lBuchanan,  might  I  ask 'you  a  question?  Would 
your  question  extend,  also  to  the  military  who  have  historitally 
been  large  Users  of  written  tests?  ' 

Mr.  Buchanan^  Tes,  qtertainly.  - 

Well,  I  have,  in~e^rlier  hearings,  expressed  that  my  grpatest 
personal  concern  is  the  extent  to  which  the  test  may  be  accurate 
rather  than  inaccurate.  If  these  tests  are  in  fact  accurate,  they 
reflect  some  much  deeper  problems^  in  tjie  system  with  which  we 
also  need  to  deal.  •  4^       ,  , 

Thank,  yovi,  Mr.  Chfiirmari.  f 

Mr.  Weiss.  Thank  you,  Mr.  Buchanan. 

I  wonder,  justjso  we  have  something  in  the  record  about  it,  Mr. 
Gould  or  Dr.  Harper,  could  you  give  us  some  background  as  to 
what  in  fact  the  congressional  and/or  committee  history  has  been 
.  over  lib  course  of  the  iMt  3  to  S  years  in  attempting  to  foeus  on 
the  Ijwminations,  the  fideral  examinations  that  you  have  been 

talking  about?  „     J         •,  , 

Mr.  Gould,  I  think  we  can  provide  that  fOr  the  record  for  you, 
sir.  To  my  knowledge  there  has  nOt  been  a  lot.  The  primary  focus 
•  has  been  as  it  relates  to  veteran's  preference  and  the  impact  that 
the  veteran's  preference  .has,  the.  augmented  scoreS;  wjiich  prevents 
women  from  competing  equally.  /     '  ■  "  ,  . 

The  work  that  we  have  done  on  the  PACE  exam  did  result  m 
hearings  in  the-House  Post  Office  and  Civil  Service  Committed. 

Mr.  Weiss.  That  is  what  I  am  asking  you  about.  Can  you  tell  us 
when  those  hearings  took  place,  how  many  hearings  took  place, 
and  >ftat  the  results  of  those  hearings  are  to-  date  ^^nd.  what  the 
projections  are,  if  you  know?  ' 

Mr.  Gould.  I  believe  the  committee  hearmgs  have  recei^tly  been 
printed.  The  initial  hearing  was  held  on  May  15,  1979,  before  the 
Subcommittee  on  Civil  Service,  House  Committee  on  Post  Office 
and  Civil  Service.  I  am  hot  aware  6f  ahy  legislative  proposal  that 
has  resulted  from  the  hearings, ,  ,  - 
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had  indipated  that  this  report  which  came 
grew  out  of  what?  Were  you  commissioned 


that  revitfw  on  our  own  because  we 
.  a  problem.  We  had  heard  thrx)ugh 
)d  otherwise,  that  ^is  was  a- problem, 
dlable  in  ter^s  of  the  makeup  of  the 


5nsive\|5fffortNld 
ited' 


t6  identify  the 
report,  as  I 
\o  coincide 
some  time  right 


\p^d  Civil  Service 
.eratioh,  UA4er  active  con- 


Mr.  Wfeiss.  Biit 

*  down  on  May  15, 
to  undertake  this  stui 

Mr.  Gould.  We  ihi 
wanted  to  find  out  if  if 
various  comments,  publio; 
There  was  not  information^ 
people  who  were  taking  theV 

'We  went  through  q^ite  ail^ 
compoisition  of  those  people, 
recall,  the  testimony  aiid  the 
with  fhe  issuing  date^f  that 
around  May  15  that  those  hearingi 

Mr.  Wkiss.  Right,  so  that  in  fact  tna^: 
Committef  has  h^  and  has  under  cajni. 
sideration*  the  subject  matter  of  they&Vej 

Mr.  Gould.  That  is  correct,  sir.  /  .    \  \ 

Mr.  WBisSsTlmnk  you  very  mucfc.  % 

If  there  are^o  further  questions,  I  want  V)  thank  all  of  you. 

Mr.  BuchamA?  \  ^  ' 

Mr.  EucH^AN/  Mr.  Chairman,  may  I  ask  orie^additiomal  ques-. 
tion? 

Mr.  Weiss.  Sure. 

Mr.;BucHANAN.#Do  you  Ih^ve  any  concerns  about  thg  disclosure 
.  provisions  of  Hf,R.  4949  creating  pressures  upon  the  Ibcftl  schot)ls 
and  teachers  to  teach  to  the  test, 'to  create  pressures  mjit  might 
have  an  impact  on  lo<Jal  curriculum?  As  a  parent  that  idea  occurs 
to  me.  V 

Mr.  Cameron.  NEA  has  a  concern  about  teachers  teaching  to  this 
test  relative  to  standardized  testing  in  general.  We  have  long  b^en 
on  tecord  as  being  concerned  about  that.  Anytime  that  you  have 
standardized  testing  with  all  the  foibles  iri vol ved  you  are  going, to 
haye  human  beings  reacting  to  these  standardized  tests  in  attempt- 
ing to  teach  to  them.  * 

That  is  not  to  say  that  is  a  general  principle  going  ph  around  the 
country/ but  it  is  a  concern  of  ours.  We  &re  very  supportive  of  H.R. 
4949  in  order  to  open  up  the  whole  process  to  be  sure  principles  are 
written  into  the  standardized  tests  which  would  preclude  that  kind 
of  thing. 

Mr.  Buchanan.  Thank  you.    '  ■  \  1 
Mr.  Weiss.  Thank  you. 

I  want  to  thank  all  tne  menibers  of  the  panel  for  your  patience 
as  well  as  foi*  your  testimony.  ^ 

Thank  you  very  much.  . ' 

The  next  panel  will  be  Dr.  John  T.  tiasteen,  Mr.  Frank  Erwin, 
Dr.  Edwin  Fleishman,  and  Dr.  Judy  Hall  . 

Mr.  Buchanan,  I  understand  that*  you  are  acquainted  with  Dr. 
Hall  and  perhaps  you  woiild  like  to  introduce  her.  I  had  not  given 
any  of  the  credits.  Let  me  do  that  at  this  point  and  perhaps  you 

•  will  b0  able  to  expand  on  your  credits.  f  f 

Dr.  Casieen  is  the  dean  of  undergraduate  adinissioriip.  University 
of  Virginia- 
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Mr.  Erwin  is  a  member  on  the  Advisory  Panel  on  Declining.  Test  * 
Scores  representing  the  American"  Society  for  Personnel  Adminis- 
tration. .  ,     J  ' 

Dr.  Fleishman  is  past  president  of  the  Division  of  Industrial  and 
Organizational  Psyaiology  of  the  American  Psychological  Associ- 
ation and  pre8i4ent  pf  the  Advanced  Research  Resources  Organiza- 
tion. *  A  " 

Dtv  ^udy  Hall  is  presjaent-elect  of  the  An^rican  Association  of 
State  Psychology  Boards.  v 

I  see  five  people^^there.  .  Who  have  I  not  mentioned? 

Dr.  Fleishman.  Dr/Mwty  Tenopyr,  who  is  currently  president  of 
the  American  Psiphological  Association  Division  of  Industrial  and 
Organizational  Psychology,  who  is  here  as  a  reschirce. 

Mr.  JVeiss.  We  have  Dr.  Casteen  first  on  our  witness  list  and 
perhaps  y6u  would  like  to  start. 

STATEMENTS  OF  DR  JOHN  ti  CASTEEN  III,  DEAN^OF  UNDEBGIUD- 
.  tJATE  ADMISSIONS,  UNIVERSITY  OF  VIRGINIA;  FRANK  ERWIN, 
MEMBER,  ADVISORY  PANEL  ON  DECLINING  TEST  SCORES,  REP- 
RESENTING AMERICAN  SOCIETY  FOR  PERSONNfcL  ADMINISTRA- 
TION; DR.  EDWIN  FLEISHMAN,  PAST  PRESIDENT,  Dl^tlSlAN  OF 
INDUSTRIAL  AND  ^)RGANIZATIONAL  PSYCHOLOGY,  AMERICAN 
PSYCHOLOGICAL  ASSOCIATION,  PRESIDENT,  ADVANCED 
RESEARCH  RESOURCES  ORGANIZATION;  DR;  JVDY  E.  HALL, 
PRESIDENT-ELECT,  AMERICAN,  iWSOCIATION  OF  STATE  PSY- 
CHOLOGY BOARDS;  B(R.  ftlARYL.'TENOPYR,  PRESIDENT,  AMERI- 
CAN PSYCHOLOGICAL  ASSOCIATION,  DIVISION  OF  INDUSTRIAL 
AND0RGANIZA?Pl6j>IAtJ?^YeH0L0GY;APANEL  ^ 


STATEMENTS  DR  JOHN  T.  CASTEEN  III,  DEAN  OF 
UNDERGRi!k^^ji  ADMISSIONS,  UNIVERSITY  OF  VIRGINU 

Dr.  Castbsn'.  'ijb'^,  €hairman,  I  have  submitted  a  written  state- 
ment to  v/hieh[  1  will  refer  briefly  in'  the  time  allotted  _to  me. 

Attemptiiijj  to  primarily  summarize  the  points  covered  in  that 
statement  and^  to  indicate  how  I  think  they  have  to  do  with  the 
practice  of  undergraduate  admissions,  especially  in  a  State  univer- 
sity, I  HaVe  descnbed  in  the  statement  three  areas  in  which  I  and 
imany  of  my  colleagues  in  admissions  have  ,  been  concerned  about 
Tthe  possible  applications  of  H.R.  8664  and  H.R.  4949  on  the  trade 
•  that  we  prac^ce  and  on  the  students  that  we  serve.  * 

*t)asiBfo  areis  include  the  predictable  effects  of  these  bills  on  ho>y 
Students  i^rogifedi^  from  high  schooltto  college  and  from  under- 
graduat0  to  gt/aduate  and  professional  schools,  their  impact  on  the 
quality  of  etmcation  offered  to  young  Americians  at  all  levels,  but 
Mpedally  in  ^((pcondary  schools,  and  their  implications  for  the  op- 
pprtvmitiefl  available  aftfer  high  schod  to  certain  groups  of  young 
pj^ple  Who  have  only  in  recent  years  be^n  to  participate  in  main- 
stream, piitltsecondary  education,  which  is  to  say  the  opportunities 
availabl6/vto  the:  nonwhite,  the  nonafduent,  nonsuburban,  the 
hsMicapp^,  and  even  now  women.    *  ,■        .....    ^,  -  ^ 

;  The  fuAt  area  of  my  .concern  has  to  do"  with  the  possibility  that 
ijhese  biUs  may  disrupt  orderly  progress  for  students  from  high 
jichool  college.  I  am  concerned  about  several  possible  implica- 
/tlons  in  mis  at ea. 


One  is  the  potential  loss  of  the  existing  system  of  verification 
that  standardized  testing  allows  us  to  use  in  evaluating  other  cre- 
dentials that  appear  in  the  .student's  files.  ^  •  ' 

As  you  know  from  other  testimony,  responsible  academic  admisr 
sidhs  officers  are  concerned  more  perhaps  with  othpr  parts  of  the 
record  than  with  standardized  testing,,  particularly  with  the  high 
school  transcript,  recommendiations  from  schools,  statements  made^ 
on  their  own  behalf  by  students,  and  especially,  with  their  own 
historical  experience  with  Students  from  similar  backgrounds  and 
similar  goals.  ^ 

•  With  that  body  of  evidence,  the  standardized  test  scores  have 
provided  for  us^n  element  of  predictive  validity  that  has  made  the 
System  bepome  extremely  effective  in  identifying  students  who  can 
indeed  succeed,  especially  in  highly  demanding,  academically  com- 
petitive programs,    v  '  \ 

We  are  concerned^that  the  legislation  appears  to  us  to  disrupt 
this  8y;stem  of  verification  without  providing  a  reliably  documented 
replacement  system  on  which  we  can  rely  provide  the  necessary 
information  to  make  responsible  selections. 

We  are  concerned  also  that  if  this  Uteruption  occurs,  the  least 
harm  will  occur  to  those  students  who  come  from  the  most  privi- 
leged section^  of  our  society  and  the  most  harm  will  come  to  those 
students  who  come  from  the  least  privileged  Sections,  especially 
from  those  who  - are,  as  I  said  before,  nonwhite,  nonaffluent,  * 
nonsuburban,  et  cetera. 

/  We  are  concerned,  second,  about  the  possibility  that  the  enact- 
ment V)f  such  legislation  as  that  contained  ki  these  two  bills  maj; 
actually  serve  to  interrupt  an  ongoing  drive  toward  reassessment 
of  the  quality  of  schooling  that  goes  on  in  this  country. 

In  my  written  remarks  I  have  referred  to  three  signal  documents 
in  this  process  of  reassessment.  ,^ 

The  first  of  these  documents  was  the  announcement  in  1975  by 
the  College  Entrance  Examination  Board  that  SAT  scores  since  the 
year  1963  jhad  declined  in  all  the  relevant  areas  of  measurement 
for  all  significant  parts  of  the  population,  cutting  across  geographi- 
cal, socioeconomic,  ethnic  «and  other  lines.  # 

The  second  is  a  series  of  articles  published  in  the  summer  of  1976 
by  the  Los  Angeles  Times  about  the  declining  American  education, 
articles  which  attempted  to  quantify 'the  causes  for  the  declining 
'scores  and  to  begin  a  national  climate  in  which  we  could  begin  a 
discussion  about  the  possibility  of  schooling  to  our  students. 

The  third  document  is  the  report  of  the  Wirtz  Commission,  the  - 
panel  trying  to  diagnose  the  score  decline  in  terms  of  the  experi-  : 
ence  of  students  prior  to  taking  the  tests.  v 
-Since  these  documents  became  available  to  the  public,  the  devel- 
opments h^ve  seemed  to  me  to  be  a  mixture  of  good  and  bad.  For* 
•  example,  I  have  seen  no  maior  assumption  of  leadership  in  the 
direction  of  reassessing  schooling  on  the  part  of  the  ihiajor  profes- 
sional associations,  including  the  NEA,  AFT  and  other  organiza-^ 
tions  representing  teachers. 

We  have  seen  little  from  Government  in  the  way  of  addressing 
the  actual  causes  for  declining  measures  of  achievement  at  the  end 
of  high  school  and  at  the  end  of  college.  We  have  seen  movement 
^  on  the  partpf  local  jurisdictions,  on  the  part  of  individual  schools. 

■/' 


We  have  seen  a  growing  senae  that  the  public  is  alarmed  that 
students  deem  not  to  able  to  read  as  well  as  they  should  be  able 
to,  to  deal  with  the  English  language,  ^rite  or  compute  as  well  as 
they  should  be  able  to,  and  moreover  in  all  field?  to  perform  as 
well  as  they  could  before  the  educational  revolutions  of  the  sixties 
and  early  seventies.  # 

We  see  evidence  that  school  boards,  private  employers,  the  Gov- 
ernment, the  military,  find  all  of  our  students  suffering  in  one 
respect  or  another,  but  many  of  our  students,  especially  those  who 
are  nonwwhite,  nonaffliient,  et  cetera,  receiving  at  the  end  of  high 
school  credentials  that  appear  not  to  present  the  qualifications 
necessary  to  make  a  meaningful  contribution  to  society  after 
school.  ;  . 

Testing  in  effect  ble>y  the  whistle  on  the  failure  of  the  school 
system.  We  are  concerned  that  legislation  aimed  at  interrupting 
the  normal  flow  of  information  from  properly  evaluated  tesj^ng 
does  not  address  the  crime  but  punishes  the  police  officer  wh^^lew 
the  whistle,  .  * 

Tblirl^  we  are  concerned  about  the  possible  interruption  of  ad- 
van^mg/^  opportunities  to  constituencies  which  have 

^histoi^ltally  represented  the  mainstreaniT of  education  in  this  coun- 
try. 

Testing  in  the'  last  5  years  has  diagnosed  area^  in  which  school- 
ing and  society  in  general  have  failed  to  provide  the  opportunijties 
theyMhould.  It  is  not  the  fault  of  testing.  If  we  do  poorly  in 
teachyig  black  children  to  read,  to  write,  to  think  in  the  English 
language  and  to  compute,  it  is  instead -the  function  of  testing  as  it 
has  to  point  out  areas  of  failure  and  it  is  after  that  particular  , 
demonstration  the  function  of  Government  and  of  education  to 
mQve  expeditiously 'and  intelligently  in  resolving  the  problems  that  . 
.  have  turned  up. 

Testing  has  helped  us  to  bring  new  constituencies  into  the  educa- 
tional mainstream.  I  need  oiily  poir^  to  the  progress  of  women  in 
receiving  entry  into  the  fields  of  engfineering,^  business,  architecture 
and  other  fields  that  "have  histwically  been*xjlosed  to  women  and^ 
second,  not  all  black  students  wore  lower  than  white  stud^ts  ancy 
not  all  students  who  have  hism  batside  the  mainstream  are^jsufferf 
ihg  because  of  test  scores,  apa  that  in  fact  the  obvious  deficiencies  ' 
in  the  s^ool  program  puj^ed  by  such  children,  a  fact  I  see  daily 
in  nty  work  when  I^d  fright  black  children  who  have  not  been 
.  ,  advised  to  pursue  studiei^  in  the  social  studies,  engineering,  math- 
em^itics,  science  and  bther  areas,  in  seeing  that  evidence  in  my  own 
daily  work,  I  am  al^trmed  by  the  prospect  that  the  normal  flow  of 
information  that  . i^ls  us  these  children  may  have  not  been  well 
served  may  bN^iiiierrupted  by  legislation  o 

Testing  Ji^j^  fo^  in  summary  served  to  break  certain  stereo- 
types. It  Jfaf  t;old  uttthat  women  caiufunction  well  in  advanced 
prograjp  .iti  |he  sciqaces  and?  in  mametnatics,  that  many  black 
child^^ 'especially  cnildren  who  have  received  responsible  and 
card^)^^tlkntion^  i  the  lower 'and  secondary  schools,  can  in  fact 
Qi^e^even  in  the  most  collective  and  CQJiipetitlve  college  situa- 
\jy^^  and  can  go  on  to  become  profe^jsioh^l  leaders  of  real  sub*  ^ 

•  .t-  X.  ■   •      »        '  ,•  ,  •  ■  '  ' 
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The  largest  concern  is  this:  For  the  present  system  to  be  properly 
indicted,  to  be  shown  not  to  serve  this  country  well,  it  seems  to  nie 
the  case  against  it  must  be  made  on  a  level  of  integrity  and  with 
the  kind  of  comprehensiveness  that  I  hav^  not  seen  in  the  materi- 
als previously  submitted  to  this  committee. 

'  It  seems  to  me,  second,  that  if  the  present  system  is  to  be 
replaced,  the  replacement  system  must  be  documented  as  being 
.equally  valid  and  must  be  directed  to  the  concerns  of  the  nonmain- 
stream  student. 

My  caution  to  the  committee  is  that  we  as  a  country  must 
address  problems  that  hav^  now  been  diagnosed  with  sufficient 
clarity  that  we  know  where  we  must  begin  to  move. 

It  seems  to  me  the  Jargest  mandate  is  not  toward  controlling 
testing  but  instead  toward  reexamining  the  quality  of  educational 
experience  and  sieeing  to  it  that  the  very  young  people  about  whom 
we  are  most  concerned  in  'bringing  them  into  the  mainstream  do  in 
fact  receive  the  kind  of  background  necessary  to  perform  well,  no,t 
only  on  the  teste  but  also  over  the  course  of  their  academic  and 
working  careers  to  achieve  the  kind  of  leadership  and  success  that 
makes  for  responsible  citizenship. 

[Prepared  statement  of  John  Casteen  follows;]- 

PrepAred  Statement  of  John  T.  Casteen  III,  Dean^of  Admissions,  University 

OF  Virginia  _     .  . 

• 

I  am  John'^Casteen,  Associate  Professor  of  Eriglish  and  Dean  of  Admissions  in  the 
University  of  Virginia.  I  have  come  todav  to  express  concern  about  what  I  believe 
would  be  the  adverse  effects  of  passage  of  H.{1.  3564  and  H.R.  4949  (as  now  written) 
in  three  areas:  their  predictable  effects  on  how  students  pro^^fess  from  high  school 
to  college  and  from  undergraduate  to  graduate  and  professional  schools;  their  im- 
pact pn  the  quality  of  educational  experience  offer^  to  young  Americans  at  all 
levels  of  education,  but  especially  in  secondary  schools;  and  their  implications  for 
the  opportunities  available  after  nigh  school  to  certain  groups  of  young  people  who 
have  only  in  recent  years  begun  to  participate  in  mainstream  post^seconaary  educa- 
tion, which  is  to  say  to  the  non-white,  the  non-affluent,  the  non-suburban,  the 
handicapped,  and  (even  now)  women.  I  speak  from  my  experience  as  a  teacher  ajad 
admissions  officer,  especially  from  experience  since  1975  as  Dean  responsible  for 
undergraduate  admissions  at  a  state  university  that  attracts  able  api^ficants  from 
throughout  the  country  and  from  virtually  all  social,  economic,  and  ethnic  back- 
grounds. My  cmn  background  is  in  public  education.  I  share  concerns  expressed  to 
you  previously  by  Fred  Hargadon  of  Stanford  University,  but  I  want  today  to  speak 
primarily  to  the.  implipatiohs  of  these  two  bills  for  public  higher  education  in  times 
of  declining  student  populations,  declining  net  inaicators  of  academic  accomplish- 

» ment,  d^lining  real  and  relative  re8()urces  to  support  educatiSn,  and  mounting 
public  concern  about  the  final  results  of  education. 

The  potential  obstacles  pofeed  by  H.R.  3564  and  HJl.  4949  to  orderly  student 
progress  from  one  level  of  education  to  the  next  have,  I  believe,  come  previously  to 
the  Committee's  attention  in  testimony  offered  in  beh^f  of  the  American  Council 
on  |klucation  and  the  Educational  Testing  Service.  With  other  admissions  officers 
with  whom  I  have  discussed  these  bills  and  their  predecessor  in  the  state  of  New 
York,  I  share  the.  A.C.E.'s  belief  that  public  disclosure  of  currently  secured  test 
items,  however  well-intended,  must  inevitably  diminish  the  quaiity  of  information 
available  to  academically  selective  colleges  when'-they  review  appbcations  and  also 
the  credibility  of  the  credentials  available  to  students  who  seelc  to  establisn  the 
viability  of  their  preparation  for  further  study.  Having  seep  no  practical  alternative 
to  the  existing  system  of  secuml,  standardized  tests  designed  to  measure  the  final 
products  of  education  at  each  level,  many  of  us  in  admissions  fear  that  H.R.  3564 
and  H.R.  4949  may,  especially  in  the  first  few  years  following  theirfenactmeift, 
hinder  us  Ih  our  efforts  to  understand  the  complete  package  of  credentials  presented 
by  af^licanta,  and  therefore  force  us  to  .make  less  reliable  decisions  than  we  can 
now  make  while  simultaneously  depriving  students  of  the  kind  of  reliable; validation 
of  high  school  courses  and  grades  tnat  now  comes  to  us  in  the  form  of  standardized 

'  test  scores,  based  on  secured  and  validated  tests.  We  are  concerned  that  the  report- 

■     ;■       .  773 


769' 


ing  and  disclo&tf^e  requirements  of  these  blUg,  combined  with  the  necessity  that  the 
test  preparation  agenties  develop  massive  new  batteries  of  test  items  and  heretofore 
untested  methods  to  equate  scores  and  Validate  tljeir  meanings,  will  drive  costs 
beyond  what  most  students  can  pay.  We  suspect  that  students  from  privileged 
communities  who  apply  to  the  most  prestigious  colleges  will  suffjsr  least  from  rising 
costs  and  sinking  test  credibility,  hut  that  less  affluent  students  will  be  increasingly 

•  less  able  to  pay  the  cost,  hence  less  likely  to  qualifv  themselves  for  consideration  by 
the  m^or  colleges.  Well-known  secondary  schools,  schools  in  our  more  affluent 
neighborhooils,  which  are  typically  white  and  suburban,  and  schools  with  estab- 
lished  traditions  of  preparing  students  for  the  most  competitive  colleges  will  contui- 
ue  to  succeed  as  they  always  have.  By  contrast,  inner  city  schools,  rural  schools, 
schools  whose  students  happen  not  to  be  like  those  who  commonly  qualify  for 

.  admission  to  the  most  competitive  colleges,  mil  almost  certainly  suffer  if  the  final 
.   measures  now  available  beCogie  suddenly  lesjs.  available  and  less  credible. 

1  share  the  conviction  of  the  American  Council  on  Education  that  standardization 
is  a  necessary  condition  of  existence  in  contemporary  Wucational  testing.  This 
conviction  grows  not  out  of  personal  preference  (who  can  favor  gridded  answer 
sheets,  machine  scoring,  or  the  intense  atmosphere  of  the  rooms  in  which  tests  must 
administered?)  but  out  oT  the  practical  requirement  that  students  be  able  to 

•  demonstrate  that  their  preparation  is  genuinely  comparable  to  that  offered  by 
others,  including  students  of  varying  backgrounds,  geographical  origins,  and  school 
experiences;  If  he  size  of  our  population,  the  diversity  of  our  educational  system,  and 
the  rich  variety  of  backgrounas  presented  by  applicants  together  demand  that  we 

'    maintain  a  workable  system  to  verify  outcomes.  Not  all  schools  teach  the  same 
things;  not  all  students  Jearn  the  same  things;  not  all  colleges  need  the  same  kinds 
of  preparation  in  their^freshmen..  But  one  must  have  reliable  means  to  sort  out 
what  credentials  prove,"  The  Ivy  League  schools,  major  national  institutions  like 
Stanford  or  the  University  of  Chicago,  and  a  handful  of  highW  selective  public 
institutions,  perhaps  including  the  University  of  Virginia,  can  if  we  must  develop 
unique,  in-house,  non-standardized  entry  examinations  to  permit  us  to  validate 
.    secondary  school  credentials  and  to  predict  studeht  success  in  our  own  curricula.  No 
doubt  we  will  do  so  if  genuinely  reliable  national  testing  disappears  from  the  scene. 
We  had  such  tests  before  the  College  Board  was  formed.  But  the  cost,  both  in  dollars 
and  in  lost  opportunities  for  students  to  participate  in  the  most  rigorous  kinds  of 
education  available  in  our  colleges,  will  be  high.  As  student  populations  shrink,  as 
iftore  colleges  undertake  policies  of  open  enrollment,  hence  taking  less  interest  in 
jhe  adequacy  of  high  school  preparation  and  perhaps  also  in  the  integfity  of  their 
own  programs,  indeed  as  colleges  realize  that  the  demand  for  their  product,  educa- 
tion, is  less  than  it  once  waj,  concern  for  quality  will  seem  less  imtk)rtant  than  will 
filling  the  dorms,  paying  the  faculty,  and  staying  in  business.  Analogously,  students 
seeking  to  progress  from  less  prestigious  undergraduate  programs  to  the  m^or 
national  graduate  and  professional  schools  will  suffer,  as  New  Yorkers  may  next 
year,  if  the  graduate  admissions  tests  become  less  reliable  arid  more  costly  than 
they  are  now.  Students  at  all  levels  need  properly  devised,  generally  administered, 
readily  comparable  final  credentials  of  the  kind  rtOW  available  through  the  tests^ 
My  contern  about  the  potentially  advert  effects  of  H.R.  8564  and  H.R.  4949  on 
educational  quality,  especially  in  higl^  schools  but  also  in  college^  grows^  out  of 
;    experience  since  1975  with  evidence  to  the  effect  that  schools  have  been  in  recent^ 
years  less  succ^ful  m  teaching  reading,  verbal  reasoning,  writing,  and  arithmetic 
than  they  ought  to  be  and  once  were.  The  evidence  comes  from  sundry  sources.  It 
first  became  available  to  the  public  in  1975  when,  the  College  Board  revealed  that 
mean  S;A.T.  scorw  had  declined  precipitously  in  the  yearp  since  1968.  The.CoUeffe 
Board's  announcement  came  as  no  sttrprise  to  many'  of  us  in  teaching  oa^/admifl- 
slons,  because  we  had  known  for  several  yearsrthat  something  was  amiss  with  our 
students.  At  the  University  of  California  in  Berkley,  where  I  was  teaching  when 
the  College  Board  announcement  appeared.  We  had  bv  1975  been  engaged  for 
several  years  in  mcjor  remedial  efforts  in  the  area  of  writing.  More  /than  one 
classroom  teacher  had  already  modified  his  or  her  methods  and  expectatioup  in 
order  to  deal  with  newjsets  of  student  needs  and  deficiencies,  especially  in  the  most 
basic  disciplines.  National  discussion  of  the  score  decline  began  at  once.  Many 
commentators  condemned  the  College  Board  for  making  the  arinouncement  on 
grounds  that  it  tendid  to  bring  discredit  on  schools;  others  commended  it  on 
grounds  that  it  prov*  that  times  were  bad;  still  others  attacked  teetingotself, 
aUeging  that  the  tests,  not  student  performance,  were  growing  worse.  This  discus- 
'     sion  gained  focus  with  the  publication  in  August  1976  of  three  feature  articles  in  the 
.   Los  Angelee  Timee.  Written  by  Times  education  writers  Jack  McCurdy,and  Don 
Speteh  and  entitled  ^'The  Decline  of  American  Education"  these  articles  presented 
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for  the  r^jat  time  empirically  sound  evidence  that  th^  apparent  decline  in  student 
skills  WAS  "real  and  not,  for  example,  the  result  of  changes  in  the  ethnic  or 
sQcioeconomic  makeup  of  test  takers/'  The  Times  permitted  other  newspapers  to 
reprint  the  series,  and  distributed  copies  to  educators,  members  of  Congress,  and 
other  concerned  persons.  • 

McCurdy  and  Speich  offered  evidence  that  the  decline  was  by  no  means  restricted 
to  SAT  and  ACT  scores,  that  indeed  it  appeared  with  disturbing  consistency,  in 
virtually  all  available  indicators  of  educational  progress  and  at  all  levels  of  educa- 
tion, fhey  also  suggested  that  declines  in  fmal  measures  of  achievement  closely 
matched  the  upward  progress  of  the  mean  grades  awarded  to  students  during  a 
decade  of  grade  inflation  and  lowered  requirements.  Seeking  causes  for  the  decline, 
they  suggested  among  other  factors  changing  school  curricula,  especially  in  high 
schoola,  changing  student  populations,  changing  educational  objectives,  new  ways  of 
learning  (notably  television  learning),  and  progressive  deterioration  in  the  fabric. of 
»the  Ameriaan  family.  McCurdy  and  Speich  dealt  harshly  with  our  schools;  their 
third  article  made  the  case  that  education  generally,  and  especially  secondary 
education,  was  doing  little  or  nothing  to  remedy  th^  ills  of  our  young  people. 
Together,  these  articles  became  and  remain  mayor  docunlents  in  the  case  against 
our  schools  as  they  now  function. 

These  articles  were  followed  in,  turn  by  the  creation  of  the  Wirtz  Commission,  . 
properly  known  as  the  Advisory  Panel  on  the  Scholastic  Aptitude  Test  Score  De- 
cline, sponsored  jointly  by  the  uollege  Board  and  the  Educational  Testing  Service. 
On  Further  Examination,  the  panel  s  summary  report,  along  with  its  cpmpafkion 
appendices,  ought  in  mv  judgment  to  be  required  reading  for  all  framers  of^  fduca- 
tional  policy,  concerned  citizen  leaders,  and  ^ve  all  ^teachers.  Without  attacking 
schools  or  sqhool  leaders.  On  Further  Examination  documents  at  least  seven  megor 
contributors  to  the  score  decline:  the  changing  composition  of  the  college-bOund 
population  (a  cause  generally  acknowledged  to  be  consistent  with  our  national 
purposes  ahd  of  no  immediate  concern  in  a  negative  sense),  the  prpliferation  of 
elective  coUrses  ih  schools,  esp^ially  in  English  and  verbal  skills,  where  student 
performance  has  declined  most  precipitously,  a  diminished  seriousness  of  purpose  in 
the  learning  process  as  reflected  in  tolerance  of  excessive  absenteeism,  grade  infla- 
tion, easier  textbooks^  and  generally^ lower  stQindards,  increased  viewing  of  televi- 
sion, changing  structure  of  the  faxnily,  social,  turbulence  of  the  sixties  and  seventies, 
and  diminution  of  learning  motivation.  . 

The  College  Board  became  involved  in  this  disctrasioh  of  the  causes  for  the  score 
decline  oniv  after  serioti^  and  thorough  consideration  of  the  possible  outcomes, of  its 
involvement  A  desirable  outcome  might  have  been  ^rious  national  scrutiny  of  the  ' 
purposes  anay  methods  of  American  education  at  the  three^^uarter-century  mark^ 
with  an  eye  tpward  rediscovering  what  worked  well  in  the  past  and  either  adapting 
it  to  present  bircumsntances  or  developiVig  effective  new  solutions  to  our  problems. 
Sadly,  neither  Congress,  the  Office  of  Education,  state  leaders,  nor  the  msgor  educa- 
tional associations  undertook  this  reassessment.  A  second  possible  outcome  wa^  a 
reaction  against  the  tests.  Such  a  reaction  is,  I  fear,  best  exemplified  by  legislation 
that  would  miate  the  system  of  final  measures,  the  existing  standardized  tests, 
without  guarahte^ing  the  immediate  development  of  equally  effective,  equally  inex- 
pensive, and  eqih^jy  general  final  measures.  I  take  it  as  proper  and  constructive 
that  our  political  leaders  should  promote  the  use  of  good  measures  of  educational 
accomplisnment,  and  also  that  Congress  ^ould  monitor  the  services  deliverejd  na- 
tionally to  students,  colleges,  and  American  society  by  the  test  preparation  agencies. 
Yet  one  does  ndt  cure  disease  by  <lepriVing  the  diagnostician  of  his  tools  or  reverse 
bad  news  by  executing  the  messenger  who  brings  it.  The  educational  establishment 
failed  to  take  effective  action  when  students  first  showed  signs  that  the  education 
revolution  of'  the  sixties  It^d  failejd.  Instead,  the  testing  agenciiss  and  the  College 
Board,  the  keepers  of  the  final  measures,  had  to  do  so.  Without  such  agencies  and 
withoiit  their  conviction  that^^he  public  must  know  when  the  evidence  BUgges*ts  that 
students  are  not  learning  what  they  should,  we  might  not  know  even  now  just  how 
desperately  we  need  to  undertake  a  thorough  reexamination  of  hpvr  we  raise  our 
children.  ^ 

My  third  concern,  extending  educationar opportunity  to  broader  constituencies, 
es^ially  to  persons  not  histoKcally  within  the  mainstream  of  higher  education, 
has  been  discussed  previously  by  spokesmen  on  both  sid^s  of  the  issues  raised  in 
H.R.  3564  and  H.R.  4049.  Two  matters  critical  to  the  actual  practice  of  admissions 
seem  to  me  not  to  hc^e  received  proper  analysis.  One  is  the  placiB  of.  testing  in  the 
admission  process.  In  colleges  that  deal  responsibly  with  theftr'applicants,  the  SAT 
and  similar  tests  serve  tvyo  functions:  they  allow  us  to  understand  the  credentials  of 
individual  applicants  in  light  of  norms  that  are  larger  thanihose  of  the  individual 
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high  school  from  which  the  apblicknt  may  come  or  of  our  own  student  population, 
nofms  that  are  both  dwChronic  (because  the  test  ftjores  equtafe  acroes  time)  and 
synchrc^ic  (because  all  applicants  in  a  gfiven  year  have  faced  essentially  the  sapie 
I  measure  of  their  reacjinees  to  perform  in  oiir  freshman  courses);  ai^jd  they  allow  us  . 
to  makp  reasonably  close  assessments  of  student  skills  in  the  basic  areas— in  read- 
ing, vocabulary,  writing,  and  arithmetic,  Fox  every  college*  whose  selection  system  I 
.  know,  other  credential  matter  morej  indeed,  the  test  pre|6aration  aaegcies'  them^ 
selv^  'ei\join  colleges  ajgainst  simplistic^)peliance  on  test  scores,  and  call  on  them  to 
develop  what  have  come  to  be  complex  models  of  student  preparation  as  it  gan  be 
aseessed  iniundry  ways.  High^^hqbl  transcripts  tell  us  how  rigorous  a  program  of 
studies  an  Applicant  has  pursued  and  how  wibll  the  student  compares  to  other  , 
applicants  from  his  or  her  school  and  fitm  schools  provM,  historically  to  be  similar. 
Counselor  or  teacher  fficomniendations^  less  readily  aVailable  now  than  before  pas- 
sage of  the  Buckley  Amendment,  can  add  insights  into  student  motivation,  ability  to 
cope  with  obfltaclesj  ^mmitment  to  good  citizenship,  and  other  relevant  matters. 
Studeni  eelf-descriptiotis  can  detail  personal  goals,  non-echool  accomplishments,  and 
a  wealth  of  other  topics,  vhile  also  giving  us  a  direct  sample  of  how  effectively 
applicantkwrite  and  think.  Edch  element  matters  if  the  admissions  o^ce  does  its 
job  consciehtiously  and  well;  obviously  the  non-quantitative  measures  matter  most 
to  those  of^8  who  deal  v^th  large  applicant  pools  and  seek  to  admit  students.whose  ..- 
/uture  Womplishniients,  academic  and  other*  are  likely  to  be  welj  above  average. 
The  ^p^uliar  value  of  the  ^tandardized-^t  score  iq  the  selection  process  is  itis 
historical  and  contemporary  comparability,  its  potential  to  indicate  whether  e  stu- 
dent  from  a  specified  background  has  learned  ^hat  he  or  she  must  in  order  to 
faipete  and  succeed  in  the  requested  program  of  study.  _ 
The  second  matter  is  the  application  6t  test  scores  in  the  actuaL>ftVes8  of 
jlecting  students  whose  backgrounds  differ  from  those  of  what  oile  mi^ht  call  this 
generation's  mainstream  college  student,  especially  in  the  more  selective  colleges, 
omen,  ndn  white  students,  handicapped  students,  older  students,  students  from. 
Sal  backgrounds  or  from  the  kindis  or  Innef  city  schools  tM/have  developed  since 
odd  War  II— theee  studesfis  ougnrpfopgrly  to  be  the  su^ect  of  continual  study  on^ 
he  part  of  all  admission/clffices.  Each  of  these  groups^as  eniierged  In  relatively 
aecent  years  as  a  new  yftudent  constituency  in  coU^^  that  previously  enrolled 
primarily  white  male  jftudents  from  our  more  affluent  neighborhoods.  In  certain 
niBtances,  th*^ S.A.Trand  sunilar  tests  have  helped  to  Vteak  down  barriers  by 
proving  that  suspafted  or  alleged  deficiencies  eimply  do  not  exist.  Women  who  have . 
entered  program/in  engineering, vbwiness,  and  arclmecture  have  benefited  from 
the  availability  at  evidence  that  bias  against  them  lacka  an  empirical  basis.  In  other 
instan(^,  test  stores  have  pcQved  to  be  less  reliable  Vbecause  normative  stud^jit- 
performance  eitter  fails  tc^reJKct  college  grades  accurately  or  falls  outsi^krt^e 
limits  within  which  we  can  equate  s^es  from  gur  historj^fU^.  In -the  fi^year  or 
two  of  my  effort  tbslncrease  the  nunfbo-  of  black  studente  enroHedat  tti^;I*mvei^ 
of  Virginia,  I  came  ttLthe  realization  that  njp/predictor.  Including  t^HiCSfes,  toldNne 
what  I  n(E«fded  to  knlb^  in  order  to  K^tn^  success.  Like  adhr^issioni  oQlcers  at 
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newspapers,  and  even  the  presentations  Ji(ade  to  this  (H)imiitteeJmu8t  cl^^rm  to 
some  linguistic  nonn.  Spokespersons  for  the  test  prepardition  a#ncie«i  haVI^NLber 
lieve,  teetifled  previously  about  their  enorta  to  minimize  the  pol 
effects  of  cultural  bias;  schools,  emploters,  and  govemmcbt  agei 
related  problems  every  da^.  With  regard  to  the  use  of  «MUnR 
proceie,  certain  principles  must,  hold  tnie:  scores  are  UMfuNonh 
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tion  agent  in  any  other  area  of  competitive  endeavor  juatly  refuse  an  applicant 
because  he  or  she  does  not  look  like  other  applicants/ College  admissions  officers 
who  do  their  homework  have  known  these  truths  for  years;  indeed,  the  College 
Board  and  other  such  agencjes  have  throughout  my  own  career  work^  to  educate 
the  profession  on  how  best  to  assess  the  premise  of  non-mainstrearrNapplicants. 
Ironical  ly^ the  agencies  that  I  know  to  use  tests  irresponsibly,  which  \s  to  say 
mechanically,  'without  regard  to  other  indicators  that  can  be  documented\o  have 
more  validity 'in  predicting  student  performance,  are  not  college  admission  commit- 
tees (although  no  doubt  more  than  one  errs)  out  governmental  agencies,  stale  and .  • 
federal,  that  ignore  the  -College  Board's  advice  by  using  fixed  cut-off  scofes  to 
dettermine  eligibility  for  scholarships  or  entry  into  special  training  progranys.  H.R. 
3564  would  require  that  test  takers  beiiotified  of  "the  score  required  to  pas^/he  test 
...  or  the  score  which  is.  generally  required  for  admission  to  institutions  of  higher 
education.*'  No  one  passes  or  fails  tests  like  the  S.A.T..  and  A.C.T.;  nor  is  any  score 
generally  required  for  admission  to 'institutions  of  higher  education. <  H/R.  3564 
amounts  in  this  respect  to^a  mandate  for  irresponsible  selections^  especially  selecr — 
tioRS  harmful  to  the  interests  of  non-mainstream  students. 

My  largest  reactions  tp  the  proposals  embodied  in  H.R.  3564  and  H.R.  il949  at 
these:  many'  actions  itiajridated  by  these  bills  are  already  common  practiae  among  ^ 
th6  major  test  prepar^ion  agehcies;  "others  are;  not  common  practice^  byt  peV^ap« 

tion  in  behalf  of  the  American  Council  or  ' 
-dressed,  these  matters/in  Retail-  still  others  derive  from  faulty  premise^ about  ttpw 
tests  fit  into  the  ajdmlssion  and  selection  process,  about  how  student^matureyfand 
especially  a|;>out  the  rplatiotTof  testing  to  educational  and  social  PoVi^-  Tests  jevel- 
oped  in  this  cpunlrv  because  colleges  and  students  needed  the/final  measures 
implicit  in  them.  They  developed  as  Results  of  private  endeavor,  ana  heretow-e  they 
have  performed  their  service  to  students  and  to  college  without ixpense  to  govern- 
ment and  without  government's  having  developed  expertise  of  the  kind  requisite  if 
government  is  now  to  define  reasonable  standards  of  performance  for  test  makers 
and  users.  With  most  of  myNjall^igrf^»rT^elcome  your  examination  of  the  role  of 
testing  in  the  selectionTrroCe^F^-b^t^e  tjiat  education  generally  expects  to  comply 

X  may  develojatijom  your  deliberations.  At  the 
Idents  to,^fip#in  thpse  bills  so  many  potential 
fe  benefioal  results  of  the  system  that  has 
(cation  needs  reformation,  and  that  citizens, 
deliberate  national  move  toward  more  effec- 
specially  for  the  non-white,  the  non-affiuent, 
(ation*that  risks  sacrificing  the  effectiveness  of 
/ere  w^  are  and  of  where  we  need  tp  go  seems^ 
ingress  should  and  can  provide  leadership  in  the 


in  every  sense  with  any  legislation 
same  time,  I  am  concerned  foj:,j34irl 
hazards  and  so  little  cono^$^4£t 
developed.  My  judgment  is  that 
educators,  and  students  want  to  see 
tive  schooling  for  all  young  people, 
the  non-privileged.  To  t^at  end,  legi| 
the  existing  tests  as  measures  of ' 
me  to  fairfar  short  of  the  mark^ 

search  fof  anlend  to  the  profyf^ive  declines  in  student  performance  in  the  basic 
skills,  for  an  end  to  the  aajfent  disparity  between  the  educational  outcomes  of  our 
most  privileged  citizens  alSthose  of  citizens  who  have  yet  to  participate  fully  either 
in  higher  education  or  limine  process  of  self-government.  Sad  to  say,  H.R.  3564  and 
hA  4949  seem  to  me  fcj  ignore  our  most  compelling  needs  while  taking  away  our 
abSity  to  develop  and  Employ  at  least  one  means  of  making  education  effective, 
meritocratic,  and  in  th€( end  democratic. 

Mr.  Weiss.  Thank  you  very  much. 

We  will  commence  questioning  after  all  the  members  of  the , 
panel  have  spoken. 
Mr!  Erwin?  . 

STATEMENT  OF  FRANK  ER)VIN,  MEMBER,  ADVISORY  PANEL 
ON  DECLINING  TEST  SCORES,  REPRESENTING  AMERICAN  SO- 
CIETY  FOR  PERSONNEL  ADMINISTRATION 

*Mr.  Erwin.  I&r.  Chairman  and  members  of  the  committee,  my 
name  is  Frank  W.  Erwin.  For  the  past  11  years  I  have  been 
president  of  Richardson,  ^Bellows,  Henry,  &  Co.  a  nationally^ recog- 
nized personnel  research  firm  headquartered  here  in  Washington, 
D.C.  •  1 

In  that  position  I  have  been  involved  intimately  and  directly  in 
the  .development  and  validation  of  selection  procedures,  particular- 
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ly  tests,  and  during  two  of  those  years  served  as  member  of  the^ 
advisory  panel  oif  the  scholastio^aptitude  test  score  decline. 

I  am  appearing  before  you ^nis 'morning  in  the  hope  that  Avhat 
experience  I  have  will  be  helpful  to  you,  and  additionally  (o.ex; 
press  the  views  and  the  concerns  of  the  American  Society  for. 
Personnel  Administration  (ASPA)  on  the  proposed  testing  legisla* 
tion  you  are  considering.  \'  .  ' 

'  Xhis  society,  which  consists  of  over  23,000  personnel  practi|;ioners 
'  in  busines^,  government,  and  education  has  catyse  for  concern  since 
any  action  of  this  committee  which  in  any  Way  compromises  the 
quality  9f  those  entering  higher  education  ultimately  will  compro- 
mise the  quality  of  those  who  we  expect  to  manage  our  enterprises 
in  the  years  to  come.  ^ 

In  that  context)  we  have  approached  this  testimony  with  a  great 
sense  of  apprehension  which  we  hope  this  committee,  will  share, 
H.R.  3564  and  H.R.  4949  venture  into  one  of  th^  most  complex 
.fields  ever  addressed  by  this  committee  and  you  are  being  asked  to 
take  a  precedent  setting  and  dangerous  step  toward  regulation  of 
the  educational  admissions  process  and  the  procedures  whi6h, serve, 
at  least  in  part,  as  indicators  of  the  quality  of  our  ^society  and  its 
institutions.  ^   ,  _ 

The  statement  which  we  make  tod^iy,  therefore,  attempts  to  ad- 
dress major  elements  which  must  be  considered  as  part  of  your 
determinations  as  to  the  need,  the  purpose;  and  the  potential  im- 
pact of  the  proik)sals  before  you.  ,  '       .  ^ 
J\  think  n^y  predecessor  to  my  left  has  stated  it  quite  well  in 
"Xtferms  of  the  role  of  tests. 

In  Excellence,  John  Gardner  wrote  that,  'Tests  are  designed  to 
•  do  an  unpopular  job."  An  untutored  observer  listening  to  critics 
lash  out  at  the  im^rfectioiis  of  the  tests  might  sup^se  that^e 
criticisms  Vould  be^stiUed  if  ^le  tests  were  perfect.  Not  at  all.  As 
the  tests  improve  tmid  b^ome  less  vulnerable  to  jpresent  criticism, 
the. hostility  to  them  may  increase.  *^ 

A  proverbial  phrase  indicatirfti  complete  rejection  is,  ''I  wouldn't 
like  it,  even  if  it  were  good»"  With  the  tests,  the  more  appropriate 
\    phrase  might  be,  "I  wouldn't  like  them,  especially  if  they  were 
good." 

Tests  are  clesigned  to  serve  a  performance  measure  related  tp 
\  ^  some  future. point  in  time.  That  is  v\^at  Mr.  Gardner  refers  to.  The 
-concept  he  expresses,  however,  also  is  applicable  to  the  role  of  test 
scores  as  messengers' about  our  excellence  as  a  society  arid  the 
extent  to  which  ouiunstitutions  are  functioning. 

Intereertingly,  wmH  you  are  being  asked  to  oegin  restricting  the 
Use  of  tests,  the  messages  we  have  been  gettibig  are  increasingly 
unflattering  and  unpleasant.  ^1  ^ 

In  education,  these  messages  center  around  the  fact  that  ou^ 
schools,  particularly  those  where  our  poorest  c^izerjp  are  clustered, 
are  doing  an  increasingly  inadequate  job,  dei^ite  massive  transfu- 
sions of  Federal  funds.  Fewer  and  fewer  sttidents  are  able  to  read 
^  and  write,  or  add,  subtfract,  divide,  and  multiply,  and  the  National* 
Education  Association's  respoiise  is  a  call  for  a  moratorium  on  ^e 
'  use  of  tests.  . 

^'    In  the  employment  8etting[,>due  principally  to  civil  rights  enforce- 
ment activities,  tests  and  test  practices      better  than  ^ver  before 
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aiid  Ifhese  messages  are  centering  around  the  fact  that  those  who- 
do  less  well  on  the  tests,  irrespective  of  subgroup,  whether  that  be 
black,  white,  rural,  urban,  female  or  male,  also  are  doing  less  well 
on  the  job,  * 

All  of  this  should  raise  questions,  first  concerning  how  we  can 
measure  quality  objectively  without  the  use  of.  tests,  and  second, 
whether  s6me  of  the  siippojrters  of  H.R.  35154  and  4949  have  a 
hidden  agenda.  ^  ; 

The  test  messengers,  like  thermiOmeters,  are  telling  us  that  we 
have  a  worsening  illness.  Rather  than  seeking  a  cure  for  the  dis- 
ease, those  for  whom  the  test  results  are  most  thteatening  would 
ask  ydu  to  restrict,  arid  preferably  destroy,  the  use  of  thermom- 
eters. Like  Persian  kings,  they  would  slay  the  messengers  who 
bjring  them  bgjd,  tidings.  * 

You  were  asking  earlier  about  bias  in  tests;  That  is  an  inaccurate 
or  incomplete  measurement.  The  measurement  is  how  Varying 
groups  score  on  it^  but  most  importantly,  does  that  set  of  scores 
predict  subsequent  performance.  *  7 

Bias  in  teste  and  bias  in  items,  different  groups  performing  dif- 
ferently, is  not  real  measure  of  whether  a  test  is  indeed  discrimina- 
tory or  appropriate  for  use.  The  measure  is:  Does  the  difference  in 
test  performance  correlate  with  differences  in  academic  or  oSccupa- 
tional  performance?       '  ' 

It  is  not  .easy  to  fix  what  we  are  findii^g  with  differences  in  tesl 
scores.  Therd  have  been  niytwerous  experimente  to  try.  We  found, 
for'^example,  removing  test  itemtf  which -appear  to  differentiate 
between  groups,  in  general  ability  teste,  to  take^  that"  procedure 
would  more  than  likely  result  in  the  removal  of  virtually  all  erf  the 
items  in  the  teste  because  the  difference  is  consistent  across  all  of 
the  items. 

Those  who  have  supported  these  bills  have  diligently  resisted  or 
downgraded  all  refererices  to  the  teste'  validity  and  reliability. 
Rhetoric  has  been  used  in  place  of  evidenced  and  misleading  con- 
^Cepte  such  as  extent  of  variance  accounted  for  liafe  been  waved 
'  like  flags  at  a  parade. 

As  a  firm  rule,  given  the  critical  nature  of  these  proceedings,  this 
committee  shcAild  remain  unconvinced  by  such  argumente  and 
should  kno^utfiat  a  wealth  of  data  establishing  the  validity  and 
usefulness  o^these  instrumente  for  their  pttrpose  is  available  to  the 
committee,  gA  it  was  to  the  advisory  panel  and  has  been  to  respon- 
sible r^searchtr^.  Contrary  to  what  you  have  heard,  data  has  been 
available.  \ 

There  is,  too,  a  substantial  number  of  studies  available  concern- 
ing the  fextent  to  which:  these  teste  also  are  applicable  to  subgfoups 
within  the  total  tfest  taking  population  and  whether  changing^  tne^ 
content,  the  speed,  or  the  format  of  the  teste  eliminates  the  defi-* 
ciencies  which  exist  among  certain  subgroups,  generally,  no,  it  does 
ngt.  .  - 

In  general  termsj  the  cgnimitte^  first  should  be  wa^v  of  any 
statements  bafied  on  evidence  flfbrtf  one  study.  Responsi  ne  profes- 
sionals do  not  usfe  one  study  to  pei'suade,  particularly  wh  n  there  is 
a  larger  body  of  evidence  available,  as  there  is  here.  Tfo  dp  so  is 
contrary  to  professional  ethics  and  is  analogous  to  taking  a  ri^in 
out  of  context. 


Second,  the  larger  body  of  evidence  shows  that  there  is  a  consist- 
ent and  likely  underestimated  relationship  between  test  scores  and 
subsequent  performance  which  ifl  sufficiently  high  to  justify  the  use 
ot;  the  tesls.  Obviously  tests  are  far  from  i*rfect  predictors,  a 
condition  which  is  even  more  trufe  of  any  subjective  approaches 
which  you  have  hfeard  mentioned  here.  ^ 

If  you  were  to  summarize  the  data  that  exists,  it  would  say  the 
tests  are  valid  for  their  .purposes.  cHigh  school  grades  are  generally 
better  predictors,  but ''the  use  of  tests  in  combination  with  the 
^graides  arie  a  bettier  predictor  of  college  performance.  ^ 

High  school-grades  alone,  you  ha^^&^jjeard  questions  about  if  high 
schooL^ades  are  as^good  as  or  bette?^  than  tests, 'whV  not  use 
grades.  Those  who  raise  •the*  question  typdesdly  share  a  misplaced 
conviction  that  te^ts  are  riot  valid  for  minorities  or  females.  The- 
faqt  is  they  are.  '  -      .    •  *    '  ^  *  . 

.  ^The  proponents  of  this  argument  are  not  aware  of  the  "validity  of 
te8t>  scores  and  high  school  grades  ugQ^in  combination.  By  recom- 
mending using  just  high  school  ^gi;ades,  y6u,  are  recommending  a 
less.yal.id  mea^s  for  fleeting  people  for  these  critical  functions  and  ^ 
aspects  .of  Our  society.        *       '   •      .  < 

It  may  be  that  high  school"  grades  would  ,not  show  such  a  rela- 
tionship if  test  scbres  were  not  present  to  interact  with  them.  It  is 
lughly  likely  that  colleges  and  Universities  fifre  using  test  scorcjs  to 
a  significant  degree  to  determine  the  reliability  of  grades,  for  it  irf 
senseless  to  argue  that  Alg _fiCnd  B's  from  EHstrict  of  Columbia 
^sdhbols  are  equivalent  tp  those  of  Montgom^^^ 

I  think  a  poll  of  the  meml^rship  of  both  Houses  in  terms  of 
Representatives  who  live  in  the  District  of  Columbia  and  who  have 
children  of  ^hool  afee,  I  would  ask,  where  do  yoy  send  your  chil- 
dren. It  as  not  likely  to  be  .  the  District  orColumbia  piiMic  schools. 
They  have  made  their  judgment  the  game  as  ihstitutions  make 
their  jtidgmenti^.        ,     .  4^       %    ^  i 

If  the  projposed  bills  are  passed  and  test  Tisage  diminishes,  as  it 
will,  and  don't  fool  yourselves  about  that,  college  and  university 
admissions  systems  will  relV"  more  heavily  on  high  school  grades, 
but  more  in  terms  of  "safe  schools— those  high  schools  known^^to 
be  of  higher  quality.  ; 

The  net  result  could  be  fewer  students  Selected  from  poorer 
schools,  partipularly^those  in  the  cities  with  their  higher  proportion 
of  minorities^  jWith  the  objectives  and  pressures  that  the  admis- 
sions systems  have,  candidates  from  th6  Montgomery  schools  would 
be  th6  safer  beta  and  the  safe  .choice  woUld  ^nore^  often  than  not  be 
.  made. 

You  have  aiskc^  about  test  scores  and  income  level  as  if  the 
relationship  betW'een  test  scores  surprised  you.  It  should  not.  The 
relationshii)  exists  between  tat  scores  and4ncome  levels.  But  that, 
is  a  simplistic  look  at  it.  ^  . 

A  fujler  exploration  of  thfe  subject  M^ould  show  that  families  with 
higher  income  include  more  two-parent  families,  more  higher  edu-, 
cated  families,  smaller  family  size,  more  value  being  placed  on 
e^ucjation,  more  books  iti  the  home  during  the  early  formative 

3 (08,  and  better  diet  for  both  mother  and  child  in  the  early  years, 
ong  with  attendance  typically  at  better  secondary  education  insti- 
tutions^     >  ,  *  ♦ 


Ail  of  these  things  are  related  to  higher  ^scores  and  higher  per-  . 
formance  in  school.  It  also  should  be  clearly  understood,  ©specially 
to  those  Who  have  raised  th|  question  as  to  whether  lygh  school 
grades  vvould  suffice  as  a  sole  measure  of  academic  success,  that 
high  school  grades  also  show  these  kinds  of  relationships. 

H.R.  4949  requires  testing  agencies  to  provide  statements  con- 
cerning the  extent  to  which  test  preparation  courses  improve  test 
subjects'  scores.  This  is  an  impossible  and  meaningless  task.  It 
would  be  easier  to  ask  beauty  schools  ±o Veport  on  tbe  extent  to 
which  they  make  change.  With  test  schools  it  is  virtually  impossi- 
.  ble  to  do.  ^  — 

And  the  question*  must  be  asked,  does  it  have 'any  meaning,  what 
meanipg  is  increased  if  it  . occurs?  There  can'be  no  question  in  my 
mind  despite  some  claims  tp  the  contrary  that  have  been  made 
before  you  that  coaching  makes  change,  I  think.  There  js  no  ques- 
'  tion,  too,  that  coaching  is  a  burgeoning  industry. 

I  think,  Mr.  Weiss,  you  have  pointed  out  the  number  of  branches 
of  jugt  one  organization  in  the  test  ^^oaching  business.  Pas|age  of 
the  bill.  However,  will  add  to  that  growth  and  make  the  CQach  s  job 
more  easy.  They  don't  have  to  resort  to  circuitous  means  to  get 
tjiat  information.. 

There  |[b  still  considerable  controversy  on  the  extent  to  which 
coaching  changes  scores,  and  more  importantly,  on  the  real  value  , 
^  of  the  chknges,  if  indeed  they  do  occur. 

V  It  is  reasonable  to  assume,  however,  that  coaching  for.  most  per- 
sons will  result  in  an  increase  in  the  score  they  otherwise  would 
have  gotten,  lifis  difficult  to  measure  the  magnitude  of  the  differ- 
ence and  the  extent  to  which  other  variables  will  affect  the  differ- 
ences which  will  occur.  ^  . 

But  it  is  simplistic  to  evaluate  coaching  in  those  terms,  Based  onA 
studies  conducted  on  other  elements,  including  the  performance  of 
various  subgroups  on  tests  containing  content  and  more  related  to 
their  subgroup  and  the  effect  of  the  removal  of  time  limits  on 
speeded  telsts,  it  is  reasonable  to  expect  that  majority  enrollees  who 
are  already  higher  scoring  will  in  such  courses  have  a  scOTe  gain  at 
least  as  much,  perhaps  more,  than  minority  enrollees. 

If  one  considers  all  of  the"  things  related  to  higher  income  that 
were  discussed  above,  it  also  is  reasonable  to  expect  that  enrollees 
in  these  courses  from  higher  income  families  will  achieve  changes 
at  least  as  high  and  probably  greater  than  low-income  families.. 

In  shortf  itis  unlikely  that  establishing  funding  to  insure  that  all 
persons  hiave  access  to  coaching  schools  will  do  much  more  than 
wildly  enrich  the  coachers.  Tliose  who  would  have  scored  higher 
without  the  coaching  will  be  more  likely  to  take  advantage  of  it 
and  will  achieve  greater  gains.  The  differences,  thereTore,  will  not 
be  erased  and  may  well  be  incrieasecl. 

If  thei?^e  is  to  be  a  test  oif  test  coaching,  reporting  score  differences 
that  occur  is  not  sufficient.  The  test  of 'test  coaching  will  be  Its 
validation,  to  what  extent  do  those  persons  entering  test  coaching 
schools,  and  who  have  a  subsequent  increase  in  scores,  perform  to  a 
similar  higher  degree  when  they  go  into  the  educational,  setting  or 
is  that:  increase  false? 

For  exaitaple,  coaching  on  analogies  will  improve  analogy-solving 
skill  and  those  coached  will  do  better  on  that^it^m  txp^. 


The  question  remains  as  to  whether  that  improved  test-taking 
skill  improves  performance  in  college.  The  solving  of  analogy  prob- 
.  lems  for  some  reason  is  related  at  least  .in  part  to  college  grade 
achievement.  It  is,  however,  not  a  direct  sample  of  the  performance 
"ttehavior;  that  is,  getting  §ood  college  grades. 

Since  the  relationship  is  not  clearly  direct,  a  coached  ability  to 
solve  analogy  problems  may  reduce  or  eliminate  the  predictive 
power  of  that  kind  of  item  for  the  individual  involved. 

In  short,  the  difference  may  be  artificial  in  terms  of  test  ability 
but  have  no  meaning  in  terms  of  test  performance  in  the  acsfdemc 
sipfting.  Test  coaching  and  the  trud  test  of  it  lies  in  the  validation 
of  increased  performance"  or  the  performance  ^is  a  result  of  coach- 
ing to  determine  empirically,  does  coaching  and  the  increaises  re- 
sulting from  it  result  in  a  corresponding  increase  in  the  peiform- 
ance  of  those  individuals  coached  in  the  college  setting? 

Mr.  Weiss.  We  have  about  7  or  8  minutes  to  answer  the  quorum 
calj.  We  will  have  to  leave,  but  we  will  be  back  a^  quickly  as  we 
can.  •  ^  *  I 


Mr.  Weiss.  We  are  ready  to  resume. 
I  should  indicate  and  should  have  at  the  outset,  at  any  time  if 
any  of  you  wants^  tp  summarize  your  statement  or  highlight  it,  the 
entire  statement  of  each  of  you,  without  olqection,  will  ite^  entered^ 
into  the  recorci  so  use  your  own  judgment  if  you  want  to  ^ave  it 
entered  into  the  record  automatically,  &nd  how  much  you  want  to 
givao^ally. 

Mr.  Erwin.  I  will  close  very  quickly^  Mr.  Chairman,  with  several 
more  points.  n 
'  One  is  destroying  tests,  whether  it  will  or  won't.  The  legislation 
Will  indeed  destroy  some  tests,  particularly  those  lA  the  achieve- 
.ment  area  and  especially  ^thdse  such  as  autobiographical  question- 
naires, which  L  might  note  For  you  that  if  there  is  any  promise  on 
suitable  iilternatives,  autobiographical  information  is  probably  the 
best  promise  or  ha^  the  best  promise.  ,  . 

r  My  statement  deiscribes  this  system  much  more  fully,  but  provid- 
ing answers  to  questions  on  autobiographical^  questionnaires  will- 
destroy  them  because  of  the  inherent  characteristics  of  th^t  kind  of 
instrument.  » 

There  has  been  considerable  research  that  indicates^  that  these 
do  indeed  have  less  impact  than  the  kinds  of  instruments  we.  are 
discussing  here.  Achievement  tests,  depending  on  how  specific  the 
knowledge  measured,  will  become  less  valid  in  the  short  term,  and 
in  the  long  t^rm  Could  eliminate  quite  a  few  of  them. 

The  time  involved  to  handle  what  is  before  you  is  extraordinarily 
short.  The  panels  of  which  I  was  a  member,  the  advisory  ^anel  on 
toore  decline,  took  2  years  to  reach  its  conclusion  and  even  at  the 
end  of  the  2  years  we  felt  very  strongly  we  could  have  used  another 
2.  We  commissioned  87  separate  studies  as  part  of  that  work. 

The  Federal  agencies  in  publishing  the  uniform  guidelines  on 
employee  selection  procedures;  namely,  the  Departments  of  Labor 
and  Justice,  the  Department  of  Ti^easury  involved  peripherally. 
1%e  EEOC  and  the^Omce  of  Jpersonnel  Management  took  6  years  to 
arrive  at  its  unifonn  guidelines.  You  are  being  asked  to  proceed  to 
mark  up  in  some  6  to  8  weeks  the  subject  being  ^o  complex  and  so 


>  critical  which  cannot  be  handled  or  dismissed  in  so  short  a  period 
of  time. 

The  opposition  that  you  are  hearing  is  more  than  from  test 
.  publishers.  The  America^  Psychological  Association  registered  its 
dissent  in  . the  proceedings  on  the  New  York  bill.  The  colleges  and 
universities  uniformly  oppose  the  bills  before  you.  .  \ 

The  business  community  opposes  the  bills  before  you;  and  insofar 
as  ^PA  is  concerned,  it  woiild  oppose  the  bilfs  m  their  present 
form  and  would  recommend  Either  rejection  or,  at  the  minimum,  a 
'  putting  on  the  shelf  for  a  month.  You  qould  raise  a  question  as  to 
which  is  better  for  the.  industry,  and  for  what  we  are  trying  to  do 
in  measurement,  the  threat  of  the  iron  or  the  iron  itself. 

In  terms  of  the  irons  that  are  proposed,  they  are  not  adequate  for 
their  purpose.  We  do  have  legislation  in  New  York.  We  have  less  [ 
onerous  legislation  in  California. 

Two  States  have  turned  down  similar  proposals.  The  National 
'Acad^n^y  of  Science  has  been  taking  hearings  on  the  subject  of 
ability  testing  and  is  sclfieduled  to  release  a  report  in  the  middle 
1980*s.  I  would  recommend  at  a  minimum  that  we  wait  until  expe- 
rience is  gained  in  New  York  and  California  and  the  balance  of  the 
States,  and  at  least  until  the  National  Academy  of  Sciences  has 
published  its  report.  ' 

I  think  in  the  interim  that  this  .committee  has  done  ah  extraordi- 
nary job  of  .surfacing  what  is  indeed  a  problem  and  that  surfacing 
is  going  to  have  some  effect  in  terms  of  things  being  done  better 
£fnd  things  changing. 

Perhaps  we  could  convince  the  Federal  Government  to  do*  more 
than  it  has.  Its  action  thus  far  has  been  to  substitute  for  the 
Federal  "service  entrance  examination  jbl  similar  example  called  the 
PACE.  .  ^ 

It  has  halitosis  in  one,  bad  brteath  iti  the  other.  They  are  inter- 
.  changeaWe,  and  there  needs  to  be  much  ftiore  done  m  terms  of 
suitable  alternatives.  The  action  of  this  committee  thus  far,  the 
threat  of  the  iron  will  help  considerably  but  in  terms  of  final 
action  the  committee  should  wait. 

Thank  you  very  much. 

[Prepared  statement  of  Frank  Erwin  follows:] 


Pkepared  &^Atement  of  Frank  "W.  Erwin  on  Behalf  of  the*  American 

f     Society  for  Personnel  Administration 
*    /  * 

Mr.  pydTman,  JKeidbers  of  the  Committee,       ntoe  la  Frank  W.  Ervln.    Fqt  the 
past  eleven ^64^8 »  \  have  been  Prealdent  of  Richardson,  Bellowa,  Henry,  and  Company > 
«  nationally- recogwzed  personnel  research  flrrn  headquartered  here  In  Washington,  D.C.. 
In  that  position  ^^f  have  been  lhvolv^d'<rlhtlmately  and  directly  In  the  development  and 
vsl.ldstlon  6f  selection  procedures'/  pattlcu).ary  teats,  and  during  two  of  thoae  years 
ser^d  as  member  of  the  Advisory  Panel  on  the  Scholsstlc  Aptitude  Test  Score  Decline. 
I  so  appearing  before  you  this  morning  In  the  hope  that  what  experience  1  liave  will 
be  helpful  to  you,  and  additionally  to  express  the  views  snd  the  concerns  of  the 
American  Soclefy  for  Personnel/ Admlnlstrstlon  (A5PA)  on  the  proposed  testing  legislation 
you  sre-  considering.    This  Society,    which  consists  of  over  twenty-three,  thoussnd 
personnel  prsctlcltl6ners  In  business,  government,  snd  education,  hss  csuse  for  concern, 
since  any  action  of  this  Committee  which'  in  any  wsy  oompromlses  the  qusllty  of  thoa'e 
entering  higher  educstlon  ultimately  v;l.ll  compromise  the  quality  of  those  who  we 
expect  to  mansge  our  enterprises  in  the  .years  to  come.  .  .  ^ 

In  thsf  contiext,  we  have  approached  this  testimony  with  a  great  sense  of 
apprehension,  which  we  hope  this  Cpnnlttee  will  share.    H.R.  3564  snd  H.R.  4949  venture 
into  due  of  the  most  ^complex  fields  ever  addressed  by  this  Committee  and  you  ate  being 
AskedJfto  take  a  precedent-setting  and  dangerous  step  toysrd  regulation  of  the 
edyca  :ionaL  admissions  process  and  ^le  procedures  which  serve  ,  st  least  in  part,  as 
indicators  of  .the  quality  of  our  society  and  its  Institutions.    .The  statement  which 
we  ik^e  today,  therefore,  attempts  to  address  major  elements  which  must  be  considered 
as  part'  of  y'c^r^detarm^natiqns^ss  to  the.j)eed,  the  purpose  snd-  the  potential  impact 
of  the  pr(/p<»als  'before  you.    ^  . 

^The  Role  of  Tests  *  .  *  . 

'^'la  Excellence,  John  Gardner  vrote^  that, "T^sts  are  designed  to  do.  an  unpopular 
job..  An  untutored  observer  listening  to  critics  lash  out  at  the  inperfectiotis  of 
the  tests  might  suppose  that  the,  criticisms,  would  be  stilled  if  the  tesfs  were 


perfect.  .Not  at  all..   Aa  the  testa  Improve  and  become  less  vulnerable  to  present 
critldam,  the  hostility  to  then  may  Increaae.    A  proverbial  phrase  Indicating  complete 
rejection  Is,  *I  woul^n^t  like  It,  even  If  It  were  good,'    With  the  tests,  the  more 
%)propjdlate  phrase  might  be,   'I  wouldh^t  like  them,  especially  If  they  were  good.'" 

Testa  of  course  serve  as  predictors  and  It  I3  this  function  to  vhlch  Mr.  Q^rdner  > 

"l  "       ■  ^    '   .  '■ 

'  ^principally  refers.    The  concept  he  expresses,  however,  slso  Is.  applicable  to  the 

^  ■    ■  .  *. 

role  of  test    scores,  as  messengers  about  our  excellence  as  a  .socli|f:y  and  the  exten^  .' ,  ' 

to  which  our  Institution?  are  functioning.    Interestingly,  while  you  are  being  asked 

to  begin  restricting  the  use  of  teats,  the  messages  we  have  been  getting  are  ^ 

Increasingly  unflattering  and  unpleasant.  .In  education j  these  messages  center  abound  '.' 

the  fact  that  our  schools ,  particularly  those  where  our  poorest  citizens  are  clyster^ , 

ate  doing  an  Increasingly    Inadequate  Job,'  despite  massive  tranfuslons  of  fed^al  funds. 

Fewer  and ^ fewer  students  are  able  to  read  and  write, tor  add,  subtract,  divide,  and     .  / 

multiply  and  the  National  Education  Association's  response  Is  a  call  for  a  o^Ora^orlum  v 
»■  ^    ■  '  «  ' 

on  the  use  of  tests.    In  the  employment  setting,  due  principally  to  civil  righJf^8 
7 enforcement  activities,  :tests  and  test  practices  are  better  than,  ever  before yand  these. 
I  messages  are  cantering  around  the  fact  that  those  who  do  less  well  on  the .testa. 

7  ■ .  '  ■  .  •  ••  ■ 


f 


Irrespective  of  subgroup,  also  are  doing  less  well  on  the  Job. 

All. of  this -should  raise  questions,  first  concerning  how  we  can  manure  qualify 
objectively^  without  the  use  of  tests,  and  second  whether  some  of  <^e  sypporters  ot^ 
H.R.  9564  and  4949  have  a  hidden^  a^genda.    the  test    meaaengers,  lllCeyhermometers, 
are  telling  us  that  we  have  a  worsening  lllpess.    Rather  than  seeking  a  cure  for  the 
disease,  those  for  whom  the  test  results  are  most  threatening  would/ ask  you  to  restrict 
and  preferably  destroy  the^use  of  thermometers.    Like  Persian  kin^j  they  would  slay 
the  messengers  who  bring  them  bad  tidings.  V 


781 


Thtfc  VaUdity  of  and  ^liability  of  TMti  * 
«      8oM  of 'the  voitr  cavalier  ,  teitimny  that  thla  CoiatfitCee  has  been  subjected  to 
concema  the  extent  to  which  adrntsslons  tests  achieve  their  basic  purpose-;  That  ls»  .  . 
to  p^vlde  oila  objedtlve  aeans  by  which  An  Individual's  probable  college  performance,  ' 
particularly  firs t  year  grades »  can  be  eatlmated.   Questions  also  have  been  raised 
•a  to  whether  the  teats  show  validity  for  all  groups  who  must  take  them. 

Those  who  have  supported  these  bills  hii^e  diligently  resisted  or  downgraded  all 
references  to  the  . tests'  v^ldlty  and  reliability.    Rhetoric  has  been  Ised  In  place 
of  evidence  and  misleading  concepts ,  such  as  extent  of  variance  accounted  for,  have 
been  waved  like  flaga  at  a  parade..  As  a.  firm  rule»  given  thA  critical  nature  of 
these  proceedings,  this  Committee  should  remain  unconvinced  by  such- arguments  snd 
should  kiio«^  that  a  wealth  of  data  establishing  the  validity  and  usefulnesrs  of  these  . 
Instruaeiits  for  their  purpose  ^^s  available  to  the  Committee,  as  it  was  to  the  Advisory 
Panel  and  has  been  to  responsible  researchers*    There  is,  too,  a  Substantial  number 
of  studies  available  concerning  the  extent ^o  which  these  tests  also  are  applicable, 
to  subgroups  within  the  totaji  test-taking  population  and  whether  changing  the  content, 

ff  the  teats  eliminate 
.  ■) 


the  speedy  or  the^  format  pf  the  teats  eliminates  the  deficienciej|  which  exie^  among 


certain  subgroups  •  f  ..^  *■  ' 

In  general  terM»  the'' Conalttee  first  should  be  wary  of  any  stateotents  1)a9ed  on 
evidence  from  one  study.    Reaponaible  professional^  do  not  use  one  study  to  persuade, 
patticularly  when  there,  is  a  larger  body  of  evidence  available,  as  there  is  here.  To 
^^o  so  la  contrary  to  professional  ethica  an(|  is  analogous  to  taking  a  remark  out  of 
context. 

Second 9  the  larger  body  of  evidence  ahowa  that  there  is  a  conaistent  and  likely 
,  undereatlMted  relationahip  between  teat  acores  and  aubsequtnt  p#rformance  which  is 
sufficiently  high  to  Juatify  the  use  of  the  tests.    .Obviously  t^Sta  are  far  frott 
perfect  predictors,  a  condition  which  la  even  more  true  of  any  aubjective  ap.proacfiea 
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vhich  you  have  h^ard  vMintloned  her^.    Our  own  sunnary  of  all  of  the  data  reviewed 
would  be  thaC.  admissions  tests  are,  valid  for  their  purpose,  that  high  schopl  grades 
are  generally  better  predictors  than  the  tests.i  and  that  use  of  a  combination  of  tests^ 
and  high  school  grades  results  in  a  nore  vall^  and  therefore  fairer  measure  of  college 
potential,  trreapective  of  subgroup, • than  either  element  separately.    The.  question  is, 

doe?  this  Conaiittee,want  to  propose  legislation  to  require  that  form  of  use? 

.«.  I  ■ 

•    •  '  -J      .   .  ■.  '      .  ■ 

High  School  Grades  Alone      ■     '         .\       ■  " 

-■        ■  ^.      ■  .  ' 

One  question  you  have  heard  liaise^  is  (hat  if  high  school  grades  are  as  good  as 

or  better  than'te^ts,  why  not  Just  use  grades?  * 

•  ■  .  #  - 

Fl]%t,  those  who  raise  the  question  typically  share  aTaiaiilaced  conviction  tjiat 

'■'■«.'  '  * 

tests  are  not  valid  for  minorities  or  females.    The  fact  Is  they  are.    The  proponents  . 
of  this  argument  also  are  deliberately  Ignoring «or  are  unaware  of  the  greater  validity  '  ; 
of  teflft  scores  and  high  school  grades  used  In  combination*    They  are' In  effect  ^ 
c^ecomnendlng  a  less  valid  and  therefore  less  effective  means  to  Identify  those 
■most  nicely  to  keep  this  country- competitive.    It  .may  Well  be,  too,  that  high  school 
gradea  would  not  show  such  a-^lgh  Relationship  If  test  scores  were  not  present  to 
Interact  with  then.    It  1b  highly  likely  that  colleges  and  unlv6raltles  are  using  test 
scores  to  a  significant  degree  to  determine  the  reliability  of  grades,  for  It  Is 
senseless  to  atgue  that.  A's  and  B's  from  District  of  Columbia  schools  are  equivalent 
to  those  of  Montgomery  County.  '        '  . 

Finally,  and  most  importantly,  it  the  proposed  bills  are  -passed  and  test  usage 
diminishes,  as.  It  will,  college  and  university  admissions  systems  will  rely  more  heavily 
on  hlph  tchool  grades,  but  more  In  terms  of  "safe"  schools-^^thos^  high  schools  known 
to  be  of  higher  quality^*'  The  net  result  could  be  fcwy  students  selected  from' poorer 

r  * 

schools,  particularly  those  in  the  cities  with  their  higher  proportion  of  minorities. 
The  admissions  system's  responsibility  Is  (1)  to  ensure  ^e  quality  of  ths  Incoming 
student  population  so  as  to  miiilntaln  the  Institution's  standards  of  excellence. 
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(2)  .  to  Identify  candidates  vith  the  competence  at  ^leaat  to  abaorb  tHe  educational 
off«rlngp  (3)'  to  Biolmlze  freshman  yeat  attrition  rates  In  order  to  maintain  the 

*        •  V 

Institution's  economic  viakLlity,  *Bnd  (4)  to  eAaiire  that  public  and  private  employers 
look  to  the  institution  aslbne  providing  high  quality  graduates.    With  these  objectives 
and  their  accompanying  pressures,  and  contlnufVig  the  example  above i  candidates  from 
the  Hontgooery  County  schools  would  be  the  safer  beta  and  the  safe  choice  would  more 
o£ten  than  not  be  the  one  made. 

.  /■  ,  •     ;  .  * 

Teat  Scores  and  Income  tevel 

This  committee  has  been  asked  rhetorically  if  it  were  surprised  that  test  scores 
and  income  level  are  strongly  related.    The  fact  is  that  tests  scores  and  income  levelr 
arc  strongly  related.    It  is,  however,  a  aimplistic  look  at'  the  problem.    A  fuller 
exploration  of  the  aubject  would  show  that  families  with  higher  income  include  more 
tiK^parent  families',  isore  higher  educated  families .  amaller  family  size,  more  value 
being  placed  on  education,  more  books  in  the  home  during  the  early  formative  ages, 
and  better  diet  for  bot^  mother  and  child  in  the  early  yeara,  along  with  attendance 
typically  at  better  secondary  education  institutions.  ■  All  of  these  things  are  related 
■  to  higher  scores  and  hi gher"* performance  in  school.    It  also  should  be  clearly 
understood,  especially  to  those  who  have  raised  the  question  aa  to  whether  high  school 
grades  would  suffice  as  a  sole  measure  of  academic  success,,  that  high  school  grades 

also  show  these  kinds  of  relationships.  ,  ^ 

» 

tiea.t  Coaching.  .        *    .  , 

f —  ^   .  , 

B.R.  A9A9  requires  testing  agencies  ^  provide  atatements  concerning  the  extent 

to  ^which  test  preparation  couraetf  improve,  teat  subjects*  scores.    This  is  an  ^ 

.      \  ■  •■ 

iapossibXe  and  aeaninglcsa  task,  j  ^ 

There  can  be  no  queation  that  test  coaching,  particularly  aidmiflsions  test" 
coachings  has  bi^one  a  burgeoni^Tgyndustry .    There^an  be  no  question^  too,  that  the 
provisions  of  the  billl^  having  toWo  with  the  release  of  tes^  answer  sheets 
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and  anivera  will  add  to  that  growth  and  make  the  coaches  job  easier.    They,  no  longer 
vUl  hAva  to'reaorfc  to  clrcuitoiu^  neana  to  get  their  raw  material. 

There  la  still  considerable  contrdveTsy  on  the  extent  to  which  coaching  changes 
acorea  and  sore  Importantly  on  the  real  value  of  the.  changes »  If  Indeed  they  do  ptcur. 

It  la^reasonable  to  iaaaume,  however,  that  coaching  for  most  persons  will  result 
in  an  increaae  in  the  score  tliey  otherviae  would  have  gotten.    It  la  difficult  to  . 
measure  the  magnitude  of  the  difference  and  the  extent  to  which  other  variables  will 


affect  the  differencea  which  will  occur.    Baaed  on  (tudies  conducted  on  other 
elenenta  auch  119  the  performance  of  varioua  6ubgroup^>n  teats  containing  content 


I  Itudl 

>upw>n 
^e  rca 


more  related  to  thoif  subgroup  and  the  effect  of  the  removal  of  time  limlta  on  speeded 
teata,  it  la  reasonable  to  expect  that  majority  enrolleea  who  are  already  higher 
scoring  will  in  such' courses  have  a  score  gain  at  least  ae  much,  perhaps  more  than 
minority  enrolIaetT^,    If  one  considers^,*!!  of  the  things  re late(L.^o  higher  income  that  ^ 
were  diacussed  above,  lt|alao  la  reasonab^  to  ex^ct  that  ehrollees  in  these  courses 
from  higher  income  families  will  achieve  changes  «  least  aa  high  and  probably  greater 


^      than  low  Income  enrollees.    In  short,  it  is  unlikely  that  establishing  funding  to 

ensure  that  all  persons  have  acceaa  to  coaching  schools  will  do  much  more  than  wildly--^ 
enrich  the  coachera.    Those  who  would  have  scored  higher  Without  the  coaching  will  be 
more  likely  to  take  advantage  of  it    and  will  achieve  greater  gaina.    The*  difference* 
therefore,  will  not  be  erased  and  may  well  be  increased.  .  •  . 

There  »l80  is  a  question  as  to  the  value  of  reporting  score  changes.  Scqte 
:    .    changea  are  not^the  ^e  measure  of  the  effectivenesi  of  coaching  achoola.    At  thia 
point,  there  is  no/reaaon  to  assume  that  sco^  changea  brought  j'bout  by  coaching  will 


reault  in  equivalent  changea  in  college  grades.    Thbae  individuala  who  are  coached 
wl^  be  teat  smarter,  but  there  la' serious  question  aa  to  whether  th^ir  mastery  of 
content  area  has  been  increased  to  the  point. where  it  will  make  a  difference  in 
college  grade  achievement-.    For  example,  coaching  on  analogies  ^11  improve  analogy:* 


er|c 
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•olvlng  skill  so  that  those  coached  vlll  do  better  on  that  type  Item.    The  question 

reaalna  as  to' vhetheir  that  Improved  teat-taking  skill  Imptoves  performance  In  college. 

Tha^aolving  of  analogy  problems  for  some  reason  la  related  at  least  In  part  to 

college  grade  achievement.    It  Is,  hove,ver,  not    a  direct  aaiaple  of  the 

l»erformance  behavior;  that  Is,  gettlng«sood  college  grades.    Since  the  relationship 

Is  not  clearly  direct,  a  coached  ability  to  solve  analogy  problems  may  reduce  or  ' 

eliminate  the  predictive  poyer  of  that  kind  pf  Item  for  the  Indlvldtual  Involved. 

The  true  test  of  coaching  s(!hools  and  coaching  tetfhnlques,  therefore,  lies  In  their 

validation  and  that  validation  need  only  would  be  satisfied  by  a  subetantlal  showing 

*  ■ 

that  the  Increased  performance  on  the  admissions  teat  as  a  consequence  of  coaching 
vas  also-delated  to  Increased  {Performance  In  the  college  setting. 


Pes  troy  In  R  The  Tests 
^  You  haVe  heard  repeated  assu^nces  that  the  pubjLlc  release  of  teat 

Itev  and  answers  will  not  destroy  %  reduce  their  valldlt;y.    That  adlvsory  Is 


teija 


patently  false  on  both  Counts  and 


record  should  show  that  the  profession  .does  not' 


uivtf 

agree.    In  a  telegram  sent  to  Governor  C»ey  prior  to  the  passage  of  the  New  York 


legislation,  the  American, Psychologlcll  Association  made  It  abundantly  clear  that 
Section  3U2  of  that  bill  w6uld  result  In  decreased  predictive  validity  of  the  tests. 
The  Association  fiirfcher  saw  no  purpose  |l)elng  served  by  the  release  of  test  Itemtf  and 
vanswers  ceiled  for  under  that  Section. 


As  to  asBurancea  that  this  legislation  will  not  destroy  tests,  that  must  be  . 

»  '  *  ■ 

responded  to  In  terms 'of  test  type.    At  one  end  of  the  test  spectrt^jn  la  found  the 

SAT,  the  ACT,  and  tests  coononipk. described  as  general  aptitude  l^sVrumenCs.  These 

teats,,  balog  of  a  more  general  nature,  have  a  wider  body  of  knowledge  frop  which  to 

draw  and  the  problem  of  repeated  Item  creation  Is  less  acute  than  with  any  other  test 

type.    The  testu  whlch  are  the  prlmaiy  focus  of  these  bllle,  therefore,  will  be  most 

likely  to  last  longest  in  Iterna  of  the  release  provision.-  The  ude  of  such  tests  will 


ERIC 


dlainlththovever,  and  costa  will  |o  up»  as  will  the  use  of  other  teets  and  leas 


11  |o  u 


reliable  kinds  of  Inforsatlon.  ^T4|^  adalolatratlona  will  become  leas  frequent;  If 
ona.hatf  to  releaMi  teat  anawera  every  tine  a  teat  la  given,  why  ^Ive  It  ao  often  to 
accoBodate  student  aqd  subgroup  needs?  ^Research  Into  altetnat^e  aiethods  also  will 
dlmlnlah*    Since  new  devices  will  be  comproalAd  Inmedlately  and  copy.rJI^ts  of  ^ 
developers  will  have  been  rendered  meaningless,  the  economic  Incentive  will  be  gone.t 

'^^^■P  the.  next  point  In  the  testing,  apectnim^  one  will  find  the  full  array  of 

'  achleveiibnt  and  knowledge  tests.    Xgalni  aoae  of  theae  testa  will  have  broader  bodies 

of  knowledge  from  which  to  draw  and  net/  Item  poaalbllltles  will  be  greater.    As  a 

general, rule,  however.  It  can  b^^atated  that  the  more  ftedflc  and  therefore  more  • 

limited  the  field  measured  by  a  knowledge  oif  achleveme|p  teat,  the  more  likely  It  la 

that  the  creation  of  new  items  will  become  Increasingly  difficult  and  that  the. quality 

of  theae  teat  a  will  diminish  aa  a  consequence  of  less  precise  meaaurement,.  Ultimately, 

the  breach  of  security  provisions  of  these  bills- 4lll  result  In  many  of  these  teats* 

.  demise  aa  meanlngfxil  Indicators.    Also,  If  the  quality  of  these  Inis t rumen ts' does 

substantially  Alralnlah,  as  Indeed  It  %d.llt^ what  alternatives  are  auggeated  by  the 

proposers?    Afl  you  .have  heard  to* date  on  that  subject  Is  eupheml^is. 
•»       ■  ■  ' 

Finally,  at  the  tOr  ead  of  the.  teat  apectrum,  you  will  find  Intereat  Inventorlea, 

.  y  ■    '  >    ■  • 

.ju<fgement  tests,  leadership  and  creativity  mebsurement  Instruments,  and  perhaps  most  * 
Importantly,  autoblog^phlcal  questionnaires.    If  there  la  onk  characterlatlc  which 
'  la  mhared  by  theae  Instrumenta,  It  la  tha^  there  are  no^rlght  or  wrong  anawera  in  the 
tradltlohal -sense.    "Right"  answers  typically  ar^  determined  on  the  basis  of  empirical 
comparlao'ns  across  popxilatlons. 

You  have  heard . repeatedly  that  traditional  adiclsslons  tests  do  not  measure  the 
peraonal  characteristics  of.  those  taking  them.    That  Is  true,  at  least  In  a  direct 
meaaurement  aense.    You  have'  heard,  toO|.  that  theae  characterlatlca  Include  auch 
things  as  schlevement  orientation,  motlvatloni  Judgment,  and  creativity,,  and  that  " 
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theit  chtract«lrltti6«  wist  bt  ^»a»ur«d      obtain  the  fullest  meaaure  of  the  potential 
contribution 'and  auccess  of  an  individual;    That  alao  ia'erue.    There  ahould  be  fuller 
conaideration  of  auch  elafflenta* 

Thaat' conatruoca*  or  trait  a  aa  thay  say  be  called,  perhapa  can  be  meaaured  .beat 
by  autobiographical  information  <i'ueationnairea.    Jheae  paper  and  pencil  inatruSenta 
ara  baaed  on  the  ainple  logic  that  peraonal  pharacteriatica  are  predictive  and  that 
paat' experience  and  achieveaent  predicta  future  achievement.    Biodata  In^ruoenta 
.  contain  mich  of  vhat  is^ound  in  interviewa,  only  the  instrunente  are  etandardited— 
al  ^rsona  are  faked  the  same  quest iogl  in  Ihe  same,  way— and  their  record  of  validity 
in  occupational  aettings  ia  available  and  eiStraordinarily  impreasiva.    The  "right" 
anawera;  that  is,  those  which  receive  a  score  aje  thoae  which  are  determined  by 
empirical  rcflcar^  to  be  selected  aignificantly  more  frequently  by  the  euccessful 
or  unaucceasful,  however  that  ia  defined..  A  queation  concerning  high  achool  grades 
received  is  a  biodata  item.   The  item  would  call  for  the  respondent 'ta  ii^dicate  the 
"gradea  he  or  ahe  has  achieved,  or  to  deacflbe  hia  or  her  class  standing  in  high  ^  ; 
achbol,  or  both.    If  higher  grades  were  8hown.*l)y  research  to  Jbe  significantily  related 
to  academic  or  occopational  success,  tl\jn  higher  grades  would' be" given  a  positive 
weight  "in  the  scoring  jystem.    Biodata  items  also  can  be  construcled  to  meaaure 
the  significance  of  achievements  other  than  gradaa,  auch  .aa  participation  in 
athletics,  or  in  social  or  comwinity  activitiaa.    Additionally,  they  can  tap 
motivation,  achievement  orientation,  self  concept^  and  work -Orientation  and  valuca. 
le  is  important,  too,,  to  n6te  that  autobiographical  quaationi^alres  seem  to  be 
resulting  inaignificantly  lower  adverae  impact  than  the  traditional  teataf  including 
tha  PAcJuaea  by  the  federal  government .    In  short,  autobiographical  qucationnairea 
ahow  gr^t  prottiae  as  an  alternative  or  complement  to  the  more  tradition|il  tests. 

"A      ■  ■  '  ^ 

Having  aaid  that,  however,'  Jit  rflao  muat  be- pointed  out  that  while  adverae 
impact  may  be  jfeducad  by  the  Ude  of  autob/ogyaphical  queationnairea,  they  cannot  ^ 


•llaliiace  what  the  SAT  and  th«  ACT  t«ll  M  Aput  the  educational  praparednMS  of  low 
•corert*    For  exa^>le,  a  }^ung  man  In  the  Diatrlct  of  Colunbla  achbola,  a  yaledlctorlan 
of  his  cImb,  vas  reporj^d  to  have  been  denied  admlsalon  to  a  university  on  the  basls-'- 
Of  hie  SAT  Bcoresa    Had  those  acorea  been  coupled  In  terna  of  their  uae.vlth 
sAitoblo^taphlciiBL  data — his  gradei,  hla  achievement  as  a  valedlctbrlsp;  and  I  aift  sure 
the  other  activities  that  this  young  man  engaged  In,  the  Impact  would  have  been  . 
diminished  and  most  likely  the  young  inan  would  have  been  selected*    Atythe  same  jtlme 
thete  are  educational  deficiencies  %fhlch  the  SAT  unmasked.    This  young  man,  as  Is  true 
with  hundred  of  thousands  like  him.  Is  beliig  chested.      Education  coats  are  Incteaslng 
at  an  «ljBost  geometric  rate»  but  there  Is  no  conmensurste  Increase- In  the  quality  of 

education ;  In  fact  It  la  going  down  and  Increasing  numbers  of  sti^denta  are^  leaving 

•  .  .  ■  li  ■  ♦ 

schools  unable  to  read  and  unable  to  compute.    As  fat  as  othtir  skills  are  concerned,.  ^ 

'        .  \  .  '  ' 

young  giVls  are  coming  out  of  the  school  systems,  p^tlculsfly  the  large  city  schools* 

with  high  achool  diplomas  Indicating  mastery  of  clerical  skills,  but  when  asked  to 

^it  down  at  a  typewriter  and  take  a  typing  test,  they  manage  to  produce  20  word^  a 

minute.  If  that.    Are  fhese  tests  wrong?  ^' 


Returning  to  the  auti^lographlc^al  Information  questloruialre's  validity  and 
promise  in  the  educational  setting,  if  either  H.R.  3564  or  H^R.  4949^re  passed  with, 
provisions  requiring  reltese  of  test  questions  and  answers,  then  the  use  of 

l^logrsphlcal  Information  as  ajj^tematlve  will  be  permanently  foreclosed.  Given 

-    ■  ♦  ■ 

the  nature  of  the  Instnupent,  releasing  the  right  answers  destroys.lt.    I  would  urge 

.  you  most  strongly  If  you  wish  a  fuller  discussion  of.  the  possible  utility  of  blodata, 

I  ■       ■        ■  ■ 

to  Invite  exjierts  In  the  field  such  as  Dr.  Wllliaa  Owens  from  the  University  of  Georgia, 

Vhere  there  hae  been  extraordinary  use  of  such  a  system;  Iqvlte  Di^.  Halanle  Baehr,  • 

f^^  the  University  of.  Chicago,  wlio  said  In  a  recent  Symposium  that  she  has  been 

uslnjf  biodata  for  yeats  a^id  has  found  no  adverse  Impact.  , 


«  A|tiii»  hoirav«r»  thm  will  bt  and  can  bt  no  quettlon  f roa  any  aource  that  If  elthar 
oot  of  thtsa^lllt  an  paiaed  with  tblf  proviaion  of  ralaaaa  In^thca,  blodata  vlll 
}  '  i^t  aurvlva.   In  fact,  Ita  proolaa  viU  be  foradoaed  before  It  dan  be  conaidejred. 

.  ^  Ihe  aiae  of  thy  Taalc-Conduaion  - •  ....    *  .  . 

An  SIS  ataff  menber  la  alleged  to  have  aaid«  *Ve  are  the^gatekeepera."  ^iThat 

la  an  axtraprdlnai^ly  arrogant  consent,  matched  oaiy'lof  Ita  Injudldouaness. 
.    Neyerth^eaa,  we  are  talking  about  propoaala  to  leglalate.hbw  we  measure  our  excellence 

and  amr  precipitous  action  by  thla  Comndttee  would  be  e^n  vore  Injudicious. 

•■  .■  ■     ■  ■ 

Aa  an  example  of  the  cooiplexity  of  what  you  are  being  asked  to  control,  the 
federal  agencies  Involved  In. clvlf  righta  enforcement  activities,  namely  the  Departments, 
^'of  Juatlce  and  Labor,  the  Equal  Employment  Opportunity  Commission,  and  tt^e^^Offlce  of 
,  personnel  Kanagenent  engaged  in-  the  development  of  what  are  -called  the  Uhlform  '  . 
jCuidelinea  on  Employee  Selection  Proceduree.    These  guidelines  have  as  thi^lr  stated, 
purine  the-' provision  of  advice 'to  the  .employing  community  as  to  how  to  demonstrate 


the  job-relat^iaa  of  their -teata.    The  effort  the  develop  uniform  guidelines  began, 
in  1972  aa  a  recognition  of  inConslatendes  between  standarda  published  by  the  Office 
of  Federal  Contract  Compliance,  the  EEOC,.  and  the  then  Civil  Service  Commission*  The 
proceaa  took  six  yeara  and  tHe  final  document  is  still  the  subject  of  controversy  and 
heated  contention.   The  adequacy  of  certain  of  Its  provisions  will  ultimately  be 
tasted,  in  the  courts  and  there  ia  queatlon  aa  to  ^e  extetvt  to  which  the  agendea 
have  eompoi^ed  with  profeaalot^a^  atandarda. 


Am  indthar  example,  the  Advliory  Pand'of  which  X  was  a  member  accepted  nif 
giveoa  and  took  alaoat  two  yeara  to  reach  Ita  eonclualons.    Bkten^lve  revieya  were 
made  of  aj^atlng  data  and  thlrty-aavan  new  teaaarcb*  acMdlifc^  were  coiqnlaaloned  to 
fltpvlde  the  aiunrara'we  soOght.    Evin  with  that  length  df  tliia  and  that  amount  of 
probing,  ire  felt  tfhat  olir  xoi^  could  have  gone  on.    I  think  It  -important  to  note, 
too,  that  I  would  Expect  that  the  aeoibera  of  that  Panel  wot^d  unanlmoualy  oppose. tt^e 


ItglaUtiva  proposals  b«for^  you. 

In  suMiry,  this  Conmlttea  if  baing  aakad  to  produce  legislation  which  ia 
pathaps  as  far  reaching  as  anything  it  aver  has  beeti  asked  to  do^  and  you  should 
uofc  be  seduced  by  the  blithe  Msurancas  that  you  have  received  concerning^ the  minimal 
Impact  tha't  can  be  expected,  from'thasa  bills,   You^  are  beiiig  asked  to  venture,  into 
on  extraordinarily,  complex  and  critical  subject,  one  which  touches  most  of  us  .it^one 
time  or  another,  and  you  are  b^ng  asked  to  reach  conduaions  on  the  Abject  in  a  aix 
to.  eight  week  tlma  span.  '    .  * 

At  thia  point,  there  is  a  new  law  in  the  State  of  New  York.    There  ia  a.  less 
onerous  law  in  the  State  of  California.    Two  statca  have  considered  such  measures  • 
and. have  rejected  them.    'The  National  Academy  of  Sciences  also  has  gathered  extenaive 
testimony  OD|ahllity  testing  as  part  of  i%B  review  of  the  subject,  and  a  response  from 
tlie  Academy  is  due  to  be  reported  in  mld-19«0,  not  an  unreasonable  time.    It  would 
aaem  at  the  minlaium  that  this  Committee  should. defer  action  of  any  kind  on  theae 
meaaurea  untU  experience  under  the  atate  legislation,  including  ita  posaible  revision 
or  repeal,  is  gained  and  the  National  Academy  of  ^Sciences  report  has  been  published.  ; 

He  are  talking  about  the  techniques  we  use  to  meaau^e  preparedness  and  the 
risks  of  tampering  wltlj  them  are.  incredible.    What  If  the  test;.s  are  right  and  theii?  ^ 
critica  wroni?   WharjS  are  the  altemativaa  we  can  turn  to  if  teats  ara  made  less 
affective  or  destroyed?   Gardner 'a  Excellence  aiao  pointed  out'  that,  "Anyone  attaching 
the  uaafulnaas  of  the  teata  muat  suggest  workable  alt^emativea  *    It  haa  been  proven 
over  and  over  ag^n  that  the  alternative  methoda  of  evaluating  ability  are  aubject  to 
groas  arrors  and  capable  of  producing  graVe  iivjusticea,"   In  one  taspect,  what  you 
have  been  hearing  is  analogous  to  requests  that  permission  be  granted  to  tear  down 
a  building  to  determine  if  ita  architecture  is  sotind.    The  question  mst  be  asked  if 
'  ve  tesr  down  the  building  and  we  do  indeed  determine  that  the  ajichitactura  was  sound, 
who  will  rebuild  it,  what  will  be  left?   Again,  in  the  lA$t  testimony  a  member  asked 


i4iat  l£  thi  mtt  «r«  right,  an  IntrtdAbly  ialitnt  queition  which  was  met  >y  ' 
silanca.-  Fioa^iy*  tha  statawant  that  it  appears  that  only  the  testing  companies  and 
"*  l^ublishars  oppose  these  bills  is  patently  falsa.    The  opposition  is  being  expressed  by 
the  oveivyiming  majority  of  our  colleges  and  universities.    Opposition  already  has 
bean  stated  by  the  psychological  coonunity;  and  these  bills  are  opposed  by  the  business 
cotpunlty  as  veil.    On  balance^  this  legislation  appears  to  be  a  child  only  of  those 
With  a  hidden  agenda,  the  deistruction  of  all  testing  as  we  knott  it.    Th6  Americaii 
Society  for  Personnel  Administration  therefore  opposes  botli  H.R.  3564  and  H.R.  &49 
.  as  ill-conceived,  ill-timed  and  unnecessary.    We  would  urge  you  to  reject  or  shelve 
'    th^  in  their  entirety.  •         .  . 

Thank  you  for  permitting  us  to  appear  before  you.   We  would  be  happy  to  respond 
'  to  any  questions' which  you /have. 

Mr.  Weiss.  Thank  you  very  much. 

Dr.  Fleishman?  ' 

-  STATEMENT  OF  DR.  EDWIN  FLEISHMAN,  PAST  PRESIDENT,  DI- 
VISION OF  INDUSTRIAL  AND  ORGANIZATIONAL  PSYCHOLO- 
GY, AMERICAN  PSYCHOLOGICAL  ASSOCIATION,  PRESIDENT, 
ADVANCED  RESEARCH  RESOURCteS  ORGANISATION 

Dr.  Fleishman.  Mr.  Chairman,  my  name  is  Edwin  Fleishman, 
and*  I  am  happy  to  have  with  me  Dr.  Mary  Tenopyi:,  current 
president  of  the  American  Psychological  Association,  Division  of  • 
Industrial  and  OrganiJsational  PsMjhology.  She  ^vould  be  an  addi- 
tional resource  to  the  committee.  " 

I  start  here  'as  a  representative  of  the. American  Psychological 
Asspciat^ori's  Division  of  Industrial  and  Orgaiiimioni^  P8ych,oIpgy, 
of  which  I  iim  past  president.  •         ,  »  . 

I  am  also  past  president  of  the  American  Psycholo^cal  Associ- 
ation's Division  of  Evaluation  and  Measurement  and  of  its  Division 
of  Bngineerinig  Psychology,  and  am  the  current  president  of  the 
InterriationiU  Aisoc^ation  ot  Applied  Psychology. 
I  have  been  a  professor  at  both  Yale  UjjiVersity  and  the  Univer^k 
V  sity  of  Caltforhla,  and  from  1971  through  1976  was  the  editor  of  the* 
)  ViTou^taal  of  Applied  Psychology,  a  primary  outlet  for  the  publication 
^  "  of  ifesearcl|on  test  development  an(i  v^^^ 

1  appreciate  the  opportunity  to  address  those  aspects  of  the  Weiss 
'^Hi^Gibbons  btjjs  that  deal  withxwcupatiohal  testing.  We  support 
Uie  desire  to  iiicrease  the  protection  of  donsumers  of  testing  serv- 
t  Ices;  however,  we  have  serious  reservations  about  specific  provi- 
'slonsofthe  two  bills.  '       „  , 

My  testimony  focuses  on  the  impact  of  the  bills  oh  occupational 
•  testing.  I^o  so  orQy  to  highlight  those  is^es  most  directly  applica- 
^ '  bleto  teptsusedinthenvorkplace.         *         ^  .  ,..« 

fh^  adverse  effects  of  certain  key  provisions  of  the  biHs  upon 
eiac«ttiondl^  testing  have  already  been  amply  spelled  out  by  some  of 
d^.  coUeaiues  lin  earlier  testimonies  before  this  subcommittee. 
Some  Of        ^oerns  have  their  counterparts  in  the  use  of  occu- 


••      .  '792    ■        .  ,    •  • 

pational  testS:  in  organizational  contexts.  I  shall  elaborate  upon 
them  shortly.  ^  \ 

Tests  are  used  for  a  wide  range  of  personnel  decisions  including 
those  thfi^t  involve  assigtiing  miliary  recruits  to  different  technical 
training  Schools,  assessing  the  oijitcome  of  some  training  program, 
or  deciding  which  job.  applicantii  to  accept  for  the  limited  number 
of  job  openings.  The  U9e  of  occupational  tests  for  selection  purposes 
is  one  that  niost  people  are  familiar  with  and  one  that  is  expressly 
envisioned  by  the  langauge  in  the  Gibbons  bill,  which  refers  to  . 
occupational  admissions  tests  as/'any  test  which  is  used  as  part  or 
all  of  the  basis  for  admitting  or  denying  amission  to  an  individual 
to  any  occupation  in  or  affecting  ihterestafi  Commerce."  According- 
ly, the  selection  context  of  occupational  testing  is  my  point  of 
reference.  - 

A  personnel  selection  problem  is  one  in  which  many  are  called 
but  not  all  ca»  b6  chosen;  they  .occur  in  bpth  industrial  and  educa- 
tienal  settings.  In  most  orgai)izations,  tests  are  used  over  again  on 
^  daily  basis  with  administration  to  job  applicants  as  they  apply. 
Occupational  tests  are  normally  not  administered  on  a  regular 
sAedule,  as  are  scholastic  aptitude  test^.  Whether  they  occur  in 
industrial  or  educational  contexts,  selection  problems  require  ttiat 
decisions  be  based  on  relevant  information, 

That  is  to  say,  if  Mary  is  accepted  or  hired  and^Tom  is  not,,  it  is 
because  Mary  has  a  higher  probability  of  succeeding  in,  the  school 
or  job  than  Tom.  In  the  language  of  the  profession,  the  procedure 
in  question  must  be  validated.  Jfk 

I  would  like  to  present  a  highly  telescopJ^cenario  of  what  test 
validation  involves  so  that  we  might  have  a  common  framework  for 
the  discussion  to  follow.  There  are  several  professionally  acceptable 
ways  of  validating  tests  for  their  job  relatedrtess.  One  way  of  dem- 
onstrating job  relatedness  and  one  thatjs  commonly  used  for  tests 
of  abilities  is  by  means  of  a  Criterion-related  validation  study. 

Briefly,  the  following  steps  are  involved: 
^  Onej  a  job  analysis  is  conducted  to  determine  what  sorts  of  work 
characteristics  are  important  for  competent  performaice  of  the  job 
Jin  question. 

Two,  tests  believed  to  measure  the  important  skilli  and  abilities 
identified  in  the  job  analysis  phase  are  then  developed  and  admin* 
istered  to  a  group  of  study  subjects  or  job  applicants. 

Thre^,  those  who  are  subsequently  placed  on  the  job  are  followed 
up  and  pf^asures  of  job  performance  are  obtained. 

Four,  iax  this  point  in  the  study,  we  have  collected  two  kinas  of 
data:  Scores  on  the  test  and  measurements  of  job  perfol^mancei 

The  next  step  consists  of  conducting  the  necessary  statistical 
analyses  tp  determine  if  and  the  extent  fo  which  performance' on 
the  test  is  correlated  with  performance  on  trie  job. 
-  The  t>roce8S  I  have  described  is  rigorous,  empirical,  time  consum- 
%ing,  and  expensive.  It  is  ako  pervasively  regulated.  For  example, 
current  Federal  testing  jgiiidelines  embodied  in  the  ''IJniform 
Guidelines  on  Emploj^ee  Selection  Procedures''  require  that,  when- 
ever technically  feasible,  theiprocegs  of  vaH4ation  be  performed 
separately  for  dffferent  race  mid  sejc  groups  for.  the  purpose  of 
determinm^  whether  a  test  that  is  valid  for  one  group  is  also  aiid 
equally  valid  for  other  groups.     /  ' 

■  ■    ■■■  ■■■        ■      ■    '  ■  ■  'X^  ■.:  ■       \  ■ 


TcM3t :validation  is  4  prominent  activity  among  pgychologiats.  The, 
results  of  validation  studies  are  written  up  in  technical  reports;  the 
most  significant  ones  are  published  in  refereed  journals,  for  exam- 
ple^ the  "Journal  of  Aj)plied  Psychology."  In  addition,  validation  • 
studies  are  summarized  and  examined  in  <|>mprehensive  reviews 
undertaken  from  time  to  time  to  integrate  the  state  of  the  art  or  to 
elaborate  upon  some  theoretical  point  of  view. .  . 

The  point  I  make  is  that  the  technical  reports  and  professional 
journals  that  are  the  natural  outlet  for  the  outcome  of  validation 
studies  are  in  the  public  domain.  Cpnsis^nt  with  the  jprofession's. 
tradition  of  sharing  the  outcome  of  scientific  investigations,  they 
describe  in  som^  detail  the  methods,  procedures,  and  analyses  by 
which  it  is  determined  that  particular  tests  are  valid  for  the  jobs  to 
whicK  they  are  geared. 

These  documents  are  the  most  relevant  and  meaningful  sources 
of  information  for  ascertaining  whether  occupational  tests  measure 
the  abilities  and  work  characteristics  related  to  the  job.  L  am 
asserting  that  those  who  would  require  disclosure  of  actual  tests 
and  test  items  for  the  purpose  of  determining,  by  visual  inspection, 
M^hether  they  are  valid  are  asking  for  the  wrong  kind  of  informa- 
tiQft. 

Since  we  have  been  conducting  validation  studies  for  some  time 
now  and  reporting  the  outcomes  of  these  efforts,  what  do  these 
studies  show?  I  think  the  following  are  most  relevant  to  our  delib- 
erations: 

One,  the  evidence  is  fairly  strong  that  occupational  tests  tend  to 
show  validity  for  important  work  behaviors  in  different  work  set- 
tings* The  degree  or  level  of  validity  is  sufficient  to  render  these 
tests  useful  in  the  typical  selection  situation,  v 

Two,  how  do  tests  stack  up  against  other  selection  devices,  such 
as  the  interview,  letters  of  recommendation,  and  indexes  of  aca* 
demic  achievement,  such  as  grades  or  rank  in  class? 

The  evidence  from  these  studies  is  fairly  stronk  that  tests  have  a 
better  track  record  of  validities.  This  finding  should  not  be  very 
surprising  when  one  considers  that  tests  are  more  standiardized  in 
administration  and  mor0  objectiva  in  scoring  than  the  typical  sub- 
jective and  unstructured  interview,  the  glittering  generalijsations 
which  may  characterize  letters  of  recommendaition,  and  the  fluctu- 
ations in  grading  standards  so  common  across  different  schools. 

I  am  suggesting  that  vis-a-vis  these  other  devices,  the  typical 
.  occiipationm  test  of  ability  has  built-in  procedural  advantages  that 
^q^ntrifoute  to  its  better  overall  record  pf  validity  in  the  workplace; 

Three,  the  evidence  is  fairly  strong  that  the  relationship  between 
test  performance  and/job  performance  is  linear  throughout  the 
entire  range  of  the  test  score  distribution.  This  meqns  that  the 
higher  the  test  performance,  the  higher  the  performance  on  the 
job.  This  means  &>at  if  for  some  administrative  reason  it  is  decided 
to.  set  ttie  qual^ng  or  passing  score  at,  let'^say,  2&,  the  ej^inee 
.  who  scores  80  is  better  qualified  than  the  examinee  who  soores  25* 

Among  those  who  are  considered  qualified  by  virtue  of  meeting 
the  passing  score,  8om6  are  better  qualified  than  others.  Hence, 
iMring  tWbest  qualified  job  candidate  that  Che  Idbpr  market  will 

iow  is  a  professionally  sound  business  practice. 
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Four,  the  evidence  is  fairly  strong  that  attest  which  is  valid  for  - 
one  group  a?vill  also  be  valid  and  to  the  saine  extent  for  another 
gfroup.  Use  of  the  same  test  and  the  sarnie  test  standard. is  appropri- 
ate for  all  race  and  sex  groups.  Put  another  >way,  if  for  some  reaison 
.  an  organization  decided  to  hire  only  blacks,^  it  ^would  mill  be  appro^ 
priate  to  use  validated  tests  to  select  the  best  qualified  from  among 
.'black.applicants.  ]^ 

•  I  conclude  this  part  of  my  testimony  by  sitr^ssing  th^  fact  that 
•occupationa|^esting  is  pervasively  regulated. 

First,  there  are  the  professional  standards'^governing  test  devel- 
opment, validation,  and  iige,  such  as  those  embodied  in  the  Ameri- 
can Psychological  Association's  standards  for  educational  and  psy- 
chological tests  and  the  principles^  for  the  validation  and  upe  of 
personnel  selection  procedures  developed  by  <\PA's  Division  of  In- 
dustrial and  Organizational  Psychology. 

Second;  there  are  the  uniform  guiaeiines  on  employee  selection 
procedures  adopted  by  Federal  Governmental  equal  employment 
opportunity  enforcement  agenCfies  and  given  substantial  weight  by 
courts  in  cases  where  testing  is  the  subject  of  litigation. 

Third,  there  are^^he  Federal/ courts  with  jurisdiction  over  kll 
asp^ts  of  employment  discrimifiation,  including  occupational  test- 
ing^ /  ^    .  • 

Fmally,  where  occupational  tests  are  used  in  the  movement  of 
bargained-for  employees,  thi?!  grievance  and  arbitration  machinery 
^contained  in  most  union-man^genien^  contracts  provides  another 
effective  safeguard.  Those  >/s^cf  wotild  argue  that  occupational  test- 
ing is  not  regulated  seriously  UnderestimaCte  the  force  of  the  forego- 
ing sources  of  regulation.  Occupational/licensing  will  probably  soon 
be  subject  vto  the'sarae  type  of  jregulation.  In  fact,  occupational 
testing  is  so  pervasively  regelated  today  that  psychologistiS  have 
become,  in  the  words  of  one  jyawyer, ''familiar  forensic  fixtu^ 
employment  discriminatioh! lawsuits. 

Another  effect  of  regulation,  besides  insuring  test  validity  and 
proper  use,  is  to  require  Specific  tests  for  individual  jobs.  Thus, 
those  employers  who  test  ^ye  many  different  tests  for  diffeirent 
jo1)s  and  it  is  a  rarie  employer  ^ho  givejs  one  general  test  like  the 
.  ^     scholastic  aptitude'-tesl.  Thi?  fact  becomes  important  in  assessing 
^     the  consequences  of  the  projpQ^e^  legislation. 

Atthis  juncture,  while  Recognizing  the  desire  to  enhance  the 
quality  of  educational  and  pc^jupatiohal  testing  services  in  the  di- 
I  ^        rection  that  safeguards  the  interests  of  the  many  consumers  of 
those  services,  I  am  compellte4  to  point  out  the  adverse  conse- 
quences th^at  flow  from  tne  application  df  certain  provisions  to  ^ 
.        occupational  testing.  Two  of  tn|se  are  particularly  troublesome. 

Literally  applied  to  testing  ii^  the  workplace,  section  6(c)  of  the 
Gibbons  bill  reduces  the  likelihood  of  hiring  the  best  qualified.  The 
law  would  require  qualiflpatiop  levels  to  be  set  at  the  minimal 
level  of  competency.  Selection  i^bpve  that  level  would  have  to  be 
random.  f         .1  ; 

»  The.  idea  of  being  satisfied  with!  minimal  competency  in^n  age 
when  national  productivity  is  on  the  decline,  competition  for 
American  products  and  services  isyincreasing,^  and  industrial  jobs 
are  becoming  technologically  mgi^Vcomplex  is^  a  soufce  of  puzzle- 
menttct^us.  .  \;''\ 
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Furthermore,  the  imposition  of  minimal  standards  is  contrary  to 
the  finding  I  had  cited  earlier  that  the  relationship  between  test 
performance  and  job  performance  is  linear.  Quite  simply,  there  is 
no  professional  justification  for  being  satisfied  with  less  than  the 
best,   r      '  '  *  - 

We  see  the  provisions  in  both  bills  which  call  for  the  full  disclo- 
sure of  test  items  as  having  the  I  following  adverse  Consequences: 
On?,  test  disclosure  of  the  magnitude  jcontemplated  in  both  bills 
will  depress  the  validity  of  occupational  tests.  Validity,  you  will 
recall,  has  to  do  with  the  concept  of  job  relatedness.  If  a  test  fa 
valid,  individual  differences  in  test  FferfOTmance  ape  associated 
with  individual  differences  in  job  perfonjaaAce.        g  . 

The  use  of  only  tests  having  validitvOs  now  mandcfed  by  Federal 
law  and  professional  standards.  Whafi'some  examinees  have  access 
to  the  test  items  while  others  do  imU  the  former  would  get  an 
undue  advantage  <on  the  t^t  which  would  not  be  reflected  in  in- 
creased ability  to  do  the  job.  V  r 
Put  another  way,  of  two  individuals  with  the  same  probability  of 
succeeding  on  the  job,  that  person  would  be  selected  who  has  had 
prior  access  to  the  test  items  and/or  could  afford  to  go  to  test 
coaching  schools.  This  situation  would  operate  to  the.  dfaadvantage 
of  mmOrity  job  applicants  and  exacerbate  furth^t  group  dfapaftties 
in  the  human  condition.                              ^        .  j 

Two,  test  disclosure  would  lead  most  employers  to  abandon  the 
use  of  standardized  occupational  tests  of  ability.  The  need  to  fill 
openings  as  they  occur  and  the  requirement  by  regulation  to  have 
different  tests  for  different  jobs  makes  the  test  regeneration  proc- 
ess almost  impossible.  Thus,  that  which  is  the  most  objective  com- 
ponent in  the  selj^tion  process  would  be  abandoned  hi  favor  of 
such  tdteinatives  as  the  interview,  reference  checks,  letters  of  rec- 
oinmend[ation,' and  the  like.      ^  ,  x- 

As  I  have  indicated  earlier,  the  validity  of  these  alternative 
selection  procedures  is  questionable.  Furthermore,  they  do  not 
enjoy  the  procedural  advantages  of  standardization  and  objectivity 
that  are  the  hallmark  of  occupational  testing  and  they  lend  them- 
selves to  dl  kinds  of  conscious  bias.  „  ,  ^  XL 
Three,  full  disclosure  of  test  items  would  drastically  shorten  the 
useful  life  of  most  tests  and  require  the  continuous  generation  and 
evaluation  of  new  replacement  items.  The  consequent  research 
effort  and  dollar  investments  required  to  maintain  the  quality  of 
occupational  t^long  under  these  conditions  could  become  prohibi- 
tive. In  additioiir  the  expense  and  effort  required  tj  develop  iiew 
items  would' discourage  research  on  hew  and  innovative  methods 
for  selecting  the  best  qualified  individuals  for  various  occupations. 

Issue?  dealing  with  Ijest  disclosure  are  not  new.  Ybu  may  be 
familiar  with  ttie  Detroit  Edison  v.  NLRB  case.  In  a  situation 
involving  two  legitimate  but  competing  interests—the  union's  re- 
queS  foj  access  to  test  and  test*elated  materials  in  0|ier  to  piK)p- 
erly  rtorescgit  its  memberthip;  the  interest  of  management  for  the 
continued  security  of  the  same  materials— the  Supreme  Court 
upheld  the  coinpany's  refusal  to  yield  the  requested  test  materials 
to  'thci  uilion.  No  leM  of  an  authority  than  the  U.S.  Supreme  Court 
lias  considered  the  alrgiiments  over  t^t  disclosure  issues  ^and 
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II  ^passed  its  judgment  on  the  matter.  These  points  have  been  ade- 
quately covered  before.  .  *  . 
^  ^  To  conclude,  the  adverse  consequences  T  have  mentioned  are 
ihore  than  inconveniences.  Their  cumulative  and  long-term  effect 
would  be  to  eliminate  the  moist  valid  and  objective  coniponent  in 
the  selection  process.' 

Without  a  clear  Imd  overriding  mandate,  indicated,  for  example, 
by  documented  instances  of  flagrant  test  abuse  or  evidence  that 
mechanisms  already  in  place  for  requesting  testing  and  for  harid- 
ing  test  feedback  are  not  working,  I  urge  extreme  caution  in  adopt- 
ing legislation  based  on 'the  Mague  and  speculative  claim  that  the 
bills  would  increase  the  accountability  of  test  publishers.  ^ 

Whatever  else  the  so-called  sunshine  in  testing  bills  may  accom- 
plish, they  should  not  generate  such  side  effects  as  would  endanger 
what  may  well  be  an  important  national  resource  for  identifying 
the  best  qualified  people  to  flU  increasingly  complicated  jobs. 

Mr.  Weiss.  Thank  you  vei:y  much.  -^j 
.    Dr  Hall?  V 

STATEMENT  OF  DR.  JUDY  E.  HALL,  PRESIDENT-ELECT, 
AMERICAN  ASSOCIATION  OF  STATE  PSYCHOLOGY  BOARDS 

Dr.  Hall.  I  am  Judy  Hall,  executive  secretary  of  the  New  York 
State  Education  Department,  State  Board  for  Psycholpgy;  I  am  also 
president  elect  of  the  American  Association  of  State  Psychology 
Board,  and  it  i3  in  that  capacity  that  I  am  here  today. 

I  want  to  comment  on  the  Gibl>ons  bill,  H.R.  3564,  and  assume 
that  some  of |fhe  sections  in  it  which  are  sufficiently  vague  may 
permit  discldsure  at  some  point,  so  I  ani  going  to  include  some 
comments  on  disclosure  on  the  effect  of  licensing  examinatioiis  in 
my  comments. 

It  is  my  pleasure  to  represent  the  American  Association  of  State 
Psychology  Boards,  an  association  of  54  boards  authorized  by  State 
'  or  provinci?il  le^slaturetf  to  certify/ license  psychologists. 
The  purposes  of  this  associdliQn  are: 
To  facilitate  communication  among  member  boards; 
To  sponsor  collaboration  between  and  among  member  boards  in 
developing  Compatible  standards  and  cooperative  procedures; 

To  represent  the  member  boards  in  serving  the  public  interest  in 
matters  of  psychological  services  to  other  psychology  organizations, 
4^)  legislative,  judicial^  regulatory,  and  executive  governmental  hod- 
"■ies;  ...  ; 

To  aid  m6mbe;;  boards  in  fulfilling  statutory,  professional,  public, 
and  ethical  obligations. 

AASPB  wa^  founded  in  1961  at  the  instigation  and  support  of  the 
American  "Psychological  Association,  which  recognized  the  need  for 
an  independent  body  to  enhance  the  interstate  mobility  of  qualified 
psychologists.     '   '  .t 

It  was  to  that  end  that  a  standardized  examination  was  devel- 
oped (in  1964  which  could  be  used  by  all  statutorily  l^cognized 
bodied  as  part  of  their  determination  of  who  is  minimally  qualified 
to  practice  the  profession. 

The  examination  provides  an  inde:^of  the  candidates'  km)wledge 
base  of  the  scientific  core  and  the  megor  fields  of  psychology  at  a 
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level  that  all.  candidates;  regftrdless  of  their  specialties,  might  be 
expected  to  reach.         .  . 

The  questions  are  develop^  and  selected  to  measure  the  examm- 
ees'  ability  to  integrate  and^pply  this  knowledge,  the  capacity  to 
exercise  ethical  judgments,  Nand  the  attitudes  of  the  applicants 
toward  the  profession.  ^ 

The  examination  for  professional  practice  in  psychology  is  spe-   

>ci£ically  designed  as  a  test  of  knowledge;  not  applied  job  skills- 
,  From  thiat  base  of  knowledge  the  practitioner  can  .decide  which 
skills  need  to  he  applied  or,  if  necessary^  what  new  procedures,  . 
derived  from  the  knowledge  base,  will  solve'fhe  problem. 

Note  that  this  exam  is  riot  designed  to  be  the  sole  evaluative 
critl^rion  on  which  licensing  decisions  are  based.  It  is  expected  that 
it  will  be  supplemented  by  other  means  of  assessing  a  candidate's 
competence  to  practice  psychology  W  a  professional. 
.•The  examination  committee  of  A^SfB  consists  of  carefully  se- 
.  lected,  prominent  psychologists  representing  the  various  specialties 
in  psychology  as  well  as  having  tidditiorial  expertise  and  experience  ^ 
in  test  construction.  They,  like  State  board  members  and  AASPB  - 
officerj?,  serve  without  compensation  and  at  great  financial  loss  to 
themselves  for  the  days  that  they  devote  to  licensing  issues.  The 
decisions  related  to  test  construction,  validation,  setting  of  passing 
points,  reporting  of  scorqerto  candidates  are  all  ones  reached  after 
many  years  of  experience  with  the  profession  of  psy<jhology  and  the 
state  of  the  art  of  psychometrics. 

Please  do  not  attempt  to -change  our  approaches  without  careful 
consideratioi!  of  the  potential  outcomes.  Test  construction  is  our 
field  and  w^  teke  our  jobs  very  seriously.  Let  me  explain  now  some 
x)f  the  test  construction  issues  and  the  progress  we  have  made  in 
providing  solutions.  >  , 

The  comments  will  relate  to  specific  provisions  of  the  Gibbons 
bill,  aB.  3564. 

VAUDITY. 

Validity  is  not  only  {an  end  product  of  an  exam,  it  is  a  process  in 
'the  development  of  an  examination. 

In  addition  to  using  pychologists  to  develop  items  for  the  exami- 
nation through  peri^ic  item  drives,  panels  of  experts  in  the  var- 
ious specialty  areas  review  the  items  after  each  item  has  been 
check^  for  accuracy,  relevancy  and  conformance  to  psychometric 
principles.  These  items  are**  then  included  in  the  samples  sent  to 
the  examination  committee  for  the  construction  of  a  new  form. 

At  this  point  at  least  15  people  have  reviewed  and  approved  ^ch 
item.  Involvement  of  a  large  representation  of  practicing  psycholo- 
gists at  etrery  stage  of  test  ^development  is  for  the  purpose  of 
insuring  that  the  examination  content  ;s  relevant  to  the  practice  of 

^ffp  u^  recently  there  were  no  funds  specific  to  research  on  the 
.  examination.  In  spite  of  that  many  States  accomplished  their  pwn 
studies  iitili2ing  approaches  which  could  be  characterized  as  con- 
tent, concurrent,  and  construct  validity.  #  '  \    .  ■ 

More  recently,  howdver,  the  State  boards  ur^ed  AASPB  to  in- 
crease the  fee  charged  to  t^^e  States  for  the  use  of  the  examination 
so  that  moneys  could  be  ihy^sted  in  validatioh  research.  At  the 
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present  time  approximately  $50,000 
validation  research  piroposals.  The  e 
searclf  .will  be  the  construction^^  of 


1$  being  spent  on  four  content 
feet  of  the  result  of  this  re- 
jan  even  better  examination. 


T  SECURITY 

The  construction  of  the  examination  is  a  very  difficult  task  since 
items  tapping  the  fimctions  of  a  psychologist  are  ones  which  in- 
>  volve  higher  mental  processes.  Items'  are  such  that  the  candidate 
may  be  expected  to  see  the  underlying  principle  or  dilemma  even 
though  he/she  may  not  be  familiar  with  the  specific  setting.  . 

These  items  are  limited  in.number.  Therefore,  it  id  imperative 
that  provisions  be  made  to  make  the  exam  secure. 
.  At  the  present  time  the  examination  is  given  twice  a  year  on 
national  testing  dates.  Once  the  examination  has  been  completed 
by^  the  candidate,  the  candidate  does  not  see  the  examination 
again.  Should  the  candidate  fail  the  examination,  the  specific  form 
can  be  released  but  only  to  the  State  board  who  is  expected  by 
contract  and  State  mandate  to  maintain  security. 

Any  State  board  can  request  a  rescoring  of  the  examination  by 
hand  as  well  as  a  copy  of  the  answer  sheet. 

The  reasons  for  maintaining  tight  security  relate  to  the  fact  th^t 
should  candidates  have  ample  opportunity  to  memorize  questions 
and  should  those  questions  be  reused,  the  State  board  cannot  guar- 
antee  to  the  public  tJiat  those  examinees  are  minimally  competent 
to  practice  the  profession.  The  greater  public  good  is  secured  by 
denying  individuals  easy  access  to  forms  of  the  examination. 

If  items  were  easily  constructed  and  forms  were  equSted  without 
the  use  of  old  items,  there  would  be  no  question  about  allowing 
more  detailed  feedback  to  failed  candidates.  But  the  examination 
forms  have'ix)  be  constructed  with  a  percentage  of  these  fbrmerly 
used  items.  Professional  decisions  are  not  easily  made,  nor  are 
items  easily  constructed  which  capture  the  essence  of  a  profession- 
al's thought  processes.  _     j,    .  '    ■  ' 

If,  for  some  reason,  the  boards  were  forced  to  disclose  the  licens- 
ing examination  in  psychology,  there  would  be  no  question  that  the 
construction  of  new  forms  would  proceed  at  a  snail  s  pace. 

Th6  immediate  result  would  be  fewer  administrations  and  fewer 
candidates  entering  tbe<  profession.  The  end  result  would  be  a 
significant  drop  in  the  numbers  of  providers  of  health  care  and  in 
consultants  to  business  and  industry.' 
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SUBSCORES 


subscores  exist  on  the  national  licensing  examination  since 
the  items  which  are  the  best' items  ar^  not  easily  classified  nor  are 
they  mutually  exclusive  of  any  other  categorical  placement. 

With  the  length  of  the  examination  kept  purposely  at  no  more 
than  200  items,  subscores  would  not  be  reliable  nor  valid. 


^  pass/fail  point 

t|^  individual  State  board  is  legally  responBible  ^r  determining 
the  passing  point,  the  use  of  two  proc^uretf— normative  approach  , 


and  absolute  standard— reflect  the  fact  that  psychologists  c^not 
decide  which  is  a  Better  approach  for  the  establishment  of  a  cutoff. 

Each  mechanism  has  its  own  set  of  strengths  and  weaknesses. 
The  choice  of  one  method  ov^r  another  will  not  prevent  abuses.  For 
the  past  several  years  a  rationale  for  the  establishment  of  a  pass- 
ing point  has  been  discussed  by  AASPB. 

A  new  approach  being  explored  is  a  methodology  using  Bayesian 
statistics.  By  combining  obtained  score  data  with  other  and  preex- 
isting data  on  candidate  competence— for  example,  academic  de- 
gree, years  of  experience  and  national  normative  test  data-*-the 
cutoff  could  be  establiiahed  after  estimating  the  loss  associated  with 
maldng  an  incorrect  decision. 

The  articulation  of  a  rationale  is  one  of  the  priorities  of  AASPB 
in  the  immediate  future.  We  psychologists  are  uniquely  qualified  to 
develop  these  prorodures  in  the  psychometric  area.  But  simplifying 
a  complex  matter  by  mandating  one  method  over  the  other  will 
only  complicate  matters.  *  - 

FEEDBACK  TO  CANDIDATES  | 

Score  information,  relative  standing,  standard  area  of  measure- 
ment on  the  exam,  the  cutoff  point  used  in  that  St^te  are  all  now 
av^able  to  the  candidates  in  each  State. 

At  any  time  a  brochure  on  the  examination  for  professional 
practice  in  psychology  can  be  obtained  from  the  State  board  or 
from  AASPB.  In  addition,  a  brochure  outlining  the  reasons  for  not 
beiiig  admitted  to  the  licensing  examination  is  available.  This  bro- 
chure is  designed  for  those  who  fail  to  mee^;  the  statutory  required- 
ments  pf  licensure! 

y  ^ONCLtJSION*r 

What  1  have  tried  to  summarize  is  thp  voluntary  efforts J)f  those 
concerned  with  licensing/certification  (ff  psychologists.  Thifee  have 
occurred  in  anticipation  of  sunset  review  and  prior  to  the^  formal- 
ization of  the  EEOC  guidelines. 

These  are  in  agreement  with  the  American  Psychological  Associ- 
ation's standards  for  educational  and  psychological  tests  and  are  in 
response  to  meeting  the  larger  public  need  of  endorsing  only  those 
who  demonstrate  themselves  to  be  qualified  to  practice  the  profes- 
sion of  psycholo^.      g  J  i 

I  would  like  to  recommend  that  no  legislation  be  passed  that- 
lA^uld  freeze  the  development  of  these  voluntary  procedures  but* 
that,  instead,  we  endour««e  research  on  testing  such  as  the  validity 
stupes  we  are  pr«ently  funding  or  such  as  the  National  Academy 
of  Science's  study  on  ability  testing  which  is  soon  to  be  released. 

Just  as  AASPB,  representing  the  licensujre  boards,  is  independ- 
ent of  the  jil^fl^  organization,  American  Psychological  Asso- 
ciation, wmch  in  turn  represents  menjb^rs  of  the  profession,  the 
examination  must  be  independent  of  the  academic  institutions. 

Thase  independent  ch^ks  on  the  system  are  important  factors  in 
the  deVeLo^ent  of  quality  professional  care.  Since  the  m^ority  of 
^  ptycholodsts.  are  health  care  proyid^rs,  we  are  tjimpering  with  the 
potential  services  to  our  constituents  when  we  no  longer  make 
securejthe  examinatiop.  ^  .  - 
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•  *      ■  *  .      .  ■  .      .  '  • 

Chairman  Perkins.  Thank  you  very  much. 

Let  me  indicate  thdt  without  objection  the'broqhures  and  pam- 
phlets that  you  mentioned  in  the  testimony  will  be  included  in  the 
record. 

[The  information  referred  to  follows:]  • 
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INFQRMATIDN  FOR  CANDIDATES 


EXAMINATION  FOR  PROFESSIONAL  PRACTICE 
IN  PSYCHOLOGY 


AMERICAN  ASSOCIATION  OF  STATE  PSYCHOLOGY  BOARDS 


lb 


i 
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THE  PURPOSES  OF  THE  EXAMINATION  PROGRAM 


The  Examlnitlon  for  ProfeBBlonal  Practice  in  Paychology  (^PP)  of  the 
Aaerlcan  Aaaoclatlon  of  State  Paychi^ogy  Boards  (AASPB)  la  provided  for 
the  purpose  of  helping  the  state  and  provincial  boards  of  exanlners  In 
psychology  to  evaluate  the  knowledge  of  applicants  for  licensure  and 
certification.    There  exists  a  vide  diversity  of  educational  preparation 
among  the  approximately  4,000  applicants  who  seek  licensure  and  certifica- 
tion eech  year,    this^dlvecslty  is  one  reason  that  the  state  and  provincial 
boards,  acting  collectively  through  the  AASPB,  construct  and  annually, 
utilise  a  connon,  standardised  yardstick  (the  EPPP). 

The  resources  of  the  whole  profession  and  of  the  Professional  Examination 
Service  (PES)  are  utilized  in  the  development  and  continued  improvement  of 
the  test  on  ja  national  basis      resources  which  are  not  available  to  an   ^  < 
Individual  board.    The  EPPP  is  only  one  part  of  the  overall  evaluation 
procedure  used  by  st^te.and  provincial  boards.    The  Aseodation  expects 
that  tha  EPPP  will  be  supplemented  by  other  assessment  techniques  to 
determine  candidates*  competence  to  practice  psychology  as  a  profession. 

Thev  EPPP  is  intended  to  evaluate  the  knowledge  of  th^  candidate  with  the 
equivalent  of  a  doctorate  and  one  or  two  years  of  experience  by  sampling  . 
the  knowledge  basic  to  the  practice  of  psychology  at  a  level  that  candi* 
dates,  regardless  of  their  specialty,  may  be  expected  to  have  attained; 
and  by  assessing  ability  to  integrate  this  knowledge  and  to  exercise 
ethical  judgiaents .    >k>Bt  applicants  with  the  required  academic  preparat.ioh 
should  be  able  t6  pass  the* test  with  little  or  no  additional  study  or 
other  preparaition.    PES  does  not  have  copies  of  past  examinations  which 
it  can  send  to  applicants,  nor  does  it  have  a  list  of  recommended  books 
or  other  material  for  use  in  preparation  for  the (examination.  However, 
*  a  candidate  can  compile  such  a  list  by  considering  the  entry-level  knowl- 
edge necessary  for  prof asaionffl.  practice  in^the  areas  covered  by  the 
test  content  outline. 


The  EPPP  is  developed  by  the  Examination  Committee  of  the  AASPB  in  coopera- 
tion with  the  Professional  Examination  Service,  which  provides  examination 
services  in  many  health-related  fields.    The  development  process  is  designed 
fto  maximize  the  content  validity  of  the  examination  for  its  intended  use« 


The' Examinst ion  Committee  decides  upon  the  content  areas  to  be  covered  in 
the'  EPPP.    Questions  (items)  are  solicited  from  psychologists  represeutiug 
-all  areas  of  the  practice  of  psychology  in  the  United  States  and  Canada^ 
Item  writers  are  provided  with  instructions  describing  the  kind  of  itema 
useQ.ln  tha  examination.    Since  the  beginning  of  the  program  in  19*64,  more 
than  500  psychologists  have  contributed  questions  for  the  examination. 


TEST  CONSTRUCTION 


I, 


tha  Itittiit  1«  to  d«v#lopUtMis  iihiich  M«0ur«  iapbrtant  knowledga  ^tch  It 
dlYtctly  t«l«ttd  to  thm  prcctlca  of  paychblogyr  Emphasis  is  on  th«  knowl-  . 
•dg«  that  haa  wldaaptaad  Apipllcatloiu  and'algfilfloance  In  the  aolujtilon  of 
pvoblfBa  an^imtatad  by  ^ftaychologlata  In  all  apec^^  .s 

•*  •  ■.  •  '  >• 

Tha  qutitloQii  ara  acrianad  and  edltad  by  ^  Staikdnatlon  Conalttaa  and  by 
taat  af|aoia^«ta'  pn  tl^  PES  ataf  f  to  anaura  subj act-matter  accuracy  and 
confotMnca  to  paychoiMitrlc  prlndplaa.    tfaay  are  thdn^  aent  to  panels  of 
three  exparts  f ot  Inddpendent  subject-iaattar  revlev.   The  revleirers'  covlments 
are  used  by  subJectHsatter  consultanta  and  teat  edltora  In  tha  final  raylew 
of  eaqjh  Iten*    Iteaa  Which  are  lipprdved  through'  these  ataps  are  Included  loi 
.  a  fil^  of  i.ltaBa  ttom  which  the  Examlnatiop  Connlttee  conitructa  each  i  ew  . 
fodb  dx  ttia'  teat.   A^^^  conclualon  of  this  process,  at  least  15  people 
have  ravlawad  and  apprAvad  each  l^em*        .    «  . 

In  the  devalopnant  of  a  new  form  of  tha  teat,  the  ComB4ttee  revlawi  each 
Item  for  continuing  reliance  and  for  psychometric  performance  aa  ahom  by 
Item  analyala.    Bach  atate  or  provincial  board  may  review  the  teat  baf ore 
electing  to  uae  It^  and^tha  oplnlofia  of  the  boarda  on  teat  content  ara 
aoiight  and  uaad  by  the  Examination  Commlttae  In  th^  development  of  sub-  f 
sequent  forms  of  . the  test*    «k  ^ 


TEST  CONTENT  AND  AlytlNISTEATION 


the  examloatloa  ^nalati  of  objective,  m^ltlple-cholee  qu^tlona  covering 
the  baalc  araaa  of  paychsiLogy*i  Each  form  of  the  examliiatlon  contalna 
approximately  200  Items^   The  araaa  bel6w  dd  not  represent  separate  parts 
dif -the  txamlnatlbn'but  Ira  provided  as  a  general  j^ut Una  of  the  content 
of  the«  examination  aa- a  whole*  '  .  .  ./  •'^ 

General  Outline  of  the 
E3camlnatlon.for  Professional  Pxitc^lce  In  Psychology 

•  .    '  *■  .  ■•  '  '.  ' 

-History  and  Syatama 
■  -Phyaiblbjlcal  and  Comparative  Psychology 

^    -Sanaatlon  fnd  Perception 

-tearnlng  aftd  Memory  *  a  • 

^Information  Proceaalngt  Thinking,  and- Language       .  f 
^Motivation  and  Emotion 

-Individual  Differences,  Intelligence,  and  Developmental  Piycbology 

-Paraonallty  and  Social  Paychology  ^ 
f  -Behavior  Diaordera 

-Program  Evaluation  * 

-Eaaaatch  Dealgn  and  Interpretation  . 
}    %Stat<jatlcli  iwd  ((ItivktltlUva  Methoda  \  f 

V^-Teal»  Theo^jji  Dev'alppvian,  and  Validation 


Omtral  (KitllQe  (cotttM) 


.      HKiKMrladg*  of  Froftttional  Affairs  /r- 
I    -FrofMtionitl  Ccmduct  and  Xthictf  , 
jf.  '  "  'Ka.inioal^ayehology 

Mk>unaaliDS  Fayc;)iology 

-Bduciiponal  and  School  Psychologj 

^•Indu/Krial/Organiiational  Ftychology 
'     -Bahavior  Modification 

•^Bi^faiBdback 

iMplat  of  tha  itaw  iihich  appaar  in  tha  ascMination  at  a  givan  iii  tba  iMick 
of  thla  bra^cfaurat  •  Bach  itaa  haa  four  altamativa  ra^ponaaa,  only  ona  of 
ubich  ia/corract*  .  Tha  acora  ia  the  total  nuabar  of  corract  raaponaaa,  Thara 
ia  nbjptealty  for  giiaaaing^  and  it  ia  to^tha  candidata*a  advantage  to  anamr 
aach^tan'  avah  irhan  unaura  of  tha  corract  raaponaa*   Ko  credit  ie  given  for 
itm  for  nhieh  aore  than  one  reaponee  ie  eeleptad,  >  > 


The  tiae  allowance  ia  auffielai^-fbr  aoat  candidatee  to.coaplete  the 
^aicag1nation» 

The  esMttination  ie  adainiatered  by  the  etate  a^d  provincial  boarde  and  the 
anawer  eheete  are  ecored  by  PS8  which  reporte  the  ecorei,  along  with  relevant 
noraative  data,  to  tha  adainieteriog  board;   Candidatee  are'  identified  in 
the  ecoiring  proi;eae  only  bynuabet.   Bach  board  eetfe  the  etandard  for  paeeing^ 
in  ita  reepa<^tiva  etate  or  province,  and  reporte  the  reeulte.  to  the  eandidatee« 
All  prdcaduriie^and  dacieipna  with  regard  to  liceneura  are  the  reepqneibili^. 
.^f  the  individual  ,boarda«  ^ 


BX^HHIATI 


VALi0AXION  OF  THB)  fiU^MIllATION 

Cobtent  validity  ie  aaxiaised  by  tha  exteneive  teet-develbpaent  proceee*  In 
>rder  that  the  validity  of  tha  ejuminatione  aay  be  continuouely  aeeeeeed,  the 

^  Ixaaination  Coaaittee  conducte  an  ongoing,  eurvey  of  the  characterietice  of  \ 
tUe  candidate  populntion*   Along  with  tjhe  exeainatlon  aeteriele  eupplied  to 
etate  and  provincial  boarde  ia  a  quaetionnaira  which  candidatee  are  requeeted ' 
to  coaplete  and  whiQh  ^  daeigned  to  oollacj:  data  on  deaographic,  educational 

'  and  aocpaf iential  background.   Candidaate  are  identified  by  nuaber.  The 
queetionnaire  ^ata  are  oo^mrad  with  thalfeauUe  of  tha  aitaaination  total 
ecore,  paee/fail,  and  whether  or  not  a  llbenee  wae  granted.   The  reeulte  of 
the  eurvey  are  reported  periodically  to  AA8PB  and  tha  atate  and  provincial « 

;  boarde,   AASFB  haa  foraulated  and  ta  currently  iapllMMnting  further  content 
and  axtemal**criterion  validation  Btudiea* 
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:      .  THE  iNTERSXATE  REPORTING  SERVICE 

■  '  .  •  .  *"  .     *  ■ 

An  Interstate  Reporting  Service  has  been  established  to  facilitate  the 
endorsement  of  certificates  and  licenses  among  states  and  provinces.  The 
Service  maintains  a  permanent'  record  of  exaod-natlon  scores  for  those  candi- 
dates who  choose  to  register.    At  a  candidate's  request,  the  Service  will 
report  the  score »  accompanied  by  normative  data  such  as  to  assure  equitable 
comparison  of  scores  over  time  and  across  test  forms,  to  the  board  of  am)ther 
state  or  province  In  which  the  candidate  seeks  licensure  or  certification. 
Candidates  may  request  registration  of  their  scores  with  the  Service  at  the 
time  of  examination  or  any  time  thereafter.    The  Interstate  Reporting  Service 
applies  only  to  the  national  written  test.    Other  requirements  for  licensure 
In  the  states  or  provinces  are  determined  by  the  Individual  boards. 

The  Interstate  Reporting  Service  Is  maintained  by  PES.    To  register  scores 
on  the  EPPP,  candidates  should  write  to  the  Professional  Exomlnfittlon  Service, 
475  Riverside  Drive,  New  York,  ilew  York  10027,  and  should  lncl\ide  the  date 
and  place  of  examination  and  their  unique  Identification  number  of  the  exami- 
nation.   Forms  far  this  purpose  are  available  at  the. time  the  examination  .Is 
administered  or  can  be  obtained  from  PES  at  the  above  addfi^ss.  Candidates 
who  do  not  remembet  their  Identification  number  should  li^ulre  of  the  board 
in  the  state  or  province  where  they  yere  licensed  or  certified.    Once  a  score 
has  been  registered,  the  candidate  may  at  any  time  thereafter  request  that 
this  score  be  reported  to  another  state  or  provincial  board.    The  fee  for 
Initial  registration  of  the  score  Is  $25.00;  the  fee  for  repotting  the  score 
to  another  board  Is  $5.00  for  each  report  made.  "  ^ 


FURTHER  INFORMATION 


For  Information  about  procedutes  and  requirements  for  licensure  and 
scheduling  Of  examinations,  a  canjlldate  should  write  to  the  Secretary 
of  the  Psychology  Licensing  or  Certification  Board  In  the  state  or 
province  In  which  licensure  or  certification  Is  belngr  sought .  A. 
listing  of  addresses  of  state  and  provincial  boards  is  published  annually 
in  the  June  issue  bf* the  American  Psychologists 


SAMPIiB  QtJESTIONS 


A*.  According  to  tha  Standards  for. Provldtra  of  Psychojlogiol  Servict, 

patiant'a  clinical  recprd  My  be  availabla»- even  without  tha.  client ^a 
conainti  to  Msbera  of:  V 

■  .  .  ■  ;  ■      ".       .     f.    ,    .  ■ 

ir   The  referring  agency  aaaooiated  with  the  client^ a  treatment. 
2.   The  client 'a  loaediate  family. 
.  3.    The  profeaaionai  ataff  uho  certify  that  the  record  will  be  uaed  . 
for  teaching  purpoSaa. 
4*   The  profeaaional  staff  aaapciated^th  the  Client 'a  treatment;. 

B.  .  In  developing  $  wej^htsd  application  blank  whi^h.  ia  to  be  used  in  hiring 
.   aales  agents  for  your,  firm »  the  fir at  atep  should  be:  . 


1.  Look  over  the  application  bUnk  now  in  use,  4ssl]gn  weights  to  itsms 
:         you  consider  significant ^  then. proceed  to  uae  th^  scores  you  can 

now  gat  from  the  blank  in  appraising  Job  applicants.  h 

2.  Administer  a  preliminary  aptitude  test  battery  tp  all  of  the.  sales 
agenta,  and  examine  the  scores..    .  ^ 

3.  Hake  up  a  list  of  productive  sales  agentSi  then  study  theae  agenta 
to  see  what  characteriatics  they  have. 

A*    Make  up  a  'llst>  of  the  best  sales  agents  and  a  Hat  of  the  pooreat 
agents,  and  3tu4y  the  two  groups  to'see  in  what  ways  they  differ. 

C.  The  approach  to  behavior  problems  which  attempts  to  reduce  anxiety  thiroUgh 
the  elicitation  of  a  reaponse  incompatiblet  with  anxiety  is  known  as: 

1..  Operant  ahaplng.  > 

2.  Reclptocal  Inhlbitidn. 

3.  P^vlovlan  conditioning*  I 

4.  Conditioned  reflex  therapy.  .  . 

D.  A  test  of  adjustii^t  is  administered  to  100  subjects  and  those  scoring  in 
the  bottom  10%  are  selected  for  intensive  therapy.    Following  the  conclusiqi^ 
oi^  therapy/ the  test  la  readministered  and  an  improvement  in  s&irer  is  noted* 
Suich  an  improvement  in  te|it  performance  would  probably  be  expected  even 
without  therapy  becauaew 

.  ■  ■ .  ^        /     ■  ^    '    .  ■" 

1.  There  has  been  a  lapse  of  time  between  ..the.  first  and  second  administra- 
tions, 

t.    Such  tests  . are  notably  iinr^llabley  partlculary  when  basc^  on  small 
samples  r  f  . 

3.  Regression  of  scotes  toward  the  mean  is  to  be  expected  as  a""  ptiirely 
chance  phenomenon.^  ^ 

4.  The  range  for  which  the  test  was  designed,  has  been  restricted  by  the  ' 
(     method  of  sampling «  W. 

IB*   Hii^nt  research  euggeats  thaW^ sleep  during  dream  periods  tends  to  be. 
.  .   accompanied  by  characteristl|  physiological  bodily  changes.   Two  of 
'tfiese  arei  . 

1«    Low  voltage^  fast  EEC  waves  and  REHs, 

2,  Alphai^BG  wa^s  and  shallow  breathing* 

'3«   Kappa  BEG  win^ea  and  minute  generalised  movements. 

4*    High  voltage.  EEC  waves  and  vailpdilation^  ^ 

Answers;   A.  4   B»  4   C.  2   D.  3  i  E.  1  ^  '  *  \ 
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I    .  EXAMHULTION  COMMITXEE  ^  ''i 

fhft  bmlttatlon  Ccii»ltti«  is  appointed  by  t^ie  Executive  Con4tte6  of  AASFB. 
Its  MMbers  are  chosen  f ot  their  dutstandlng  abilities  and  achievements  In 

Kir  specialties  and  provide  representation  from  major  areas  of*  the  field, 
prese^  members  ot  ^thls  Committee  are: 


PES  Staff  Hemb 


George  W.  Albee»  Fh«D, 
University  of  Vermont 
Turlington »  Vermont 

Paul  J.  Hoffmahy  FhiD. 
Menio  Fai^kt  California 

Eog^r  A.  IfjrerSy  Ph.D. 
Teachers  College 
Columbia  U^ilVerslty 
New  York,  New  York 

WUbur  K,  Rlgby,  Ph.D. 
,Coninmlty  Mental  Health  Center 
Mission »  Kanaaa  . 

Virginia  Stiau4t  Sexton,  Ph.D. 
St.  John's  University 
Jamaica,  New  York 

Raymond^'R.  Shrader,  Ph.D. 
UnlVerslt/  of  Tennessee 
Knoxvlll/,  Tennessee 

G.  Stelner 
Braflley  University 
^rla,  Illinois 


Michael  Werthelmer/  Ph^D. Chairperson 
University  t>f  Colorado 
Boulder »  Colorado 


Craig  G«  Schoon,  Ph«D. 
President 

X.  Leon  Stiiith,  Ph«D« 
Division  Director 

.     '  4*  . 
Bhanna  Rlchman,  Ph«D« 
Program  Associate^  Psychology 

Professional  Examination  Service 

475  Riverside  Drive 

Hew  York,  New  York  3Jp027 
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Calendar  of  Co— 6n  Te»ting  totea 


iTha  Exaeutiva  C<«lttaa  of  AASPB  approved  tto  following  achadula  for  tha 
adBiniatratlon  of  tha  RPPP  for  tlia  slx-yaar  pariod  1979  through  1984  s 

•  .197&  4  April     20  \ 

^  .  <  .     Octobar  19 

1986  ■  ''\   AprU  11 

Octobar  10 

■  »      ■  ■■■■       ■    ■  ^ 

:  19.81  kpxlt  10 

\    '  Octobar  16 

1982  April  16 

Octobar  8 

s.  1983  '  April  8 

\  •  Octobar  lA 

'  1984  April  13  • 

Octobar  26 

V  '    .        ■  .  ■  ^    ■      .  .    ^     ■  ' 

\  Mr.  Weiss.  Mr.  Erwin,  in  the  course  of  your  oral  t^timony, 

^  ;\  although  I  could  not  find  it  in  the  written  part,  you  referred  at  one 

point  to— and  I  am  quoting^— a  hidden  agenda. 
'  '  y  \    ;      I  wonder  what  you  meari  1^  that  and  whether  you  think  that  the 
authors  of  the  bill  or  the  committee,  or  others  .at  the  congressional 
level,  are  engaged  in  attempting  to  do  spifiething  other  than  what 
is  set  forth  clearly  in  the  legislation? 

Mr.  Erwin.  I  think  that  many  of  the  supporters  of  the  bill  see  it  ^ 
as  leading  to  a  demise  of  testing  as  we  presently  know  it,  I  don't 
think  the  drafters  of  the  bill  had  that  in  miiid,  but  I  do  think  that 
naany  of  the  supporters,  in  terms  of  the  rationale  fon  their  support, 
see  it  as  leading  to  the  decline  in  testing  and  possibly  the  elimina- 
♦  tion  of  teiating.  ^  ♦ 

That  is  what  I  n^ean  when' I  refer  to  a  hidden  agenda. 
Mr.  Weiss.  You  also  referred  somewhere,  and  iagain  perhaps  you 
will  correct  me,  but  as  I  recollect  it  and  wrote  it  down,  you  refer  to 
legislation  as  urging  more  restrictive  use  of  tests. 
Now,  if  in  fact  I  hav^e  that  correct,  where  in  the  legislation 
.     deeding  with  ^tsecondary  admissions  testing,  H.R.  4949,  does  it 
suggest  more  restrictive  use  of  teste?        \  *  , 

Mr.  ERVfiN.  I  think  the  legislation's  provisions  that  have  to  do 
with  the  release  of  test  answera  and  l»st  iteins  is  a  restricting  , 
element  in  terms  of  the  use  of  teste,  certainly  not  dhrectly,  but 
certainly  indirectly  at  the  minimum. 

I  think  the  testimony  repeatedly  has  talked  in  terms  bf  the  effect^^ 
on  teste  and  specificcdly  on  certein  kinds  of  teste,  and  I  would 
include  restricting  the  use  of  teste.  ' 

I  WGiuld  include  within  that  phrase  achievement  teste  where  the 
items  will  get  increasingly  difficult  to  write  and  increasingly  poor. 
/  So  that  |he  testes  validity  will  indeed  diminish.^^W 

mento,  it  will  lead  to  their  immediate  removal,  instrumente  such  as 
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biodata  where  because  of  the  inherent  nature  of  tests,  those,  tests 
will  stop.  V 

Their  perfonqance/will  be  foreclosed  before  we  have  an  opportu- 
Ility  to  even  study  them.  The  profession  is  to  a  substantial  degree 
coming  around  to  the  notion  that  perhaps  autobiographical  infor- 
mation can  perhaps^be  an  alternative. 

There  was  an  eican^ple  I  cited  about  the  District  of  Columbia 
youngster  who  was  a  valedictoripi  of  hi§  class  and  was  turned 
down  by  an  institution  because  cfi^is  SAT  scores^  Biodata  would 
have  measured,  and  there  would  iflb  been  weights  associated  with 
the  fact  that  he  was  a  valedictorismluid  I  am  sure  he  engaged  in  a 
/tils  that  would  be  of  a  positive  nature, 
/in  requlHng  that  answers  be  provided  to  ques- 
lose  the  use  of  biodata  before  it  ever  got  off  the 
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Federal  sector  where  perhaps  25  blacks  pass  for 
passes,  if  biodata  weVe  added  to  the  Federal  selec- 
at  there  would  be  a  substantial  reduction  in  the 
that  that  system  now  has  on  minority  classes, 
g  fb  eliminate  the  situation  that  the  SAT  and  the 
lling  us  are  there,  but  at  least  it  wiU  bring  into  the 
heme  a  lot  of  what  people  have  been  saying  before 
we  ought  to  be  taking  into  account  peraon^il  char- 
and  above  how  an  individual  does  on  an  SAT  score 
exam.  There  are  ways  to  do  it,  namely,  biodata  is 
or  ways.  ^  *  . 

ity  of  Chicago  has  been  wojdung  with  it  for  quite  a 
few  ye^,  Melanie  Bare.  She  made  a  statement  recently  that  in  all 
the  years  she  has  been  using  it  she  has  less,  if  any,  adverse  impact 
from  the  use  of  this  system.  The  legislation,  what  it  should  consist 
of,  will  foreclolse  the  promise  of  those  kinds  of  systems  because  bio-*" 
data,  if  vou  {Provide  the  answers  to  the  quj^stions,  you  haye  de- 
strwed  the  syi^tem  by  doing  so. 

That,  dri  essence,  is  what  I  mea)nt.by  restricting  the  use  of  tests 
inherent  in  the  le^lation.  \ 

Mr,  Weiss,  Ilthmk  you  may  have  wanted  your  statistics  to  be  in 
reverse.  It  is  2^  whites  for.  every  black.  I  think  you  daid  25  blacks  . 
to  every  white,  r  \  • 

Mr.  Erwin.    is  reversed,  excuse  me. 

Mr.  WEisis.  Again,  without  getting  into  substance  of  the  tests,  the 
l^islation  doeS' nojb  deal  with  that  at  all.  I  am  just\curious  ais  to 
whether  it  is  ydUr  view  that  biodata  is  not  currently  being  used  by 
most  adiiiissioni9  offices?  \   .  . 

Mr.  QiwiN.  That  is  correct,  in  its  standardized  forms,^  the  fornf^ 
professionals  wpiild  describe  it,  biodata.  or  personal  chakacteristicsi; 
are  used  in  the  a4mission8  system.  ^  Vi 

People  do  take  liccouiit  of  origins,  experiences  or  ^hievemehts 
one  kind  or  another.  It  is  done*  in  a  relatively  subjeQtive  mix^ 
way,  •■  \  ,  .  \  '  ' . 

Mr.  Weiss.  You  are  still  talking  about  admis&ion  to  post-^cond- 
ary  schools,  ridit?  \  *  \ 

Mr.  Erwin.  That  jus  4ght.   '  '  \  . 

fiMatair  as  referr^  to  in  the  professional  sen9e,  is  a  pencil  atra 
pap^  instrument,  thc4  items  of  which  tap  sucb  things  as  prior 
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.Achievement,  motivatKm''^4o-'aehieve,  judgment,  work  orientation, 
work  values,  self-concept.  It  do^s  this  in  a  standardized  scor able 
wa}i  It  eliminates  any  need  to  niake  subjective  judgments.  It  is  an  . 
empirical  system.  It  has  been  used  in  industry  for  a  number  of  f 
♦years,,  decades,  in  fact.  / 

It  has  been  shown  to  be  one  of  the  most  valid  predictors  of 
occupational  success  in  industry.  It  has  hot  been  used  except  in 
rai'e  circumstances  in  the  academic  admissions  setting. 

If  you  wish  to  find  put  more  about  its  use.  in  academic  admis- 
sions. Dr.  William  Owens  of  the  University  of  Georgia  has  been 
experimenting  with  standardized  biodata  questionnaires  as  part  of 
.  the  Univei;sity  of  Georgia  procedures  and  has  a  substantial  body  of 
data  on  the  extent  to  which  biodata  predicts  success  in  academic 
settings.  • 

^Mr.  Weiss.  I  am  really  puzzled  by  that  whole  area  because  it 
would  have  occurred  to  me,  and  certainly  thie  testimony  that  we 
have  received  up  to  this  point  from  everybody,  just  about,  in  the 
testing  industry,  from  the  colleges  and  universities,  professional 
schpols,  indicated  to  us  in  some  uncertain  terms  that  the  standard- 
ized tests  are  only  a/very  small  portion  of  the  basis  on  which  they 
evaluate  applicant's  admission  and  that  tKey  take  into  account  the 
applicant's  scholastic  record,  biographiial^record,  achievements,  Ex- 
tracurricular activities,  ^t  cetera. 

It  sortlof  reminds  me  about  the  old  story  that  he  didn't  know 
they  V^re  speaking  grammar  until  somebody  told  them. 

I  don't  understand  why  or  how  this  staiidardization  of  biodata,  if 
you  will,  differs  from  that  which  admissions  people  have  been 
telling  us  they  use  in  any  event.  | 

Dr.  Qasteen,  I  wonder  if  you  could  comment  on  how  individual 
biographical  information  is  or  is  not  used  currently? 

Dr.  Qa8TEeN>  Mr.  Weiss,  I  don't  hear  well.  Perhaps  I  missed  the 
last  part  of  the  question.  .  • 

Mr.  Weiss.  I  am  not  sj^aking  tod  well  today. 

I  worider  if  you  would  comment  on  the  extent  to  which  the 
individual  biographical  background  of  the  applicant  is  used  by  you 
and  other  admissions  people,  how  it  is.  used' for  the  applicant's 
application?  \  ' 

Dr.  Casteen.  We  have  thiee  source^  of  that.  One  is  the  applica- 
tion form,  where  the  studerii;  responds  in  longhand  or  typewritten 
form  to  the  questions  we  propose,  questions  about  their  goals, 
academic  experiences,  academic  expectations^  sometimes  informa- 
tion about  possible  careers. 

'  I  use  one  question  that  says,  describe  yourself,  and  gives  the 
student  a  blank  space.  *  A 

My  purpose  for  that  question  differs  from  what  Mr.  firkin  is 
describing  as  the  Modata  form  because  I  am  looking  for  informa- 
tion and  evidence  tnat  th^e  student  can'write  andmiink  effectively. 

So  I  ijsfe  the  material  on  a  relatively  subjectwe  fashion,  based 
partly  on  my  pwn  experience  as  an  English  teacher.  1  am  looking 
for  things  that  go  into  other  areas  of  evaluation  rather  than  those 
^escribed  in  the  biodata  research.    '  ♦  ^ 

Other  than  that,  I  am,  looking  for  things  that  might  meamdiffer- 
ent  things  tp  different  people.  I  have  committee  metnbers  wno  will 
read  that  information. 
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*  #The  otker  two  resources  are  thia/lfehool  report  form,  a  document 
filed  on  behdf  of  the  student  by  a  teacher,  counselor  or  some  other 
gphool  ofGcial,  and  finally,  in  some  cases,  letters  of  recommenda- 
tion, ciBpeciaU^i  letter^  of  recommendation  that  conie  from  responsi- 
ble adults  who  h^ive  watched  the  student  grow  and  who  can  de- 
scribe in  discursive  terms  a  sul:oective  measurement  of  how  well 
the  stf:ident  has  dealt  witii  obstacles,  what  the  student  does  in  the 
fa^e  of  resistence,  h^  the  student  is  to  articulate  a  goal  and 
possibly  accomplish  it  through  a  combination  of  academic  and 
extra-academic  activities. 

The  purposes  of  the  information  I  collect  that/are  used  copimonly 
in'i;he  more  iselective  colleges  and  universities  differ  in  basic  coh^ 
cept  f^om  those  pursued  in  industry  and  the  kind  of  instrument 
that  Mr.  Erwin  is  describing.  \ 
yWe  are  ncit  interested  in  scoring  at  the  moment,  in  scoring  a 
student's  biographical  experience.  We  are  interested  insteaa  *  in 
seeing  how  well  the  student  thinks  in  describing  it,  ijn  seeing  how 
effectively  the  student  can  relate  that  experience  to  his  academic 
and  personal  intentic^s,  and  finally,  in  seeing  whether  the  student  % 
writes  a  reasonable  example  of  standard  lAmerican  English  prose. 

Mr.  Wei68.  a  number  of  you  have  commented  on  the  effects  of 
coaching^imd  I  think  that  ther<9  was  some  testimony  which  related 
to  how,  by  providing  the  answers  as  well  as  the  questions,  you  are 
in  essence  making  the  job  of  the  coaching  institutions  easier,  and 
that  likely  it  is  going  to  be  those  tvho  have  the  wherewithal  to  take 
the  c<|aching  course  who  will  be  taking  them. 

My  question  is,  Mr.  Erwin,  you  referred  earlier  to  my  enterinjg 
into  the  record  uie  item  from  the  New  York  Times  a  few  weeks  ago 
indicating  the  prevelance  of  coaching  institutions  right  now. 

Isn't  it  a  fact  that  coaching  really  goes  on  at  a  great  pace,  at  this 
point,  and  what  happens  currently  is  that  although  it  may  be  more 
difficult  for  the  coaching  ttistitutidns  to  gei  the  answers  to  ques- 
tions, what  they  are  primarily  concerned  with;  that  in  fact  they  get 
it  nonetheless. 

Certainly  you  have  indicated  that  there  seems  to  be  a  correlation 
of  improvement  among  those  who  take  the  Caching  courses,  that 
iii  fact  what  y6u  would  be  achieving  by  opening  it  up  is  not  just  # 
have  coaching  schools  burgeoning  but  thatj^yQU  would  have  people 
who  currently  do  not  have  access  to  coaching  institutions  in  fact  be 
able  to  compete  on  a  more  equal  basis  with  those  who  cjiirrently 
can  afford  to  take  the  coaching  courses? 

Mr.  ElBWfN*  liicst  assumes  that  people  who  have  the  answer  sheet 
by  themselves  on  their  lonely  basis  can  improve  by  themselves 
without  the  coaching.;I  don't  think  that  is  a  reasonable  assump- 
tion, i  •  ' 

Mr.  WEISS.  No,  it  doesn^t  assume  tHat.  It  assumes,  for  example!,  ' 
that  the  NAACP  whidn  testified  before  us  in  support  of  this  legisla- . 
tion  may  .  decide 'to  imdertake  a  coaching  course  on  then*  own  to  . 
provide  them  to  students. 

Jir.  Erwin.  Thera  would  still  remain  the  basid  question,  does^ 
ching  mflke  a  difiPer^nce  in  terms  of  subsequent  performance? 
That  questioji^has  not  been  answered  by  ahy  of  tliose  l^estifying. 
That  question  tias  to  be  answered. 


Mr,  Weiss.  You  have  indicated  in  your  testimony  that  you  think 
in  fact  it  does  improve  scores. 

Mr.  Erwin.  Test  scores,  yes,  I  do.  I  think  so.  But  I  think  also  that 
the  question  still  remains,  do  those  who  get  coached  perform  at  an 
equally  higher  level  when  they  get  into  an  academic  setting?  That 
question  is  unanswered,  ,  ^ 

Mr,  Weiss.  But  that  really  has  no  relevance  because  the  admis- 
sion is  dependent  on  the  score,*  really,  to  whatever  extent  it  is 
dependent  on  the  score  rather  than  on  t^ie  basic  fundamental 
underlying  educational  component  quality. 

Dr.  Casteen? 

Dr.  Casteen.  Mr.  Weiss;  may  I  add  a  description  of  three  tfxperi-  ' 
ments  that  I  have  undertaken  having  to  db  with  teSt  scores  and  the 
relationship  between  test  scares  and  aqademic  training? 

I  am  ijot  interested  specifically  in  coaching,  but  for  several  years 
I  have  been  asking  students  whose  records  are  generally  sound  but 
whose  SAT  scores  include  subscores  that  indicate  reading  def^ien- 
dies  and  secondly,  also  students  whose  reading  deficiencies  can  also 
document  from  other  standardized  testing^  that  appears  in  th&«^ 
school  record)  I  have  been  ^king '  those  students  on  a  randbm  basis 
to  undertake  some  kin^  of  reading  improvement  program,  some- 
tihies^  corilmercial  program  or  a  program  available *at  the  school 
aimed  at  increasing  speed  or  rapidity  of  reading,  improving  genejal 
reading  comprehension  and  teaching  students  how  to  deal  critically 
with  what  they  have  read,  and  I  have  laid  down  those  three  stipu-  \ 
lations  to  be  pursued  in  the  programs. 

Almost  inevitably,  students  who  have  taken  that,  kind  of  reading  . 
improvement  aimed  not  at  the  tests  but  dealitig  with  the  skills  that 
the  tests  rewarded  and  also  the  skills  we  rewarded  in  teaqhinj? 
studeii|ts  at  the  undergraduate  level,  I  have  found  almost  inevitably  ♦ 
that  test  scores  improve  dramatically  for  students  who  take  that 
kind  of  remediation  in  the  12th  grade. 

I  have  for  several  years  asked  Virginia  residents  whose  records 
are  generally  sound  but  whose  high  school  programs  indicate  they 
have  not  taken  the  most  rigorous  program  available  to  them  until 
the  senior  y^ear  to  wait  until  after  the  senior  year  of  high  school,  , 
which  for  many  of  these  kids  is  their  first  experience  with  five 
academic  courses  in  the  course  subjects,  and  then  retak;^  the  SAT. 

I  have  published  an  experiment  this  year  about  the  outcome  of 
that  improvement  because  we  .found  the  hiean  improvement  of 
those  students  exceeded  the  FTC  report  on  coaching. 

Third,  we  run  each  summer  a  summen  preparatory  prp^am  for 
,  students  with  nonacademi:c  backgrounds^  who  are  VirginMi  resi- 
dents, mostly  black  students.  It  has  nothing  to  do  with  standard-  j 
ized  .tesfc#But  it  deals  in  a  basic  intensive  .fashion  for  6  weeks  with 
reading,  writing,  and  arithmetic. 

I  will  be  glad  to  furnish  you  the  outcome  of  that  program,  also, 
because  at  the  end  of  the  summer  we  established  a  SAT  for  those 
students  an^  found  score  improvements  that  go  far  beyond  what 
the  coaching  companies  have  been  able  to  denionstrate  and  fur- 
thermore indicate  the  direct  link  between  the  kinds  of  acadeiriic 
skills  these  youngsters  are  n6t  acquiring  in  school  and  the  kinds  qf 
skills  they  must  have  to  do]  well  on  the  tests  and  succeed  in  the 
rigorous  undergraduate  program.     -  / 
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It  is  demonstrable  that  students  who  learn  to  read  effectively, 
write,  and  subtract  and  multiply  effectively  get  better  test  scores 
aid^^lbigher  drades  when  they  get  into  college.  That,  I  think,  is  the 
COB  of  the  moblem  in  coaching. 

.  Mr.  Buchanan.  Mr.  Chairman,  I  might  say  at  the  outset,  that? 
while  I  appreciate  thb  contributions  made  by  the  members  of  ^nis 
panel  ovenedl/  there  are  two  that  are  of  special  interest  to /me. 

I  did  graduate  work  at  the  University  of*  Virginia  which  is/very  • 
a»y  fcepresehted  this  morning  by  Dr.  Casteef;  and  Dr.  HalFcame 
to  hOT  present  position  from  the  University  that  is  my  largest  :\ 
constituency,  the  University  of  AlabamA  in  Birmingham.  So,  I.have  ' 
also  a  provincial  interest-in  the  testimony.  ^  '  i 
I  am  one  of  the  members  of  this  committee  who  is  undecided  in  J 
this  whole  area,  because^  while  I  think  something  is  the  matter,  I 
am  yery  much  afraid  it's  mostly  something  ,the  matter  with  the 
.  educational  system  at  the  elementary  and  secondary  ieveld  ratHer 
than  with  the  testing.  .  /       I  \ 

I  would  like  to  know  for  certain,  if  it  is  fact,  so  that  we  cism  take 
more  decisive  action,  so  we  can  take  steps  to  correct  the  problems. 
Some  of  the  problems  may  be  with  the  testing,  for  all  I  loiow. 

As  I  understand  Chairman  Weiss'  bill,  H.R.  4949,  the  idea  is  to 
make  possible  the  researdi  ^at  that  would  further  evaluate  those 
tests,  and  to  make  sure  that  there  are  no  restrictions  on  such 
research,  as  well  as  to  let  individuals  have  more  fre^edom  pertain-  _ 
ing  to  the  information  as  to  how.  th^  performed  on  the  tests. 

Now,  that  may  or  may  not  be  an  accurate  explanation  of  what 
you  are  trying  to  l!b,  but  it  is  tap  I  understand  it.  . 

I  guess  thera  are  several  things  about  which  I  have  questions, 
but  let  me  ask  mther  generally  and  ask  you  to  respond. 

First,  is^  this  ^  area  where  Congress  needs  to  act?  Does  there 
need  to  b^Federld  action  in  this  area?  The  State  of  New  York  has 
acted  although  I  know  that,  the  primary  sponsor.  State  Senator 
Kenneth  LaViUle  of  New  York,  has  indicated  that  he  is  going  to 
look  at  certain  aspects  of  his  law  during  the  next  legislature  to  see 
if  there  are  areas  of  revisio^n  that  shoulp  be  made  in  the  New  York 
law.      .  f 

So,  fir^t  of  Jail,  is  this  an  ar^a  where  we  need  concessional 
action? 

Second)  if  «o.  is  this  l^^lation  specifically  the  action  we  need  to 
take?  Dr.  Ha|l(h;E^  indicated  tihat  she  is  lei^  than  happy  with  some 
of  the  provisions  of  the  Gibbons  bill  and  ^  the  impact  that  they 
might  have.  Others  have  spoken  more  to  the  perceived  conse-  n 
t  quences  of  the  Weiss  bUl.  ^    i  \ 

Is  there  specific  action  we  can  take,  Ibid  is  then  action  we  can 
take,  perhaps  a  little  difl^w^nt  from  either  propoial,  that  might 
naii  down  wnether  or  not  there  is  bias  in  testing?  >  \ 
jf  Third,  if  Congrws  should  act,  should  we  act  now?  Is  thefe  any- 
thing that  would  indicate  that  we  riled  to  take  a  harder  16ok  before 
^  we  aict,  or  V'  the  sitwe^ioli  stich  that  we  need  immediate  action. 
J.  Those  are  all  general  questions,  but  I  woidd  appreciate  your  re- 
/     sponses  to  them.        *  /  ^ 

*   Dr.  FuEiSHMAN.^  WeU>  I  think  the  position  that  the  professionals 
i  -  that  I  represent  are  taking.is  that  we  don't  heed  %  act  now,  that 
i^i'  ^  there  are  a  number  of  ^nsting  regulatory  forces  that  are  taking* 
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into  account  some  of  the  concerns  that  the  committee  has 
expressed. 

Also,  there  are  some  developments  now  going  on,  such  as  the 
National  Academy  of  Sciences  study  which  is  getting  complete,  and 
the  passage  of  legislation  in  other  States  which  are  yet  to  be 
.e\5aluated.  It  would  seem  to  us  that  it's  premature  to  enact  legisla- 
tion at  this  time  unless  these  reports  and  actions  can  be  properly 
evaluated,  so  that  is.  how  I  would  respond  to  yout  question  at  this 
.time.  ^ 

The  third  point  is  that  there  are  side  effects  of  current  proposals 
which  would  in  fact  reduce  the  validity  of  existing  procedures,  and 

•  would  also  not  solve  the  problem  of  reducing  bias  and  discrimina- 
tion. 

Mr.  Erwin.  I  would  agree  in  terms^f  should  we  act  now,  that  it's 
premature.  I  pointed  out  earlier  the  advisory  panel  on  score  decline 
took  2  years  to  reach  its  conclusions,  and)  even  then  we  were  not 
satisfied.  We  commissioned  37  /separate  §B[dies  of  the  subject:  The 
Federal  agencies  involved  in^tablishihg  the  uniform  guidelines  on 
"  employee  selection  procedures  took  ,6  years  to  reach  their  conclu- 
sions. , 

There  is  law;  several  St^^s  have  rejected  the  similar  law.  There^^ 
is  the  National  Academy  of  Sciences  study  which  is  rio\v  ongoing.' 
All  of  these  things  argue  in  favor  of  a  longer  observ£^k)n  period. 

I  don't  think  that  what  is  1>eing  proposed  is  the  action  that  you 
^eed  to  take.  I  think  the  longer  evaluation  period  will  help  bring 
that  to  a  little  bit  sharper  focus.  I  think  it  is  abundantly  cleai^fwm 
the  testimony  that  you  have  heard,  not  just  from  the  testing  com- 
panies but  from  the  professionals  in  general,  that  one  of  the  major 
problem  elements  in  the  legislation  is  the  call  for  release  of  test* 
items  and  test  answers. 

This  in  fact  will  depress  validity  and  is  one  of  the  major  obstacles 
to  a  fuller  discussion  or  meeting  of  the  minds.    *  ^ 

Now,  do  you  need  to  act?  Act  is  a  broad  word.  The  question  is, 

•  you  need  to  legisliate? 

I  don't  think  ^6u  do  at  this  point  in  time.  But  I  think  the 
Congress  ought  to  include  a  little  bit  of  leverage  in  place  of 
tion.  It  may  Very  well  be  that  some  meaningful  discussioiis^c^ 
begin.  If  we  share  common  objectives,  that  is  to  say^  what  is  it  tfiSf 
can  b^  done  to  get  the  data  out  into  the  open  so  that  more  people 
can  study  the  dataj  and  the  conclusions  can  be  drawn  quicker, 
more  fullv,  and  the  concern  about  a\few  bodies  having  the  keys  to 
the  kingdom,  if  you  Will,  an^hing  tKkt  the  Congress  can  do  in  itd 
.  le.verage  role,  not  its  legisla^Ve  role.  * 

I  don't  think  it  would  J^cf  a  waste  of  this  committ^^s4ime  at  the 
stAff  level  to  be  talkiW'to  the  testing  companies  and  saying,  let's 
talk  about  if  we  agrjee  on  the  need  to  get  d^a  into  the  open  so  that 
people  can  studv^  responsible  professionals  Can  see  it  in  its  raw- 
est form  and  ^not  i  summary  form,  how  carl  we  do  that  without 
1^  bending  youj^noses  too  far  out  of  joint.'  \ 
.  ,  I  think  a^Tesponsible  discussion  can  take  place  at  that  level,  and 
we  may  reaCh  agreement.  That  is  possible.  \ 

I  doiVI  think  tiiat  the  Congress  needs  to  just  sit  still.  I  think  you 
have/ihcredible"  influence  in  terms  or  the  leverage  fader,  and  that 
that^leyerage  &ctor  ought  to  be  used.  . 
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Mr.  Buchanan.  Thank.you  very  mueh. 
Does  anyone  else  have  a  response  td  those  concerns? 
Yes,  sii^ 

Dr.  Canteen.  Briefly  It  may  be  useful  to  you  to  know  that  many 
of  the  ^concerns  that  the  conimittee  members  have  expre^ed  and 
th^lt  have  turned  up  in  testimony  on  both  sides  of  this  question  to 
tins  committee  are  also  the  common  concerns  of  those  of  us  inter- 
in  teachhig  and  moving  students  effectively  through,  the  edu- 
cational system. 

*    Tha^^^oes  not  answer  the  question  as  to  whether  legislation  is 
;  necessai^  Fof  example,  one  of  my  activities  as  d^an  at  Virginia  is 
sitting  on  bne  of  the  councils  by  which  the  college  boards  seeks  to  | 
receive  opimbns,  judgments,  responses  from  its  college  constituen- 
'ci^.'  \  '  i 

That  council  fhr  8  years  encouraged  the  college  board  in  an 
ongoing  project  to  t^ease  a  full  copy  of  the  SAT  with  relatively 
detail^  explanatory  "data  that  could  be  directed  to  students  and* 
used  in  helping  ^studentp  prepare  for  );he  test,  and  that  discussion 
predated  by  a.good  bit  cologressional  interest  in  this  issue  of  disclos- 
ing tiie  contents  of  not  ev«y  test  but  an  this  case  a  typical  ,  and 
.  authentic  test.     ^  \ 

»  The  book  was  published,  as  you  may  know,  last  year  and  goes  to 
students  whQ  take  the  SATs  on\  regular  basie^.  That  indicates  the 
fact  th(ft  Botae  of  what  Mr.  Weis^  has  been  concerned  about  has 
^n  the  subject  of  concern  in  the  Wofessional  community^  but  it 
also  indieates  the  extent  to  whiclr  a  community  that  initially  devel- 
oped nesting  because  of  a  clear  need  in  our  educational  system  and 
because  of  the  peculiai^ity  of  the  AmericanNeducation  system. 

We  .do  not,  have  a  dictated  national  curribulum.  Every  organized 
iudustrialized  nation,  can  indeed  measure  what  it  int^d^  by  edu- 
cation because  the  IStaie  dictates  what  it  needs  in  the  class. 

Given  tl^  origins  in  the  testing  system  and  our  educational 
program  in  general,  the  Ijact  that  the  community  has  been  able  to 
respond  to  perceived  needs  when  they  come  indicates  initially  that 
the  private  system  works. 

On  the  other  hand,  it's  going  to  be  the  case  in  the  course  of 
liistory,  we  aye  involved  on  a  daily  basis  with  students  and  their 
credentials  and  will  miss  points  that  will  be  obvious  because  we  are 
too  close  to  tf ees  and  too  far  from  the  forest. 

Congresaiond  scrutiny  is  a  healthy  and  necessary  phenomenon. 
In  my  earlier  appeal  for  a  serious  ijational  look^at  the  whole 
^  q^estioA^  why  schooling  does  not  accomplisn'its  stated  purposes, 
4/  and  I  tMnk  that  should  be  th6  pi'oper  businesSs  of  Congress. 
Mr.  Buchanan.  Thank  you  veiy  much.  ' 
I  mu|t  say  this  has  been  a  particularly  helpful  panel,  and  I 
appreciate  yoilr  testimony.  - 

Just  on^  further  thing,  Mr.  Chairmafi,  and  I  appreciate  your 
patience.  ^       -  "  i 

Mr.  Brwin,  you  especially,  I  think,  ha|e  been  thinking  the  u^ 
tli&kabl6  and  speaking  the  unspeakable  jjpre  this  morning. 

/It  does  seem  to  m^that  we  need  to  do  a  good  deal  more  of  this. 
/You  1^  Dr.  Cksteelf  have  both  talked  about  some  of  the,  I  am 
afraid,  very  real  problems  thatt  we  are  facing,  and  of  what  is 


happening  in  education  in  the  United  States*  at  the  elementary  and 
secondary  level.  .  ; 

I  am  very  rtiiich  afraid  that  we  have  not  had  enough  frank, 
honest  facing  up  to  the  realities  of  1j|ie  problems.  I  really  think  that 
'  the  standardized  tests  may  be  perceived  as  something  of  a  test  for 
the  teachers  as  well  as  for  the  students,  and  if  that  is  tr^e,  therf 
both  the  teachers,  and  the  students  have  been  flunking  the  test 
and  I  think  that  is  hot  and  could  not  be  a  happy  thing  for  a 
professional  group. 

I  would  say  we  may  discover  that  the  teachers  are  not  the  heart 
of  the  problem  ^fter  all.  We  have  laid  unspeakable  ^burdens  of 
v..  varous  kinds  on  some  teachers  jn  recent  years.  They,  in  many 
places,  are  an  underpaid,  underappreciated  group  of  people  who 
-    have  had  too  little  voice  in  policy  administration.  Yet,  I  very  much 
fear  that  iiF  we  look  hard  enough;  and  face  the  complexities  of  the 
♦   problem  with  enough  initiative\ifed  enterprise,  we  may  find  there 
are  some  very  real,  very  severe  problems  in  elementary  and  sec- 
ondary education  in  the  United  States. 

One  of  my  great  concerns  is  that  if  you  don't  have  clearly  valid 
standardized  tests  there  to  measure  how  we  are  doing,  whether  it 
deals  with  the  problems  of  an  ethnic  group  or  a  socioeconomic 
group,  or  with  the  problems  or  people  in  general  in  the  llnited 
States,  I  very  much  fear  we  will  lose  something  valuable  by  which 
we  can  help  or  which  can  help  us  analyze  and  try  to  deal  with  the 
problems  as  they  are. 

That  is  a  really  long  speech  rather  than  a  question;  but  if  anyone 
would  care  to  respond,  I  would  be  pleased. 

Mr.  Erwin^  I  think  that  ori  one  count  there  is  a  question  that 
says:  "How  is  your  wife?"  and  the  "response  is,  "Compared  to 
what?"  .  . 

That  has  to  do  with  norm  reference  testing  as  opposed  to  crite- 
rion referenced  testing.  The  provision  in  Mr.  Gibbons^  bill  that  has 
to  do  with  a  prohibition  against  comparing  people  in  terms  of  their 
relative  standing,  if  that  kind  of  external  measure,  how  do  we 
stand  against  the  rest  of  the  community,  other  communities,  or  the 
.  Nation,  and  if  we  are  not  permitted  to  make  those  kincte  of  relative 
evaluations,  one  school  system  as  opposed  to  another,  then  the 
parents  will  have- no  measure  of  how  well  their  children  are  being 
educated  because  there  will  be  no  comparisons  available. 

They  will  be  truly  the  captive  of  the  system.  There  are  some 
questions  about  how  much  do  you  really  want'to  find  but.  We  hriow 
that  there  is  an  tillness.  ^here  is  just  no  question  about  it.  All  of 
,  the  measures  that  .we  are  sayirig,  and  it's  not  just  the  SAT  which 
is,  incidentalljt  declining,  something  that  causes  us  some  concern. 

We  have  seen  it  in  the  math  skill  reports  that  conje  out  of  the 
National  Assessment  Association  omEducational  Progress;  and  we 
did  see  it  in  Dr.,  Jensen's  writing  a^n  in  the  Washington  Post  of 
October  5.  the  Washington  Star  of  October  4,  where  there  is'  a 
;  report  thai  the  academic  quality  of  young  teachers  is  taking  a  nose 
dive.  That  is  only  one  study,  but  to  the  extent  thaft  SAT  scores  are 
declining  genei^uly^  they  are  declining  just  as  well  for  people  who 
are  ^^oing  to  bcr  prepared  to  be  teachers  as  they  are  for  people  who 
are  going  to  be  chemists  or  engineers  or  doctws  or  whatever. 


there  are  Some  very  difficult  bullets  that  we  have  got  to  start 
bitingi  and  that,  has  to  do  with  the  quality  of  education  for  our 
chUdreh  and  what  happens  before  we  get  to  the  schools* 

You  are  right,  teachers  in  elemental  schools  have  an  extraordi- 
nary, burden  in  the  school  systems  generally.  They  ^e  Becoming 
the  caretakers  or  expected  to  be  the  carietakers.  That  is  not  ther 
way  the  system  should  work.  There  has  to  be  some  prep^atioii 
before  schooling,  and  that  is  taking  place  to  a  lesser  degre^^than  it 
ought  to.  ^ 

ought  to  do  more  about  the  effects  o(  diet  on  different  seg* 
mems  of  the  population,  on  us  aU.  We  are  all  the  same;  Depriva- 
tion is  very  fair.  It's  much  fairer  than  anything*  else  in  the  society. 
It  a^ects  aU  qf  us  equally,  and  there  are  dome  who  are  more 
derived  than  others,  not  only  in  terms- of  the  education;  they 
receive  but  what  happens  before  they  begin  to  take  their  education. 

Those  thing^  have  got  to  Jbe  addressed,  and  we  have  got  to  start 
addressing  them.  I  think  we  need  a  truth  in  education  bill  or  at 
least  start  talking  about  a  truth  in  education  bill  rather  than  just  a 
truth  in  testing  bill.  We  are  still  dealing  with  the  thermometers, 
and  that  is  iilhppropriate.  The  thermometer^  surely  have  ^to  be 
looked  at»^but  We  can't  ignore  what  the  thermometers  are  teljing 
us,  and  to  a  substantial  degree  we  are. 

Mr.  BUCHANAN;  Thank  you  very  mtich^ 

Any  other  response? 

Thank  yoii,  Mr.  Chairman.  % 
Mr.  Weiss.  Mr.  Erdahl?  .  .       "  '  . 

Mr.  Erdahl.  Thank  you,  Mr.  Chairman.  I  apologize/for  not  being 
here  for  the  panel's  presentation;  but  I  will  read  your  testimony. 
Mrr  Buchanan  asked  the  question  I  was  wondering  about.  I  thiitk 
's  well  that  this  bill  is  before  us,  whether  it  passes  or  not,  but  I 
think  that  we  have  seen -the  highlighting  of  a  concern^  whether  it's 
a  concern  over  the  results  of  the  tpstijpg  or  a  concetti  over  what 
brings  those  results-  about.  I  guess  I^would  echo  what  tiie  last 
Witness'said  in  a  different  word  perhaps,  that  maybe  we  are  pursu- 
ing the  wrong  villain.  The.  villain  could  be  a  combination' of  things, 
whether  it's  deficiencies  in  our  educational^  system,  in  the  pai^ 
ents— and  I  am  a  parent*  with  several  childreft  in.school— whether 
we  a^  parenl»|  have /ai]^, 'whether  our  chiMiQi^^^  ^pent  too 
much  time  in^oht  of  the  television,  or  what©>ferJ  /  4 

I  woiold  hope  that  with  the  bienefit  ^^ms  testimony  abd  other 
statemems  that  we  have  received  botli'^pi^^         that  w^  could 
le  oUtVaff  our  delibei^ationB  with^S^ethjbg^^^        is  good  for 
primarily  t)ft  teacher  or  the  system  or  tlie  Government,  but 
student  That  is  the  main  concern  we  ou|ht"  tQ  shar»>  iEu»  mem^ 
I  ^f  this  committee  and  as  Members  of  engross. '^^^^         »  . 
han|ryou,  M^.  Chairman.  ^/ 
Ir.  W«is%^Mr,  Erwim  iA  the  coujise  of/ydiir  testimony  you  re- 
k1,,  I  think  I  am  alltlofit  ■quo|;ing,  to  the  iarrogance  of  the-Educa- 
' '  Ig  Service  spAp9p€|||f(||»  who^  said  that  their  job^  they 
, ,  je  t^^  gatekeepers."  ■  " 

1  gather  fro^l;hat  that  you  do  not  C9nsider  that  the  appropriate 
rode  of  th^  testing  industries  to  keep  beopl^^  ^^t  of  institutions  of 
higher  learning.  •       .        /         ^  i 
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Mr.  Erwin.  I  had  a  feeling  t^jat  you  would  pick  up  on  that 
statement  and  had  considered  leaving  it  out  but  thought  I  muld 
leave  it  in. 

That  is  one  staff  member;  I  thought  it  was.  If  it  wer^rue,  it  was 
reported  to  me  secondhand,  and  if  it  were  true  it  was  arrogant  to 
say  that.  I  .think  it  was  inappropriate  and  not  really  the  function  of 
testing  as  we  see  it.  It  was  also  iujudiciqus,  to  say  the  least: 

I  don't  think  the  mentality  exists,  and  we  were  exposed  for  2 
years  during  the  course  of  the  advisory  panel's  convehings  to  a 
great  degree  to  ETS  staff  and  generally  found  them  to-be  extraordi- 
'narily  helpful  and  ypry,  Very  sensitive  to  their  responsibility  in 
terms  of  the  role  that  they  had  to  play  as  professionals.  They  are  a 
very  professional  group  of  people^  a  very  professional  organization. 

I  don't  think  they  see  themselves  as  the  gatekeepers  in  terms  of 
keeping  people  out:  They  h|Ve  taken  substantial  strides  and  from  a 
point  of  view  that  tests  to  ^  symbstantiardegree  are  the  thing  that 
ge^ people  in.  . 

If  you  do  agree  that  people  evaluate  school  systems,  they  know 
the  relative  quality  of  school  systems.  Admissions  personnel,  that  is 
their  function  to  know  how  well  school  systems  do  in  ternis  of 
educating  the  people  that  come  from  them. 

The  tests  very  often  help  to  reach  out  within  school  systems 
where  you  know  the  quality  o^  education  is  generally  poorer.  The 
tests  help  to  reach  out,  to  pull  in,  if  you  will,  those  people  who  are 
othenfise  not  pulled  in,- so  I  don't  think  they  see  themselves  as 
..gatekeepers  in  the  sense  of  selecting  out  at  all.  I  really  do  not 

I  think  it  was  a  poor  remark  to  make,  if  it  was  indeed  made,  and 
I  was  using  it  to  go  on  to  the  broader  point  that  I  was  making  in 
the  testimony. 

•  .Mr.  Weiss.  I  appreciate  your  utilizing  it,  because  to  me  it  sort  of 
Wghlights  part  of  Dr.  Casteen's  testimony  irKresponse  a  little  bit 
ago  to  a  question  from  Mr.  Buchanan,  about  when  he  referred  to 
the  fact  that  people  in  the  admissions  field  themselves  and  people 
in  ihe  Held  of  testing  generally  have  raised  some  of  the  very 
questions  and  Concerns  that  we  have  been  raising  in  suggesting 
legislation,  H.R.  4949. 

I  have  been  impressed  by.  the  testimony  from. professionals  who 
are  not  part  of  the  testing  industry  who'^have  spent  their  lives, 
some  for  decades,  some  for  5,  10,  15  yeargMn  the  field  who  he\ye 
given  us  examples  where,  in  spite  of  whatlH^ducatipnal  Testiflg 
Service,  for  example,  pretends  to  make  available  raw  materials,  to 
qualify  professionals  where  some  of  them  have  had  to  go  into  court 
to  gain  access  to  materials  of  that  kind,  so  the  legislation  that  I  am 
sponsoring  does  not  have  it  iete  its  aim  the  destruction  of  testings  ^ 

What  I  am  concerned  about  is,  in  faolf  fair  testing.  I  think  that 
fair  testing  can  only  come  about  if  professionals  in  the  field  have  a 
chance  to  really  look  at  thfe  data,  the  raw  materials,  and  to  cri- 
tique, because  I  don't  think  that  the  byproduct,  the  end  result  of 
testing  is  only  of  concern  to  the  testing  industry.      /  ^ 

I  think  th&t  it's  a  national  concern,  and  I  think  that  when  we 
have  so  many  millions  of  our  people  having  their  entire  lives, 
never  n>ind  careers,  dependent  on  some  9f  these  tests,  there  ought 
to  be  as  broad  an  evaluation  as  to  what  those  tests  really  test 
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Are  they  really  testing  aptitudes?  Are  they  testing,  as  you  sug- 
gest) Dr.  Casteen^  reading  and  writing  Capacity,  and  so  I  have  ^ied 
to  frame  tljis  legislation  to  be  very,  very  strict  in  adherifig  only  to^ 
diisclosure  rMuirements  an^not  of  trying  to  dictate  to  ^yone  what 
ought  or  oii^ht  not  to  be  involved  m  the  making  up  ofi  those  tests 
and  how  they  are  to  be  interpreted  J&y  anyone.  \ 
i  vei^  much  appreciate  your  tesj^ony  this  morniiK    ^  ^ 
Before  we  clbse^  Dr.  Tenopyr,  you  have  been  sitting  there  very 
itiehtly/  said  I  want  to  ask  you  if  you  have^any  comment  on 
lything  that  has  been  said?  ^ 
Please,  I  want  to  give,  you  the  opportunity  to  say  anything  and 
not  walk  away  and  say  nothing. 

Dr.  Tenopyr.  I  would  like  to  reiterated  business  and  industry  are 
already  very  carefully  regt^iated^  and  you  shQuld  take  the  Uniform 
Guidelines  on  Employee  Selection  Procedures  ^d  enter  them  into 
t^e  record.  You  wUl  find  them  very  interesting^  £Ui4  we  are  talking 
about  people  who  can^t  read  ayrid  write. 

These  are  written  at  about  the  23d  reading  level,  but  we  are 
quite  heavily  regulated.  We  are  doing  a  lot  of  research.  All  employ- 
ers are  doing  a  great  deal  of  research  to  insure  their  teste  are 
Valid)  and  we  did  so  before  the  regulations  and  doing  evex^  more  so 
now,  and  we  are  trying  to  take  action  in  other  ways  and  social 
programs  to  take  care  oi  the  inequities  that  have  resulted  frqpi  the 
problems  of  inferior  education  and  deprivedf^backgrounds. 

That  is  all  I  want  to  say. 
'  Mr.  Weiss.  Thank  you  very  much.  ^ 
Do^  anyone  else  have  any  finafl  words  to  say  before  we  conclude 
the  hearing? 
If  not,  thank  you  very  mudh. 

Mn  Buchanan.  I  would  like  to  aisk  that  the  studies  to  which  Dr. 
asteen  referred  be  made  a  part  of  the  record.  . 
Mr.  Weiss.  Without  objection. 
[The  informatioiJ^  referred  to  follows:] 

The  1979  class  includes  81  (±5)  Virginians  offered  admission  conditioned  on 
•retaking  the  SAT.  Of  this  group,  21%  show  no  gain,  43%  show  ^ain  in  both  tests^ 
28%  show  gain  only  in  the  veriial  test,  and  7%  show  gain  only  on  the  math  test. 
Mean  gaiii  for  the  entire  group  on  both  tests  is  66  points.  For  those  showing  gain  on 
the  verbal  test,  the  mean  gain  is  63  points;*  for  those  sho^fing  gain  on  the  math  test, 
the  mean  gain  is  67  pointo.  Insofar  the  standard  enror  of  measurement  for  the 
"-SAT  is  V8l  and  M33  and  the  standard  error  of  the  difference  is  V44  and  M47,  thete 
gains  are  all.  ^11  above  the  statistical  mQ^el.  In  other  words,  the  retake  experiment 
workk  in  that  it  gives  students  significantly  or  meaningfully  higher  scores  on  both 
tests.  I 

Thel^ypical  studtot  in  this  group  is  a  white  female  flrom  a 'Virginia  suburban 

) public  school.  Her  hi^h  school  clfltss  rank  tt  high;  hA*  academic  program  contains 
bur  solids  per  year  with  ti6  more  than^Wo  A.P.  dr.  honors  courses;  her  standardized 
te$t  recbrd  shows  readingJproblems  dating  from  the  eighth  or  ninth  grade,  and  no 
effort  at  early  retnediation.  She  was  17  on  February  1  ana  18  on  June  1.  Her  latest 
SAT  ifcores  lift  her  out  of  the  gfipup  of  entering  students  who  most  closely  resemble 
studenll  on  our  probation/suswnsion  lists  in  the  '|mst  four  years.  Our  estimate  is 
that  her  new  cmentials  predio^finj^year  work  in  the  rangie  of  2.6  ±  .2  and 
graduation  on  t^e  with  an  aver^gB  of  8.0  ±  .2. 

46  Summer  nl^p  students,  all  with  histories  of  difficulty  in  taking  standmdized 
vtests,  retook  the  oAT  on  Jillv  21  under  the^  joint  sponsorship  of  the  Omce  of 
.Admissions  and  the  Office  of  Airo^American  Affairs.  Lawrence  A.  Oroves  superviBe<L 
the  test  adminii^tratioh.  11  (24;4%)  snowed  nO  improvement  on  lither  test.  8  (17.7%r 
improved  on  the  verbal  test,  but  not  ^n  the  matn  test.  18  (29.8%)  improved  on  the 
math  test,  but  not  on  the  verbal  test.  18  (29^%)  improved  on  both  tests.^mong 
tUbse  who  improvod  on  the  verbal  test  (46.6%  of  the  whole  group),  the  mean 
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improvement' was  42.86  points.  Among  those  who  improved  on  the  math  test  (57.7% 
of  the  whole  group),  the  mean  Improvement  was  50  jpointS;  A  tentative  conclusion: 
the  Summer  rrep  experience,  which  includes  inlensive  work  in  the  core  ^academic 
disciplines,  but  no  direct  tutoring  on  the  SAT' or  similar  tests,  appears  to  produce , 
improvements  in  the  basic  learning  skills  (reading,  verbal  reasoning,  computation— 
the  skills  reward^  by  the  SAT)  that  exceed  by  significant  factors  the  normative 
score  gains  reported  for  all  students  who  retake  the  test.  (E.T.S.  reports  the  stand- 
ard 6rror  of  measurement  as  31  verbal  and  33  math  and  the  standard  error  of  the 
difference  as  44  verbal  and  47  math.) 

A  note  of  the  Test  of  Standard  Written  English:  21  students  (46.6%)  showed 
improvement,  with  a  mean 'improviement' of  6.56  .  on  the  scale  of  20— 60+.  The 
rego|||d  standard  error  measurement  is  3.9;  the  reported  standard  error  of  the 
diffemice  is  5.4.  A  tentative  conclusion:  for  students  whose  command  oT  basic 
writing  skills  improves  during  Summer  Prep,  the  improvement  exceeds  the  improve*- 
ment  reix)rted  for  all  students  who  improve  on  retaking  the  TSWE. 

Mr.  Weiss.  If  there  are  no  further  questions,  the  committee's 
appreciation  to  you  again  for  your  patience  and  persei^erance 
throughout  your  testimony. 

The  hearing  is  adjourned. 

[Whereupon,  at  12:55  p.m.,  the  Subcommittee  on  Elementary, 
Secondary,  and  Vocational  Education  of  the  Committee  on  Educa- 
tion and  Labor  adjourned*] 
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House  OP  REi?RESENTAtivEs, 
Subcommittee  on  Elementary,  Secondary, 

AND  Vocational  Education, 
•  Committee  ON  Education  and  Labor, 

Wc^ington,  D.Q 

The  subcommittee  met,  pursuant  Ito  recessr  at  9:30  a.m.,  in  room 
2175,  Raybum  House  Office  Building,  Hon.  Cari  D.  Perkins  (chair- 
man of  the  subcommittee)  presiding.  \ 

Members  present:  Representative  Perkins,  Ford,  Andrews, 
Weiss,  Kildee,  Peyser^  Kogovsek,  Goodling,  Buchanan,  Erdahl,  and 
Hinson.  »  \ 

Staff  present:  John  F.  Jennings,  c<^unsel;  Jeffrey  W.  Brennan, 
staff  intern;  and  {lichard  DiEugenio,  minority  legislative  associate. 
Chairman  Perkins.  The  committee  will  come  to"  order.  | 
Our  first  witnesses  this  morning  are  Dr.  Harold  Howe,  vice  preisi- 
dent  for  education  and  public  policy,  the  Ford  Foundation,  and  Dr. 
Gary  Keller,  dean  of  the  graduate' school.  Eastern  j  Michigan 
University. 

We  wfll  hear  from  Dr.  Howe  first  before  we  hear  from  Dr.  Keller 
and  wefidli  withhold  your  questions  until  both  of  these  gentleipeii 

testify./  '  ■ 

You  tnay  proceed  in  any  manner  you  wish,  Dr.  Howe. 
Without  objection,  all  the  prepared  statements  will  be  included 

in  the  record. 
We  appreciate  Wing  you  here  again  this  nj^pming. 

STATEMENT  OF  DR.  tlAROLD  HOWE  II,  VICE  Plt^SIDENT  FOR 
EDUCATION  AND  PUBLIC  ^OLICY,  THE  FORD/t'OUNDATION; 
DR.  GARY  I^LLER,  DEAN,  GRADUATE'  SCHOOL,  EASTERN 
MICHIGAN  taVERSITY,  REPRESENTING  THE  HISPANIC 
HIGHER  EDUCATION  COALITION, '  ACCOMPANIED  iBY  DR 
i  ALVIN  RIVERA,  HISPANIC  HIGHER  EDUCATION  COALITION,  A 
^  VPANEIi  '  j\  \ 

STATEMENT  OFs  DIt  HAROLD  HOWE  II,  VICE  /PRESIDENT  FOR 
EDUCATION  Al^  PUBLIC  POLICY,  THE  FOip  FOUNDATION 

Dir.  Howe*  Thank  you,  Mr.  Chairman.  It  is  go^  to  be  here  and  to 
seeyouagai^.  is     .  / 

Mt.  Chairman,  I  would  like  to  sWt  by  sayiftg  thai  Dr.  Kenneth 
dark,  whd  had  intended  to  come  to  these  bearings  today,  was 
prevented  from  doing  so.  H^  asked  me  to  bring  his  testimony  down 


and  deliver  4t  to  the  cqmrnittee  which  I  hstve  done;  I  have  giv^n  it 
to  your  staff*  • 

I  would  like  ta  read  three  very"  short  sentences  from  his,  testimo- 
ny simgly4^rgive  an  overview  of  what  it  has  to  say. 

He  says;  • 

I.  am  op|k>8ed  to  the  present  legislative  attempt^  to  .  deal,  with  the  important 
problem  of  abuse  and  misuse  of  the  standardized  te|9t  results  for  the  following, 
"rc^asons:  ... 

First,  the  present  truth  in  testiUlg.  legislation  is  misleading  and  confuses  the 
public; 

Secondly,  this  le^lation  will  not  benefit  or  protect  minority  and  poor  students 
from  beit^  discriminated  against  in  obtaining  access  to  higher  education  or  to  jobs; 
and  \ 

Thirdly,  the  important  problem  of  cultural  bias  in  test  results  and  their  interpre- 
tation is  obscured  rather  tnan  clarified  by,.this  proposed  legislation.  , 

The  rest  of,  his  testimony  implies  those  points  and  will^  I  assume^ 
be  entered  in  the  record* 
[SStement  referred  to  above  foHows:] 

Prepared  Statement  of  Dr.  Kenneth  B.  Clark,  Distinguished  Professor 
Emeritus,  Crrv  Coixege  of  the  City  U;piivERsrrY  of  New  York 

Mr.  Chaitm^:  I  am  oppos^  to  the  present  legislative  atten^ts  to  deal  with  the 
important  problem  of  the  abuse  and  ipisuse  of  standardized  test  results  for  the 
following  reasons:  • 

1.  The  present  -Truth  in  Testing''  legislation  is '^n^isleading  and  confuses  the 
public.  -  ^ 

2.  This  legislation  will^not  benefit  or  protect'minbrity  and  poor  stuc|ents  from 
being  discriminated  against  in  oqtainin^  aCcete  to  higher  education  or  to  jobs. 

3.  The  important  problem  of  cultural  bias  in  test  results  and  their  interpretation 
is  obscured  rather  than  clarified  by  this  proposed  legislation.    .     .  \ 

In  regard  to  the  general  pfOblem  of  misleading  and  confusing  the  pujolic,.  it  is 
clear  that  the  important  problems  invelved  iA  test  construction,  test  validation  and 
reliability  cannot  be  resolved  by  the  unrealistic  demand  t[iat  the  ^'meaning  of  test 
scores''  be  explained  to  students.  The  constructive  evaluation  and  the  interpretation 
of  tests  are  highly  tecHmcal  matters  ^vhich  must  be  dealt  with  only  by  ongoing 
empirical  research  Conducted  by  those  who  are  trained,  in  this  specialty.  Specialists 
familiar  with  this  problem  know  that  there  is  no  si^ch  thing  as^an  absofutelv  perfect 
test  with  absolute  predictability.  But  they  are  also  aware  ^  tne  fact  that  the  abuse 
of  standardized  tests  cannot  be  resolved  by  ja  simplistic  law  Which  confuses,  this 
important  issue  with  confuses  this  important  issue  with  consumer  protection  prob^ 
lem9.  To  approach  this  problem  from  the  point  jof  view  of  Ife^lation  will  merely 
give  the  puDlic  the  impression  that  it  is  being  protected  wheil  iii\^fact  this  is  not  the 
case.  This  'Is  not  only  misleading  but  miay  also  direct  attention  from  the  research 
which  is  necessary  to  increase  the  v^dity  of  these  tests. 

In  regard  to  the  protection  of  minority  and  low  income*  students,  this  law  may  in 
fact  have  the  opposi|e  effect.  Middle  class,  middle  incoriie  families  can  aiTord  to 
provide  their  children  witjh  the  type  of  specialized  tutoring  which  they  believe  wili 
increase  their  spores.  Minority  ^oup  and  low  income  families  will  remain  victims  of 
the  low  scores .  in  spite  of  requiremenj»  the^  testing  companies  explain  the  "mean- 
ing"  of  their  scores.  The  ^ap  Detween,.^ie  avdragcr scores  of  middle  class  whites  and 
the  average  scoiles  of  low.  income  andminority  students  is  a  fuijction  of  a  complexity 
of  factors  which  will  not  be  resolved  Vy  the  requirements  of  this  Istw.  It  is  conceiv- 
able that  this  gap  niay  be  increased  by  legislation  which  promises  protection  which 
it  will  be  uniable  to  give.  -  .  . 

Clpeely  related  to  the  problem  of  the  protection -of  minorities  by  a  truth  in  testing 
law  is  the  persistent  and  justifiable  concern  as  to  whether' ^standardized  tests  are 
instruments  for  the  perpetuation  of  bias  land  discrimination  in  our  society.  Those 
who  are  opposed  to  the  professional  use  of  these  tests  argue  that  they  are  culturally 
bia^.  The  fact  of, the  matter  is  that  there  is  at  present  no^test  which  can  be 
culture  fre6,  All  tests  measure  aptitudes  and  achievj^tflents  which  are  acquired  in  a 
giVen  society,  or  culture. 

A  truly  culture  free  test  wOuld  in  fact  have  no  predictive  value  in  determining  the 
ability  of  an  individual  to  function  at  a  given  level  of  perforipance  in  a  giveQ 
culture.  Standardized  tests  do  not  create  or,  when  properly  used,  reinforce  biases  in 
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a  society;.  r&ther»  they  reflect  the  biases  and  inequities  which  exist  in  a  society.  In 
this  i«gaid  these  t^ts  are  valuable  diagnostio  insttaiments  yhich  when  uoed  and 
iinterpret^  by  properly  trained  professionals  provide  us  with  the  indications  of 
Vluit  the  society  must  do  to  remedy  existing  educational, 'social  and  economic 
inequities.  Some  of  us  continue  to  hope  that  upon  the  basis  of  the  results  of  these 
tests,  it  will  be  possible  for  the  sociiety  eventually  to  niake  the  commitment  neces- 
Bsgty  to  remedy  these  inequities.  Without  these  test  results*  we  wilj  not  have  the 
'indicators  of  what  remains  to  be  done— and  what  must  be  done. 

;  The  UiWersity  of  the  State  pf*New^ork» 
,  *    .  •/      The  State  Education  iDepartment, 

*  :  ^  *'  y  New  York,        August  7, 1979^ 

The  Editoji,  | 
The  New  York  Times,  \ 
New  York,  N.Y.  ^    ■  *  '  f 

Dear  Sir:  On  July  24,  1979,  the  New  York  Times  uncritically  endorsed  the  "Truth 
In  Testing"  legislation,  which  was  signfed  by  Governor  Cairey.  Your  editorial  stated 
that  this  ainendmerit  to  the  education  law  would  take  "the  mjpst^ry  out  of  collMje 
.  testing,"  ond.that  ''students  deserve  to  know  how  they  are  being  rated  and  judged." 

In  spite  of  the  good  intentions  of  the  Times  editorial,  it  was  misleading.  So  was 
Ralph  Nader's  assertion,  in  a  letter  published  in  The  Times  on  Au^st  8,  1979,  that 
the  legislation  will  require  test  companies  "to  explain  to  students  what  t||e  scores 
mean  and  how  jhey  will  be  reported  to  schools."  And  Nader's  claim  that  objections 
to  this  legislatito  reflect  only  the  "corporate  style  lobbying  effort^ of  testing  serv-. 
ices*'  Lb  inaccurate.  Tlie  Board  of  Regents  and  The  Commissioner  of  Education  of 
The  State  of  New  York  nave  independently  advised  the  Governor  against  signing 
this  legislation.  It  is  my  contention  that  tlus  so-called  "Truth  In  Testing"  la\y  is  a 
placebo.  However  laudable  its  intentions,  this  law  cannot  force  test  companied  to 
explain  the  meaning  of  test  scores  to  students;  and  certainly  this  law  cannot  deal 
with  the  complex  issues  of  test  validity  and  thh  role  of  cultural  factor?  in  influenc- 
ing test  results.  The  construction,  evaluation  and  interpretation  of  tests  are.  highly 
technical  matters  which  must  be  dealt  with  by  on-going  research  by  those  who 
trained  in  this  speciiality.  The  important  problem  of  the  use  and  abuse  of  standi 
i2ed  tests,  cann^be  resolved  by  a  simplistic  law  which  confuses  this  issue 
^consumer  prot^iton  problems. 

Admission  tests  measure  the  abilities  developed  by  individuals  over  a  long  period 
of  time,  both,  in  and  out  of  school.  The  value  of  test  results  is  directly  related  to  the 
equality  of  opportunity  afloni^  to  the  cimdidates  taking  a  particular  t^.  The 
assumption  that,  a  candidate's  examination  of  a  test  already  taken  will  spn^ehow 
improve  scores  of  reduce  the  chances  of  abuse  is  highlv  questionable.  yOnd  can 
further  assume  that  only  the  more  privileged  students  will  avail  themselves  of  the 
opportunity  to  examine  the  test  paateritfls.  These  students  will  se^k  pri|!mte  tutoring 
<jnnhe  assumption  that  this  will  increase  their  future  test  ^ores.  Those  individuals 
who  cannot  afford  this  privilege  will  certainly  nj^l  improve  their  test  scores  by^ 
^ely  examining  the  test  questidns  and  scores.  This  is  a  deceptive  and  meaningless 
t?ise.  .  . 

-le  Niw  York  State  version  Of  the  "Truth  In  Testing"  law  is  misleading  and 

mseit  the*'  public.  It  will  not  benefit  mmoritv  and  poor  students*  It  could,  in  fact, 

letrimental  to  alreadyrdisadvantaged  individuals.  Appropriate  legislation  in  the 

^riil  area  of  me  abuse  and  the  premature  exclusionary  use  of  standardized  tests 

jHj^t  be  desirable,  but  isuch  legislation  should  be  the  culmination  of  serious  itir 

quiry,  rather  than  a  political  gesture*  It  is  toy  firm  Imiet  that  this  is  such  ail 

Important  matter  that  the  New  YoA  State  Lepri^ture  should  hold  a  series  of 

hearings  with  cdhc^med  professionals  for  the  ^ly^MO  of  amending  this  law,  whict^ 

promises  much  more  than  it  can  possibly  deliver  . 

Sincerely,  ,  ♦  .  «  ^ 

'  Kenneth  B.  Clark. 

Dr.  Howe.  My  own  testimony,  Mr.  Chairman,  has  been  submit- 
ted to  you  and  leather  than  read  it  I  will  simply  quickljt  go  ovei^  it, 
picking  out  some  fce^  points,  the  first  of  which  is  thatT  think  this 
inquiry  you  are  making  is  an  important  inquiry  aj^d  one  that  I  am 
glad  is  being  made  because  I  do  thinkl;here  are  problems  in  this 
field  of  testing  and  -the  ufie  of  testing  and  fairness  in  testing. 
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V  But  Ihave  to  say  at  the  same  time  that  I  hope  very  much  that 
'  ^  the  Ck>aBrre^  will  not  rush,  into  legislation  on  this  subject.  I  think 

that  thebills before  ybu  are  not  well  advised.  \  * 
;  Basically,  my  own  view  is  that  this  is  a  subject  which,  while 
important,  really  represents  an  undesirable  entrai^  of  Federal 
♦         concern  about  education  into  a  very  special  field  in  the  schools  and 
colleges.         '  _ 

I  draw  attention  in  my  testimony  to  some  earlier  hearings  that 
you  may  recall,  Mr.  Chairman,  just  before  you  became  chairman  of 
^      this  committee  when .  the  then  chairman.  Rev.  Adam  Cla^n 
.      Powell,  held  some  hearings  on  the  history  textbooks  in  thwa  schools. 
He  was  absolutely  right.  There  were  serious  abuses  n\  those 
history  textbooks,  abuses  of  the  record  as  far  as  minorities  and 
particularly  blacks  in  America  wer6  concerned.     |  * 
.  ilBut  hei  did  not  go  on  to  produce  legislation  on /that  subject.  He 
did  a  great  public  service  by^ventilating  the  issue  and  that  caused 
sonie  reaction  of  a  useful  kind  among  the  publishers. 
'  I.  suggest  that  this^  exercise  here  could  well  have  a  similar  effect 
in  Ihe  field  of  testing.  I  am  not  trying  to  say  that  there  are  no 
M    proBl^ms  in  the  testing  field,  but  I  would  observe  thlit,  as  Dr.  Clark 
does,  that  those  problems  are  extreniely  complex,  that  the  idea  of 
n   using  essentially  a  consumer  protection  t)rRe  legislation  to  try  to 
get  at  them  will  not,  I  believe,  "do  a  great  deal  of  good.  In  fact,  it 
.   won't  really  address  the  problems. 

I  think  that  the  mcgor  point  that  is  unrecognized  in  much  of  the 
discussion  on  this  subject  is  that  tests  really  provide  for  a  great 
.  deal  of  fairness  in  the  handing  out>of  educational  opportunities  in 
the  United  States,  that  by  using  tests  we  effectively  cancel  consid- 
erations of  race  or  wealth  or.  political  powei" 
^      criteria  and  teally  reach  for  considerations  of  merit. 

Therefore,  while  there  always  have  been  and  always  will  be 
proble^is  in  regard  to  testing,  I  don't  think  we  want  to  attack  it 
when  if  is  one  of  our  great  protections  from  unfairness; 

I  would  call  your  attention  to  the  fact  that  in  my  view  at  least 
the  testing  authorities  who  work  priftiarily  with  college  admissions 
testing  to  enter  graduate  professions  of  various  kinds  have  increas- 
ingly opened  up  their  activities  as  well  th^y  should  and  probably 
they  should  go  further  in  that  direction.  ■  I 

1  myself  was  instrumental  some  years  rago  in  lielping  them  to 
think  through  the  business  of  releasing! test  Wred  to  students 
which  they  did  not  at  one  time  do.  Now  they  do.  The  volume  and 
nature  of  interpretive  materials  for  t^sts  available  to  students, 
available  to  test  users,  has  steadily  increasedv  jt  ought  to  inccease 
more.  \  :    .  .   .       1'  . 

Again  I  say,  however,  that  I  do  not  think  that  legi^flation  by 
Confess  on  this  subject  is  the  way  to  bring  about  that  increase. 

Finally,  Mr.  Chairman,  I  jusjt  want  to  Sjay  that  •!  have  shared 
these  general  views  about  these  matters  wkn  a  number  of  educa- 
tors, amopg  them  people  well  known  to  you,  tormer  Secretary  Johrrf 
Gardner/ former  Secretary  of  HEW,  and  Precis  Keppel,  fbrfaier 
U.S.  Commissioner  or  Education. 

'  They  concur  in  these  views  of  welcoming  thik  inquiry^  tMnking  it 
will* do  some  good,  but  not  being  enthusiastic^  abput  tne  idea  of 
congressional  le^latioh^  t^is  subject. 
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CATION  AND 


lat  18  a  brief  summary  of  my  testimony,  J^^r.  Chairmftn.T^U 
^jglad  to  answer  questira^     ^  i 
\  [^e  prepared  statement  of  Harold  Howe  follows:] 

^I^PAIUdl'STATEME)^^  OF  HaR^LD  HOWE  II,  VlCE  l^fesiDfiNT  FOR  EdJc 

•  :  PuBUC  PpucY,  THE  Ford  Foundation 

]    Mr.  dhaiiinan:  It  is        to  Understand  the  concern  of  numerous  person^  about 

[  the  fairness  and  the  proper  us^  of  tests  for  guiding  admission  both  to  education 

.  opportunities  and  to  occupationc^.  Tests,  pmvide  information  about  the  performance 
of  individuals  in  a  great  variety  of  area8,^unid  it  is  important  that  both  those  who 
take  thei^  those  who  iise  the)tn  know  as  much  as  possible  about  how  they  work, 
hpw  they  are  administered,  ho>w^  their  results  are  properly  used,  and  what  their 

"liimitations  and  shortcomings  axei  I  welcome  the  inquiry  of  this  committed  into  the 
hatUre  and  problems  of  testinc^Itl  helps  to  ventilate  issues  that  should  be  before  the 
public,  and  it  hehw  tp  encourage  ^  a.tmo8phere  of  openness  in  ah  area  that  has  to 
some  extent  beQil  characterized  py  uhnecflteary  confidentiality  and  secretiveness. 

But  having  said  this'^tfr.  Ohainh&nvi]  ha«  to  say  at  the  same  time  that  the  two  * 
bills  before  3/:our  comihittee  con^l^ute  overkill  in  reaching  for  solutions  to  whatever 
problems,  ekist  in  the  ifesting  fieRk  In  my  view  the  enactment  of  such  legislation  is 
unwarranted  and  unwise.  Although  I  beheye  that  you  have  done  education  a  service 
to  open  up  this  subjcfct,  I  strongly  ^recommend  that  you  not  rush  into  detailed  . 
national  Ic^slation  concerning  it.  !  / 

B^lc'in  1966  a  former  Chairman  of  the  House  Education  and  LabonJ^mmittee 
fouTO  himself  in  a  situation  somewhat  similar  to  yours  :today.  The  Reverend  Adam*  • 
Clayton  Powell  conducted  hearing^  on  the  treatment  of  minorities,  particularly 
Blacks,' in  the  history  fext  books  used  in  American  schools.  He  called  the  publi^ers  ' 
before  him/as  you  have  called  the  test  makers,  and  read  them/the  versions  of 
A)|Kericah  history  that  their  texts  portrayed,  dhowin^  in  the  proceto  that  the  Inter- 

^  pretations  of  slavery^  the  Civil  W{^r,  and  the  situation  of  Blacks  in  America  had  . 
been  tailored  to  suit  th^  tastes  of  prevailing  opinion  in  various  parts  of  the  c6untry 
rather  than  the  facts  oiF  histonr.  Chairman  Powell  did  a  great  service  in'openir\g^up 
this  subject  as  you  have  done  u^r  the!  issues  of  testing.  J 

^  In  the  course  of  those  hearings  ,  in  1965,  f^  testifled,  as  the  then  United  States 
Commissioner  of  Education,  that  it  would  be  a  grave  error  to  legislate  Ion  this 
subject  of  Jiistory  textbooks  because  it  would  be  an  unwarranted  intrusion  by  the 
national  government  into  the  affairs  ^  educational  institutions.. This  is  exactly  my 
view  of  the  le^Iation  you  are  considehng  now.  Chairman  Powell'^  hearings  did  not 
result  in  legislation,  and  I  hope  yours  will  not.  '1/^ 

This  proposed  legislation  lays  a  hf avy  federal  hand  on  delicate  niatterfl/in  both 
education  and  en\pioyn^nt.  It  constitutes  a  significant  chdnge  in  the  assumptions 
^Jinder  which  we  operate  our  schools  and  colleges  in  this  nation.  In  the  name  of 
Truth  in  Testing,  a  foncjspt  that  evei^one  should  support,  it  brings  federal  author- 
ity into  student  ana  employee^  Selection  processes  in  great  detail.  To  warrant  this 
sort  of  intrusipn  into  the  affairs  of  educational  institutions  and  employers  would 
^require  at  the  very  least  clear  evidence  that  fundamental  and  constitutional  rights  ^ 
of  individuals  are  being  denied  by  testing  practice^  know  of  no  such  evidence.  . 
Indeed,  it  seems  to  me  that  test  m^6rs  and  t^t  ifbrs  Qre  growing  progressively  . 
more  attentive  ta  the  problem  of  minorities^  women,  and  other  special  groups. 

Mr.  Chairman',  if  ypu  will  lolpk  carefully  at  the  record  of  two  megor  private,  non* 
prolit  ^^anizations  concerned  with  admissions  testing  in  the  Unitea  States,  the 

.  CollegAlintrance  Examination  Board  and  the  iElducational  Te8tihg;Service,^you  will 
flpcl  that  over  the  vears  both  have  ihoved  progressively  and  voluntkrily ^toward  the  • 
kind  of  openness  that  this  legislation  advocat%.  In  the  early  19Q0sWftidents  were 
not  even  allowed  to  know  their  own  scores  oii'College  Board  adfe&uons  tests,  an 
unnecessarv  secrecy  that  I  and  pthfrs  helped  tb  persuade  the  ColSeg^  Board  to 

^Abandon;  ifoice  then  the  volume  an^  the  nature  or  expl^jnatory^^niaterl^l  for  test 

^PilLers  and  test'users  has  increased  manv  fold.  Sample  quediions,  publication's  on  the  ^ 
meaning  of  scores,  andl^idance  for  Colleffe  admissions  oftl^erM>n  the  proper  use  of 
test  scoree  are  widely  avitilable  today.  The  American  Coll^  Testing  Service  and 
ETS  publish  such  materials  for  tne  tests  they  provide.  So     many  commercial  test 
sources.  ^  .  ' 

I  am  not  sayinfr  that  there  are  no  problems  and  no  abu 
but  I  do  assert  uiat  they  are  not  sumcientl^yr  serious  to 
fimdamen^iy  alters  the  natiure  of  institutional  freedoi/ 
and  movA  federal  authority  further  toward  dominatid 

.  Furtjtiermore,  I  believe  that  fh^rja  are  constructive  actic 


in  the  field  hf  testing,  . 
varrant  legislation,  which 
for  schools  and  colleges 
of  the  edudation  scope, 
you  can  .  take  that  will* 
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assist  with  \yhatever  problems,  exist  without  starting  down  the  road  that  this  legisla- 

•  tion  implies. 

The  very  complexity  and  detail  of  the  legislation  voxx  are  considering  suggests 
\  that  the  subject  of  abuse  in  testing  is  a  complex  and  difllcult  one.  It  is  a  subject 
\most  educators  know  little  about.  I  strongly  suspect  that  if  ETS  were  t|  give  us 
educators  a  test  on  testing,  m'ost  of  us^  would  flunk  it.  It  is  an  area  where  quick  ; 
legislation  designed  to  satisfy  complaiats  Qd'n  create  turmoil  rather  t1^an  fairneas; 
ai[id  progress.  ...  ^  ^  \  . . 

\For  j^xample,  it  is  widely  asserted  that  tests  are  unfair  to  minorities. -If^thiat  is 
trUe,  the  problems  involved  will  not  be  solved  by  the  legislation  you  are  considering. 
Dr.  Kenneth  Clark  has  netted  (New  York  Times,  August  18.  1979)  in  opposing 
similar  legislation  in  New  York  State,  "The  important  problem  of  the  use  and  abuse 
of  standardized  tests  cannot  be  /esolved  by  a  simplistic  law  which  confuses  this 
issue  with  consumer  protection  problems.^'  Furthermore,  there  is  good  reason  to 
believe  that  the  proper  Use  of  tests  adds  a  major  element  of  fairness  to  educational 
admissions  practice  in  the  United. States  and  protects  mii*iorities  as  well  as  everyone 
.  else  from  arbitrary  judgments  based  on  racial  discrimihation,  wealth,  political 
power  and  other  undesirable  criteria  in  the  flection  process. 

I  suggest  that  instead  of  legislating  on  these  matters  you  appoint  jan  independent 
National  Commission  to  review  the  issues  and  to  report  back  to  you  after  an 
extended  study  of  all  the  allegations  that  have  led  to  considering  the  present 
legislation.  Such  a  group  will  require  both  qualities  of  statesmanship  in  its  members 
and  special  skills  and  knowledge  in  its  staff.  While  it  should  have  some  educators  on 
it,  it  should  not  be  sponsored  by  any  organization  of  institutions  or  educators.  It 
should  be  truly  independent.  Its  charge  should  be  broiad,  requiring  it  to  examine  the 
nature  and  of  testing  in  deciding  about  the  educational  and  occupational  oppor- 
tunities  of  Americans  and  to  make  recommendations  about  problems  that  need 
attention  from  educators,  employers,  and  other  parties,  including  federal,  state  and 
local  government,  if  the  Commission  believes  that  government  should  be  involved. 
To^ook  into  all  the  matter^  that  have  been  raised  on  this  subject,  the  Commission 
will  require  extended  time  ai^d  adequate  funds. 

I  have  shared  the  general  views  presented  here  with  a  number  of  educators  and  * 
found  them  su^)portive.  Among  them  was  John  Gardner,  former  'Secretary  of 
Health,  Education^  and  Welfare,  and  Francis  Keppel,  former  United  States  Commis- 
sioner of  Education.  It  Was  Secretary  Gardner  and  Commissioner  Keppel  who 
helped  this  Committee  in  tjie  early  1960s  to  fashign  a  new  role  ,  for  the  federal 
government  in  the  field  of  education.  They  agree  with  me  now  that  this  proposal 
carries  federal  regulation  of  education  beyond  a  reasonable  point,  that  the  proposed 
legislation  does  not  address  the  issued  that  need  attention,  that  the  dangers  inher- 
ent in  it  far  outweigh  anv  possible  benefits,  and  that  constructive  efforts  to  solve 
existing  problems  will  be  helped  by  the  visibility  you  have  given  these  matters  and 
iQOuld  k^^urther  helped  by  responsible  inquiries  into  them. 

*  FinfiiNy\  Mr.  Chairman,  I  want  to  recognize  that  I  have  not  in  this  testimony 
commemgd  in  detail  on  the  two  bills  before  you.  This  is  mainly  because,  as  noted 
already,  iratiW^  that  the  Congress  should  paiss  any  legislation  in  this  field.  I 
do  wahti  to  sly,  however,  that  I  find  rtiany  difficulties  with  various  provisions  of 

heseWll^         "      '  v  w 

At  the  pire^ent  time  l  ani  Vice  President  for  Education ^ma  Public  Policy  of  the 

ord  Foundation,  but  this  testimony  reflects  my  personal  vieyfs  rather  than  those  of 

he  Foundation,\vhich  does  not  take  positions  on  matters  of  this  kind.  I  attach  a 

fief  resum^  otvdy  experience  in  education. 

'harold  howp  II     .  . 

Born  Hartford,  Connecticut,  August  17,  1918;  married  Prisciila  Fo^ten  Lamb, 
September  i94q;  three  children— Gordon  A.  Howe,  Lt.,  United  States  Marine  Corps; 
Mrs.  Merrill  H(we  Leavitt,  Denver,  Colorado;  Mrs.  Frederick  T.  (Catherine  Howe) 
Short,  Fairbanks^,  Alaska.  Residence,  340  East  64th  Street;  New  York,  New  York. 

JEducation     .  ,  .    ,  .... 

Taft  School  Watertown,  Connecticut— 1936:  Yale  College— B.A.  1940;  Columbia 
University— M.A.  (history)  1947;  Harvard  Graduate  School  of  Education— Education 
Studies;  and  University  of  Cincinnati— Education  Studies. 

Honorary  degree  and  awards 

LL.D.'s  from  Princeton,  University  of  St.  Louis,  Notre  Dame,  Shaw,  Adelphi;  Gold 
meddl  from  New  York  Univetfity;  Special  Citation  from  Frank  Newman's  Commit: 
tee  on, Higher  Education.  ;  . 
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Emphymeht  ^ 

Darrow  School  in  N«w  Lebanon,  New  York— History  Teacher  and  Assistant  Head- 
master, 194(M1.  %  I 
.  United  States  Naval  ReBerve^-Conimanding  Officer  Minesweei>er  in  Atlantic  and 
Pacific  Theaters,  1941-46. 
PhilUps  Academy,  Andover,  MassachuMtts— History.  Te^^ 
Pumchard  High  School,  Andoverv  Massachusetts— Principal,  1950-53. 
Andover  Junior  High  School,  Andover,  Massachusetts— Principal,  1950-53. 
Walnut  Hilte  High  School,  Cincinnati,  Ohio— Principal,  1953-57. 
Newtpn  High  School,  Newton,  Massachusetts— Principal/ 1957-60. 
Newton  Junior  College,  Newton,  Massachusetts — President,  1957-40.. 
SuperintendehtofSchoQls^Scarsdale,  New  York,  1960-64.  ^  .  , 
Learning  Institute  of  North  Carolina— Director,  1964-65.  ▼ 
United  States  Comniissioner  oC  Education,  Washington,  D.C.,  1965-68.  ^ 
Program  Advisor  in  Education  for  the  Ford  R>undation,  New  Delhi,  India,  1969- 

;  jiVice  President  for  Education  and  Research,  Ford  Foundation,  New  York,  1971-^79. 
Vice  President  for  Education  and  Public  Policy,  Ford  Foundation,  N.Y.,  .1979-  . 

•     ■  ■    .  )f 

EfXtra  curricular  activities  (paBt) 

if  ^Mayor's  Committee  on Jiivenile  Delinquency,  Cincinnati— Chairman. 

^    Committee  on  Examinations  of  College  Entrance  Examination.  Board— Chairman. 

Commission  on  Humanities  of  the  Anlerican  Council  of  Learned  Societies. 

United  States  CouncE  for  UNESCO. 

Board  of  Trustees  of  the  John  F.  Kennedy  Center  for  Performing  Arts. 
.  Trusteeships:  Yale  University,  Vassar  College,  College  flntrance  Examinatioif 
Board,  Taft  School. 

Consultant  to  Mayor  Edward  KOch  on  the  City  University  of  New  York,  1978-79. 
•  .    '  •  .  •  -  '  .       ■  ■■ 

&ctra  curricular  activities  (present)  j 

Trustee  of  the  John  Hay  Whitney  FoundSition. 
Cleveland  Conference.. 

National  Council  on  Educational  Research,  National  Institutje  of  E<}ucation. 


che8,etc. 

eitio9.  Picking  i^)  the 


Publications^ 

Numerous  magazine  articles  irl  Saturday  Review,  Vital  Sp 
Numerous  chapters  in  oooks  on  education. 
Book  of  Speeches  as  United  States  Commissioner  of  Edv 
Options— 1968  / 

Chairman  PERKiNfii  We  want  to  thank  you  for  your  testimony, 
Dr.  Howe.  To  my  way  of  thinking  you  perhaps/have  been  the  most 
utstanding  Ck)mmissioner  of  Education  in  my  time  here  at  the. 

ipitol.  I  know  that  you  served  with  much  flistinction  during  the 
ohnson  administration  and  ypu  estc^bhshed  a  great  reputation  for 
the  building  of  education  throughout  the  Nation. 

I  think  you];  testimony  will  most  helpful  to  this  committee.  I 
hbpe  that  you  can  stay  around  a  -few  mmutes  until  we  hear  from 
tn^  other  gentlemen. 

r.  Ko^ovsdky  if  you  want  to  introduce  th^  gentleman,  we  will  be 
delfighted  to  hlar  from  you  at  this  tim 

KoGOvsEK.  Thank  you»  Mr.  Qhairman.  I  app]4ciate  the 
^ce  to  do  this.  \       j  f  ^ 

w^t  to  say  ho;^  tremendously  proud  I  am  to  haVe  as  a  member 
of  the  panel  this  jnorning^  Di^.  Alvin  Rivera  from  the  Hispanic 
Higher  Education  Ooalition  in  Washington/  D;CyDr.  Rivera  is  fitom 
Ihy  home  dktrict  ih  southern^^lorado.      .  / 

I^want  to\teIl  you  lhat  his  testimoi^jj  and  expertise  can  prove 
veryl  valuable  and  I  want  to  welcome  Dr.  Riviera  li^re  this  morning. 

f  ■■"•r      •  •  •  \  .1/  .  .  .1:  .  ■ 
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STi^TEMENT  OF  DR.  ALVIN  RIVERA,  HiSBANIC,  HIGHER 


Dr.  Rivera.  Thank  you  very  much,  Congressman  Kogovsek.  I 


apprecia 
testimon; 
jin  oppor 
/XJniversit 


EDUCATION  COALITION 


the  opportunity  to  have  th^  opportunity  t6  present 
on  behalf  of  H.R.  4949  specificllly.  The  qoalition  has  had 
r|:junity  to  find  an^expert,  a  person  from  Eastern  Michigan 
who  truly  has  expertise  and  who  has  written  numerous 
/books  on/this  tbpic.  ^  * 

^-  We  would  like  to  ask,  Mr.  Chairman,  if  he  nia'y  provide  the 
/  testimony  in  this  case^  ^..^ 

STATEMENT  OF  DR.  GARY  KELL£:R,  DEAN,  GRADUATE  SCHOOL, 
EAS'rtERN  MICHIGAN  UNIVERSITY,  REPRESENTING  HISPANIC 
^IGHER  EDUCATION  COALITION 

Dr ^/Keller.  Mr.  Chairman  and  members  of  the*  subcommittee,  I 
will  He  making  several  points  that  go  beyond  the  Written  version  of 
jstimony  we  submitted  yesterday. 

/  name  is  Gary  D.  Keller  and  I  am  testifying  as  the  spokesper- 
soiy  for  the  Hispanic  Higher  Education ICpalition  concernirig  the 
nc  of  educational  testing,  particularly  with  reference  to  H.R, 
4049,  the  Weiss  bill. 
'Today,  as  you  know,  I  am  accompanied  by  Dr.  Alyin  Rivera,  a 
)rmer  resident  of  Colorado  and  an  active  participant  in  and  sup- 
porter of  the  Hispanic  Higher  Education  Coalition.  That  group  is 
I /Comprised  of  representatives  of  11  national  Hispanic  organizations 
/enumerated  in  the  writteA  version  of  my  testimony  which  are 
/  interested  in  improving  educational  conditions  for  their  constitur 
■/■encies.-  ;  / 

My  academic  background  is  as  follows:  I  am  the  dean  o|^he 


1 1  graduate  school,  Eastwn  Michigan  University.  I  have  earned  "a  Ph/ 
D.  in  Spanish  and  an  additional  masters  degree  in  psychology.  I  am 
the  author  of  1)2  books  ^having  to  do  with  Hispanic,  Spahish  and 
language  topics  as  well. 

As  a  Hispanic  edu(^ator  I  have  been  extensively  involved  in  the 
creation  of  tests  and  assessment  instruments  primarily  in  the  field 
of  higher  education.       ^  ^ 

The  Hispanic  Higher  Education  Coalition  enthusiastically  sup- 
ports H.m  4949  iiV  all  buLtwo  tispects.  Therefore,  we  wish  to  make 
two  suggestions  concerning  this  bill: 

One:  That  data  be  gathered  by  linguistic  and  cultural  minority 
groupings  iand  that  the  testing  services  be  required  to  report  scores\ 
arid  norm  scores  separately  for  major  discernible  linguistic  and ' 
■  Cultural  groups.         ■  ^ 

4TW0:  That  the  provisions  for  disclosure  of  test  questions  and 
answers  be  deleted. 

Me  support  the  Wpiss  bill  because  it  will  go  a  long  way  toward 
piTOecting  the  Hispanic-American  consumer  of  tests,  making  the 
test  services  accountable  for  their  product,  in  facilitatirig  more 
equal  access  to  education  for  Hispanic  Americans,  ia  more  accu- 
rately d$fming  the  appropriate  use  of  specific  tests,  ir\  correcting 
\the  unwarranted  mystique  surroundi^ig  standardized  testing,  sig-  | 
iificantl;^  incr-easing  the  awareness  and  sophistication  of  the  gener- 
il  jpubiic  and  the  Hispanic  communities  with  respect  to  the  nature 
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of  standardized  other  tests,  and  controlling  for^  nonvalidating 
and  nonpredictive  distortions  of  the  tests  when  used  with  Hispanic 
populations. 

We  feel  that  certain  reports  with  negative  iihplicatipns  for  stand- 
ardized testd  have  not  been  released.  For  example,  a  majoF  study 
iroduc  hy  and  at  the  Educational  Testing  Service^jenmled  "Ciil- 
sural  Bias  in  Testing:  Challen||^  and  Response/'  prepared  by  Dr. 
David  Loye  of  the  ETS  stafrat  the  request  of  ETS  president 
TumbuU.  .  j(  ^  ' 

Another  example  of  missing  data  appears  dn  the  report,  "Califor- 
nia: Cbll^e-Bound  Senior  1979/'  reported  by  the  admissions  testing 
program  of  the  college  boar4. 

In  that  report,  both  the  relationship  between  SAT  scores  and 
income  level  and  the  relationship  between  ethnicity  and  income 
level  of  those  taking  the  SAT  is  reported  yet  unaccountably  the., 
relationship  between  ethnicity  aiid  SAT  scores  is  glaringly  absent, 
perhaps  because  such  data  might  have  cast  the  SAT  in  a  bad  light. 

llie  testing  agencies  need  to^be  compelled  to  provide  the  back- 
ground data  and  statistics  to  permit  outside,  independent  and  im-  / 
partial  recorders  to  evaluate  the  adequacy  of  the  tests. 

What  little  preliminary  evidence  that  there  is  from  outside 
sources  due  to  the  overly  pi^otective  attitude  of  tMe  testing  agencies 
is  cause  for  great  disquietude.  » 

For  example,  David  White  at  Berkeley's  childhood  and  govern- 
ment projm  has  reported  findings  indicating  a  negative  correla- 
tion bjetweenNmedical  exam  scores  and  performance  in  actual  clini- 
cal situations,N(h6reby  casting  doubt  on  th0  validity  of  those  tests  t 
as|ij[)redictors.  \ 

Prof  Benish  mffman's  well-known  study  has  demonstrated  how 
the  tests  use  ambiguitieis  and  misleading  language  in-order,  to  m^e 
their  questions  inappropriately  difficult. 

.  We  need  to  have  research  conducted  to  determine  the  effect  of 
such  artificial  test  language  on  mirroi|ty  linguistic  and  cultural 
groups.  We  urge  that  the  queistions  be  con^^idered  and  empirically 
reisolved  "about  a  possible  interaction  effect  between  artificially  cre- 
ated, misleading  English  test  language  and  the  linguistic  param- 
eters of  the  U.S.  Hispanic  communities. 

,  We  ne^  to  answe]^  the  following  question:  How  much  of  that 
standardized  test  purports  to  measure  in  the^cholastic  aptitudes  of 
Hispanic  students,  and  how  ihuqh  ie^  merely  a  subterraneous  index 
of  the  purely  linguistic  ^peculiaritieis  of ;  various  Hispanic  commu- 
nities?- "     ^  ■. 

In  this  r^ard  we  Wte  that  apparently  because  the  LSAT  was  a  ^ 
poor  indicator  of  acad^ic  success  in' the  law  schools  on  the  island 

^of  Puerto  Rico,  about  jO  years  ago  the  Educational  Testing  ^rvice 
established  ^  Spanish  version  of  its  graduate  record  examination, 
Prueba  de  Aptidud  Para  Estudios  Gi^aduados,  PAEG,  appropriation 

-for  measuring  aptitudes  for  the  study  of  law. 

Currently,  student^gseeking  entrance  to  law  schools  In  Puerto 
Rico  are  required  to  take  both  the  English  language  LSAT  and  the 
Spanish  language  law  test  section  of  th^  PAEG,  a  test  which  was 
independently  developed  for  Spanish-speaking  students  ^d  which 
in  no  way  is  a  translation  of  th^  LSAT.     j^  . ' 


Apparently  bilingualsj  fluent  in  bbth  English  and  Spanish  who 
talce  this  test  have  widely  varying  scores  on  the  English  LSA^  and  i 
the  Spanish  PAEG.  We  ne^d  to  carefully  integrate  this  pher^pm- 
enon  which  on  the  face  of  it  points  to  language  and  culture  as  very 
strong  determining  factors  in  tests  which  are  purported  to  measure 
aptitudes  siich  as  for  Isuv. 

*We  need  to  invjpstigate  the  extent  to  which  testing  agencies  have 
either  confused  fostered  in  the  ^neral  public  a  confusion  be- 
tween the  prognostic  v£ilue  of  tests,  and  their  diagnostic  value.  , 

Prognostic  is  the  process  of  predicting  putcomes.  Diagnostic  is 
the  process  of  identifying  causes.  Tests  identified  as  progi\0stic  ' 
function  to  predict  future  student  perf(Jlrmance  and  have  been  in- 
terpreted ^s  such.     ■  • 

Using  aptitud^  tests  for  diagnostic  purposes  is,  in  our  juidgmetit, 
a  test,  abuse  wmch  H.R.-  4949  can  help  control  by  compelling  the  ^ 
testing  agencies  to  specific  for  what  purpose  a  test  has  been 
devised.    /  ... 

Even  th6  late  Dr.  Oscar  Burras,  publisher  of  the  Mental^e^i- 
surements  Yearbook  and  winner  of  the  ETS  award  for  distin- 
guished service  to  measurement,  declared  in  the  Educational  Re-  - 
searcher  in  1977  that  tlje  information  available  to  permit  an  ^adt-N^* 
quate  assessment  to  be  made  of  test  makers  secure  tests  is  quite 
unsatisfactory!  I  quote  him,  "quite  unsatisfactory." 

The  reason  for  this,  it  appears  to  us,  is  that  not  enough  material 
is  niiade  availabl^for  adequate  review.  We  liken  this  situation  to 
having  the  fox  guarding  the  hen  house  data. 

In  sum,  the  Hispanic  Higher  Education  Coalition  endorses  the 
general  goals  of  the  truth-in-testing  movement,  most  of  the  specific 
goals  of  H.R.  4949,  and  most  of  the  provisions  by  which  this  bill 
proposes  to  attain  these  goals. 

The  first  aspect  of  the  proposed  Weiss  bill  for  which  we  are 
suggesting  modifications  is  one  of  the  methods  by  which  the  bill 
attempts  to  monitor  the  need  to  insure  equal  access.  ^ 

Th^  bill  requires  that  each  test  agency  shall  provide  ''a  compari- 
son of  the  average  score  arid  percentiles  of  test  subjects  by  major 
income  groups." 

In  addition,  the  bill  requires  that: 

Within  1  year  of  the  effective  date  of  this  Act,  the  Cpmiriissioner  shall  report  to 
Congress  concerning  the  relationship  between  the  test  scores  of  test  subjects  and 
income,  race,  sex,  ethnics,  and  handicapped  status. 

We  propose  that  H.R.  4949  not  only  require  the  aforementioned 
disclosures  Which  we  enthusiastically  endorse,  but  in  addition  re- 
quire affirtnatiye  action  to  counter  linguistic  and  cultural  biases  in 
th^  content  by  m^ans  of  appropriate  modifications  in  the  norming 
procedures  of  tests.  •  ' 

The  testing  services  should  not  be  merely  required  to  provide  * 
information  concerning  the  average  score  according  to  income,  but 
should  also  be  required  to  report  scores  by  major  discernible  lin- 
guistic anfl  cultural  groups  and  to  scale  the  test  scores  within  these 
groups. 

In  other  words,  we  propose  that  scoring  be  based  on  the  achieve- 
ment of  a  student  I  using  his  or  her  language  and  culture  groups  as 
the  norm  or  the  control.  Tl\eMujs  already  a  well-established  ^rece- 


dent  within  the  graduate  recoil  examination  and  other  stjjldied 
tests  foi*  tHis  pi*ocecim'6 

In  the  GRE,  for  example,  the  verbal  score  of  any  given  woman  is 
converted  to  a  percentile  score  based  on  group  scores  of  women. 
Men  are  given  a  percentile  score  based  on  male  performance.  This 

-  prcteedure  candidly  admits  that  men  as  a  group  are  disadvantaged 
cojnpared  to  women  in  the  verbal  CQmponent  of  the  GRE  and  that 
normalised  scores  increase  their  chance  to  get  into  graduate  school. 

•  .  This  p^ederit  needs  to  be  extended  to  all  of  the  pertinent  stand- 
ardized J^ts  that  affect  identifiable  language  minorities  such  as 
the  Hist)anic  American  communiti  Only  in  this  way  can  we 
remove  the/biases  of  our  standardized  tests,  if  not  from  the  contept, 
then  from  the  scoring  procedures  and  the  interpretation  of  the 
results. 

Wife  wish  to  emphasize  both  the  purpose  and  the  practicality  of 
.thg^^uggestion^^that  we. offer  to  have  test  scores  normed  according^ 
to  identifiable  linguistic  minority  groups. 

Hispanic  Americans  should  be  normed  separately,  not  in  accord- 
ance with  any  philosophy  of  educational  separatism,  but  on  the 
contrary,  so  that  Hispaijic  students  can  be  permitted  access  to  the 
prest^ou^  American  institutions  of  higher  educaticfn  in  the  num- 
bers (pat  their  capabilities  warrant,  ^ 
4  The  norming  procedures  that  w0  suggest  would  control  for  biases 
s'in  the  testing  content  that  hold  back  significant,  numbers  of  His- 
panic youngsters  from  equality  of  educational  opportunity  and  ac- 
cess. We  want  morfe  of  our  children  in  the  mainstream  of  American 
education,  and  that  is  why  we  propos^  t^ese  corrective  norming 
procedures.  ^ 

Ija  further  support  of  our  position,  it  should  be  noted  that  there 
^  at  least  one  law  in  force  which  establishes  the  fequirement  for 
.  what  we  are  suggesting.  '        ,  ^ 

In  section  121a.530(b),  Protection  in  Evaluation  Procedures,  of 
Public  Law  94-142,  tiiducation  of  Haitdicapped  Children,  it  is  stated 
that  testing  and  evalution  material  and  procedures  used  for  the 
i  purpose  of  evaluation  and  placement  of  handicapped  children  must 
be  selected  and  administered  saas  not  to  be  racially  or  culturally 
discriminatory.     .        j  .     .  „ 

The  problem  has  been  Ito  enforce  this  requirement.  believe 
that  the  procedure  that  we  are  suggesting,  requiring  of  the  test 
agencies  that  they  normalize  test  scores  for  identifiable  linguistic 
minorities,  would  bring  us  one  step  tloser  to -meeting  the  legal 
,  requirement  of  Public  Law  94-142,  and  the  intentions  of  H.Ii  4949. 

The  second  aspect  of  HiR.  494&  about  which  the  Hispanic  Hifher 
fiducation  Coalition  has  reservatipnsniivolves. those  portions  of  sec- 
tion 5  which 'require  the  disclosure  of  all  test  forms,  including  all 
questions  on  the  test,  together  with  the  correct  answers*^  i 

The  creatidn  of  culture  fair  test  items  is  ji  difficult  task  to 
.  ^perform  in  the  establishment"  of  standardized  tests.  Questions 
whicTi  Have  proven  reliability  with  respect  to  Identifiable  linguistic 
minorities  need  to"  be"  careftilly  husbanded.  If  they  were  to  be 
rfevealed,  we  don't  think  that  they  could  be  effectively  substituted. 

Thefeforf,  the  coalition  is  concerned  that  the  good  intentions  of 
•  the  wfeiss  bill  might  be  hihderpd  by  the  actual  dii^clbsurfe  provision 
80  that  instead  of  the  purported  gpal  of  the  legislation  to  insure 
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equality  of  educational  access,  an  undesired  side  effect  would  occur: 
A  deleterious  weakening  of  the  validity  of  standardized  tests  with 
respect  to  controls  fof.  linguistic  and  cultural  bias.  . 

Instead  of  providing  general  test  disclosure^  it  is  more  in  the 
interest  of  educators  concerned  with  equality  of  educational  access 
that  the  test  services  be  required  to  provide  timely,  periodic  evi- 
dence of  the  nondiscriminatory  nature  of  their  tests,  both  with 
*  j-espect  to  the  scaling  and  scoring  procedures  and  with  respect  to  . 
the  actual  Content  of  the  questions  themselves. 

The  Hispanic  Higher  ^]ducation  Coalition  wishes  to  close  this  i 
testimony  with  one  last  observation.  The  intent  of  our  suggestions 
is  not  to  put  roadblocks  in  the  way  of  the  testing  agencies  with  a 
view  to  ultimately  destroying  the  testing  industry^  Far  from  it,  we 
see  important  benefits  to  be  derived  from  objective  tests,  including  - 
standardised  tests.  V  ■  ' 


For  example,  Hispanic  educators  have;  beenMQyolved  with  bilin- 
gual education  for  the  last  20  years  and  longer.  Most  Hispanic 
educators  readily  acknowledge  the  extremely  important  contribu-" 
*tion  that  the  development  of  assessment  procedures  has  made  to 
'  bilingual  education. 

.Hispanic  educators  are  usually  leery  of  iassessment  procedures, 
and  rightly  so,  because  of  their  potential  for  bias.  And  yet,  in  point 
of  fact,  bilingual  education  as  we  ^now  it  today  wpufd  not  have 
•  been  possible  witjhout  the  massive*  often  court  ordered,  as  in  the 
Aspira  consent  decree,  development  of  assessment  procedures  to  * 
determine  the  language  competencies. of  nQnnative  English-speak- 
ing children. 

Contemporary  bilingual  education  is  irrevocably  tied  to  the  good 
services  of  assessment  procedures  in  determining  placement  of  chil- 
dren within  bilingual  classrooms.**rhat  is  all  to  the  good,  for  bilin- 
gual educators  often  have  many  sad  exjJerienceis  to  recount  in 
witnessing  the  illegitimate  subjective  placement- of  minority  young- 
asters  in  special  education  classrooms,  often  for  the  mentally  retard- 
^ed  or  learning  disabled,  simply  because  of  their  lack  of  experience 
with  the  English  lan^age. 

Bias  among  educational  personnel  is  just  as  real  as  content  bias 
in  tests.  Disclosure  of  test  items  in  the  area  of  bilingual  education 
will  serve  no  useful  purpose. 

Indeed,  to  cite  one  example,  it  is  generally  acknowledged  in  the 
city  of  New  York  that  the  language  assessment  battery,  the  test 
used  to  implement  the  Aspira  consent  decree,  is  in  urgent  need  of 
addSEional,  secure  versions  because  a  result  of  the  current  policy  to 
readminister  it  over  several  grades  causes  children  to  becpme  ''test 


Because  of  repeated  exposure  to  the  test,  children  receive  a  high- 
er paper  score  than  their  language  competericy  warrants  and  there- 
fore are  removed  from  bilingual  education  classrooms. 

In  conclusion,  we  fully  support  the  movement  toward  more  ac- 
countability in  testing.  We  endorse  most  of  the  iprovisions  of  the 
Weiss  bill  We  think  that  the  bill  should  be  modified  and  strength- 
ened, however,  in  the  particulars  that  we  have  described  above  in 
order  to  better  attain  its  provisions  for  equality  of  educational 
access  for  linguistic  minority  students. 


wise. 
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.  ft  is  because  the  Hispanic  educator  probably  more  than  any 
other  minority  group. professional  has  been  privy  to  the  worst,  most 
biased  aspects  of  the  testing  process,  as  well  as  its  potential  for 
accurately  assessing  competencies  and  determining  placement,  that 
these  suggestions  are  entered  in  the  spirit  of  a  throughgoing  re- 
form o(;a  semdce  that  needs  to  regain  public  trust  in  order  to 
continue  to  be  productive  and  beneficial  to  Society. 

I  thank  you  very  much  for  your  attention  and  I  stand  ready  to* 
respond  to  any  questions.  ..  < 

[The  prepared  statement  of  Dr.  Gfftry  Keller  follows:]       -  , 

Prepared  Statement  of  Dr.  Gtary     Keller,  for  the  Hispanic  Higher 

Edikation  Coalition  . 

jtfr.  Chairman,  members  of  the  Subcommittee:  Myfiaine  is  Gary  D.  K^llen  and  I 
am  testifying  as  the  spokespersdn  for  the  Hispanic  ^Higher  Education  •  Coalition 
concerning  the  topic  of  educational  t^ti^g,  particularly  with  referenpre  to  H.R.  4949^ 
(the  Weiss  BJll).  ..  •     '  ^ 

.  The  Hispanic  Higher  Education  Coa|lition  (HHEC)  is  comprised  of  individuals 
repreisenting  11  national  Hispanic  6rti[ahizations  interested  in  improving  i&ducational 
conditions  for  their  constituencies.  The  HHEC  has  as  its  central  purpose  to  increase 
participation  of  Hispanic  populations  in  higher  education  in  the  nation.  The  11 
national  organizations  which  comprise  the  HHEC  are:  ASPIRA  of  America;  El 
Congreso  Nacional  de  Asuntos  Colegiales;  League  of  United  Latin  American  Citi- 
zens; Mexican  American  L^al  Defense  and  Educational  Fund;  Mexican  American 
Women's  National  Association;  National  Association  for  Equal  Education  Opportu- 
nities; National  Council  de  La  Raza;  National  IMAGE,  Inc.;  Puerto  Rican  Legal 
Defense  and  Education  Fund,  Inc.;  Secretariat  for  Hispanic  Affairs,  U.S.  Catholic 
Conference;  and  Spanish  American  League  Against  Discrimination. 

^upport  for  mp^  of  the  pYovisions  of  H.K  4949 

The  Coalition  supports  H.R.  4949  in  .  all  but  two  of  its.  aspects.  We  wish  to  make 
two  Suggestions  concerning  this  bill: 

(1)  That  dat^  be  gathered  by  linguistic  and  cultural  minority  groy pings  and  that 
these  data  be  normed  by  such  groupings;  and.  jr 

(2)  That  the  provision^  for  disclosure  of  t^t  items  !pe  deleted. 

Hispanic  communities  have  long  been  victimized^  we  believe,  above  and  beyond  any 
other  identifiable  population,  by  certain  kinds  of  tests,  including  the  princip^ 
standardized  assessment  instruments  such  as  the  SAT,  GRE,  LSAT,  MCAT  and 
.  others,  because  of  the  wellrecognized  linguistic  and  cultural  biases  against  Hispanic 
^Americans  that, those  tests  have  bUilt  into  them.  The  testing  services  have  not  done 
enough  to  counter  or  control  for  these  non-validating,  non-predictive  distortions  of 
^the  test  scores  when  applied  to  Hispanic  American  populations,  and  we  Mieve  that 
^e  proposed  H.R.  4949  as  well  as  at  least  one  additional  feature  in  H.R.  3564 
represent  a  first  and  long^-needed  st^p  in  improving  the  situation  of  our  community. 
Our  remarks  will  primarily  focus  on  H.R.  4949,  although  we  r^cogniTie  the  need  for 
greater  public  accountability  in  occupational  testing  as  required  by  H.R.  3564. 

The  Weiss  bill  will  go  a  long  way  in  pi'otecting  the  Hispanic  American  consumer 
.0^  tests,  in  making  the  test  services  accountable  for.  their  product,  in  facilitating, 
mora  ^ual  access  to  education  Hisjpanic  Americans,  in  more  accurately  defining, 
the  appropriate  use  of  specific  tests,  m  correcting  the  unwarranted  mystique  sur- 
rounmng  standardize  testing,  and  in  significantly  increasing  the  awareness  and 
sophistication  of  the  generc^l  public  and  the  Hispanic  communities  with  respect  to 
the  nature  of  standardized  ana  other  tests. 

We  fell  that  H»R.  4949  prdvides,  legal  requirements  that  will  encourage  more 
openness  on  the  part  pf  the  testing  serviceis.  These  reauirements  have  become 
essential  becauseiof  the  current  climate  of  mistrust  witr^in  Jarge  sectors  of  the 
publics-including  The  Hispanic  American  sector— with  reispect  to  the  services  now 
provided  by  the  toting  agencies.  At  this  time  we  ate  very  concerned  about  the 
charges  that  varioiut  supporters  of  truth-in-testing  le^lation  have  made  thdt  cer- 
tain- repprts  W^h  negative  implications  for  standardized  tests  have  not  been  report^ 
edr  foi^  example,  a  me^or  internal  study  produced  by  and  at  the  Educational  Testing 
Seirvlee,  entitled,. ''Cultural  Bias  in  Testing:  Challen|;e  and  Response,"  prepared  by 
Dr.  David  Loye  of  the  ETS  staff  at  the  requ^t  of  ETS  president  Turnbull.  The 
.seciQusnesp  an4  substance  of  charges  such  as  these  have  led  to  a  critical  situation. 

t    ■  , 
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.  The  necessary  trust  that  is  essential  for  the  proper  use  of  standardized  tests  has 
'  eroded  to  such  a  degree  in  the  general  public,  and  within  the  Hispanic  communities^  ^ 
that  federal  action  is  required.  We  feel  that  the  test  subjects  and  postsecondary  .  .^ 
education  institutions  will  welcome  the^royisioos  of  the  bill  requiring  the  disclo- 
sure  of  information  (reports,  statistics,  4nd  other  information)  and  will  restore  the 
public  confidence  in  standardized  tests. 

In  sum>  the  Hispanic  Higher  Education  Coalition  endorses  the  general  goals  of  the 
truth-in-testing  movement,  most  of  the  specific.  goaU  of  H.R.  4949,  and  most  of  the 
provisi(His  by  which  this  bill  proposes  to  attafn  these  goals. 

Need  to  strengthen  the  antidiscrimination  provisions  of  H.R.  4^49  *   ^    ■  ^ 

The  first  aspect  of  the  proposed  Weiss  bill  for  Ayhich  we  are  suggesting  modifica- 
tions is  one  of  the  methods'by  which^he  bill/attempts  to  monitor ^the  "continuous  * 
need  to  ensure  equal  access  for  all  Ameri3bns  to' educational  opportunities  of  a  high, 
quality."  [Section  2.(aK2to]  The  bill  requires  that  each  test  agency  shall  provide  a 
comparison  of  the  average  score  and  percentiles  of  tes4.  subjects  by  major  income 
grpups."  [Section  3.(aXB).]  Wp  btelieve  that  in  order  to  better  attain  equality  of 
educational  opportunity,  the<  requirepients  of  the  Weiss' bill  can  and  should  be  . 
strengthened  in  the  following  mminer:  '         ,     .  ^ 

We  propose  that  H.R.  4949  nbt  only  require  disclosure  but  in  addition  require 
affirmative  action  to  counter  linguistic  and  cultural  biases  in  the  content  by  means 
of  appropiriate  modifications  in  the  i^orming  procedures  of  te^ts.  The  testing  services 
should  not  be  merely  required  to  provide  information  concerning  the  average  score 
according  to  income,  but  should  also  be  required  to  report  scores  by  m^jor  discern- 
ible linguistic  and  cultural  groups  and  to  scale  the  test  scores  within  these  groups. 
In  other  words,  we  propose  that  scoring  be  based  onj^he  achievement  of  a  student  ' 
using  his  or  her  language'and  Culture,  groups  as  the  norm  or  the  control.  As  John 
Garcia  ("Intelligence  Testing:  Quotients,  Quotas,  and  Quackerjfe^*,  in  Joe  L.  Martinez, 
Jr.,  Chicanb  Psychology,' NT.:  Academic  Press,.  1977.  p.  207)  has  "noted,  therTis^— 
already  a  well-established  precedent  wi|hin  the  Graduate  Record  Examination  for 
this  procedure:  -  ■  ^ 

*  *  *  in  the  GRE  *  *  *  for  example,  the  verbal  score  of  any  given  woman  is 
converted  to  a  percentile  score  based  on  group  scores  of  wom^n.  Men  dre  given. a 
percentile  score  based  on  male  performance.  Since  men,  as  a  group,  score  lower  on 
the  verbal  GH^,  each  man  is  assigned  a  higher  percentile  score  than  any  woman 
who  does  as  well  as  he  on  the  test,  and  he  receives  a  higher  percentile  score  than 
many  women  who  do  better  than  he  does.  (The  converse  is  true  of  the  quantitative  " 
component  of  the  GRE).  This  procedure  candidly  admits  that  men,  as  a  group  are 
'di^dvantaged'  compared  to  women,  in  the  verbal  component  of  fne  GRE  and  that 
normalized  scores  increase  their  chance  to  get  ihto  graduate  school. 

This*^  precedent  needs  to  be  eXj^nded  to  all  of  the  pertinent  standardized  tests  that 
affect  identifiable  language '^Iflii^orities  such  as  the  Hispanic  American  communities. 
Only  fn  this  Way  cnn  \ye  remove  the  essential  Anglocentric  bias  of  our  standardized 
iesi&t  if  not  from  the  content,  then, from  the  scoring  procedures  and  the  interpreta- 
tion of  the  results. 

Lest  it  be  argued  that  .the  number  of  Hispanic  students  who  take  standardized 
tests,  is  too  small  a  population  to  adequately  perform  the  hormin^g  procedure  th|it  we 
are  suggesting,  we  observe  that  according''to  Table  10  of  California:  College-Bound 
Seniors,  1979,  published  by  the  JVdmissions  Testing  Program  of  the  College  Board,  in 
\  the  state  of  Californief  alone^ /r,287  Mexican-Americans  and  ^11  Puerto  Rican  stui 
dents  took  the  SAT  test.  This  fitudent  population  base  is  more  than  ample  to  provide 
separate  norms  for  Hispanic  fiiudents.  . 

The  Coalition  believes  that  Hhe  grouping  categories  for  both  ;disGlosure  and  iiorm-  i 
ing  requirements  should  also  include   linguistic,  and  cultural  minbritied."  U  can  be  I 
.clearly  established  that  standardized  tests  are  biased  for  both  income  groupf  and  for  / 
linguistic  and  cultural  minorities  and  we  believe  that  the  degree  of  bias  is  more 
acute^for  linguistic 'minority  groups:  We  wish  to  cite  statistical  e^^ence  of  such 
biases: 

a.  In  the  document,  California:  College-Bound  Seniors,  1979,  produced  by  the 
Admissions  Testing  Program  of  the  College  Board,  Table  11  breaks  down  meap  and 
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There  is  a  ckar»  direct,  iT)anifest»  correlation  between  income  level  and  SAT  scores. 
The  more  tKe  incon^  level  of  the  parents,  the  better  the  SAT  score  for  all  income 
f  groups.  I  J 

D.  in  Table  10  of  the  same  report,  Annual  Parental  Income  by  Ethnic  Group,  the 
relationship  between  ethnic  origin  and  income  level  is  reported: 


Mexican:AnKrican 

White 

  ^  $16,200 

$30,500 
25,100 

 :            "  13,600 

 '■ — ^  .  

A  compfiirison  of  the  statistics  reported  in  a.  and  b;  reveals  that  the  mean  and 
median  income  of  Mexican-Arpericans^is  below  the  smallest  incoma.category  report* 
.  ed  (below  350  on  the  SAT)  while  white  students  average  in  the  SOO-iGOO  range  on  the 
SAT.  By  comparing  the  two  tables  (Table  10  and  Table  11  in  th|  report),  we  fmd 
I  what  would  appear  to  be  an  interaction  effect  between  income  ana  linguistic  minor* 
*  itv  origin.  Mexican*Americans  dd  poorly  on  the  S/\^  because  they  Have  low  incomes. 
..  The  combination  of  factors  interact  so  that  the  bi^a.  effect  is  made  extremely  acute 
'  for  Hispanics.  \^ 

Apropos  of  the  above  analysis,  the  following  comment  is  in  order:  Why  was  it 
necessary  to  make  such  indirect  comparisons?  Why  didn't  the  Admissions  Testing 
.  Program  of  the  Ck)llege  Board  ^ve  us  a  table  which  directlv  compared  SAT  scores  in 
California  with  ethnic  group^status?  Perhaps  because  such  data  cast  the  SAT  in  a 
very  negativcwight.  Hopefidly,  the  HR  4949  provisions  will  require  the  clear  and 
systen^atic  pifjientation  of^uq^  data,  as  well  as  the  norming  proyfislpns  to  control 
for  the  bijiafis-v^ch  such  data  point  out.  x  . 

Just  asf men  and  womeli  are  normed  differently  in  verbal  and  quantitative  scores, 
respectively,  we  suggestahe  same  process  be  used  for  linguistic  minority  groups.  We 
wish  to  emphasize  Dotn  the  purpose  and  the  practicality  of  the  suggestion  that  we 
ofTejr  to  have  test  scoras  normed  according  to  identifiable  linguistic  minority  groups. 
Hispanic  Americans  should  be  normed  separately,  ^ot  in  accordance  with  any 
^philosophy  of  educational  separatism,  btit  on  the  contrary,  so  that  Hispanic  students 
can  be  permitted'^Access  to  the  prestigious  American  institutions  of  )iigher  education 
in  the  numbers  that  their,  capabilities  warrant.  The  norming  procedures  that  we 
suggest  woUldT  control  for  biases  in  the  testing  content  that  hold  back  significant 
numbers  of/Hispanic  youngsters  frpm  equality  of  educational  opportunity  and  ac- 
cess. Wei  want  more  of  our  children  in  the  mainstream  of  American  education,  and 
■  th^t  is  why  we  propose  these  (corrective  norming  procedures. 

Moreover,  let  no  testing  agency  claim  that  it  is  impossible  or  impractical  to  norm 
in  th/ fashion  that  we  have  suggested.  In  addition  to  the  precedentd  that  we  have 
'  described,  ^ane  R  Mercer,  one  of  the  best-known  and  most  respected  assessment 
Brts  in  the  United  States,  has/developied,  in  collaboration  with  a  number  of 
jues,  an  assessment  instrument  called:  System  of  Multicultural  Pluralist|jC 
^Assessment.  This  instrument,  published  by  onk  of  the  largest  test  organizations.  The  \ 
Psychological  Corporation  (a  qivisioj^of  Harcmirt  Brace  Jovanovich),  among  other 
procedures,  evaluates  a  child's  perfmhance  relative  to  others  from  t^e  same  socio- 
cultural  backgrouii|l,  thereby  taking  into  account  the  cultural  specificity  of  tests  and 
the  distance  between  the  student's  socioculturalnpacie  and  the  culture  of  the  school. 

Modeling  H.R.  4949  On  Public  Law.  94-14^  (education  of  handicapped  children) 
In  further  support  of  our  Position,  it  should  be.  noted  that  there  is  at  least  one  law 
in  force 'which  establishes  the  requirement  for  what  we  are  suggesting.  In  section 
121%630(b)  (Protection  in  Ehjlduation  Procedures)  of  Public  Law  94^142  (Education 
of  Ifandicapped  Children),  at  is  stated  that  "testing  and  evaluation  material  ant 
prodedures  used  for  the  purpose  of  evaluation  aild  placement  of  handicapped  chil- 
Vdren  must  be  selected  and  administered  so  as 'not  to  be  racially  or  culturally 
•diiicriminatory/'  i  • 

.  The  problem  has  been  to  enforce  this  requirement.  We  believe  that  the  procedure 
that  we  are  suggesting,  requiring  of  tt^  test  agencies  that  they  normalize  test  scores 
for  identifiablelinguistic  minorities,  would  bring  us  one  stop  closer  to  nieeting  th^ 
legal  requirement  ofiPublic  Law  94-142,  and  the  intentions  of  H.R.  4949. 
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Concerns  about  the  disclosure  of  test  questions  and  answers 

The  second  aspect  of  H.R  4949  with  whiclf  the  Hispanic  Higher  Education  Coali- 
tion has  reservations  is  those  portions  of  Section  6  wnich  reauire  the  disclosure  of 
all  test  forms^  including  all  quosuona  on  the  test,  together  with  the  correct-answers. 
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It  is  the  contpption  of  the  testing  agencies  that  systematic  disclosure  of  test 
questions  anti  test  answer^  in  itself  will  les^d  to  #  general  deterioration  of  test  * 
quality  because  it  will  make  pre^testing  very -difficult  and  .repeated  use  in  future  . 
tests  impossible.  Moreover,,  its  restrictive  effect  on  the  testing  agencies'  efforts  to 
both  isolate  and  reject  culturally  biased  test  items  and  to  include  those,  items  which 
do  have  high  correlations  *not  only  with  the  mainstream  population,  but  with  all 
identifiable  linguistic  and  cultural  minority  populations,  will  be  very  ^reatlv  hin- 
dered, further  promoting  bias  in  the  content  of  tests  which  have  been  revealed  to  be 
..biased  in  the  first  place.  In  Qther  words,  it  is  the  contention  of  the  testing  agencies 
that  the  proposed  requirements  we  ha vel alluded  to  in  Section  5  of  H.R.  4949  will 
further  increase  the  Anglocentrisni  of  standardized  tests  and  cause  the  cbllapseiof 
the  ongomg  partial  progress  that  the  t^ing  agencies  and  assessment  researchers 
nve  mad^  over  the  last  20  years,  to.  create  "culture  fair^'  tests;     .  . 
^  the  extent  that  the  .  testing  agencies  can  provide  cohviaeing  proof  of  the 
vali^y  of  their  contentions,  we  are  in  concurrence  with  their^rgument  that  the 
test  items  and  test  ans>yer  disclosure  provisions  in  H.R.  4949  should  not  be  enacted.  . 
Our  position  is  that,  in  addition  to  the  suggestions  that  we  have  offered  to  modify 
scoring  and  morning  of  standardized  tests,  the  test  services  should.  be  made  more 
.  accountable  for  reducing  the  current  biases  of  standardized  test  item  content.  ^ 

The  provisions  of  the  Weiss  bill  ought  to  bb  strengthened  along  the  lines  of 
section  121a.530  of  Public  Law  94-142  which  wej  have  cited  earlier^  so  that  testing 
agencies  are  required,  to  provide  evidence  that  the  testees  are  eval lifted  in  a  fashion 
not  to  be  raciallVvor  culturally  discriminatory.  We  don't  think  that  this  requirenient 
would  be  aided  by\a  test  disclosure  provision  because  the  creation  of  "culture  fair" 
test  items  is«>a  dimcult  task  to  perform  in  the  establishment  of  standardized  tests. 
Questions  which  he^ve  proven  reliability  with  respect  to  identifiable  linguistic  minor- 
ities need  to  be  caremly  husbanded.  If  they  were  to  be  revealed,  we  don't  think  that 
they  could  be  effectimy  substituted;- Therefore,  the  Coalition  is  concerned  that  the 
good  intentions  of  theXWeiss  bill  might  be  hindered  by  the  actual  disclosure  provi- 
sion so  that  instead  or  the  purported  goal  of  the  legislation  to  ensure  equality  of 
■  educational  access,  an  lindesired  side-enect  wouldjoccur:  a  deleterious  weakening  of  . 
the  validity  of  standardized  tests  with  reapect  to  controls  for  linguistic  and  cultural 
bias.  Instead  pf  providing  general  test  disclosure,  it  is  more  in  the  interest  of 
educators  concerned  with  equality  of  educational  access  that  the  test  services,  be 
required  to  provide  timely,  periodic  evidence  of  the  non-discriminatory  nature  of 
their  tests,  both  with  respect  to  the  scaling  and  scoring  procedures  and  with  respect 
to  the  actual  content  of  uieuueptions  themselves. 

.l%e\  Hispanic  Higher  Education  Coalition  wishes  to  close  this  testimony  with  one 
lasf  observation..  The  intent  df  ou  a  suggestions  ip  not  to  put  roadblocks  in  the  way  of 
the  testing  agencies  with  a  wew  to  ultimately  destroying  the  testing  industrv.  Far 
from  it,  we  see  important  tbnefits  to  be  derived  from  objective  tests,  including 
standardized  tests.  For  examine,  Hispanic  educators!  have,  been  involved  with  bilin- 
gual education  for  tlTe  last  2d  years,  and  longer.  Most  Hispanic  educators  readily 
icknowledge  the  extremely  important  contribution  ihat  the  development  of  assess- 
ment procedures  has  made  to  pUingual  education.  Hispanic 'Cthicato^s  are  usually 
leary  of  assessment  procedures,\  and  rightly  s6»  becalise  of  their  pcH^ntial  for  .  bias. 
And  yet,  in  point  of  fact,  biling\ial  education  as  we  know  it  today  would  not  have 
been  possible  without  the  massive— often  court  ordetred,  as  in  the  Aspira  Consent 
Decree — development  of  assessnient  procedures  to  determine  the  language  compe- 
tencies of .  non-native  English^^pe^king  children.  Contemporary  bilingual  educe^tCon 
is  irrevocably  tied  to  the  good  services  of  assessmerit  procedures  m  determiryng 
•  placement  of  children  within  binngual  classrooms.  This  is 'all  to  the  gq^td,  for 
bilingual  educators  often  have  many  sad  experiences  to  recount  in  witnessing  the 
illegitimate  subjective  placement  of  minority  youngsters  in  special  education  class- 
rooms often  for  the  nientally  retarded  or  learning  disabled,  simply  because  of  their 
lack  of  experience  with  the  English!  language.  Bias  am6hg  educational  personnel  ia 
just  as  real  as  content  bias  in  tests,  disclosure  of  test  items  in  the  area  of  bilingual 
education  will  serve  no  useful  purpdse.  Inde^,lo  cite  one  example,  it  is  generally 
acknowledged  in  the  city  Of  New  York,  . that  the  Language  Assessment  Battery,  the  /- 
test  used  to  implement  the  Aspira  Consent  Decree,. is  inf  urgent  need  of  additional, 
secure  versions  because  a  result  of  the  cut/rent  poli^  to  lieacTminister  it  over  several 
grades  causes  children  to.  become  ^^test  wpse.''  Because  oi  repeated  expojiure  to  the  . 
test,  children  receive  a  higher  paper  Wdre  than  their  language  competency  war- 
,  rants,  and  therefore  are  removed  from  Dillngual  education  classrooms. 

In  conclusion,  we  fully  supiport  the\  movement  toward  more  accountability  in 
testing.  We  endorse  most  of  tne  Jirovisioiis  of  the  Weiss  bill.  We  think  that  the  bill 
should  be  rnodlfied  Bnd JP^engtnened,  fowever,  in  .the  particulars  that  we  have 
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described  above,  in  order  to  better  attain  its  provision  for  equality  of  educational 
access  for  linguistic  minority  students.  It  is  because  the  Hispanic  educator  probably  . 
..more  than  aiiy  other  minority  group  professional  has  been  privy  to  the  worst,  most 
biased  aspects  of  the  testing  process,  ais  well  as  its  potential  for  accurately  assessing 
competencies  and  determining  placement,  that  these  suggestions  are  entered  in  th% 
spim  of  a  thoroughgohig  oeform  of  a  service  that  needs  to  regain  public  trust  in 
order  to  continue  to  be  proauctive  and  beneficial  to  society. 

Chairinan  Perkins.  Mr.  Weiss. 

We  vdll  abide  by  the  5- or  6-minute  rule  first. 

Mr.  Wjass.  Thank  you  very  much,  Mr.  Chairman.  My  voice  is 
such  that  I  am  not  sure  that  I  can  rfeally  even  carry  on  for  5  or  6 
minutes.  ^  , 

Dr.  Keller,  I  apl>reciate  your  testimony.  I  think  that  you  have 
really  given  us  somife  very  new  and  important  insights. 

You  referred  in  your  testimony,  and  in  your  written  testimony 
on  page.  4  you  spell  put  in  detail  soriiething  which  I  was  not  aware 
of  and  I  ata  not  sure  if  the  public  at  large  was  aware  of.  That  is, 
that  in  fact,  not  in  effect  but  in  fact  the  graduate  record  examina- 
'  tion  itself  has  a  built-in  bias  in  favor  of  men,  that  women  do  not 
get  the  same  break  in|that  test  that  men  do.  •  I 

Is  t)li£it)  correct? 

i  Dr.  Keller.  Yes,  sir,  that  is  correct.  The  converse  is  correct,  also. 
Women  do  not  make  the  same  distribution  of  scores  overall  With 
respect  to  the  quantitative  part  of  the  GREs,  so  that  men  do 
significantly  poorer.  Although  they  attain  a  standard  distribu^on, 
the  distribution  has  a  lower  threshold  you  might  say.        .  \  i  i 

With  respect  to  the  verbal  component,  ,wom6il  do  signifiqa|ntly 
poorer  with  respect  to  the  quantitative  component  of  the  GRE. 

I  might  add  that  other  standardized  teists  report  out  the  same 
results  and  also  have  conversion  charts-  for  men  and  for  women  so 
that  wdirien  are  their  own  control  group  with  respect  to  the  percen- 
tiles reported  out  and  men  are  their  own  control  group  in  analo- 
gous fasMdn."  ■         .        ,1  ^  , 

Another  fuch  test  is  SAT.  The  same  thing  at  the  undergraduate 

level  occurs.  *      /  / 

Mr.  Weiss.- Which  is,  at  the  undergraduate  level  again? 
(    Dr.  Keller.  Men  and  women  vary  with  respect  to  their  perform- 
ance in  connection  with  verbal  versus  mathematical  aptitudes!.  '  ^ 

Mr.  Weiss.  But  there  is  no  special  help  provided  to  Women  tO 
help  them  perform  as  well  as  men?  p. 

Dr.  Keller/ It  is  my  todei^tanding  that  such  a  procedure  analo- 
gous to  the  GRE  is  m  tel  with  the  SAT.  Scores  are  reported  out 
with  distributfpn  accdrdltoK  to  gender,  male  or  female. 

Mr.  Weiss.  So  that  alrthe  arguments  that  haveHjeen  jnade  in 
support  of  the  impartiality  and  objectivity  by  the  testing  companies 
about  the  tests  and  their  own  attitudes  the  tests  test  the  same  for 
everybody  no  matter  who  they  are  and  wherie  they  come  from  in 
fact  is  a  lot  of  nonsense  oji  the  basis  of  this  kind  of  converspn  of 
4  their  own.  .    '  *  . 

I     I  used  stronger  language  than  you  did. 

%  Dr.  Keller.  The  evidence  is  there  that  the  spores  are  reported 
out  by  gender  differencesv*That  is  an  uncontestable  matter  of  fact. 

So  the  graduate  Schools  such  as  my  own  will  look  at  the  distribu- 
^on  of  scores  for  nien  and  analyze  those  separately  with  reject  to 
me  distribution  of  fcores  for  women.  We  don't  combine  apples  and 


pears  and  we  don^t  combine  men  and  v^(jmen  with  respect  toihQse 
scores.  We  analyze  them  ai)d  evaluate  tl)em  for  admission  separiaite- 
ly.  ■  •  '  '   ■       _  1       '    ■■    ^'  i 

Mr.  Weiss.  Is  there  a  similar  kihd  of  differentiation  by  way  of 
record  conversions  on  trie  basis  of  iethnicity?  ^ 
\:>Vr.  Keller.  There  is  not  with  fespect  to  the  GRE,  SAT  or  any 
other  sta1pdardi2;ed  tests  thxp  Educational  Testing  Service  or  other 
kin  agencies  provide.  ,  ^  ,\ 

There  is  stt  least  one,  ho>^rever,  in  existence  which  is  reported  in 
the  written  Version  of  our  testimony  produced  Jane  Mercer  and 
a  large  commercial  testing  house,  Harcour^  Brace  Jovanavitch^ 
that  is  the  SEA,  part 'of  which  test  scores  that  take  into  account 
the  ethnicity  and  cultural  background  of  the  testees;  That  is  a  sort 
of  IQ  test,  the  SAFPA.  x 

Mr.  Weiss.  The  thing  that  has  disturbed  me  through  ^11  these 
hearings  and  all  the  inquiries  about  it  is*  that  when  it  fcomes  to  our 
•  cont^e^n  for  culturaj  bias  built  in  on  the  basis  of  ethnicity  or  race 
or  geography  or  whatever,  the  argument  is  always  made  that  you 
cannot  miess  with  the — never  mind  the  test  itself— you  cannot  dis- 
close whiat  goes  into  the  process  because  in  some  way  those  te^ts 
are  sacrosanct  and  vou  will  be  intruding  in  the  educational  process. 
That  w^  Dr.  Howe  s  testimony  as  I  understood  it, 

HereVe  have  an  example  that  in  fact  those  tests  thiemselves  are 
skewed  to -^get  a  result  the  testmakers  want  which  is  to  give  men 
more  of  a  break  in  th^  GRE  examples  than  they  would  deserve  on 
the  examination; 

Ms.  Rice  shakes  her  head,  but  isn't  that  right? ' 

Dr.  Keller.  Yes,  a  special  attentjop  has  to  be  given  td  the 
significant  statistical  ^difference  in''x[;i^  distribltioji  of  scores 
achieved  by  men  as  compared  to  women  on  the  same  test  with  the 
same  test  items.  *  A  / 

Mr.  Weiss.  Right.  T  really  have  only  one  fisher'  question  or 
comment.  You  know  what  we  have  had  here  all  along  and  the  part 
of  tne  educational  testing  service  and  fts  allies  and  pup^rters  is  an 
attack  on  a  straw  man.  ,  ■  jm 

If  in  fact  the  bill  did  what  you  propose  in  your  first  modpiation 
which  is  in  fact  to  mandate  the  kind  of  differentiation  of  norms  on 
the  basis  of  different  groups,  then  they  could  come  in  and  attack  us 
on  the  basis  that  we  are  trying  to  tell  them  what  kind  of  tests  to 
compose  and  how  to  score  them  and  so  on.  ^  ' 

The  legislation,  and  you  criticize  it,  but  the  legislation,  very,  very 
clearly  prevents  and  does  not  touch  on  that  at  all.  What  we  simpl^ 
do  is     ask  fo^  disclosure  and  openness.  ■      i    ■  \ 

I  don't  understand  how  Dr.  Howe  or  anyone  else  can  Suggest  that 
this  is  an  Intrusion,  We  are  not  trying  to  tell  them  what  to  put  in 
th^  test.  It  is  not  akin  to  Adam  Clayton  Pbweirs  question|(  about 
what  should  be  in  textbooks. 


I  think  a  lot 
testing  iitdustry 
tion.  \ 
Thank  you,  Mr.  Chairman. 
Chairman  P6Ri:iNS.  Mr.  Goodling? 
I    Mr.  GooDUNG.  Firsf  of  all,  I  might  say  ray  Golleague| tecentl 
f  made^  statement,  something  about  the  people  opposed  j9  t^is  bi 


ople  are  being  misused  and  piisled  jjjy  the 
have  a  very  real  financial  stajce  in  this  sitfla 
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or  those  people  who  hav6  e^e  interest  in  the  tejstijt]^  programs  or 
some  connection  with  the.testmg  programs.  I 

Let  me  tell  you,  as  an  administrator  and  as  an  ec^ucatpr,  I  was 
ye^ry  reluctant  to  administer  standardized  tei^ts  because  of  the  mis- 
use that  teachers  would  sometimes  make  of  them  as  far  as  deter- 
mining what  a  youngster  could  or  could  not  do. 
'     I  have  real  concerns  simply  because  I  think  it  is  an  intrusion 
Mnto  something  we  had  better  be  very  careful  about  before  we  do  it. 

My  first  question  would  1^  to  Dr.  Howe.  You  have  been  in  this, 
business  a  long  time  and  very  close  to  education.  Do  you  see  ah 
emergency,  tha$\  requires  ua  to  move,  rapidly  into  some  kind  of 
truth-in-testing  i^i^og^'a^  from  the  Federal  level  before  we  have  an 
opportunity  to  se^  what  New  York  is  going  to  come  up  with  when 
they  begin  thei^  program,  I  think  in  January,  or  the  National 
Science  Foundation,  before  they  come  up  with  their  results  of  the 
study  they  are  doing  which  I  believe  is  due.fiii  the  middle  of  1980, 

Do  you  see  that  kind  of  emergency? 
'  Dr.  Howe.  Mr.  GoodUiiiig,  \  woiild  like  to  take  a  moment  to 
ianswer%hat,  if  I  may,  rather  than  just  give  a  yes  or  no  answer 
because  I  think  the  question  is  more  complicated  than  yes  or  no. 
\  First  of  all,  I  hiive  a  lot  of  agreement  with  many  points  made  by 
Aiy  coUe^gue.  Wlien  he  says  that  testing  needs  to  regain  public 
Erust,  I  think  h6  is  right.  There  i?  clearly  a  great  deal  of  concern 
among  educators,  among  the  piiblio  in  general,  on  this  subject. 

When  he  points  i  to  such  e^i^ples  as  he  has  about  the  niisuse  of 
tests  that  ate  supposed  to  be  predictive  for  diagnostic^purposes  land 
•  that  kind  of  thinK,  what  little  bit  I  know  abput  testmg— and  he  is 
much  more  an  ek^ert  on  the  explicit  subject  of  testing  than  I  am,  I 
am  by  no  means  in  expert  on  it— my^xperience  would  lead  me  to 
think  that  he  is  right,  that  thei;e  are  abuses  of  this  kind. 

My  nfajor  point,  however,  is  that  I  do  think  it  is  perilous  ground 
for  legislation,  that  to  get  into  national  legislation  in  this  field  with 
the  hope  of  correcting  those  kinds  of  problems  simply*  by  laying 
things  out  in  the  open  in  the  way  of  test  scores  and  reporting  test 
questions,  an  openness  type  of  legislaMon  does  not  seem  /to  me  to 
'  address  those  problems.  ^ 

That  is  why  there  is  suggested  in  my  testimony  a  point  I  did  not 
make  before  in  my  summary  of  it^  that  you  consider  appointing  a 
national  commission  on  this  subject  that  wpuld  be  a  distinguished 
group  of  interested  and  informed  people  with  an  adequate  staff 
really  to  look  at  mese  questions  |in  the  kind  of  depth  that  no 
matter  how  hard  you  try  in  the  course  of  congressional  hearings  to 
get  interpretations  frW^  many-BOtiroes  it.  is  very  difficult  for  j^ou  to* 

achieve  an  indepth  unqerstan^g.     .  - 

Therefore,  to  ^swerVour  question^  I  don't  think  there  is  what  I 
would  call  a  national  emergency,  but  \  think  there  is  a  real  prob/ 
lem  in  public  confidence  ok  this  featter.  \ 

Since  I  agree  with  the  tdstinlony  that  has  been  given  that  public 
con^dence  needs  t^be  reestablished  and  the  k|rid  of  specific  abuses 
|that  hafve  been  charged  neea  to  be  looked  at  in  detail,  they  require 
_o  ^__t..^xi^_i.«  -"Expertise  w^ich  l  am  ready  to  admit 


a  kind  of  sophistication  and 
that  I  don't  have. 
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Thei;eforej  again,  I  welcome  this  kind  of  inquiry  tq  give  a  chance 
for  exactly  that'  sort  of  ventilation.  But  I  really  worry  about  two 
tliingg:     \  ;      '  ' 

One,  the  adequacy  df  this  sort  of  legislation  to  lead  to  the  result 
my  colleague  would  desire  and,  ^e<5ondly,  to  come  back  to  some 
things  that  Mr.  Weiss  jSaid,  I  do  thhlk  that  there  is  implied  in  this 
kind  of  legislation,  if  not  stated  (urectly  in  it,  the  notion  that  the 
Way  students  aye  adnnitpd  to  college  in  the  United  States  is  the 
Congress  biisiness.  I  tmnk  it  is  primarily  the  college's  JSusiness  and 
not  the  Congress.  I  thiiik  it  ought  to  be  kept  that  way.f 

We  have  recently  hid  a  major  debate  here  in  the  Congress  on 
the  Federal  role  in  legislation  and  a  very  close  vpte  on  whether  we 
have  a  national  departlpient  of  education.  This  issue  of  the  appro- 
priate Federal  role  was  pretty  well  reviewed  £^t  that  time  and  there 
was  a  good  deal  of  controversy  on  that  subjectl 

When  the  Congress  is  saying  in  legislation  that  it  thinks  that 
multiple  criteria  is  the  way  to  admit  students  into  college,  it  is 
entering  into  the  college's  business.  That  is  what  this  says. 

It  is  Hot  requiring  that  multiple  criteria  be  used,  but  it  is  saying 
that  it  wants  to  encourage  the  use  of  niultiple  criteria.  ; 

I  fully  agree  that  multiple  criteria  is  a  fine  idea  and  I  am  for  it. 
But  I  am  not  for  the  Congress  saying  that  is  where  it  stands.  I 
know  of  institutions  which  use  open  admission  systems.  Other  in- 
stitutions use  other  admissions  systems  and  give  varying  weights  w 
multiple  criteria.  •  '    •  ( 

I  think  opening  this  door  of  a  national  expression  of  wanting  to 
bring  about  oertain  results  in  the  business  of  institutions,  many  of 
which  are  private  and  those  of  which  are  public  are  controlled  by 
the  States  and  not  by  the  national  government,  is  not  a  good  idea. 
Mr.  GoooLiNG.  Thank  you.  \ 
Dr.  Keller—  ^ 

Chairman  Perkins.  Let  me  interrupt  the  gentleman. 
Would  you  want  to  recess  and  go  over  and  vote  and  come  right 
back?  y 

Mr.  GooDLMG.  Td  like  to  ask  two  questions.  ' 
What  two  clianges  do  you  suggest? 

Dr>KELLER.  We  suggested  that  the  data  be  gathered,  the  data 
awhich  the  H.R.  4949  requests  be  gathered  not  only  by  income  level 
put  by  linguistic  and  cultural  minority  groups,  and  furthermore/ 
mat  the  testing  services  be  required  to  report  scores  and  norm 
scores  sepafately  from  major  discernible  arid  linguistic  and  cultural 
groups.  That  is  one  suggestion. 

The  second  is  that  those  provisions  folr  the  disclosure  of  test 
(Jues^ions  qnd  answers  be  deleted  from  section  5  of  H.R.  4949. 

Mr.  GboDLiNG.  My\  second  question:  I  am  not  sure  of  your  age. 
Are  you  old  enough  to  know  how  people  were  'admitted  into  col- 
leges before  we  had  the  kind  of  national  test  results  now  used  as 
part  of  that  admissions  procedure?  * 

For  instiance,  if  you  wanted  to  go  to  an  elite  school  and  you  were 
a  minority  or  you  were  poor,  what  chance  did  you  have? 

Dr.  Keller.  Congressman,  I  don't  have  experiential  knowledge  of 
thatT  but  I  have  the  kind  of  knowledge  that  accrues  to  one  who  is 
acquainted  with  the  literature.       /         .  / 


Lei  me  hasten  to  say  that  I  think  the^  Hispanic  Higher  Educatibn 
Coalition  and  my^lf  personally  recognize  many  of  the  benefits  p 
the  testing  agencies.  We  in  no  way  wi^  to  curtail  or  destroy  the 
testing  services.  ,  |t' 

Our  suggestions  are  made  in  the  spirit  of  refirm.  We  do  regojg;- 
Aiize  that  to  some  degree  the  testing  services  Jiave  provided  for 
a(icess  to  students  >vhQ  very  vrell  mi^t-not  have  been  admitted  p 
^tsecondary/education.  .  ! 

Ir.  GooDUNG.  Thartk  you.  ? 

FoRD./l  am  sorry  I  was  not  here  Kjryour  testimony  ^  Dr. 
HoWe,  but  I  am  drawn  to  your  concern  about  Federal  intrusion 
into  education.  This  might  surprise  some  people  because  since  we 
worked  together  in  1965. 1  have  been  intruding  constantly  from  the 
Federal  leyel  in  education— that  is  as  ah  advocate  of  Federal  intru- 
sion. ,     j  '.  '         '  .  ^  ■ 

But,  as  the  chairman  of /the  Higher  Education  Committee,  I  have 
become  more  dnd  more  sensitive  to  the  pressures  oh  us  all  the  time 
to  move  into  areas  that  would  conipletel^\change  the  relati6nshi| 
of  Federal  aid  to  education  ^nd  Federal  concern  for  equity  an(S 
access  in  education.  They  are  Constantly  trying  to  get  us  invol^e^ 
in  some  type  of  administrative  entanglement 

I  would  ask  Dr.  Keller,  not  pecessarily  in  your  capacity  speaking 
for  the  organization  reprefieriting  Hispanics,  but  as  someone  famil- 
iar with  what  happejis  at  Eastern  Michigan  University  and  one  I 
ana  very  familiar  with,  who  in  Washington  would  we  iook  to  to 
provide  the  kind  of  public  confidence  which  is  sought  in  the  en- 
forcement of  legislation  of  thisi  kind? 

Laying  asidfe  the  differences  which  are  involved,  if  we  assume  the 
adoption  of  some  form  of  legislation,  would  it  he  predictable  that 
institutiojis  like  yours  would  be  willing  to  trust  a  Federal  agency  to 
assess  the  value  o^  the  testing  they  were  using  for  -admissions? 

Dr.  K^LER.  I  think  that  many  institutions  would  do  so'enthusi' 
astically.  Many  others  would  certainly  accommodate  themselves , 
quickly  to  the  idea. 

Mr.  Ford.  Let  me  interrupt  you  to  say  for  the  record  that  past- 
ern Michigan  has  an  outstanding  record  of  recruiting  minorities. 
^  Dr.  Keller.  Thank  yotJL  very  much,  sir. 

^  MFTFoRD.TTiat'  is  eviaenced  by  jthe  dramatic  change  that  has 
taken  place  in  r^ent  years  in  thcJbntire  makeup  of  that  institu- 
tion; the  att^udeSN^n  the  campus,^  ^and  the  nisiikeup  of  the  student 
body.  :  I 

But  that  is  one  of  the  schools  which  I  would  consider  to  have 
progressed  very  rapidly  in  the  last  decade  and  a  half,  and .  not 
much  before  that.  I  helped  to  change  its  name,  as  a  matter  ^  fact, 
from  Yipsilianti  Normal  to  Eastern  Michigan  State  University  in 
196L  It  certs^inly  was  not  the  change  of  name  Which  changed  the 
\  attitude.         '  ^ 

But,^  would  we  have  Federal  enforcement  which  went  down  to 
the  norm  olf  the  recruiting  system  at  our  small  private  colleges  in 
Michigan,  or  to  an  Eastern  Michigan  norm? 

Is  it  likely  that  we  could  get  some^sort  of  an  overall  standard 
which  ^wouid  not  go  down  to  the  lowest  common  denominator^  and 
therefore  leave  Eastern  Michigan  imperiled  in  terms  off  what  it 
doe6  as  an  institution,  while  stoying^  conscious  of  its  responsibility 
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to  ilcruit,  retain  and  guaraktee  the  success  of  minorities?  This  is  a 
concern  that  I  have.       .    \  J 

When  you  start  ttf  talk  about  setting  national  standards,  it  can 
become  very  entangled.  If  Ifcan  go  ^o  a  completely  different  subject, 
we  used  to  have  the  best  clean  meat  law  in  the  coifnti-y  in  Michi- 
gan regarding  comminuted  meat,  which  is  meat  ground  up  into 
sausage  or  hamburger,  until  the  Federal  Government  came  along 
to  help  the  American  public  and  passed  a  consumer  bill  which  set 
standards  for  what  you  can  put  into  sausage.  From  that  day  on,  we 
in  Michigan  began  eating  snouts  and  ears  in  sausage  and  we  never 
were  subjected  to  that  in  the  past.  ^ 

In  making  a  national  standard,  you  make  it  impossible  for  some- 
one who  wants  to  exceed  that  standard  to  do  so.  Wheii  you  note  the 
tremendous  diversity  we  have  in  higher  educ&tioii,  you  should 
re(»ll  that  prior  to  World  War  II,  I  could  not  have  Obtained— even 
if  I  had  the  money— entrance  to  schools  which  I  eventually  attend- 
ed. The  system  would  not  let  a  factory  vyorker's  kid  get  into  those 
schools. 

I  grew  up  understanding  that  doctors'  children  had  a  chance  to 
be^.doctors  and  lawyers'  children  had  a  chance  to  be/awyers.  It  had 
np.thing  to  do  with  race  or  sex  or  ethnicity.  It  had  tcT do  with  a  very 
closed  system. 

Everything  we- have  been  doing  since  the  GI  bill  has  been  direct- 
ed toward  opening  up  the  systepi.  We  have  institutions,  such  as  the 
one  with  which  you  and  I  are  familiar,  which  have  taken  years  to 
respond  to  this  situation. 

I  aril  concerned  about  what  I  ani  hearing  in  the  testimony  here 
about  putting  the  Federal  Government  in  a  position  where  we  may, 
in  fact,  impede  the  people  who  are  exceeding  without  doing  very 
much  for  the  people  who  are  no^. 

Is  that  6  concern  that  you  view  as  legitimate?  . 

Dr.  KELiLEft>^s,  Congressman,  an  extremely  legitimate  one. 

If  I  may  take  a  minute  or  two  to  address  .myself  to  your  ques-  - 
tion— by  the  way,  I  think  that  your  idea  to  change  the  name  to 
Eastern  Michigaa  University  was  an  inspired  one,  one  which  has 
benefited  the  university  greatly. 

I  believe  all  colleges  and  universities  in  the  United  States,  bpth  i 
public  and  private,  are  profoundly  disquieted  by  the  manifest  rela- 
tionships that  have  been  reported  out,  for  example,  by  the  admis- 
sions testing  program  or  the  College' Board  that  show  a  direct 
correlation  between  income  level  and  tests  on  standardized  tests 
such  as  the  SAT.  . 

Mr.  FoHD.  Does  that  surprise  you? 

Dr.  Keller,  No,  it  does  not. .  \  ' 
Mr,  Ford.  What  is  the  significance  of  that?  I  saw  the  California 
study  and  I  was  amazed  that  anybody  would  set^iously  say  that 
they  had  discovered  something  when  they  found  that  people  from 
families  with  over  $30,000  incomes  did  befter  in  school  th^  people 
from  families  with  less  than  a  $30,000  ingpme.  They  do  ^better  at 
everything.  That  is  what  Jimmy  Carter  meant  when  he  said,  no, 
.  life  isn't  fair.        ^  J 

I  come  from  a  family  in  which  ifo  one  finished  high  school.  But,  I 
know  what  the  California^  study  concludes  from  my  work  on  this 
comn^ittee.  Why  is  it  surprising,  when  you  recognize  that  only  20 
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percent  of  the  entire  population  is  in  tha^  income  category  above 
$30,000— probably  something  less 'than  20  percent  as  aT  matter  of 
fact.  I 

The  chances  of  having  parents  who  have  a  greater  ■  appreciat;ion 
for  the  value  of  education  and  provide  support  for  educational 
endeavors  in  all  the  ways  that  are  important,  is  that  much  greater 
at  that  iricom4  level.  ? 

But  I  don'f  understand  the  significance  of  relating  success  on 
tests,  or  success  in  the  Boy  Scouts  or  success  in  any  other  endeavor, 
to  that  income  if  voU  don't  deny  the  fact  that  virtually  all  the 
legislation  we  deal  with  here  recognizes  that  people  from  low- 
income  backgrounds  start  off  and  continue  throughout  life  with  a 
disadvantage  that  has  to  be  made  iip  for  in  some  fashion. 
_JKirtually  all  the  programs  that  we  haye  legislated  since  the 
Elementary  and  Secondary  Act  in  i  1965  have  been  predicated  on 
the  assumption  that  there  is* a  correlation  between.^low-income 
family  background  and  a  need  for  additional  help  in  achievement 
of  some  sort  of  normal  educational  experience  in  this  country. 

Then,- suddenly  after  all  these  years  of  operating  on  that  assump- 
tion, not  only  for  the  purpose  of  designing  programs  but  also  for 
..  ^distributing  most  of  the  money,  you  take  an  entirely  different 
approach  to  that  assumption.  But  now  people  say  we  are  surprised 
that  people  who  come  from  the  higher /income  potions  of  the 
country  score  better  on  tests  and  that  more  of  themt  go  to  ^fes- 
sioiial  schools.  M  /  1 

That  is  not  because  of  the  tests.  It  is/because  x)f  tvie  gcJH^uck 
they  had  picking  their  parents.  /  l 

Dr.  Keller.  The  tests  providd  a  very/  special  case.  As  Congress- 
man Goodling,  I  thinks  brought  up,  one  of  the  important  arguments 
and  to  a  certain  extent  valid  arguments  of  the  testing  services  is 
tiiat  they  have  provided  open  Recess  to  higher  education,  irrespec- 
*  tive  of  income  level  and  even  perhaps  ethnicity.  |V 

But  to  the  extehl  that  those  tests  iare  not  able  to  discover  the 
pNOtential  and  the  aptitude  of  students  who  might  be  handicapped 
simply  because  of  cultural  or  lingui$tic  or  social  class  biases,  to 
thai  extent  it  is  necessary  for  the  tests^to  ISe  forthcoming  with 
respect  to  their  deficiencies  or  inadetjuacies  and  it  is  necessary  for 
'  those  educators  who  are  concerned  vnth  the  .  problem  to  reform 
.  those  test  services  and  those  speci|ic  tests  in  order  to  make  them 
.  better.  - '  .\    ;  . 

'Riat  is  why  I  am  not  surprised  by  the?  correlation  between  in- 
i  Come  level  and  scores  (fc  TOe  SAT.  I  am  not  surprised  by  the 
apparent— because  I  don't  know  the  actual  details,  I  don't  think 
^  the  testing  services  have  been  forthcoming  with  them,  but  thete 
\seem8  to  be  an  apparent  relationship  between  ethnic  origin  •and 
scores  on  the  SAT,  when  you  read  between  the  lines  6f  teible  10  and 
table  1 1  of  California  College  Bound  Seniors,*  1979.  ; 

A^in,  I  am  iu)t  surpri^  by  tlpse  relationshij^sjlb^  I  am  deeply 
and  profoundly^saddened  by  them.  I  think  that  tne\;!Eesting  agencies 
could  do  better  to  provide  a  quality  of  educational  access,  aaid^the 
^suggestions  that  we  make  we  believe  are  practical,  sound,  affirma-f 

tive  action  procedutss,  fair  ones,  easy  to  put  into  practice. 
\     They.  woUld  help  those  tepting  services  correct  for  content  bias, 
bias  in  the  content     modif3ring  the  norming  procedures.  It  is  easy 


to  do,  Why  shouldn't  we  do  It?  Why  shouldn't  we  heljijthe  testing 
services  make  their  argument  more  substantial  that  indeed  they, 
i    are  helping  to  control  for  the  relative  states  of  adyai]|tage  that  can 
.  be  perceived  in  differen^^income  levels  or  ethnic  origins?  • 

Mr.  Ford.  But  you  see,  I  don't  think  anyone  in  this  foom  dis- 
agrees wifh  the  points  that  I  think  you  are  making.  And,  I  think 
.:that  Dr.  Howe  has  agreed  with  you  up  to  that  point.  . 
V    The  question  is  Whether  you  are  going  to  accomplish  that  by 
J  tiying  to  establish  some  sort  of  a  federally  mandated  test  of  what  is 
^\,  or  what  is  not  the  right  .way  to  achieve  that  in  a  System  as  complex 
-^^as  we  have  in  this  country. 

We  visited  China  this  year  with  this  committee  aiw  discovered 
that  they  are  doing  a  very  interesting  thing.  They  were  very  forth-  • 
coming  in  telling  us  that  they  abandoned  testing  in  favor  of  politi- 
cal committees  to  decide  who  was  going  to  attend  their  colleges  and 
.  universities.  » 

Quite  frankly  they  now.  acknowledge  that  they  have  lost  10  years 
of  development  ^t  that  level  and  they  are  desperately  trying  to 
.  reconstruct  their  system.  They  insi^d  that  the  first  consideration 
in  the  future  for  entrance  to  their  totally  publip/system— a  govern- 
mental system— will  be  a  student's  ability  as  measured  by  tests. 

On- flrery  close  questioning,  however,  we  discovered  that  even 
there,  they  are  not  willing  to  be  that  objective.  There  is  gbing  to  be 
an  additional  subjective  test  that  will  be  applied  at  the  recommen- 
dation of  the  student's  hi^  school  or  the  ecfliivalent  of  the  high 
school  with  regard  to  deportment. 

Now  I  suppose  in  a  Communist  country  that  means  whether  you 
are  ^  party  member  or ^  not,  but  in  any  event  they  arje  not  willing  to 
go  the  whole  route.  - 
I  don't  think  there  are  many  institutions  Which  are  basing  ad- 
mission entirely  on  testing.  Biit  I  am  pleased  that  testing  has  a 
greater  influence  on  the  overall  makeup  of  the  student  body  today 
than  it  did  25  years  ago  in  this  country.  Because  then  the  admis- 
sions system  for  colleges  was  an  incestuous,  very  narrowly  based,, 
-  elitist  system.  \ 
My  problem  is:  How  do  we  presen^p  the  progress  that  has  been 
made,  and^  improve  upon  that  progress  without  Imying  the  Federal 
Government  intrude  in  a  way,  as  Dr.  Howe  iras  warned  about, 
wl^ich  will  holfi  back  the  people  who  are  blazing 'the  trail  and 
p^oving.that  you  can  do  things  better.  \  a 

It  is  the  schools  like.  Eastern  Michigan  and  others  aroliid  the 
country  that  have  proven  ^hat  you  qan  develop  ^  gpod  student 
body,  carry  out  all  the  missions  of  that  school,  and  Still  meet  the 
ambitions  that  many  peoj^  have  for  improving  the  lot  of  minor- 
ities and  low-income  pecfple  and  still  maintain  a  school  with  rela- 
tively high,  stanc^ards.  These  are  the  ones  that  should  be  copied. 
I  would  not  even  like  Jo  see  a  State  average  in  our  State,  and  I 
'  don't  think  5tou  would  mther.  Given  the  competition  for  students 
now,  1  suspect  that  if  you  are  warp, and  have  a  tuition  check  in 
' ,  your  hand,  that  tnere  is  a  college  some  place  in  Michigan  which 
^    will  take,  you  no  matter  how  you  sqore  on  the  SAT.  | 

Now,  that  wasn't  true  jxist  a  few  years  ago,  but  today  it  is 
•  virtually  ' that  bad.  Every  tinie  I  go  near  a  high  school,  there  are 


recruiiing  posters.  They  are  advertising  all  over  the  place.  Five 
years  ago  the  shoe  was  on  the  other  foot. , 
During  thiai  period  of  tremendous  pressure  on  institutions  like 
I   Eastern  Michigan,  the  only  way  th6y  could  say  no  to  people  was,  to 
.  become  very  arbitrary  with  testing.  I  think  that  is  v^here  a  lot  of 
the  pressure  developed  which  is  now  being  reflected  in  the  .people 
\  who  are  concerned  with  this  legislation. 

^  I  share  the  concerns  of,  Mr.  Weisd  and  all  the  other#We  have 
just  reviewed  a  very,  very  arbitrary  system  which  had  15  peoptle  for 
(every  iseat  that  was  available  in  a  freshman  class.  You  have  to  find 
some  way  to  ration  those  seats. 

For  example,  many  institutions,  ,  particularly  the.  larger  ones  in 
Michigan,  accepted  you  or  tuiyied  you  down  without  ever  talking  to 
anyone.  Ypu  never  became  more  than  a  punch  card.  The  joke  was 
that  if  the  dean  happened  to  step  on  your  card  on  the  way  to  play 
golf,  you  might  get  in  by  accident. 

But  the -truth  is  that  kij^  were  being  turned  off  in  the;  sixties 
because  there  was  .  a  totally  impersonal  systeni  adopted.  It  was  in 
response  to  the  pressure  of  too  many  consun(iers,  and  not  enough 
available  product.  That  has  completely  cHcmged.  To  now  develop 
responses  predicate  on  the  extraordinarily  wrong  things  that  oc- 
curred during  that  period  of  time  raises  spme  questions  with  me. 

For  example,  I  don't  know  to  what  extent  there  are  people  who 
.'would  not  like  to  eliminate  dependence  on  tests  because  the  stu^ 
dent  mrollm^nt  is  draping  in  some  of  our  small  priVate  schools  in 
Michigan.  There  ,  has  to  be  some  standard  some  place  alon^t^e 
line'  I  don't  know  the  difference  between  how  important  a  test 
result  is  to  get  into  Eastern  Michigan  University  or  the  University 
•  of  Michigan,  as  opposed  to.  Alma  CJoUege  or  Hope  College  pr  some 
other  siiiall  school.  ;  ' 

I.  suspect  everybody  from  Alma  or  Hope  is  interviewed  individ- 
ually, and  a  good  deal  of  subjective  determinations  go  into  admis- 
sions^ There  are  practically  none  at  the  University  of  Michigan.  It 
^^is  much  too  big,  except  in  the  graduate^  $chobl.  I" 

1  don't  really  understand,  after  all  the  years  1  haffe  tried  to 
wrestle  with  this^  what  the  relative  weight*  of  the  SAT  is  at  the 
entry  level  if  ypU  take  ^away- the  problems  of  economic  access  and 
access  by  numbers. 

^aybe  We  are  wrestling  with  pr6bleins  that  are  solving  ^them- 
selves as  we  are  here  wrestlings  with  them. 
Dr.  Howe.  M^  Ford,  can  1  comment  on  that?        ^  ^ 
V  ;  Mr.  Ford.  Yes.  x  ( 

"  Dr. , Howe.  I  think' you  raisejl  some  "very  important  problems.  I 
think  it  is  important  to  recogn^  that  the  type  of  progress  that  has 
been  made  in  Michigan  abput  admitting  more  minorities  to  higher 
education  is  lai*gely  th^ result  of  affirmative  action  effoyte. 

But  different  instit^tioi»"cdnduct  affirmative  action  m  diffeirent 
ways.  Thdt  affirmative  |icti($n*  in  admissions  is  not  require  by 
Federal  law.    #  *    ^     .  *  ^ 

I  think  we  haye  made  some  more  progress  by  the  con^0s£Hohal 
insistence  that  there  be  equaUty  of  educational  opportunity  in  ilie 
^iJnited  States  aiid  by  the  kind  ofiKrovision  of  funds  to  bSick  up  ttiat 
purpolS^^'that  you  nS&itioned  ear^^^     i  -.^  • 


But  for  Congress  to  try  to  start  writing  the  exact  arrangements 
"^how  that  is  going  to  happen  is  another  problem.  .  ^ 

Second,  we  face  a  shifting  situation  in  our  country's  population. 
By  the  year  2000)  the  Spanish-speaking  population  oi  the  United 
States,  perhaps  well  before  that,  is  going  to  be  the  largest  minority 
segmient  by  a  long  shot.  It  ig  growing  more  rapidly  than  any  other. 

We  are  going  to  have  to  adjust  testing  and  a  variety  of  other 
things  in  our  schools,  and  colleges  and  institutions  are  going  to 
have  to  make  major  changes  to  be  fair  to  a  growing  population 
with  a  language  and  indeed  a  culture  that  demands  some  InstiCxi- 
tional  adjustments. 

So,  again,  I  say  that  caljing  those  kinds  of  matters  to  the  atten- 
tion of  educators  i^  very  iniportant,  getting  tl\em  on  the  agenda  for 
consideralHon  and  making  sure  they  stay  there  is  very  important. 
But  I  do  believe  that  |iiWL^o  try  to  particularize  hqjvinstitutions 
should  respond  on  tlw  f^ml^he  National  Government  is  full  of 

To  repeat  what  I  s^kNIi^^  think4t  opens  the  door  in  legisla- 
tion- which  does  not  reqw^Kinstitutions  to  do  anything,  as  Mr. 
Weiss  quite  proper^  Say^Tt  opens  the  door  thrgugh  which  all 
kinds  'of  other  changes  in  education  are  then  likely  fo  be  coming 
before  the  Congress,  before  the  Congreiss  for  more  detailed  legisla- 
tion, and  tp  me  that  is  unwise. 

You  said,  Mr.  Ford,  that  you  had  iregarded  me  in  earlier  years  as 
an  advocate  of  Federal  intrusion  ipto  education  and  that  Aow  you 
t%ught  I  had  changed  my  stripes.  - 

Br.  Howe.  I  call  your  attention  to  the  fact  that  I  testified  vigor- 
ously against  Mr.  Powell's  effgft  to  get  into  the  curriculum.  I  will 
do  sST  again  if  it  comes  up. ' 

I  think  that  that  kind  of  issue,  while  not^rectly  raised  here,  is 
indirectly  raised  here,  and  that  is  why  I  inctuded  that  matter  in 
my  testimony, 

Chairman  Perkins.  Mr.  Buchanan,  any  questions? 

Mr,  Buchanan.  Thank  you;  no,  Mr.  Chairman. 

I  will  read  very  carefully  that  testimony  which  I  missed. 

Chairman  Perkins.  Mr.  Peyser,  any  questions? 

Mr.  Peyser.  No;  Mr.  Chairman. 

I  also  arrived  late,  and  will  reserve  any  questions  until  a  later 
time; 

.  Mr.  Weiss.  Dr.  Howe,  I  don't  know  how  you  stand  on  the  cre- 
ation of  the  new  Department  of  Education.  I  opposed  it  very  ^trong- 
>^-4jkjexactly  for  the  reasons  that  you  have  expressed  about  concern 
for  Federal  intrusion  into  education.  I  it||ke  second  place  to  no  one 
on  that.  \ 
ETr.  Howe.  I  waffled  pn  it.  '  \  , 

Mr.  Weiss.  I  m^ke  ilo  comment  on  that.  ^ 
Chairman  Perkins.  All  right.  \ 
Thank  ji^ou,  gentlemen,  very  much.       *      -  I 
* '    Dr.  Keleer.  May  I  just  address  myself  very  briefly  p  the  Jast 
questions  that  Congressman  Ford  brought  up? 

Chairman  Perki;^s.  Go  ahe^d,  hut  letjs  make  it  brief.  We  have  a 
lot  of  witnesses  here.    , .  . ,  '  .       ■  ■ 

/Dr.  Keller.  Pthink  that  the  question,  that  you  are  asking  Isf  why 
should  the  Federal  Qoverriftient  intervene  in  this  situation^ 


My*bolleague,  J)r.  iHowe,  has.  agreed  with  me  thact'themis  a 
climate,  per]|^I^F^  Gritical  one^  of  puWc  mistrust  with  respec||to 
the  listing  seryi(^ea  is  exceedingly 

Ipng.  Given  thai|cliliate  in  the  spirit  of  a  thorough  going  |*eform  of 
the  services,  not  on|jr  does  CJongress  and  the  Federal  Government 
hav#  the  right  to  inte^ene  but  it  would  be  wise  to  do  so  in  order  to. 
£[hore  up  those  important  services  that  the  tepting^  agencies  give  to 
;us;  V.     ■    ■      .  ■  ^'  ■   ■  ;  ■ 

iln  addition,  you  observod  with  respect  to  my  suggestions  that 
raentifiable  linguistic  and  cultural  groups  be  normeo^  differently, 
^u  made  the  following  observation,  that  you  agreed  with  it^  I 
I  faplieve,  and  you  thought  everyone  else  in  this  room  probably 
agreed  with  it/ 

I  am  gratified  by  that  comment,  and  I  sincerely  hope  tliat  is  true. 

However,  I  iEim  not  sure,  and  my  reading  of  the  situation  at  this 
point  is  that  the  testing  serVicbs  make  the  argument  that  the 
scores  can  be  reported 'out  as  if  there  were  only  one  distribution  of 
scores  irrespective  of  income,  sex,  linguistic  and  cultural  pl^am- 
eters,  even  though  in  point  of  fact,  as  Congressman  Weiss  has 
mentioned,  they  actually  separate  |;he  distribution  with  respect  to 
sex.*  •■■   •  ^ 

Our  contention  is  they  should  follow  that  precedent  and  separate 
out  the  scores  and  ndrtn  separately  those  students  of  identifiable 
linguistic  minority  back^ounds«  . 

Mr.  Ford.. I  have  to  disagree  with  you  only  to  that  extent.  1  afree 
with  your  general  pro|)Osition>  and '^continue'' to  agree '  with  the^ 
general  proposition,  but  when  you  get  to  the  specifics,  you  get  to 
the  problem  of  dealing  with  national  standards. 

When  you  are  trying  to  predict  the  likelihood  of  success  in  law 
school  where  the  entire  program  is  in  English,  and  where  the  basic 
testing  system  in -most  of  the  law  schools  is  by  essay  questions 
which  depend  very,  very  strongly  on  your  ability  to  communicate 
well  in  the  English  language,  I  cannot  conceive  of  why  ^^ou  should 
test  somebody  in  a  language  other  than  ^glish.  This  is  question- 
tablet  especially  when  it's  clear  that  it  is  not  general  intelligence 
I  here  that  you  are  testing  for.    *        v  ^  x 
r    It  is  the  probsibility  of  being^able  to  respond  to  that  course  of 
Study  no,  matter  how  arbitrary  it  ma»  seem.  I  use  Puerto  Rko,  for 
example,  whfere  we  disoovered  that  children  who  ga  througH  their 
'^entire  educational  experience,  then  reach  health  profeissions  educa- 
tion and  must  switch.to  all-English  smdy  material^   >  * 

The  expl^uiation,  given  to  me  was  th^tthere  aren't  Spanish  text- 
books or  teaching  materiais,  nor  arie  ihCre  trained  persbixnel  to 
teach  in  Spanish.  So  they  have  to  make  a  total  transformation  by 
lan^age.  Thus,  in  Pu6rtq|RiW  it  would  make  sense  to  give  the 
test  in  either  English  m  Spanish,  v 

It  woulci  Qot  make  ipnse,  'it  seems  to  me,  to  test  for  adini§sion  to 
'  a  professional  school  in  another,  ilangviage  where  the  language  wias 
goiing  to  be'  in  fJnglish.         i  . 

It's  apparent  to  me  thtft,  if  you  haV(^  a  system,  you  don^t  do^ 
anything  to  chai^ge  the  systetft,  you  ao  something  about  how  some- 
body^ penetrateilxtne  system.  •  .       .  .        .  • 

You  have  tWo  standards  aboift  m)w  you  get  into  a  professional 
school^  and  two  stanaards  ab^t  how  you  progress  in  the  profes- 
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sional  school,  and  then  you  ultimately  meet  a  blind  test  called  me 
bar  examination.    ^  !       \  *  / 

One  groui*  is^  not  going  to  do  as  well  as  the  other.  It  has  not)iing  . 
to  do  with  their  intelligen'Ce  But  I  predict  to  you  that  if  we  Start 
reporting  test  r6sjilts,' SAT,  LSAT's  and  £he  rest  orrtne  basis  of 
race  and  ethnicity  »all  over  this  country,  wev  will  have  kookySgrofes- 
sors  all  over  thi^  country  saying,  told  you  so;  these  yeoplte  are 
inherently  inferior."  \  '  ,  .  ' 

If  you  wiirit  to  push  civil  rights  a  generation  back,  you  ^staSrt 
publishing  Government-accepted  national  figures  showing  that  cer- 
tain groups  score  lower  than  others.  For  every  intellectual  who' will 
grasp  thiat  as  proof  of  the  fact  we  have  to  improve  the  opportuni- 
ties for  those  people,  there  will  be  10  people  listening  and  say  that 
is  proof  of  the  fact  that  these  people  are  inferior. 

It  sort  of  surprises  me  that  some  of  my  friends  over  the  years 
who  typicaUy  have  been  concerned  with  civil  rights  don't  see  tnat 
as  a  threat. They  apparently  are  not  listening  to  the  winds  that  are^ 
blowing  across  this  country.  Hate  is  just  under  the  surface;  but  it's 
never  been  so  willing  tp  bubble  out  and  slap  back  at  the  people  we 
have  been  tidying  to  help  in  this  country  as  it  is  now;  and  I  see  in 
that  kind  of  approach  a  threat  that  perhaps*  people  in  Washington 
don't  hear. 

Maybe  Michigan  is  a  little  different  than  others. 

Dr.  Keller.  We  entirely  agree  witli  you  with  respect  to  the 
language  in  which  the  tests  should  be  written  for  mainland  United 
States.  It  should  be  English;  We  are  not  saying  that  there  should 
be  separate  tests  created  in  .Spanish  for  the*  mainland  United 
Statefe.  ^ 

The  example  that  we  use*  of  Puerto  ^Rico  is  with  respect  to 
necespait/  research  that  has  to  be  done  to*^etermine  how  much  o? 
the  tests  are  really  measuring  language  and  culture  rather  than 
the  purported  aptitude  such  as  law. 

Howevor,  it  was  shown  by  Professor  Hoffman  that  the  tests  are* 
created  in  a  written  and  artifical  language  with  misleading  inap- 
propriate ambiguities,  and  we  suspect  that  fluent  English  speaking 
Hispanic  Americans  might  be  prejudiceid  more  than  other  popula- 
tions within  the  United  Stat®  by  such  nkificial  language. 

That  is  one  of  the  reasons  why  we  ask  for  separate  norming. 
There  are  plenty  of  people  at  this  time.  Congressman ''Ford,  who 
claim  that  women  are  inferior  or  blacks  are  inferior  or  Hispanics 
are  inferior.  At  the  sariie  time  the  precedent  has  already  been 
established,  women  and  men  are  reported  out  from  those  tests 
differently;  different  percentile  are  reported  out. 

We  don't  .think  that  any  more  koolly  professors  than  thpse  who 
already  exist  have  or  will  jump  on  that  fact  with  respect  to  women; 
and  we  don't  think  that  they  will  juitip  on  that  fact  with  respect  to 
identifiable  linguistic  and  cultural  minorities. 

'  ^  But  one  thing  that  could  happeh  is  a  net  increase  qf  students 
entirely  capable  to  enter  .college  and  professional  schools  but  who 
have  been  turned  back  simply  because  to  some  exten|  the  tests 

,  have  been  measuring  the  linguistic  parameters  and  that\ distortion 
could  easily  be  looked  at  by  separating  the  linguistic  minority 
pqpulation  from  the  nriainatream  population  in  norming  separatejiy. 


\f  ■. 

^lITe  think  it  would  be  a  good  way  to  implement  the  equal  access 
Rbilosophy  of  U.S.  educalion  and  the  equaj  opportunity  clause  of 
tKe  1964  Civil  Rights  Act. 

Mr.  Ford.  We  are  still  hot'  In  disagreement.  How  vi^uld  you  like 
to  be  |trying  to  get  at  the  root  of  the  problem  of  someone  whose 
basic  language  is  not  English  and.  who  is  not  doing  as  well  at  your 
institXitiori,  and  then  be  confronted  with  somebody,  with  a  list  of 
statistics  prepared  by  a  Federal  bureaucrat  that  proves  that  the 
group  that  you  ^  are  dealing  with  can  «t  score*  anyhow,  who,  for 
whatever  other  reason,  does  not  want  to  see  you  make  progress  in^ 
.  that|  area. 

That  i^  what  the  problem  is.  It's  not  the  problem  with  the 
inadequacy  of  the  institution  but  the  inadequacy  of  ii  category  of 
people.  They  are  going  to  have  a  Federal  stamp  of  approval  on  the 
phoney  figured  they  throw  around,  They  c^n't  prove  the  assertion 
they  are  piaking^  and  that  is  the  only  defense  you  got  against  those 
people.  .     t  '  ■  . 

You  said  &  little  while  ago  that  you  had  confidence  that  ihe  very 
fact  the  Federal  Government  would  certify  these  tests  to  be  fair 
would  instill  confidence  in  the  public. 

I  am  afrAid  that  that  is  not  an  advantage,  We  don't  know  wheth- 
er this  Federal  agency  would  make  tjie  test  fair,  but  they  would* 
appear  to  be  fait  because  the  Fedieral  Government  said  they  were. 

At  that  point,  if  you  were  stuck  with  that  test,  you  wouldjreally 
-be  stuck,  because  then  you  get  Uncle  *Sam  putting  on  his  "Good 
Housekeeping"  seal,  which  has  been  put  on  bad  information,  be- 
cause I  don't,  trust  the  Federal  Government  to  be  able  to  do  any 
be^r  than  we  are  doing  on  an  ad  hoc,  State-by-State  or  institu-' 
.  .tlqn-bjr-institution  basis  now.  .  , 

If  *they  do  a  lousy  job,  and  if  they  do  what  you  suggest  is  true, 
people  believe  that  the  Federal  Government  certiifies  that  teats  are 
fair,  they  will  then  have  undue  confidence  in  the  fairness  6f  those 
^^test^;  and  you  will  never  make  any  progress  /beyond  that  point. 
^  Somebodyrover  here  who  doesn't  know  what  he-  or  she  is  doing 
says  something  As  good,  and  because  the  Federal  Government  has 
tested  it,  they  belieye  it  is  OK.  We  have  this.problem  in  accredita- 
tion now.  We  have  a  big  argument  going  on  whether  the  Office  of 
jpoucation  ought  to  be  accrediting  accrediting  agencies.  ' 

The  Office  of  Education  says  th|Hfec£  is  that  they  accredit  any- 
"Body^whcu-appJIes  to  becoipe  an  accrediting  agency.  The  result  that 
produces  is  that  pe6pte"^re-4e<itoJb^eUe^^  because  the  Office  of 
Educa^ioix  said  this  is  ^n  accr^ited  accredittng-agencjL  that^there- 
fore,  it  \h  fact,  meets  the  retirements  that  people  would  ejqmctr- 
^and  then>  displfijjwthat  orf  th|[r  literature  jpnd  advertise  Tor  stu- 
dents, tnA  the  slidents  go  to  ma^schbol  thinking  in  B/mie  Way  the 
U|g.  Office  of  Education  knows  whether  or  not  that  is  a  -godcL 
school.  •  \  • 

Mr.  Buchanan  and  I  have  been  wrestling  with  that  for  months 
aiid  have  all  kinds  of  pplitical  pressures  coming  at  us,  hut  we  can't 
get  anybody  to  suggest  >yhat  the  solution  isi  7  / 

We  wouldn't  haVe  a  problein  if  we  didn't  have^  people  believing 
that  the  Federal  Government  y/as  doing  something  to  protect  them 
that  it  does  not  do. «  >  \  . 


We  have  so  many  examples  of  well-meaning  f^ederal  attempts  to  . 
protect  the. consumer  that  in  fact  have  k  reverse  effect.  People 
believe  that  ever  since  we  have  had  the  Federal  Deposit  Insurance 
Corporation  that  they  can  trust  the  banker  to  take  car6  of  their 
money,  and  they  never  have  to  worry. 

Iffhat  has  never  been  true,  but  the  purpose  of  that  legislation  has 
been  fullilled  by  rebuilding  in  this  country  after  the  Great  Depres- 
sion confidence  in  the  banks  but  that  confidence  is  now  misplaced 
by  an  bverconfidence  because  the  ordinary  citizen  doesn't  take  the 
time  to  find  out  what  the  Federal  Government  is  really  guarantee- 
ing you  against,  and  many  people  are  far  beyond  the  scope  of  any 
help  from  a  Federal  Government  when  they»are  in  a  bank  that 
may  have  50  percent  of  its  folio  in  New  York  bonds,  and  they  are  in 
iJlichigan. 

The  people  didn't  run  on  the  bank  because  they  believed  that 
Uncle  Sam  would  protect  them;  ahd  too  many  times  we  hold  out 
from  Washington  a  suggestion  that  we  are  doing  something  that 
will  protect  you  and  so  people  don't  watch  out  for  themselves.  They 
don't  listen  to  groups  who  try  to  tell  them,  look,  you  can't  trust 
Uncle  Sam  tq  look  out  for  your  interests,  and  you  have  to  trust  us, 
because  we  are  more  interested.  /  ^- 

This  is  where  I  have  the  conciern.  T  am  not  really  concerned 
about  the  kind  of  amendment  you  are  talking  about  and  the  specif- 
ics of  what  is  or  is  not  the  real  probleny  at  this  point.  I  just  can't 
understand  how  the  Fesjleral  Government  is  going  to  improve  it. 

Dr.  Keller.  I  don't  think  that  the  Federal  Government  could 
possibly  certify  the  fairness  jof  tests,  but  it  can,  and  I  think  should, 
take  strong  affirmative  actions  to  get  the  test  services  to  be  more 
forthcoming  in  disclosing  information  periodically  on  a  timely 
ba^is,  showing  what  md  how  they  are  addressing  themselves  to  the 
problems  of  content ^liit,  as  I  say,  that  reflects  negatively  oh  liit 
guistic  minorities  and  certainly  I  think  it  is  in  order  for  the  FederJ* 
al  Government  jto  require  a  different  norming  process  for  su6h 
li^inorities. 

That  will  not  certify  that  fairness  of  the  test,  and  the  Govern- 
ment* would  never '\yant  to  do  that, .  because  tests  Can  always  be 
improved.  MQasurementJvill  alwaifs  be  imperTect  to  some  degree 
and  improvement  will  always  be  in  order.  HoweVer,  vou  can  make 
an  extremely  timely  contribution  to  Amerkan  education  at  this 
time  which  is  suffering  from  a  climate,  of  public  mistrust. 

Pongressmah  Ford,  I  v/ihh  to  thank  you  very  much  for  your  kind 
remarks  with  respect  to  the  activities  over  the  last  15  years  that 
we  have  been  undertaking  at  Eastern  Michigan  University. 

Dr.  Howe.  Could  I  just  say,  Mr.  Ford,  that  I  share  your  dilemma 
about  the  business  of  accrediting  institutions.  I  remember  when  I 
was  Commissioner,  I  came  up  against  the.  schools  of  mortuary  and 
embalming,  and  I  didn't  know  how  to  advise  the  Congress  on  the 
subject  of  how  these  institutions  should  be  propejrly  handled.  I 
concluded  it  wasn't  6  good  field  for  the  Commissioneryto  be  in,  or 
theXlongress,  and  that  is  the  way  I  feel  about  this-fiii^ject  here.' 

I  would  have  many  worries  about  the  testing  services  themselves 
Igoing  into  reporting  their  data  strictly  on  ethnic  grounds  or  ethnic 
classifications.  But  for  the  Congress  to  say  that  that  is  what  they* 
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,  shduld  do  and  should  horm  their  tests  in  those  terms,  it  just  seems 
to  nie  extremely  unwise.  / 
:  I  come^bi^ck  to  my  suggestion  about  an  in-depth  national  look  in 
an  effort  to  build  confidence  anfl  develop  information  on  this  sub- 
.  jectVThis  kind  of  suggestion  thalf  my  colleague  has  made  could  well 
b6  examined  in  that  context  and  examined  without  the  weight  of 
national  authority  behindiit.  The  national  and  international  impli- 
cations of  this  Governmem;  legiiftatiog  that  the  testing  information 
about  youngsters  in  school  shallf  be  collected  on  an  ethnic  basis  just 
see^s  to  me  worth  thinking  iibout  a  long  time  before  you  put 
anything  like  that  into  legislation. 
Mr.  Buchanan.  Will  the  gentleman  yield?  .  \ 

Dr.  .E[owe,  I  would  appreciate  your  elucidating  a  little,  if  you 
would,  on  your  proposal  for  a  coplmissioii.  We  had  a  witness  yester- 
day who  recommended  that,  in  lieu  of  legislating  in  this  field,  we 
use  our  leverage,  with  perhaps— with  the  club  of  legislation  in  the 
background.  However,  it  does  seem  to  me  that  getting  at  the  truth 
is  what  the  author  of  the  Weiss  bill  has,  at  least  partially^  in  mind. 
I  wonder  if  you  would  elucidate  a  little. 

Dr.  Howe.  It  does  seem  to  me,  as  a  generalization,  when  we  face 
very  complex' and  difficult  national  issues,  that  we  frequently  re- 
sort to  this  device  and  other  countries  do.  , 

The  Royal  Commissions  in  the  United  Kingdom  are  for  this  kind 
of  purpose.  They  are  frequently  used  in  the  field.  They  are  fre- 
quently used  in  the  field  of  education^  We  have  not  used  them  in 
_  exactly  the  same  way  here  in  education,  but  we  have  had  some 
Significant  commissions,  and  we  have  got  one  working  now  on 
.international  studies  appointed  by  the  President  and  I  think  it  will 
provide  .some  useful  suggestioii9,-  some  of  which  may  result  in  legis- 
vlation.        .  •  yv'V^ 

But  it' seems  to  me  that  fif^&fv/e  have  a  highly  technical  area 
loaded  with  frustrations  for  ^^^ious  institutions.  On  the  one  hand, 
and  for  various' groups  on  the'bther,  that  the  legislative  process  is 
^probably  wise  to  allow  itself  to  be  insulated  from  action  by  that 
kind  oil  commission.  1 

I  do  think  that  maiiy  of  the  serious  difficulties  that  many  people 
see  in  ihis  area  can.  receive  longer  term,  more  thoughtful,  more 
analytical  attention,  and  can  b6  ventilated  over  a  period  of  time.  It 
may  be  that  Such  a  group  ^yould  recommend  legislation.  I  would 
doubt  it,  however.     .  *  f 

I  think  that  as  a  basic  proposition,  really  indepth  legislation  in 
this  field  does  change  the  balance  of  the  Federal,  State,  and  local 
roles  and  institutional  roles  in  education,  and  that  is  why,  without 
baling  any  negative  comment  to  make  at  all  about  the  evident 
issues  of  unfigtirness  that  have  been  called  to  your  attention  that 
there  be  by  other  witnesses,  I  do  worry  about  rushing  into  this 
field. 

.  Mr.  Buchanan.  Thank  you. 

Chairman  Perkins.  Let  me  compliment  the  panel  You  have 
been  most  helpful  to  the  committee  and  we  appreciatep^our  ^p6ar- 
ance  hfere  this  morning.  / 

Dr.  Howe,  we  will  see  you  baclt  here  (again.  We  apprecijite  your 
.   being  back  here  and  we  will  see  all  of  you  again.  Good  luct  to  you. 

■     •  •      ■-,  ■  ,  :    •  , 

ERIC  :h 


852     y  V 

Now  we  will^a^  the  panel  to  cpiiie  around  h^detf  By  Mr.  Albert 
Shanker,  president^  AmericarKrederation  ot  Teachers,  who  has 
been  before  the  coriimittee/riiany  times;  Dr,  George  Jacksoi^  Na- 
tiohal  Association  of  Blg^cik' Psychologi^  D,  Kay  Clawson, 
dean,  College  of  Medicine;  University  pf  Kentucky;  Mr.  David  Gast- 
iFriend,  chairman,  medic^(l  education/committee,  American  Medical 
Students  Association;  dnd  Dr.  .Eloyd  Bond,  research  associate, 
learning  research  tand  'devel^fment  center.  University  of  Pitts- 
burgh. 

Also,  Mr.  Kenneth  Drex^ler,  president  of  the  student  govern- 
ment. North  Senior  High  School,  Great  Neck,  N.Y.;  Dr,  Clark  R. 
Cahow,  associate  professor,  hMory  and  assistant  provost,  Duke 
University,  consortium  on  fiirahcing  higher  education;  and  Mr, 
William  Geer,  Jr.,  principal,  Frances  W.  Parker  School,  Chicago, 

Our  first  witness  this  mornmg  is  Mr.  Shanker;  Lret  me  Welcome 
ypu  here  again,  and  you  have  been  with  the  cornmittee  many 
times.  ^  '  J 

I  have  got  to  be  out  for  just  a  few  momehts  in  the  back  room,  but 
you  may  starj;  now.  Ypu  have  many  other  members  here. 

Excuse  n^e,  we  have  got  a  colleague  from  your  State  that  wants 
to  introduce  you,  and  that  is  Mr.  Peyser,  who  is  one  of  our  most 
outstanding  members. 

Mr.  Peyser,  you  go  ahead.  ■'       ■  \ 

Mr.  Peyser.  Thank  you  very  much. 

As  we  welcome  the  entire  panel,  I  particularly  want  to  welcome 
you,  Mr.  Shanker  for  the  years  that  you  have  been  working  with 
this  committee  and  the  committees  on  education.  I  think  the  testi- 
mony on  this  issue — an  issue  that  is  really  developing  nriore  and 
.more  awareness— is  pointing  out  what  this  legislation  is  involved 
with  and  what  is  happening  in  New  York  State. 

We  will  be  most  anxious  to  hear  what  you  have  to  say.  If  you 
would  start  at  this  point,  we  will  be  delighted  to  hear  you  first  and 
then  question  you.  ^' 

I  will  be  glad  to  yi^ld^to  the  gentleman  from  Michigan.  * 

Mr.  Ford.  I  ask  for  this  time  to  apologize  to  th|p-pane|.  I  have  an 
11  a.m.  commitmeiit  in  line  with  my  responsibiliues  as  chairman  of 
the  Subcommittee  on  Postsecondary  Educatiop,  and  I  am  leaving 
someone  here  to  catch  the  highlights  which  are  set^-fortm.  I  hope 
that  I  will  be  able  to  direct  som^  questions  Ito  you  lat^r  in  the 
hearing.  ^     /     /  ' 

Mr.  Peyser.  Thank  you. 

Mr.  Shanker?  r   -  1 

[Prepared  statement  of  Albert  Shanker  follows:]  ^ 


i       RRBf  ABED  S^TEMENT  OF  ALBERT  ShANKER,  PRESIDENT,  AMERICAN  FEDERATION  OF 

^  '  Teachers,  AFL-CIO  - 

V  I  am  Albert  Shanker,  President  of  the  American  Federation  of  Teachers,  AFL- 
CIO.  I  am  here  today  representing  over  520,000  teachecs,  paraprofjessionals  and  . 
liealth  c^re  workers  who. have,  a  profound  interest  in  the  future  role  of  both^ 
-  aptitude  and  agJiieVemeni  tests  in  our  society.  Our  members  have  an  interest  in  the 
proper  use  of  qtiality^t^sts  not  only  because  of  their  effect  on  the  futures  of  children 
they,  teach,  but  also  because  of  their  use  in  partially  regulating  entry  into  the 
teaching  and  health  professions.  '  ' 

I  believe  that  there  are  two  sinyple  questions  that  must  be  asked  and  answered  in 
considering  the  merits  of  the  two  testing  bills  you  have  before  you,  ^.R.  3564  ^nd 
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H.R.  4949.  The  firstyi^  wttat  are  the  pressures  and  problems  they  attempt  to. 
address?  The^second/s^  do  they  provide  an  appropriate  response? 

These  arepiot  sample  questions.  Certaiply  I  do  nbt  have  all  the  answers.  Propo- 
neifita  of  this  type  of  legislation  don't  either.  Only  Monday  Xhe  New  York  Times 
repbrted  that ^J^w  York  ^tate  senator  Kenneth  P.  La Va lie,  y/ho  marshalled  similar 
legislation  tJ*rough  the  New  York  State  Legislature,  was  co/isidering  recom'meijding 
changes  i;r;1t  because  of  unforeseen  problems  that  had  arisen  sihce  that  bill  became, 
law  in ytfly  1979.  I  noW  believe  that  the  haate'with  which  the  legislation  was  passed 
in  Yoi»k  was  a  mistake,  even  though  the  APf  affiliate  there  supported  it.  I 
"-'^  this  corttmittee  to.  carefully  consider  all  the  ^iijrlplications  of  the  legislatiop 
e  you,  since  any  mistakes  that  are  made  will  affect  the  extremely  delicate 
business  of  measuring  educational  achievement  throughout  the  nation. 

Let  me  point  out  that  I  find  some  of  the  consumer-interest  concerns  reflected  by 
some  supporters  of  this  legislation  very  understandable.  Much  of  the  press  reporting  / 
on  education  would  have  us  overemphasize  tbe^se  of  tests  in  making  key  decisions 
•  without  fully  considering  their  limits.  The  American  Federation  .of  Teachers  has 

stated  its  opposition  to  this  practice,  as  have  some  members  of  this  committee.  But .    4  • 
'  our  Executive  Council  will  shortly  reconsider. the  specifics  of  positions  we  have 
taken  in  the  light  of  what  has  already  happened  in  New  York  State  and  with  a 
clearer  view  of  the  possible  consequences/of  similar  legislation.  ' 

The  basic  purpose  behind  the  developfnent  .of  objective  aptitude  and  achievement 
tests  was  to  provide  us  with  an  objective ^fidard  of  quality,  that  coi^ld  be. used  in. 
conjunction  with  various  subjectiv^ measures  like  student  grades  and  personal 
interviews,  in  making  decisions  aljdut  acjinissions  to  various  postsecondary  under- 
IH'^duate  airid  graduate  programs. /An  o^ective  test  like  the  SAT,  for  example,  cian  . 
just  as  wi^ll  be  used  to  "discoy6r"  the  bright  student  who  has  done  poorly  by 
subjectivePgrade  standards  ^s  to  raise  questions  about  the  possibly  inflated  subjec- 
tive reports  oti  a  grade-A  stucjent.  There  is  every  indication  that  the  public  qontin> 
ues  to  want  bbiective  and  comparative  test  standards.  The  con  tin  uiog>  support  for 
elerAentary  and  secondaiy^inimum  competency  test^  .at  the  state  and  local  level 
are  clear  evidence  of  thid/The  push  for  this  bill  must  be,bat6nced  by  taking  these  • 
sentiments  into  account./ 

Today  th^  issue  of  te^  is  being  considered  in  two,  highly  polarized  ways.  On  the 
one  hand  is  the  contmuing  push  to  weigh  test  scores  more  and  more  heavily  even 
further  in  decisions  /elatea  to  grade  promotion,  high  school  graduation  and  postsec- 
ondary  school  admissions?  On  the-  other  is  the  attack  being  waged  against  tests  by 
those  who  cannot/bear  to  face  the  implications  of  what  their  results  tell  us.  Neither 
extrehie  positioyserves  us  well.  Scfme  testing  advocates,  failing  to  consider  the  real 
limits  of  test  /ise,,  are  too  willing  to  rely  on  test  information  alone  in  making  . 
educational  decisions.  Test  detractot^  on  the  other  hand,  readily  dismiss  the  value 
of  all  comparative  test  information,  and  along,  with  this  the  importance  Of  what 
tests  expo^  about  unequal  educational  Opportunity.  I  would  hope  that  in.consider- 
ing  these*  bills,  the  members  of  this  committee  will  take  care  that  the  legislation 
they  rejjommend  does  not  have  tfife  effect  of  sidipg  with  either  extreme.  My  fear  is 
that  iy^will  seriously  iYnpede  our  ability  to  test  and  to  use  test  information  well. 
^  Le^.  me  discuss  these  pressures  in  relation  to  the  effects  of  what  I  b^elieve  to  be  the 
mMt  controversial  provision  of  either  bill.  Section  5  of  H.R.  4949,  which  requires 
te^  publishers  to  provide  test  takers  with  the  test  and  their  corrected  answer 
aneets.  Advocates  ot  suc^i  a  measure  assume  two  things— first,  that  faulty  test  items 
/will  be  exposed  and  open  to  criticism  by  students  and  others;  and  second,  that  the  . 
studeht  will  benefit  from  seeing  where  he  was  wrong!  I  believe  that  the  first  of 
these  intentions  is  what  mpVes  supporters  of  this  bill  the  most  and  that  its  potential 
efTect^must  be  exaimined  Very  carefully. 

Cofistant  standards 

What  will  the  effects  of  this  exposure  be  on  tests,  when  the  obvious  purpose  is  to 
♦  subject  each  item  to  rigorous  scrutiny  and  at  the  same  nme  make  it  dmicult  to  use 
that  item  again?  While  it. must  be  acknowledged  that  tests,  and  the  individual  items  ' 
in  them  are  sometimes  Oawed,  I  believe  that  the[ potential  negative  consequences  of 
.  politicizing  test  scrutiny,  accompanied  bj^the  re&aking  of  tests,  . far  outweigh  what-  . 
ever  benefits  may  derive  from  these  processes.  Let  me  explain  why.  ^    •  * 

The  most  basic  benefit  from  good  educational' tests,  consistently  applied  over  long 
\  periods  of  time,  is  that  they  provide  us  with  the  only  constant  standards  We  have  ^ 
\  over  time  for  assessing  educational  progress  and  achievement.  Constant  standards  ^ 
▼are  .essential  because  without  them,  we  cannot  be  certain  whethor  children, are 
l^arnihg  more  or  less  than  they  did  io  previous  year%  and  we  .  Cannot  be  certain 
wHIther  some  methods  of  helping  children  learn  are  more  effective,  than  others.  * 
.  "  These  are  vitisil  social  facts:  educators,  legislator!^,  and  other  policy  makers  must 
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have  them  to  do  their  jobs  properly;  parents,  children  and^axpayers  in  general  also 
need  them  and  have  a  right  t6  them  «s  citizens  and  as  consihiiiGrs. 

That  right  is  threatened  by  the  provision  for  the  blanket  d^losure  of  test  ques- 
tions. Good  ilitentions  notwithstanding,  such  provisions  are  dan^rous  because  they 
severely  undercut  the  key  method  used  to  maintain  constant  stanMrds.  This  meth- 
od is  known  as  equating  and  it  involves  including  samples  of  previously  used  test 
questions  on  each  new  versioi?  of  a  test  to  make  sure  thai  each  new  edition  of  the 
test  is  no  easier  or  no  harder  than  the  old  ones.  Differefrit  tests  require  different 
methods  of  equating  and  the  restrictive  provisions  of  these  laws  may  make  constant 
equating  difficult  if  not  impossible  for  some  tests.  This  is  a  veryf^erious  matter.  Any 
insistence  on  the  disclosure  of  all  or  more  test  questions  after  each  test  administra- 
tion necessarily  and  inevitably  jeopardizes  test  constancy  and  the  essential  educa- 
tional truths  it  peripits  us  to  see. 

We  are  aware  that  some  test-producers  have  prpmised  to  try  to  maintain  test 
constancy  in  spite  of  these  blanket  disclosure  requirements,  but  we  find  these  vague 
promises  totally'  unsatisfactory.  We  would  also  question  their  ^bility  to  produce  an 
endless  series  of  quality  tests  with  all.  new  questions  in  every  single  edition.  We 
doubt  that  the  testing  agencies  can  or  will  maintain  test  constancy  given  the  factual 
circumstances  confronting  them. 

Quality  tests 

There  is  another  consideration  that  must  be  raised  here,  the  issue  of  quality.  Once 
the  process  of  teat  development  is  speeded  up,  and  at  the  same  time  each  test  is 
subject  to  the  rigorous  scrutiny  of  test  critics,  I. believe  that  the  quality  level  of  the 
tests  will  also  be  subject  to  dangerous  fluctuation.  Some  will  argue  that  particular 
items  are  inappropriate  for. a  given  region  of  the  eountry,  or  a  particular  sex  group, 
or  a  particular  ethnic  group,  or  for  people  who  li^e  in  rural  areas,  ad  infinitum.  I 
believe  that  particularist  groups  will  argue  for  items  peculiar  to  their  own  experi- 
ence or  orientation  and  this  will  have  the  effect  of  erroding  a  common  quality 
standard.  '  ^ 

Too  much  Federal  control 

This  legislation's  potential  effect  on  test  quality  and  constant  standards  are  the 
most  compelling  arguments  against  it,  but  there  are  others  well  worth  noting.  Why 
should  the  requirements  it  outlines  be  a  matter  for  the  federal  government?  Do  \ve 
reafly  want  the  federal  government  to  determine  that  '*no  educational  or  occupa- 
tional admissions  test  which  tests  knowledge  or  achievement  (rather  than  aptitude), 
shaft  be  graded  (for  purposes  of  determining  the  score  required  to  pass  the  test  fot| 
admission)  on  the  basis  of  the  relative  distribution  of  scores  otbther  tests  subjects.' 
(H.R.  3564)?^  Do  we  really  want  the  federal  government  defining  admissions  stand- 
ards in  such  detail?  Besides,  what  is  wrong  with  evaluating  comparative  perform- 
ance, and  selecting  the  most  competitive  candidates?  ^ 

I  have  predicted  that  the  creation  of  a  new  and  separate  bureaucracy  for  educa- 
tion at  the*  federal  level  will  bring  increased  federal  intrusion  into  educational 
matters  that  are  more  appropriately  decided  by  individual  statis,  school  districts 
and  universities.  I  cannot  help  noticing  that/ many  supporters  of  this  intrusive 
legislation  are  also  among  those  who  Advocated  that  separate  Department  of  Educa- 
tion, and  who  are  waging  a  campaign  against  testing.. 

I  opposed  the  creation  of  a  national  test  when  it  was  proposed  by  Admiral  Hyman 
Rickover  two  years  ago.  and  I  oppose  federal  government  regulation  of  tesft  today 
for  many  of  the  same  reasons.  The  reports  required  of  test  publishers  and  of  the 
Commissioner  of  Education  by  this  legislation  iactually  amount  to  a  series  of  federal- 
ly mandated  conclusions  about  the  effects  of  the  tests  given.  These  requirements  are 
Virtually  designed  to  produce  conclusions  that  will  amoUnt  to  national  verdicts  on 
tests,  and  I  view  this  asr  one  step  short  of  granting,  the  federal  goverr^ment  the 
authority  to  approve  sonte  tests  and  not  others— in  effect,  to  nationally  control  tests* 
.  Why,  for  exaftiple,  should  each  testing  agency  provide  a  comparison  of  the  aver- 
age score  and  percentiles  of  test  subjects  by  major  income  groups  only,  unless  the 
legislation's  authors  think  this  is  the  only  meaningful  set  of  relationships  for  test 
publishers  to  look  at?  «  * 

Why  should  the  Commissioner  report  to  Congress  on  the  relationshipJ>etWeen  the 
scores  of  test-takers  and  income,  race,  sex,  ethnic  and  handicapped  status  only, 
unless  it  is  assumed  that  these  are  the  only  meaningful  sets  of  relationships  hfe  and 
the  Congress  both  should  look  at? 

These  kinds  of  provisions  in  the  law  amount  to  the  legislation  of  a  particular 
research  methodology.  Why  not  look  at  test  scores  as  related  ta  family  sijpe,  for 
example,  or  class  size,  or  school  size,  or  family  composition,  or  ntmber  of  books  in 
the  home,-i)r  any  of  the  many  other  variables  researcher^  suspect  may  relate  to  test 
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performance?  SRould  federal  legislation  insist  that  a  federal  official  view  limited 
dAta  in  a  limited  way?  Obviously  the  answer  is,  no^  These  type^  of  provisions  are* 
extremely  dangerous.  Thiey  are  precisely  why  we  shou 
legislating  in  Ihis  area. 


d  be  v^ry  cautious  about 


(hstf  availability,  and  other  arguments       *  *         /  ^ 

There  are  other  argumente  which  must  be  considered, 'rriany  of  which  have 
already  been  presented  to  this  committee:  V  ' 

The  cost  of  test  development,  and  ultimately  to  students  will  inevitably  go  up. 
Should  the  application  of  ^ysclosure  requirements  made  to'  employment  testing 
and  oral  examinations,  as  is  provided  for  in  H.R.  3564,  the  cost  to  government  and 
to  private  industry  wiOuld  magnify  as  well.  .  / 

The  number  of  times  a  te^t  is  offered  will  inevitably  go  down  as  a  result  of  cost 
factors.  { 

While  some  in  New  York— ourselves  included— had  a  tendenpjfcytp  dismiss  these 
arguments  as  simply  the  . contrived  opposition  of  the  testing  indmstry,  their  validitv 
must  be  given  some  weight  when  we  now  se:e  that  teSt  publishers  are  voting  with 
their  feet  by  deciding  not  to  administer  some  tests  in  the  state  and  not  to  forward 
test  results  to  New  YOr^  Ck)lleges  and  Universities, 

The  federal  government  does  not  require  .what  this  legislation  would  require  for 
its  own  civil  service  examinations  and  armed  services,  examinations.  In  fact,  its 
testing  records  are  specifically  protected  frotn  disclosure.  Since  this  legislation  has 
clear  iniplications  for  existing  government  policies  their  apparent  inconsistencies 
should  be  thoroughly  examined. 

While  the  intention^  of  this  legislation's  authors  are  good,  I. do  not  believe  that 
the  ramifications  of  the  enactment  of  either  of  these  bills. has  been  adequately 
thought  through.  I  welcome  the  discussion  that  has  surrounded  them  as  a  great 
coptribution  to  education  of  the  public  and  educators  on. the  subject,  including  that 
of.mv  own' organization.  But,  after  reviewing  criticisms  that  have  been  made  of  this 
legislation  by  others,  and  after  witnessing  the  initial  confusion  that  is  accompany- 
ing the  enactment  of  shnilar. legislation  in  New  York,  I  am  convinced  that  federal, 
legislation  of  this  type  would  be  dangerously  premature.  My  concern  for  the  preser- 
vation/of  test^quality  and  constant  standardsT^and  my  fears  regarding  a  drastically 
alterealfedfipgl  role  in  education  are  behind  niV  recommendations  to  you  to  delay 
quick  consideration  of  these  nieasures  until  alLof  their  potential  hazards  have  been 
thoroughly  reviewed. 

STATEMENT  OP  ALBERT  SHANKER,  PRESIDENT,  AMERICAN 
FEDERATION  OF  TEACHERS,  AFL-CIO;  DR.  GEORGE  JACKSON, 
NATIONAL  ASSOCIATION  OF  ^  BLACK  PSYCHOLOGISTS,  AC- 
COMPANIED BY  ALVIS  ADAIR;  DR.  D.  KAY  CLAWSON,  DEAN, 
COLLEGE  OF  MEDICINE,  UNIVERSITY  OF  KENTUCKY;  DAVIIi 
GASTFRIEND,  CHAIRMAN,  MEDICAL  EDUCATION  COMMITTEE, 
AMERICAN  MEDICAL  STUDENTS  'ASfeOClATION;  DR,  LLOYD 
BOND,  RESEARCH  ASSOC^IATE,  LEARNING  RESEARCH  &  DE- 
VELOPMENT CENTER,  UNIVERSITY  OF  PITTSBURGH;  KEN- 
NETH  DREXELER,  PRESIDENT,  STUDENT  GOVERNMENT, 
NORTH  SENIOR  HI6H  SCHOOL,  GRKAT  NECK,  N.Y.;  DR. 
CLARK  R.  CAHOW,  ASSOCIATE  PROFESSOR,  HISTORY  AND 
ASSISTANT  PROVOST,  DUKE  UNIVERSITY,  CONSORTIUM  ON 
FINANCIN(2  HIGHER  EDUCATION^  WILLIAM  GE^ER,  JR.,  PR\% 
CIPAU  FRANCES  W.  PARKER^CHOOL,  CHlCAGtf  ILL,\ 

STATEMENT  OF  ALBERT  SHANKER,  PRESIDENT,  AMEI^ICAN' 
I    FEDERATION  OF  TEACHERS^  AFL-CIO 

Mr.  Shanker.  Thank  you  very  much  for  this  opportunity  to  be 
here  and  testify  on  this  important  matter. 

I  am  Albert  Shanker.  I  represent  the  American  Federation  of 
Teachers,  which  has  over  500,000  members  in  elementary,  second- 
ary, and  higher  education.  • 
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We  are  very  much  concerned  with  the  issues  which  have  bieen 
raised  around  this  proposed  legislation.  In  hearing  some  of  the 
testimony /this ;  morning, -I -am  i^minded  ofsomething  which  came 
up'  a  few  years  ago  when  Sidney  Marland  was  U.S.  Commissioner 
of  Education. 

I  remember  at  that  time  the  Office  of  Education  proposed  to 
iiivest*some  money  in  a  school  (fiatrict  in  Brooklyn  which  would 
develop  a  new  set  of  tests  Which  would  b^  normed  in  suclj  a^jvay 
that  the  students  in  that  particular  district  which  chose  th^  ^aixie 
range  of  distribution las  students  :      o  5  .  .  ' 

This  was  a  district  which  had  great  educaBional  proM^i^SK.Xhe^ 
•students  wer^  not  achieving  as  well- as  t^^^  nprm^.  It  was  a  disttt^ct*; 
'  with,  heavy  minority  concentratidhs.     ^  V      "  - 

What  I  .found  was  very  interesting  in  that  situation  Was  When  „ 
the  CommiSsidher  proposed  that  such  a  test  bfe  created/ ther^iWas  ^ 
an  outcry  from  the  parents  of  etiildren  in  tliat 'community  Wfeo 
came  down  tp  Washington,  and  said,  "We  don't  want  a  test  that  is 
going  to  tell  us  that  our  children  are  doing  jas  wefl  stei  other  c^ 
dren  when  we  know  that  they  are  not/'     . .    ■    : " '  > ,      ^  ;  ■ 

Finally  that  project  Was  abandoned.  1  would  be  happy,  to  go  back  ■ 
into  the  archives  of  the  W^hington  anctTt^ 
to  puirout.  those  clippings  and  to  see  hbW  rapidly  a  government^ 
ventured  into  the  testing  business  for  a  few  weeks,  how'  quickly  it " 
got  but.  It  was  driven  out?  I  am  sili-e,  by^  the  very  people  ,;that  ^bi»fe 
of  the  people  in  the  Office  of  Education  thought  they  weire  "going  to 
appeal  to  9i>d  kelp.  *        ^  .  ^  v 

„  Before  we  get  into  a  few  of  the  specifics  here,  I  have  ^upthitted 
written  testimpny^which  I  ^m  not  going  to  ire^id.  I  will  just  maka*^ 

^feW  points.     ■        ^  ■  ■    ■  ^  • '  "  "      .  ■■  ■  .  ' 

I  believe  that  soineohe  is  misreading  the  current  American  tern-- 
per.  I  do  not  think  that  the  3,  oV  5  items  on  th^ 

minds  of  .the  Americ^^n  peofde  &  a  whole  list  of  complaints  agiEiinst. 

:test6?>-;.  -  ."-i^'^"^  ^ .     -  / 

I  tJiirtk -most  people  i^ul^fhere  think  Jhat  they  took  -  tests,  ;and^ 
^  most  of  them'^iiev^r,  t^>bug]^t^tHai;the  te^  Were  hot  fair;  or  they 
were  biased.' V^ennh|y  .!^ia  well  ijn  the  j^efets,  t^^  the  tests 

were  food:  When;they'^filti^ 

pfepacpii' themg61vei§.":  :  ■  :  -^i: ,     ^        "-^  - -  ■  '  •  ■  <• 

^  Most  people  stitl  think  th^t  weiy;  that  it  is  aV  very,  very  small 
gl*oup  of  i^eople  jn  this  country  Who  havje  developed  this  sophistica- 
tion abpiit  what-lt  isL  the^^t^  ,meaSur€,itton^  fee^^^^  ^hftt 
the;difficuities  ai^T^^- •  ^•'-•^'."-.V'v":\. :        .'ik^ •■ 

The  big  public  concern  Iri^the, ,  co^  ^day  is :  not j«ath  the 
problems  of  testing.  Jt  is  with  t^ie  dedinin  standards,. /nd.  every- 
place you  go,  whether  it  is -local  or  national  or  at  the  State  leve^^U^^ 
there  is  a  demand'for  a  greater  .ua.ei)f  ^pb^ective  test$j^       ■'■     ?  . 

There  are  problems  with  that/ we  icn 
context  is  very  important,  that  we  are  ' con?i$lermgiiferel developing 
a  cure  for  a  disease  which'Wst people  don*t  recognize.. 

As  a  matter  of  fact,  the  cure  for  the  disease  that  We  are  workihg 
on  is  likely  to  create  problems  in  terms  of  achieving  wh^t  the 
public  wants^o  achieve,  which  is^  a  lightening  of  standards  and  a 
raising  Of  standards. 
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If  you  create  confusiph  in  administration  of  tests  and  everything 
else  at.  a  very  time  when  you  are  trying  ta  improve  standards  and 
tightening  up,  you  stai-t  raising  questions  febout  this  test  and  how 
much  additional  .work  has  to  be  done  and  what  it  means,  and  s6 

Yoii  begin  a  Idhg  process  of  changing  the  measuring  instrument 
and  you  will  have  a  public  out  there  that  is  going  to  believe  that 
the  reason  we  ar^  changing  the  measuring  instrUmertt  at  the  very 
time  when -scores  are  going  down  is  because  we  do^  t  want  them  to 
.  know  What  the  results  ar^;   '  . .  fw 

"  .    I  do  not  believe  that  vire  have  a  public  in  this  country  that  is 
'  tfbing'to«pfend  bitiions  of  dollais  for  education,  elementary,  second- 
ark^d'Mgh^' educ^tipn^'alia  deprive Jt^elf  pf  information  as  to 
whether  that  Tiioney  is  bayiftg-anj^hiftgv  and  whether  we  are  get- 
ting  better  or'-wo  time-     time'  in.  ternns  of  .the  delivery  ot 

■'>-tl4t^Wce^~  "  ■  ■  ",0  1        X  e 

:  .  So  r,  hope' that  :th&  pwni^  I-:re»ise.  are:  t^^^^^  context-^ol 
.  jybat  I  believe  is  a  COhQera:  -^  .   ,       .   :  v 

^    I  happen  to  agree  with  ,  that  concerfl.  .j  nhink  ^it  is  importantN 

-  .  before  we  go  into  all  th6  negatives^  pf  testing  that  there  are  some 
t  Wtive  thingsv  positives  tKaf  ftiay  be  d^trqye'd.  If  others  get  into 

^  '^his^^^^^^^  modifications— 
'  ~^^l^''m-^,&rt^  »nd  simple  one. 

:  <rhe  :  existence  of  tfesis  jiMty  niuch.  the  same  4«sts  which  are 
'  "  given  over  ^  long  peBbd  tif  time  creates  one  of  the  few  reliable  ^ 
;  5iece^  :of  knoivledge  we  h^^ve.  iil^  pur^^^  B^^^^^  9«r  .:. 

.   .schwls  and  our  students  are  doing.    ;^     ;   ,  ^^   .    v  "  .  > 

.  Theinterestitig  thing  when:  the  SAT,  scores  declinedr  you  did  not 
hayiB  -a  biirich  of  people  saying  they  diMvireally.  dfeclme-.  T^ey  are.:.,  ^ 

/'"iribafluring  sotheljjing/^  .  .V  ^c      ■  /     u-a  r^^i,  J  ^ 

Th6  tests  have;  cMngVd.  Every  expert  m^the  cpun^^^ 

"  at  those  said  yesrt#re  is  h6  way.you'can  deifiy  it;  There  arfe^^ings 

-  /  that  students  were^le  to  do  «  ye^r&  ago  that  they:  are  not  able  .tl?„  „ 

do  riorw.  I  wish  the  sCores.had  gone  up.  f      *b  r*.,    .  - 

wish  -we  didn't  have  the  bad  nfews,  but  we  hai^-very.  little. 
reWle  informatioii  In  the  field 'of  education.      ajlff  ;5rou  krtow> 
4-  yoli  j)rbBoae"  ajMost  kriythihg  and  you  vei«  get  ^  -whol^,  , bunch  pt , 

'"peopt^  he*^^^^^  -^'v      "  \  v 

•  ^  It  lis  very  good  to -have- a  piece  \of  legislation  that  no^ one  has  ^. 
'^"-Cont&drhaS^  those  te|ts  measure  students  are  -  . 

not  doing  asweli  as^th^yoiJCe  did.  It  is  important  to  have  that. 
V  ^  i  tbink  seeoniy  tho^  tests- are*  used  as  one  piece  0f  information  , 

"  Wd  evidence  afilpw  admitted  into 

•--^;d§rtain^6lleges  or  into  pfdgrams  or  in  terms  of  one  pieCfe  of  Jemsla-,  : 

•  ^ori,^firlmp^  relationships^ -et,  cetera.  / 

: «  >•  •  I  doif t  know;  of  anydnft  who  ha^  cbme  forW^Md  §aif^M 

l^ittffl!p?'M  I  w  submit  that  mMper|ence  as  a  teachff?viifg  in 
higher  education,  but  in  elementai-y  ^and  secondary,  that  for  ejery 
time  a#est  was  used  to  classify  a  student,  and  perhaps  deny  ijim 
some  opportunity,  I  WQ«fld  submit  that  my  .  experience  is  that  it 
'  worked  20  to  1  the  othlr  way,  that  if  ydu  had.  a  student  who  did 
not  test  well  but  who  rimonded  well  in  class  and  who  d;d  well  on 
the  work  and  everything  well,  the  tendency  of  the  teacher  or  the 

O  ■     .    ■       ■         •  ^'■^  '     ■  ^  • 
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institution  was  to  question  the  validity  of  the  test  because  you  had 
the  evidence  of  the  student's  performance  right  in  front  of  you. 

Gn  the  other  hand,  if  yoif  had  a  student  who  was  not  doing 
'  particularly  well  but  the  test  showed  that  that  student  supposedly 
had  great  ability,  you  started  working  on  that  student  and  sit  down 
with  the  student  and  say,  "This  test  shows  you  are  really  very  able 
and  you  are  not  doing  as  well  as  you  should." 

You  talk  to  the  par6nts  and  we,  have  to  give  them#hdlp  and 
provide  outreach,,  guidance,  so  forth.  v 

.  Now,  I  think  that  what  we*  are  cau^t  in  here  is  a  conflict 
between  what  I  think  i^  the  overwhelming  pressure  of  the  Ameri- 
can public  now  to  use  tests  more  and  to  tighten  up  against  a 
coalition  of  forces.  ^  i  . 

Some  of  it  is  part  of  a  very  good  consumer  movement  but  you 
have  tir^very  carefully  and  make  sure -you  are  not  destroying  old 
values  with  the  new  ones  you  are  trying  to  create. 

But  also  there  is  a  movement  in  this  country  that  is  kind  of 
naive  that  believes  if  you  get  rid  of  the  teists  you  automatically 
create  quality.  ^ 

If  you  get'  rid  of  the  yardstick,  everything  is  equal,  and  I  am  not 
making  that  up.  I  have  been  in  major  national  debates  here  in  the 
Capitol  sponsored  by  the  National  Institute  of  Education  and  oth- 
ers where  prominent  organizational  leadets  stood  up  and  said  tests 
rank  people,  so  that  somebody  is  first  and  somebody  is  second  ahd 
somebody  is  third.  That  makes  people  unhappy,  et  cetera.  ^ 

Twould  say  that  we  ought  to  be  rather  careful  that  we  are  not 
over  responding  to  the  views  of,  I  think,  very  small  groups  that 
believe  that  achievement  should  not  be  a  purpose  in  the  schools, 
tlikt  the  scliools  are  designed  for  happiness  or  for  play  or  for 
pleasure  or  for  all  sorts  of  other  things! 

I  certainly  think  we  should  try  to  make  those  in  our  institutions 
happy  and  try  to  make  learning  as  ple^asant  as  possible.  B.ut  we 
ought  to  keep  our  eye  on  what  schools  are  about  and  what  educa- 
tion is  about.  Achievement,  of  course,  is  a  main  part  of  it.         •  ' 

Now,  it  is  our  belief  that  a  program  which  WouM' require  the 
kind  of  disclosure  which  is  being  proposed.here  will  destroy  the 
knowledge  base  that  now  exists.  If  you  keep  creating  ijew  tests 
egch  time  because  you  can't  give  the  one  that  was  given  last  time 
because  you  had  to  release  it,  you  are  not  going  to  be  able  to  tell 
the  public  10  years  from  now  whether  the  SAT's  went,  up  or  down 
because  it  will  be  a  different  tesf  each  time. 

We  think  that  is  a  very  big  price  to  pay,  and  we  ought  to  think 
^long  and  hard  before  paying  that  price. 

We  are  impressed  with  the  evidence  that  making  up  new  tests 
constantly  wiU  substantially  increase  the  costs.  / 

We  are  impressed,  with  the  evidence  th^.  as  these  te$ts  are 
opened  up  and  hiade  pubHq,  that  we  will  defihitely  further  the 
industry  of  cram  courses  and  that  we  will  in  a  sense- be  determin- 
ing the  curriculum  of  many  of  our  S9hools  . by  making  the  passage 
of  ^these  tests  the  major  subject  of  study  for  quite  a  period  of  tiihe. 

I  would  say  that  it  is  certainly  open  to  .question-whether  any  6f 
these  things. are  going  to  help  fhe  rich  6r  the  poof.  I  dont  think  the 
evidence  is  m,  and  anyone  who  is  gOing  to  support  this  on  the  basis 


that  they  know  what  the  answer  is,  I  think  they  are  developing 
answers  which  are  not  there  yet^  * 

Now,  just  a  point  oirf  this  question  of  the  way  these  tests  are 
supposed  to  be  reported  in  terms  of  race,  in  terms  of  ethnicity,  in 
terms  of  sex,  income,  and  so  forth.  ^  ^ 

If  yoii  are  going  to  have  a  research  program,  I  would  agree  ^ylth, 
Dr.  Howe,  who  jusf  spoken  about  the  dangers  of  that,  and  associate 
myself  with  the  remarks  of  Congressman  Tord. 

If  you  want  to  conduct  research  into  what  it  is  that  makes 
students  not  do  as  well,  you  oufeht  to  find  out  how  often  these 
stwl^nts  move  from  one  school  jfco  another,  while  they  are  with  the 
elementary  school  And  secbndkry  school,  what  the  psychological 
and  social  services  were  in  tne  community,  you  might  thrpw  iti 
something  about  the  medical^care  they  received  and  the  question  ot 
how  many  hours  a  week  they  watch  television.  • 

If  we  are. going  to.  do  som6  of  the  research,  let  s  do  pome  research. 
But  I  am  very  worried  that  in  deciding  that  these  are  going  to  be 
reported  on  an  ethnic  ba^is,  for  example,  that  we  are  feaUy  deter- 
mining something.       -  ■        :  ■  , . 

We  are  really  saying  that  if  year  after  year  giVen  ethnic  groups 
do  poorly  on  certain  auestions,  therefore  those  questions  must  be 
culturally  biatfSd  and/ must  be  thrown  out.  That  was  one  o^  the 
debates  I  had  with  Dr.  Marland  when  he  was  Commissioner  ot 

Education.        •       *  ,  ,  .        ,  ^  ..  .r-. 

A  What  we  are  going  to  do  is  get  the  companies  and  testing  outtits 
to  keep  throwing  out  those  questions  which  tend  to  separate.  Some 
do  better,  others  do  worse,  et  cetera.  • 

I  think  it  is  kind  of  . a  nonsens-icat  approach.  It  may  very  well  be 
the  questions  of  simple  arithmetic  or  questions  in  the  use  of  the 
language  in  a  sophisticated  way,  that  these  skills  because  of  past 
discrimination  and  recent  entry  into  the  country,  language  difficul- 
ties and  so  forth  are  not  equally  distributed  at  the  present  time, 
but  that  does  not  mean  that  they  a?e  not  valid  questions  to  ask. 

If  we  ajjihrough  this  process  of  getting  rid  of  these  questions, 
what  we  are  really  doing  is  dtestroying  standards  and  an  adequate 
testing  program  and.  really  politicizing  it.  We  will  end  up,  I  thmk, 
the  public  is  not  going  to  lose  faith  in  testing  because  of  this. 

They  will  lose' faith  in  government  and  lose  faith  in  education 
because  they  are  not  going  to  believe  that  we  ar:«r  maintaining  the 
standards  that  they  want.  •  ,  X  v   i  b*  * 

■  I  ^ant  to  finally  point  to  what  is  happenijag  in  Ne>y  York  State, 
that  testing  publishers  have  made  a  decision  there  not  to  give 
certain  tests,  not  to  provide  results  within  that  State.  . 

There  are  already  members  of  the  legislature  in  the  State  who 
are  rethinking  legislation  and  there  may  very  well  be  some 
changes  tfere.  I  will  stop  at  this  point  just  saying  that  I  am  not 
ready  to  say  that  there  are  never  under  any  circumstances,  that  we 
should  absolutely  stay  away  from- any  legislalion. 

I  think  it  might  very  well  be  that  after  lengthy  study  on  this 
that  there  is  some  greater  yrutiny  to  which  these  tests  can  be 
subjected,  but  I  don't  like  tHe  rush.  The  issues  are  very  complex 
and  the  consequences  are  pretty  serious,  if  we  rpake  a  wrong 
'mistake.     '       ■      .:  ^  .'  •      '  . 
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I  would  hate  to  sit  IWe  \yith  a  list  of  actions  which  have  been 
taken  in  recent  years  hy^e  Congress  in  the  name  of  advocacy  and 
consumerism  which  bob^if^^nged  with  all  the  unanticipated  conse- 
quences that  are  sitting  thi^ 

There  are  as  many  unantlqfeated  consequences  as  m  any  of  these 
lother  fields/so  I  am  here  to  uwce^that  ypu  couldn't  look  at  this  and 
move  very  slowly.  V  , 

Mr.  Peyser.  Thank  you,  Mr. '^^ker,  fbr 

The  Svay  we  are  going  to  pi^oJi^^is  t0 
then  the  member  will  have  an  opp^un^t 

The  ne^t  witness  is  Dr.  George  bta 
Black  Psychologists. 

Dr.  Jackson? 
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STATEMENT  OF  DI^  GEORGE  JACI 
ATION  OF  BLACK  PSYCHOLOGISTS/ 
ADAIR 

Dr.  JACKSONNi^  name  is  Dr.  Georga  J^cksoA  National  Associ- 
ation of  Black  Psychologists,  1417  16thVtreet,^NV^.,  Washington, 
D.C.  I  speak  for^e  association.  I  am  a  professbr  a\  Howard 
versity.  % 

At  the  school  of  social  work  where  I  am  currently  ff^'^rofessor— 
excuse  me.  Dr.  Adair  is  also  w^  me  from  the  associafioi  and  will 
be  among  the  person^  who  willfanswer  questions,  if  rfiere\re  any,, 
for  us.  .  ^ 

At  the  s(4iool  of  social  work  we  turn  out  approjcimately  125 
students  a  year  with  MSW's.  We  refuse  to  use  standardized  -testing 
as  a  means  of  looking  at  our  students.  Our  students  we  would  stack 
up  against  any  group  of  students  throughout  the  country. 

One  of  the  reasons,  many  of  the  reasons  why  we  are  successful  in 
what  we  do  is  because  we  do  not  countenance. falsehood. 

It  is  pur  contention  that  to  suggest  that  the  standardized  tests 
are  able  to  measure  the  aptitude  of  an  individual,  the  aptitude  of 
an  individual,  even  as  a  partial  predictor,  even  as  a  partial  predic- 
tor,,is  a  fallacy.'  ; 

We  believe  that  it  is  time  for  the  Federal  Government  to  move 
into  the  arena  because  the  tesftompanies  have  been  recalcitrant. 
They  have  not  behoved  as  honest  scholars.  Indeed,  they  have  at-- 
tempted  to  place  within  the  marketplace  insidious  comparisons 
based  on  false  assumptions.       •        '  ,*  ' 

.  The  Association  of  Black  "Psychologists  in  1969  decided  to  call  for 
a  moratorium  on  the  testing  of  oppressed  peopip  in  this  country.  It 
was  not  a  response  to  those  individuals  who  said  that  black  people 
were  inferior.  >i 

What  we  vvere  addressing  is  the  inherent  nature  of  the  tests 
jitsielf  It  was  our  contention  that— and  it  is  our  contiention  now— 
psychometry  in  its  current  condition  cannot  and  does  not  measure 
what  it  purports  to  measure.  '  ' 

If  you  are  talking  about  prediction,  which  is  what  SAT>  ORE  say 
they  are  talking  about,^  measure  an  aptitude  which  they  are  then 
able  to  ^predict  from,  if  you  are  talking  about  prediction,  it  is 
incumbent  upon  the  person  who  has  a  theoretical  formulation  for 
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doing  this  to  demonstrate  not  only  pfediction  but  a  logibal  relation-  ^ 
ship  between  the  prediotor  and  the  criteria. 

You  can  use  any  variable  as  a  predictor— skin  Color,  hair  color, 
union  membership,  et  cetera— in  tems  of  how  people  behave.  So  it 
is  incumbent  to  talk  about  not  oiily  prediction  but  alsO  to  talk,  in 
.  terms  of  the  logical  relationships.  ; 

If  we  talk  ip  tferms  of  prediction,  and  \^e  use  multiple  equation, 
as  you  enter  more  predictors  into  ,the  equation  each^f  ybur  compo- 
nents decreasesi  in  its  p^dictability. 

If  you  are  talking  about  using  correlations  for  cause  and  effect  or 
relationships  because  of  a  statistic  called  the  coefficient  of  alien- 
ation which  uses  the  i^ndard  deviation  and  square  root  K)f  yojir 

variables.  * 

You  need^  to  have  over  a  0.90  correlation  before  yqir-can  talk 
about  any  significant  degree  of  variance  ^hich  is  describable.  It 
being  describable  to  your  predictors  under  considratipn,  or  as  we 
put  forth  in  1969,  there  is  an  issue  of  what  we  call  the  moderating 
variable  which  suggests  that  when  you  make  correlations  'between, 
say,  test  scores  and  GPA  in  racist  institutions,  puck  as  ate  all  oyer 
this  country,  that  you  may  be  talkirig  about  not  only  a  correlation 
which  is  high  because  the  two  yariables  related  but  because' 
there  is  a  third  variable,  a  moderating  variable,  a  racist  curricu- 
lum. /  /■ 

These  and  other  things  are  what  led  us  in  1969  to  call  for  a 
moratorium  for  testing) the  . disadvantaged.  I  will  not  go  through  the 
whole  list  of  consideratipns.         y  ' 

I  would  remind  you  again  that/we  also  suggest  that  the  assump- 
tion of  the  norm  curv^  as  a  measurable,  as  a  measure  of  continu- 
"  ous  variables  of  ability  across  ethnic  groups,  we  regard  as  a  fallacy. 

So  at  the  very  least  it  seems  to  hie  if  companies  are  compelled  to 
place  theit  questions  on  t^e  table  annually*  it  will  foster.  It  will 
compel  a  new  technology  within  the  psychometry  industry,,  and 
possibly  we  might  then  through  l^eing  able  to  get  feedback  and 
knowing  what  the  instrument  is,  maybe  eventually  they  will  stop 
developing  what  might  possibly  be  Called  the  achievement  test, 
which  they  are  not  either,  instead  of  aptitude  tests. 

Bov(ie  years  ago.  many  years  ago,  in  fact,  the  New  Jersey  Com- 
.  mission  for  the  $lind  made  it  essential  for  a  blind  person  to  take 
the  SAT  and  to  scorfe  at  some  level,  I  don't  know  what,  in  order  to 
get  a  scholarship  to  pay  for  blind  persons'  tuition,  and  so  on. 
p  I  don't  know  hpw  it  happened;  but  somehow  I  was  2  years  in  the 
upiiversity  and  suddenly  someone  noticed  that  I  hadnt  taken  the 
SAT,  and  they  called  me  up  and  said  you  have  to  come  in  and  take 
theSAT  in  order  to  get  a  continuation  of  your  scholarship. 

I- was  getting  all  A's  at  that  time,  excepting  in  religion,  and  went 
dowi>  to  t^ke  this  tes,t,  which  I  later  learned  I  flunked,  so  there  I 
-  was  moving  into  m;^  junior  year  in  college,  full  scholarship,  A 
average^  and  they  wfere  telling  me  the  only  thing  we  can  let  you  do 
is  take  the. test  ove/ again.  *         „  *    ^  * 

.    Tasked,  ''What^m  I  going  to  do?'^  I  was  told,  ''Well,  we  don  t 
nknow  f  I  said,  ''What  can  I  study?"  They  said,  "We  hrfve  a  Braille 
^  bbokl/t  Ave  will  siend  you  which  gives  you  some  sample  itents,  but 
we  cmi^i  tell  yo\f  what  to  do,''  so  I  did  nothing. 


The  next  year  I  took  the  test  again  in  Braille  and  this  time  I  got 
a  letter  saying,  *you  passed  it  by  such  a  margin,  it  can  only  be 
called  fantastic.  I  don't  know  how  I  passed  it  or  flunked  it,  and  I 
•was  unable  to  prepare  myself.  * 

There  was  another  blind  student  who  went  through  high  school 
with  me  who  used  to  doimathem^ical  problema  in  his  head.  Unfor- 
tunately, he  took  the  test' before  he  trieS  to  go  to  college.  He 
flunked  it.  ■  ^  ' 

He  went  to  a  factory  to  work.  I  am  not  trying  to  suggest  that 
<^people  shouldn't  work  in  factories,  but  he  was  interested  in  going 
to  college. 

You  might  suggest  that  this  is  a  one-person,  example.  It  is  a  case 
of  one.  My. experiences  in  higher  education  as  a  black  psychologist, 
as  a  musician,  and  as  a  politician  at  times  indicates  that  this  is 
not. 

.  In  Newark,  N.J.,  for  example,  in  1958  on  first  trial,  fiot  one  l^ack 
'student  got  into  a  college  that  year;  that/ is,  to  the  multiple  criteria. 

We  talk  in  terms  of  the  test  being^n  objective  indicator.  We 
would  submit  that  the  test  is  a  psuedoscientific  replacement  for  the 
objective  or  the  subjective  racist  attitudes  which  we  black  people 
confront,'  arid  we  would  submit  that  the  tests  have  been  used  to 
exclude  us  from  admission.  \ 

^Yes,  it  is  understood  that  there  are  ethnic  differences.  On  most 
of  your  psychometric  tests,  the  mean  performance  for  blacks  as 
compared  with  whites  Ts  one  standard 'deviation  below'  the  mean, 
below  the  the  white  group  in  most  of  your  standardized  testing. 

We  would  submit  to  you,  we  understand  that  we  do  not  haye 
educatiort  at  the  level  thai;  we  would  like  to  have  it.  We  understand 
that,  but  in  this  notion  that  the  test  brings  the  message  and, 
therefore,  don't  kill  the  messenger. 

We  submit  that  is  a  fallacy.  We  submit  that  the  messenger  is 
trying  to  kill  us,  and  we  are  not  going  to,Iet  it  kill  us, 

I  think  that  we  have  to  understand  that  it  is  not  subjectivity 
which  determines  what  test  items  will  be  pulled,  nor  is  it  subjectiv- 
ity which  finally  determines  what  a  cutoff  point  w.ill  be. 

It  has  never  been  determined.  It  has  never  been  determined  by  a 
college  or*  university  that  they  could  show  a  relationship  between 
SAT,  their  grade  points,  and  success  in  the  world  of  work  or 
performance.    -  .   .  ' 

It  has  been  sugg6sted  that  SAT's  and  other  standardized  tests 
reflect  what  is  going  on  in  the  schools.  We  say  it  does  not.  It  does 
not  mirror  what  is  going  on  in  the  schools.  In  omer  \yor9ls,  the  tests 
do  not  measure  what  tliey  purport  to  measure.  \ 

Therefore,  to  use  them  is  a  fallacy  ana  places  a  travesty  and 
dishonesty  upon  the  young  people  of  our  country.  In  Howard  Uni- 
versity we  have  a  newly  developed  doctoral  program  5  years  in 
existence.  We  do  Hot  use  Jhe  GRE.  . 

We  have  students^  now,  only  one  student  has  been  lost  for  aca- 
demiQ  reasons,  StAod^pds  at  Howard  University  continually  go  up, 
and  so'Boes  the  levelof  our  students' performance. 

It  continues  to  go  up.  .When  1  was  the  dean  oY  academic  affairs  of 
Essex  County  College  iji  Nevvark,  I  was  able  to  move,  with  the  help 
^  of  the  faculty,  olir  jiursing  program  from  almost  losing  its  accredi- 
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tation  because  of  the  scores  that  our  graduates  were  getting  on  the 
nursing  test  ,  ' 

4n  1  year  we  moved  that  group  to  receiving  the  highest  score  in 
the  State,  and  there  was  no  relationship  between  the  teste  which 
they  recommended  we  use  as  a  predictor  and  the  outcomes. 

What  we  did  was  we  taught  the  students,  and  we  taught  them  ' 
not  only  the  cohitent,  but  we  taught  them  tifiat  they  are  important, 
something  which  the  tests  say  they  are  not. 

At  Seton  Hall  University,  where  I  was  the  director  of  black' 
studieg,  we  brought  in  the  students  who  had^he  so-called  nominal- 
ly low  SAT  scores.  Those  students  should  not  have  been  able  to 
perform  in  college  if  the  tests  were  measuring  an  aptitude  wnich 
we  say  the  tests  did  not. 

Within  2  years  you  could  not  distinguish  those  special  students 
from  other  students  in  the  mainstream  cif  the  university.  And  this 
kind  of  activity  where  you  have  faculty  and  you  have  people  believ- ' 
ing  in  the  fact  that  they  can  undo  perhaps  some  of  the  dam&ge 
that  was  done  in  the  public  school  system  makes  it  possible  for 
people  to  f4inction. 

In  conclusion,  if  we  had  used  as  a  criterion  the  black  people  who 
graduated  froip  our  black  colleges  and  universities  who  were 
taught  by  black  scholars  who  had  a  heritage  of  coming  from  an 
ediicational  system  wWch  in  fact  was  oh  a  par  with  anything  that 
we  had^een  in  tiiis  rountry,  if  a  criterion  group  of  that  type  had 
been  sele«tedf  perhaps  maybe  we  wouldn't  have  called  for  a  mora-, 
torium.  But  the  test  companies  still  do  not  do  that, 

I  would  have  to  ag«ep  or  disagree  with  Mr.  Shanker,  and  I  an> 
glad  to  disagree  with  him  because  I  can  think  of  no  person  who 
tried  harder  to  hurt  black  people  through  5a**e. 

It  is  very  interesting  that  he  and  I  are  on  opposite  sides  of  this 
issue,  but  we  cannot  judge  issues  by  the  company  people  keep/It  is 
just  that  I  never  thought  I  would, have  an  opportunity  to  s^y  that 
so  close  to  him  after  seeing  him  on  television  for  many  yeiar?. 

Finally,  in  1975;the'  Association  of  Black  Psychologistsj/eccjgniz- 
ing  that  the  climate  would  not  be  conducive  to  continuing  the 
-moratoriuln,  called  for  more  than  a  moratorium.  W§  called  in 
various  articles  and  publications— we  called  for  truth  in  testhig 
laws.     '  ♦ 

Through  the  offices  of  the  National  Association  for  the  Advance- 
ment of  Colwed  Peopje  did  sit  many  times  at  the  table  with 
ETS  and  Coljege  Boards.  They  did  acknowledge. , that  these  tests 
behind  closed  doors  are  culturally  biased.  ^ 

We  called  for  more  than  a  moratoriiim.  We  hea^rtily  endorse  all- 
aspects  of  this  legislation.  , 
•  Chairman  Perkins.  Jiet  me  thank  yoa  very  miich. 

Our  next  witness  is  Dr.  D.  Kay  Clawsori,  dean.  College  of  Medi- 
;eine.  University  of  Kentudcy.  .  ' 

STATEMENT  OF  DR.  dVaY  CLAWSON,  DEAN,  COLLEGE  OP 
MEDICINE,  DIVERSITY  . 

Dr.  Claw$ON.  I  aMiiiciate  the  op^rtunity  of  testifying  here. 
The  College  of  l^emcine  at  the  IJfniyersitv  of  Kentucky  was  es-' 
tablished  in  1960,  specifically  to  .address  the  issue  of  the^  doctor 
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shortage  in  the  eastern  part  of  the  State  and  in  some  rural  coun- 
ties that  had  been  traditionally  imderserved. 

The  purpose  of  my  testimony  today  is  to  try  and  show  you  how 
the  standardized  MCAT  has  been  an  advantage  to  us  in  the  admis- 
sions process,  and  to  caution  you  about  what  I  think  would  be  thfe 
dilatorious  effects  of  this  particular  law  which  you  go  through  on 
the  admissions  process  tp  not  only  our  college  of  medicine  but  to  a 
number  of  other  ones  in  the  country. 

Let  me  say  something  about  the  admissions  process  into  medical 
education.  Admissions  policies  are  established  by  faculties  in  the 
various  colleges.  # 

This  committee  usually  composed  of  basic  an4  clinical  scientists, 
practicing  physicians  from  the  community,  students,  alumni,  and 
knowledgeable  lay  individuals  are  the  ones  that  make  the  admis- 
sions decisions i^jour  school's. 

Chairman  PerkJns.  Have  the  students  in  ydur  institution  always 
had  input  in  the  setting  iip  of  standards? 

Dr.  Clawson.  We  have  always  had  students  on^our  admissions 
committee,  yes,  Mr.'  Chairman,  that  is  correct.  We  believe  that  if 
you  look  at  the  varying  criterion  used,  the  MCAT  |s  only  one.  *We 
give  consideration  ip  the  accumulfitive  grade  point  average. 

We  also  use  the  MCAT  in  a  positive  way  because  we  believe  it 
maximizes  the  objectivity  and  insures  consistency  and  makes  the 
process  more  fair  to  all  individuals.  . 

Let  me  ,tell  you  a  little  more  about  this  process  because  we  are 
very  well  aware  that  a  B  grade  in  one  collie  may  have  the  same 
standard  as  an  A  or  a  C  in  another,  and  we  nave  no  way  of 
knowing  tHis  except  in, the  prejudi<;ial  mind  of  people  who  may  be 
sitting  on  this  committee  or  a  faculty  as  to  how  they  might  weight 
a  college.  • 

In  addition,  we  also  know  in  a  college  there  arte  those  instructors 
who  are  called  hard  graders  and  also  those  wno  are  called  easy 
graders  and  we  have  no  knowledge  about  this.* 

The  MCAT  as  it  is  now  constructed  and  as  it  now  works  has  been 
an  advantage  to  us  in  that  we  have  been  able  to  take  students  ihat 
might  not  for  paSt  reasons  be  considered  on  the  objective  sense  of 
their  grade  point,  their  past  performance  to  be  competitive,  to 
undergo  the  medicalTnrriculum,  and^on  the  basis  of  scores  that 
they  have  received  on  the  MCAT  have  made  itpo.  4 
y  '  \  would  illustrate  two  from  the  recent  class:  One,  a  boy  from  a 
mountainous  Pike  County  in  Kentucky  who  had  scored  very  poorly, 
less  than  a  C  grade,  in  college.  He  went  into  the  military  and  came 
back  to^college.  He  got  better  than  a  C.  fie  started  working  as  ah 
orderly  and  then  a  respiratory  therapist  in  a  hospital  environm^t- 
and  had  an  excellent  track  record  and  still  wanted  to  go  to  medical 
school, 

I  can  say  without  his  performance  on  the  MCAT  I  don't  think  an 
admissions  committee  would  have  looked  at  his  academic  perform- 
ance and  passed  in  a  gbod  position.  * 

Another  man  in  Russell  County  hsA  a  B-minus  level  perforniiince 
but  in  grade  point  levels  for  admission  he  would  not  have  jbeen 
competitive  and  yet  the  MCAT  which  showed  him  scoring  ip  the 
top  20  percetitile  was  clearly  the  thing  that  tipped  the  scale  and 
allowed  him  to  the  admissions  process:   •  * 

\      '  ■    '  ^  „■ 
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So  I  have  numerous  illustrations  like  that  I  could  go  to,  but  I  do 
feel  this  particular  test  has  been  a  great  advantage  to  us.^ 
•  Let  me  say  something  about  the  MCAT  itself.  We  have  been 
talking  about  a  lot  of  other  tests  ,  that  I  know  about,  but  I  don  t 
know  the  details.  I  know  American  medicine  was  very  concerned 
about  the  old  MCAT  and  through  our  American  medieal  colleges 
we  Kave  contributed  over  $lVfe  million  to  do  research  m  and  try  to 
^ake  a'  better  tool,  even  though  an  imperfect  tool,  as  a  standard- 
ized test,  and  that  is  what  I  call  our  hew  MCAT  which  was  admm- 
istered  for  the  first  time  in  1977. 

We  think  it  is  a  much  better  test.  Why- we  cannot,'open  up  the 
pool  of  questions  is  very  simple.  We  have-decided  in  the  process  of 
doing  this  that  we  want  the  future  physician  to  have  a  very  broad 
education.  Therefore,  we  hav?  said  that  the  questions  we  wijl  tes^ 
on  will  be  from  the  normal  first  year  of  college  categories  and  have 
selected  from  that  area  the  questions  and  materiqjjhat  we  think  is 
broad  based  and  essential  and  have  the  student  coming  from  a 
small  college  have  the  same  opportunity  as  a  student  from  a  large 
cT)llege.  "  -I*. 

We  hope  we  have  done  this  in  the  process  and  the  pool  of 
questions  is  very,  very  sm^ll.  If  we  open  it  up,  then  we  would  have 
to  expand  the  pool  and  we  would  go  back  to  a  situation  where 
students  would  be  spending  years  study^ngjiertain  scientific  disci- 
plines in.  order  to  pass  the  test  and  tryand  cover  the  whole  horizon 
rather  than  getting  a  broad  education. 

We  think  that  is  a  wrong  way  to  go.  For  that  reason  we  are  very 
ple'asedjwith  what  we  have  now  been  able  to  accomplish  in  this 
particumr  regard..  T  i.ii 

What  would-  hdppen  if  the  test  was  opened  up,  I  can  tell  you 
probably  what  would  happen  in  medicine.  I. go  back  to  the  days 
when  it  was  q^ite  different,  when  standardized  testing  was  not  as 
readily  available,  and  when  you  got  in  by  either  who  you  might 
know  or  because  your  father  Was  from  a  particular  background  or 
a  particular  school.  ,     ,         r  mu 

At  this  point  in  time,  we  do  have 'a  good  tool,  one  ot  many,  ihe 
grade  point  average  and  the  MCAT  combined  in  our  institution 
only  make  up  60  percent.  We  look  at  humanitarian  communities, 
we  look  at  how  the  student  has  performed  in  social,  religious  and 
other  groups.  We.  look  at  their  background  in  athletics,  art,  music, 
and  other  things.  We  give  extra  points  for  those  commg  from 
underserved  areas  and  underrepresented  groups  in  medicine. 

So  we  think  we  have  a  fair  process  of  which  the  MCAT  as  it  is 
now  constructed  and  as  it  is  now  applied  is  a  very  valuable  tool  in 
doing  what  I  believe  the  proposer,  Mr.  Weiss,  wants  to  accomplish 
and  that  is  to  getting  underrepresented  and  underpriviteged  ones 

into  our  medical  school.  .  ,  .  .  ^     j  i.  i.   i.uj ; 

If  we  ane  to  lose  it  and  go  back  to  locally  administered  tests,  thdy 
won't  be  as  good.  This  will  be  a  burden  and  a  problem  feotudents. 
If  we  rely  on  the  subjjective  judgment  of  the  committee  members 
sitting  around  the  table,  I  have  been  through  that  for  manyrman^ 
years  and  I  know  how  ^ielpful  it  is  for  me  if  I  look  at  a  student  s 
record  at^  somebody  m  somebodies  arg,  I  think,  unconsciously 
discriminaling  against  ^me  of  our  stu<^ents  who  fon  economic_rea- 
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sons  or  for  cultural  reasons  have  elected  to  go  to  one  of  the  small, 
less  prestigous  colleges.  <  '  ' 

There  is  a  psychologic  thing  in  academia  th^t  might  not  give 
them  the  same  level  of  credibility  as  going  to  the  tnote  prestigious 
institutions,  and  I  can  say,  now  wait  admissions  committee,  take  a 
look  at  this.  Look  how  this  student  really  has  proven  he  can 
perform  coming  from  one  of  these  institutions. 

I  think  it  has  been  a  great  tool  for  us  to  accomplish  the  goals 
that  the  bill  wants  to  accomplish  and  for  that  reason  I -am  very 
much  concerned  about  the  deleterious  effects  this  legislation  as  it 
IS  particularly  proposed  right  now  would  have  on  oui*  admissions 
process.  ' 

Th|||ik  you. 

[The  prepared  statement  of  D.  Kay  Clawson  follows:] 

Prepared  STATE^lENT  of  Dr.  D.  Kay  Clawson,  DEAN„Ck)iXEOK  of  Medicine.  ' 

University  of  Kentucky  \ 

Mr.  Chairman  and  Members  of  the  Subcommittee:-!  appreciate  this  opportunity  to 
present  testimony  on  H.R.  4949.  "The  Educational  Testing  Act  of  1979.'' I  am  Dr  D 
Kfly  CJawson,  Dean  of  the  College  of  Medicine  at  the  University  of  Kentucky  in 
Lexington,  Kentucky.  As  you  know.  Mr.  Chairman,  our  College  was  founded  in  1960. 
because  Kentucky  was  a  doctor  shortage  state,  and  one  of  our  primary  missions  has 
been  to  increase  the  number  of  physicians  practicing  in  the  Commonwealth,- particu- 
larly in  the  eastern,  mountainous  area  which-has  traditionally  been  underserved 
My  testimony  will  be  directed  at  the  deleterious  effects  the  proposed  legislation 
lid  impose,  on  our  medical  school's  admissions  process  and  will  attempt  to  show 
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how  the  use  of  the  standardized  MCAT  test  has  been  of  great  advantage  tb  us  in 
getting  qualified  rural  and  non-traditional  students  into  medical  school 

•The  University  of  Kentucky  College  of  Medicine  requires,  as  do  99%  of  this 
nation  s  medical  schools,  the  careful  consideration  of  tie  New  MCAT  results  as  an, 
integral  part  of  the  review  and  evaluation  of  an  applicant's  credentials.  If  enacted, 
the  test  disclosure  provision  of  H.R  4949  would  greatly  impair  the  conHdence  placed 
in  the  reliability  of  the  New  MCAT  test  results,  and  might  eventually  eliminate 
their  use  entirely.  Many  scholars  and  educators- have  put  in  countless  hours  of 
extensive  research  and  development  to  produce  this  ve^y  specialized  examination. 

A  lew  words  about  the  medical  school's  admissions  process  may  be  in  -order 
Admissions  policies  are'  established  by  the  faculties  of  the  various  colleges  The 
selection  process  is  pefformed  by  a  Committee  appointed  by  the  Dean,  consisting  of 
basic  science  and  clinical  facultv.  students,  practicing  physicians  from  the  Commurti- 
ty.  and  frequently,  knowledgeable  lay  individuals  and  alumni.  To  be  fully  aware  of 
the  implications  this  proposed  legislaUon  would  have  on  the  utilization  of  the  New 
MUAl,  and  ultimately  on  the  admissufc  process,  it  is  important  to  understand  that 
the  evaluation  of  each  applicant's  cllBentials  is  a  comprehensive  and  exhaustive 
process  No  single  criterion  determines  acceptance  to  medical  school.  Since  the 
medical  student  and  ul.timately  the  practicing  physician,  must  possess  a  brOad 
range  ol  personal  and  academic  Qualities,  the  admissions  decision  is  based  upon  the 
Committees  best  judgement  of  the  applicant's  possession  of  these  .qualities.  Addi- 
tionally. It  IS  imperative  that  the  process  insiireis  that  these  judgements  are  execiit- 
ed  in  a  rtianner  which:  (1)  maximizes  objectivity;  W  insures  consistency  in  our 
review  and  ultimately  in  our  decision,  while  allowing  for  the  uniqueness  of  each 
indiyiduaras  they  establish  their  total  record;  (3)  makes  full  and  appropriate  use  of 
all  indicators  of  the  applicants  previous  academic  achievement;  (4)  responds  to 
current  and  future  societal  needs;  and  (5)  enhances  the  diversity  of  the  academic 
and  personal  backgrounds  of  the  students  in  our  medical  schools  to  provide  a 
heterogeneous  output  of  future  physicians  capable  of  providing  a  broad  scope  of 
personalized  services,  as  well  as  adequate  numbers  to  enter  into  research  and 
academic  pursuits.  . 

■  At  the  Univerjty  of  Kehtucky.  we  give  maximum  weighting  to  the  cumulative 
grade  point  avefge.  However,  we  feel  the  MCAT  is  essential  alio  to  insure  that 
there  are  not  uiiquitiefl.'in  the  GPA  measurement,  and  to  identify  students  who' 
may,  tor  one  reafeon  or  another,  have  had  a  poor  semester  or  yeaf,  but  whose  total  ' 
knowledge  base  is  significantly  above  what  their  grade  point  wouid  indicate.  I  would 
like  to  amplify  gn  these  two  points.  First«f  all.  a  "B'Vadypoiftt  performance  in 
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one  College  may  signal  the  same  level  of  performance  m  another  College  as  an  A 
or  a  "C."  Furthermore,  there  is  no  consistency  even  within  ^  College;  some  instruc- 
tora  are  "hard  graders,"  and  other  instructors  are  ^'easy  gfaders.  The  .MCAT,  as^it 
is  now  constructed  and  administered,  calls  the  attention  of  the  Admissions  Commit- 
tee to  potentially  strong  studfents  who,  because  of  grading  practices,  may  be  over- 
looked. Furthermore,  and  most  important  for  us  in  Kentucky,  many  of  our  students 
go  to  smaller,  less  recognized  institutions,  and  there  is  the  constant  dangej  that* 
subconsciously,  or  even  consciously.  Admissions  Committee  members  may  weigh  tar 
more  heavily  the  academic  achievement  of  students  who  have  gone  to  tjie  tradition- 
ally well-known  institutions;  hence  the  very  bright  and  capable  student  who  for^ 
economic  or  social  reasons  has  selected  one  of  pUr  smaller  schools,  w  penalized.  Ihe 
weight  placed  on  the  MCAT  gives  this  student  an  equal  break  with  student^  who 
have  attended  more  prestigioUs  institutions.  Secondly,  it  is  frequently  alleged  that 
too  much  reliance  is  placed  *  a  single  test  such  as  the  MCAT;  However,  I  wou  d 
suggest  to  the  Committee  that  a  student  is  equally,  or  at  times  more,  severely 

JjBnalized  by  weight  placed  upon  a  less  well  designed  evaluation  tool  in  the  final . 
xamination  of  a  required  course,  th^n  oh  the  well  constructed  and  administered 
f CAT.  The  MCAT  allows  a  student  who  has  had  a  bad  experience  to  prove  that  he 
has  a  greater  knowledge  base  to  prepare  him  for' the  study  of  medicineithan  is 
mdicated  by  his  grade  point  average.  Two  specific  cases  co/he  to  mind  which,  1 
believe,  will  illustrate  mv  previous  comments.  Both  students,  were  applicants  to  our 
College  of  Medicine  and  both  were  accepted  for  admission.  ^ 

The  first  student  is  frbm  mountainous  Pike  County.  This  person  entered  the. 
military  after  attaining  less  than  a  "C"  average  in  one  and  one-half; years  of  college. 
After  his  military  service,  he  still  did  not  perform  that  well  in  college,  but  he  began 
working  full-time  in  jobs  as  an  orderly,  pulmonary  technician,  and  respiratory 
specialist.  He  completed  all  college  requirements  for  medical  school,  but  with  a  loy 
grade  point  average.  His  competitive  MCAT  scores,  however,  were  the  added  cogiii- 
trve  criteria  which  increased  the  Admissions  Committees  level  of  confidence  in  his 
academic  ability  and  potential.  Other  supportive  documents,  letters  of  recommenda- 
tion, and  positive  interview  reports  contributed  to  his  selection.  ' 

The  second  illustration  I  would  present  to  further  illustrate  my  point  involves  a 
student*  from  rural  Russell  County.  This  student  entered  college  as  an  engiheering 
major,  one  of  the  mMt  difficult  courses  of  study  in  the  undergra^ate  curricqlum. 
His  performance  in^^the  first  two  yeaj>ma»^fisfactory— about  the  middle  O 
range,  and  hifr  final  two  years  were  kOhe  g+  range.  His  cumulative  performance, 
nevertheless^  was  too  low  to  be  corfipetitive  with  ofhw-^uedical  school  applicants. 
Once  again,  the  Medical  CoHege  A/lrriission  Test  proved  invd^able  in  assessing  his 
academic  credentials.  Thfe  candid/te's  MCAT  scores  placed  bim  m  the  top  10-20 
percentile  of  all  candidates  taking:  the  exam.  Without  this  atendardized  examina 
lion,  he  would  have  had  little  chafice  for  admission.  A*      ,  m.^Am 

While  I  have  stressed  the  weighting  of  the  grade  point  averafee  and  MCAT  scores 
for  this  testimony,  I  want  J/he  Subcommittee  to  recognize  thjt  in  the  radmissions 
process,  m6ny  non-cognitii^  characteristics  are  identified  antKim^n  almost  equal 
weighting  to  the  cognitive  dimensions.  These  characteristics  include>(l)  humanitar- 
ian, cultural,  service,  or  religious  activities;  (2)  premedical  recommendations;  W 
interpersonal,  group,  club,  or  social  accomplishments;  and  (4)  vocational  pursuits, 
artistic,  athletic,  or  professional  achievements,  residence  in  physician  shortage 
areas,  and  minority  status.     \.  * ,  ,  •         i  r 

Before  1  amplify  mofe  on  whV  I  believe  this  law  would  destroy  tlifi  unique  value  of 
the  New  MCAT  and  severely  cAnpromise  fairness  m  the  eidtQjmpns  process,  I  would 
like  to  reiterate  several  poSits  Jnade  by  Dr.  John  A.  D.  CoblBrrhe  medical  schools 
of  this  country,  through  tHb  A&sociatioh  of  Americah  Medical  Colleges,  have  invest- 
ed approximately  $1.6  mijfen  in  an  unprecedented  review  of  the  admissions  testing 
urogram  and  the/fS^KjIl  and  development  neci^ssary  to  have  a  ipore  relevant, 
cognitive  test,  'mis  haslSesulted  in  the  new  MCAT.  As  you  know,  it  was  first 
a<Cninistered  in  April  of  ml  and  was  the  result  of  a  comprehensive  review  and 
rating  of  the  ritotive  content  ^prerequisites  of  over  150  jnedical  school  faculty 
members.  It  is  exSemelyimportoutib  the  members  qf  the  Subcommittee  to  recog- 
nize that  all  subjects  covefe4>Ia /ormal.one-ys.ar  introductory  courde  in  biology, 
chemistry  and  physics  are  not  tdted.  Only  specific  toj)iC8  within  each  of  thesfe 
science  disciplines  have  been  s^ted  and  these  topics  are  published  la  order  tor 
students  to  prepare  for  thM^It  is  equally  important  to  empha^  th^t  questions 
designed  to  test  the  within nhe  disciplines  must  be  limited  to  the  depth  of 

coverage  normally  involved  In  a  firsb-year  undergraduate  college  course.  Ihe  deci- 
sion to  limit  the  con)fent  coverage  was  made  consciously  and  deliberately  to  discour- 
age students  from  taking  all  of  their  undergraduate  experience  in  specific  science 
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disciplines,  the  antithjesis  of  a  broad  undergraduate  education.  Wh^fTspeciflc  ques- 
^tions  and^answers  must  be  disclosed,  a  severe  constraint  is  placed  up6rt  our  ability 
to  devejop  and  administer  a  reliable  test..  The'' requirement  of  H.R.  4949  to  disclose 
test  items  would,  thus,  prevent  out  testing  program  from  maintaining  its  present 
directipn  and  specificity.  If  proposed  legislation  is  Mssed,  it  would  certainly  destroy 
the  important  elements  and  direction  the  New  MCAT  "test  has' taken,  it  Wpuld 
undermine  the  confidence  the  Adn?issions  Committee  members  place  in  rt  as  a  tool 
for  admission,  and  it  would  oertainlv  make  the  admissions  process  more  subjective. 
Furthermore,  this  requirement  could  potentially  lead  to  . the  development  of  local 
tests  which  would  increa^  the  burden  on  candidates  with  limited  resources  and 
there  would  be  no  assurance  of  the  same  standard  of  cjuality.  WhiJe  the  MCAT  is 
only  one  dimension  of  the  admissions  process,  it  is  an  important- one  in  assuring 
fairness  in  the  admissions  pr9ce8s  to  all  students,  ft  is  well  known  that  such  things 
3s  personal  recommendations  presented  to  the  Admissions  Committee  are  sought,  by 
the  applicant;  therefore  the  process  of  self-selection  most  certainly  infiuences  the 
nature  of  the  submitted  recommendations.  Grading  and  evaluation  practices  vary 
donsiderably  am^ng  and  within yuridergraduate  colleges  and  universities,  artd  it  is 
totally  impossible  ta  think  that  Admissions  Committees  can  be  aware  of  the  various 
differences.  Moreover.  preconc/iyedHdeas  in  the  minds  of  Admissions  Committee 
metnbers  could  prejudice  then/  against,  very  desirable  applicants.  When  discrepan- 
cies arise  and  reduce  the  imoprtance  of  ^ny  one  of  these  'sources  of  information,  it 
may  present  an  applicant  iiV  an  unfavorable  light.  .Withoufkthe  reliability  of  the 
New  MCAT.  ♦  predict  that  /medical  school  adn>ission  committees  will  be  slowly 
forced  to  rely  on  more*  subjective  and  highly  ambiguous  information  in  reaching 
admission  decision^.  I.  therefore,  respectfully  urge  the  members, of  the  Subcommit-. 
tee  to  carefully  examine  the  claims  made  by  l|iose  in  .support  of  this  type  of 
legislation.  There  is  an  abundance  of  cliches  regarding  admission^  tests  that  is 
almost  totally  unsupported  6;ccept  by  an^dotal  evidence.  I  do  not  see  how  the 
provisions  of  thTs  bill  will  achieve  the  desired  results  of  those  proposing  it.  Minor- 
ities and  those  of  nontraditional  backgrounds  wilhlose  the  opportunity  the  MCAT 
has  givej^^em  to  demonstrate  cogrii;tive  abilities  at  a  lovel  which  enables  them  to 


proceed  mto  and  through  medical  school.  I  strongly  recommend  th^this  Subcom- 
mittee report  negatively  on  H.R.  4949.  I  sincerely  thanl^JfeiJ.  as  Chairman,  for  the 
opportunity  of  expressing  my  great  concern  regar(dj|^ this  piece  of  legislation. 
Most  sincerely, 

D.  Kay  Clawson,.M.D.,        , "  * 
.      '  Dean,  College  ojf  Medicine.  * 

University  oj' Kentucky.  - 

Chairman  PEttKiNS.  All  right.  We  will  get  around  to  the  question- 
ing in  a  few  minutes. 

Our  .next  witness  is  Dr.  David  'Gastfriend,  Chairman  of  the  Com- 
mittee on  Medical  Education,  American  Medical  Student  Associ- 
ation. • 

^STATEMENT   OF    DAVID   GASTFRIEND    CHAIRMAN,  MEDICAL 
EbUCATION  COMMITTEE,  AMERICAN  MEDICAL  STUDENTS  AS-' 
SOCIATION 

Mr.  GAsTFRiEND.  Thank  you  for  that  error,  Mr.  Chairman. 

Mr.  Chairman  and  members  of  the  committee,  first  of  all  I  am 
grateful  for  the  opportunity  to  testify  on  the  Educational  Testing 
Act  of  1979,  H,R.  4949. 

My  name  is  David  R.  Gastfriend.  I  am  a  resident  of  the  Stat0*of 
Pennsylvania,  a  graduate  of  Haverford  College,  and  presently  a 
medical  student  in  the  fourth  year  at  Jefferson  Medical  College  in 
PhiladelUhia.  . 

I  speak  about  testing  with  a  r^elatively  fresh  recollection  of  the 
Bcholastic  aptitude  test  (SAT)  the  old  medical  college  admission  test 
(MCAT)  and  as  recently  as  2  weeks  ago  the  tests  of  the  national 
board  of  mpdical  examiners  (NBME). 

I  also  serve  the  American  Medical  Student  Association  (AMSA), 
as  national  coordinator  of  its*  committee  on  medical  education.  This 
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cpminittee  convenes  the|Student'  representatives  to  curriculum  com- 
mittees at  all  U.S.  medical  schools. 

'  AMSA  is  comprised  of  over  20,000  dues-paying  medical  students 
^nd  i$  dedicated  to  the  improvement  of  medical  educ'ation,  health 
care^^nd  health  care  delivery.  It  holds  the  belief  that  access  to 
basic  health  care  is  riot  a  privilege  but  a  right.  „ 

Our  commitment  and  expertise  in  the  healt|i  care  problems  of 
rural  America  i?  rec9gnized  by.  HEW  in  that  MASA.  has  been  the 
contractor  for  the»  summer  program  of  the  National  Health  Serv- 
ices Corp.        ^  ^         .    ,    •    '  r 

In  the  past  4  years,  AMSA  has  been  mcreasmgly  concerned  over . 
the  issue  of  standardized  testing,  particularly  wigi  regard  to  the 
NBME  which  publishes  tb^  instrument  most  widl^  used  in  medi- 
C£tl  licensure.  ■  * 

We  hold  a  seiat  on  th6  board  of  directors  of  the  NBME  an(fhave 
participated  vigorously  in  recent  investigations  of  these  tests.  This 
testimony,  however,  will  be  related  primarily  to  tests  utilized  in 
medical  school  admissions,  i.e,  the  MCAT. 

Let  us  begin  with  the  assurnption  that'  the  role  of  this  le^slation 
is  to  protect,  not  the  standardized  tests,  but  this  society  which 
makes  use  of  the  tests.  Therefore,  consider  not  whether  this  bill 
will  have  ah  adverpe  effect  on  publishers  of  the  tests,  or  even  on 

educators.  f     >  .  . 

Instead,  we  address  ourseTfes  to  whether  the  present  situatio* 
creates  adverse  influences  on  ^ucation,  or  whether  society  and 
those  seeking  education  stand  to  benefit  from  this  reform. 

While  the  ^Association  of  American  Medical  Colleges  (AAMC) 
contends  that  the  MCAT  is  not  a  sole  criterion  in  the  selection  of 
America's  fature  doctors,  this  is  wily  a  partial  truth.  Since  the  test 
scores  are  utilized  to  scyeen  applicants  but,  for  many  this  is  the 
equivalent  of  a  sole  criterion. 

I  personfflly  have  known  many  otherwise  highly-qualified  preme- 
dical  students,  I  could  tell  at  least  two  stories  about  graduate 
students  in  theJikto^al  sciences  who  were  sufficiently  'qualtfie^i 
to  be  employed  ISJ'medical  schools  to  teach  medical  students,  yet 
who  were  clearly  told  by  advisors  and  admissions  officers  to  retake 
the  MCAT  because  their  scores  would  preclude,acceptance. 

Sq  I  think  there  are  flawe  in  citing  what  may  turn  but  to  be 
exceptions,  even  though  they  might  have  personal  relevance  and 
we  may  benefit  more  by  citing  comprehensive  studies  that  have 
been  made  on' the  tests.  ^  . 

This  is  a  pi^oblem  onTOCAT  because  2  years  ago  the  test  was 
changed.  I  would  like  to  go  into  what  problems,  wete  cited  as  the 
need  for  that  change.  I  think  the  opinion  of  studentalmay  be  borne 
out  in  ttar  next  2  or  8  years  by  the  studies  that  the  cHange  is  not  as 
significant  as  the  Association  of  American  MedicaLCoUeges  might 

have  ua  believe.  .  .*  ,5r    -  . 

The  AAMC  hol'ds  that  the  tests  are  essential  to  determine  who 
will  be  the  best  doctors,  that  they  are  designed  to  predict  how  well 
•  a  student  will  peifprm  in  medical  school  and  later  as  a  practicing 
physician.  ,  '  . 


Actually,  medical  educators  have  disputed  this  among  them- 
selves for  the. past  two  decades,'*  *  and  recent  research  has  shown 
that  there  is  no  significant  correlation  between  MCAT  scores  and 
perforniance  as  a  physiciaii.^ 

One  study  which  I  cite^  conducted  at  the  Universitv  of  Missouri- 
Columbia  School  of  Medicine,  reported,  cpncerning  admissions,  and 
I  quote:  '  ^  ' 

Typically,  GPA  and  MCAT  scores  are  used  for  this  screening  process.  As  the 
screening  device  becomes  more  restrictive,-*  possibiiities  exist  that  students  with 
othe^desirable  characteristics  will  be  eliminated  from  the  applicant  pool. 

Neither  of  the  cognitive  measures,  college  GPA's  or  MCAT  scores<  correlated 
•significantly  •  •  •  with  internship  letter  ratings  after  four  years  of  medical  school. 
(Exhibit  A.)  "       ■  . 

Another  study  fram  the  University  of  California,  Berkely,  stated: 

'  It  must  be  concluded  that  ratings  of  internship  performance  for  these  students 
Vwere  not  related  to  and  could  not  be  predicted  by  MCAT  scores  V  *  \*  (Exhibit  B.) 

This  report  even  found  that  MCAT  scores  tended  to  be  negatively 
related  to  ratings  of  the  youngl  doctors  by  their  sujperiors.  There- 
fore, the  point  is  made, that  emphasis  on  these  tests  is  not  useful, 
and.  may  even  be  detrimental  in  the  selection  of  our  future  physi- 
cians." . 

There  is  further  evidence  on  this  issue.  A  major  study  of  the 
MCMT  prior  to  its  revision.  Conducted  by  the  AAMC  itself,  found 
that  MCAT  performance  w§s  significantly  related  to  race,  and 
statec  that:       <,  .  v 

An  jldmissions  policy-.based  exclusive^  on  CPA's  and/or  MCAT  scores  would, 
proportionately  excude  minority  applicants  from  medical  'education.*  (Exhibit  C.) 

This  is  troubling,  particularly  since  these  tesjs,  historically- 
emerged  in  the  search  for  equality  in  education,  and  objective 
standards  held  the  promise  of  rewarding  ability,  selecting  purely 
on  the  basis  of  merit,  without  regard  to  racial  or  any  other  preju- 
dice. 

^  Now,  we  learn  that  the  bbiective  instrument  itself  may  have  an 
inherent  bias.  Thus,  many  admissions  officers  fouhd  it  necessary  to 
crea^  separate  criteria  for  the  admission  of  those  students  who 
could  best  serve  the*needs  of  the  society.  Meanwhile,  those  students 
selected  by  the  testi  a/*the  best  and  the  brightest  may  not  have 
been  the  best  for  society.  ' 

What  are  \he  l»rt$fits  of  this  proposed  reform^  howevejr,  because 
since  these  tests  iWe'  been  shown  to  have  problematic  and  pos^bly 
detrimental  influem^s  on  the  selection  of  n6w  physicians,  we  will 
let  that  stand  as  a  primary  concern,  and  not  elaborate  on  second- 
ary issues  such  as  \whether  the  bill  will  injure  the  reliability, 
validity  or  economic  expediency  of  the  tests. 

However,  regarding  fiscal  implications,.!  would  like  to  state  as  a 
medical  studetit  that  when  a  test  will  determine  the  course  of  the 


'Gottheil.  E  ,  and  Michael.  CM.,  Predictor  Variables  Employed  in  Research  on  the  Selection 
of  Medical  Students.  J.  Med  Educ.  :\2:  131-147,  1957.  [ 
»GouKh,  H,S..  Hall,  W.B.,  and  Harris.  R.E.,  Evaluation  of  Performance  in  Medical  Trair  Ing,  J 
•  Med  Educ.  H9:  «79-692.  1^64.  *  ^ 
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of  Clinical  Success  in  Medical  School,  J  Med  Educ,.rj3:  711-719,  1978. 

*Kegei'Fio.  P..  Predicting  Supervisor.  Peer  and"  Self  Ratings  of  Intern  PerTormance,  > 
Educ.  50;  813-815,  1975.  >  *r  .  ,  'F 
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r^st  of  my  life,  the  price  of  it  is  the  least  of  my  worries,  *id  I  have 
yet  to  hear  a  fellow  student  haggle  over  the  cpst  of  an  exam  in  the 
hopes' of  a  discount  ^ 

.  •  Indeed,^  let  us  consider  whether  the  constituency,  the  student  arid 
the  public,  standf  to  gain  from  this  reform,  Tljere  are  three  student 
neeas  which  arS  addressed  by  this  bill: 

One:  A  need  for  feeback;  /  , 
•  .Two:  A  need  for  equal  Opportunity  for  test  preparation;  and 

*  Thre«:  A  need  for  input  and- participation  in  the  evaluation  and 
policy  determination  process.  Let  me  begin  with  feedback. 

When  you  thint  about  feedback,  you  might  wopder,  Jbr^what 
God  fors^^ri  reason  would  a  student  seek  feedback  on  a  test  after 
sitting  through  2  solict  days  of  nearly  1,000  iSTuTtiple-choice  ques- 
tions? What  could  be  more  tir,esome  than  to  then  review  all  wie 
answers  you  might  asL"  ^  '  o  ^ 

The  problem  here  is  that  you  are  lookirfe  on  from  the  perspective 
of  one  whcf  has  done' well.  Look  again,  buV^om  the  other  pergpec- 
tive:  Upon  seeing  youi*  scores  you  i)«wv  realize  that  you ''may  well 
fail  tgr  gain  adpiittance  to  the  cpllege  of  your  choice,  or  you  may 
fail  to  gain  admittance  to  medical  school  Qntirejy  this  yeaTr. 

*  if  you  are  dedicate^  to  the  aspiration  of  becoming  a  doctor,  you 
(»rtainly  will  want  that  feedback  bidly.  You  wiljwant  to  know  the 
^weaknesses  in  your  knowledge  base,  your  patiifg,  your  cojnprehen- . 
sion^aitd  interpretive  skills.  We  know  students  want  this  feedback. 
We  kno\v  because,  they  pay  for  ii;  "  ^  '        ;  , 

;  The  ^many  students  who  seek  out  coriimerciai  preparative 
courses,  paying  as  much  as  $500  to  lelarn  this : same  information, 
often  from  pirated  or  Verbatim-memorized  test' items,  in  hopes  of 
$0-  to  iOO-point  improvements  on  SAT  or  MCAT  scores,  these  stu- 
dents and,  many  moi'e  seek  the  "very  feedback  fhis  legislation  would 
provide.  .       ;     ■  /   ^  ' 

However,  at  the  i>resent  time,  only  certain  ^uderitlrcan  afford 
these  luxuries.  Release  of  this  information  wouM  tend  to  equalize 
the  opportunity  Ifor  students  to  prepare  for  these  tests  since  every 
student  M{Puld  have  access  to  aT  pool  of  standard  questions  and 
correct  answers  from  which  to  pretest  and  review  performance.  . 

Finally,  there  is  the  problem  of  accountability  and  diveifsity  of 
input  into  the  policy  determinations  of  tesFpublishers.  Educational 
testing  service  OETS)  reports  that  *  *  authority  concerning  its 
operations  is  dispersed  among  sponsors,  committees,  professional 
associations,  staff  and  institutional  useris."*?  * 

Yet,  considering  the  immense  effect  of  this  QorpoVation  on  the 
lives  and  careers  of  students,  students;  are  notably  omitted  from 
any  such  role  at  ETS.  3V-e4ielieve  that  both  students  and  the  public 
have  a  necessary  atfd  •  legitimate  role  in,  policy  determination 
among  educations  tei3t  publi8hers.t 

In  AMSA's  experience  with  the  NBME,  thi^  role  is  not  easily 
accomplished  by  the  presence  of  a  token  representative  on  a  corpo- 
ration^ board.  Access  to  information  may  provide  a  more  tangible 
route. 

'  I  would  venture  that  with  the  inforination  that  this  reform 
would  make  available,  individual  students,  student  groups  such 

*  Premer,  J.  an^  Irby,  A  Jm  Why  Should  Som^  Teste  Be  Secure?,  paper  preeented  at  the  $priAg 
Conference,  of  the  NatlonarCoeortium  on  Toting,  Arlington,  Va.,  April  1979. 
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AMSA,  independent  research  teams,  consumer  interest  groups,  et 
cetera,  would  find  it  easier  to  examine  the  policy  manifest  in  these 
tests  and  these  groups  would  be  able  to  make  more  active  and  valid 
contributions  in  this  area. 

To  summarize  the  points  I  am  bringing  to  you,  there  is  evidence 
that  the  MCAT  is  not  essential  to  the  selection  of  good  physician 
candidates,  although  it  may  too  often  be  used  as  if  it  were  essential 
and  its  use  is  not  helpful  in  selecting  future  pkvsicians,  although  it 
may  be  detrimental.  '  \ 

*»This  is  the  essence  of  our  concerns.  And^econpmics,  reliability, 
and  validity  only  serve  jto  cloud  the  issue. 

Students  clearly  want  feedback  on  these  exams  which  influence 
the  course  of  career  and  life.  The  Congress  should  act  to  equalize 
currently  available  advantages  in  commercial  cram  courses  by  prc^ 
viding  actual  test  responses  and  corrections  diractly  to  students. 

The  public  needs  more  data  and  better  means  of  scrutinizing  the 
te^t  industry  so  as  to  address  the  very  types  of  discrepanci0s  dis- ' 
cussed  abovQ,  For  these  reasons,  the  Atnerican  Medical  StudAt 
Association  supports  the  principles  of  H.R.  494^. 

Thank  you.  ,    "  ■  .    ■  ^ 

[Material  submitted  for  the  record  follows:] 

/       4  k  ■ 
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EXHIBIT  A 

Academic  and  Personal  Predictors 
Of  Clinical  Success  in  Medical  School 

Robert  Murden,  M.D.,  Greg  M.  Galloway,  M.D:, 
John  ^.  Reid,  Ph.D.,  and  Jack  M.  Colwill.M.D. 

Abstract— Admiss^ns  interview  data  and  college  academic  9redentials  of  Hve  classes 
of  University  of  Missouri-Colunibia  medical  students  were  evaluated  as  possible 
-predictors . of  clinical  success.  Those  students  who  were  judged  by  admissions 
interviewers  to  have  high  levels  of  maturity,  nonacademic  achievement,  motivation, 
or  rapport  were  approximately  two  to  three  times  as  likely  to  receive  outstanding 
.internship  recommendations  as  those  without^uch  persona)  characteristics.  Under^ 
■  graduate  grade-point^erage  had  a  smaller  but  nevertheless  significant  relationship 
With  clinical  success  as*  measured  by  internship  letters.  These  data  suggest  that 
additional  qmphasi^  during  selection' upon  applicants'  personal  characteristics  would 
(lave  enhanced  the  clinical  success  of  these  students.  - 


tained  from  application  forms,  letters  of 
reference,  and  interviews. 

The  effectiveness  of  selection  processes 
should  be  demonstrated  thi^ough  high 
correlations  of  each  of  the  selectioiT  cri- 
teria vyith  success  in  medical  school. 
N4any  studies,  however,  have  demon- 
strated little  or  no  correlation  of  various 
admissions  parameters  with  academic 
success  in  medical  schc^l. 

Typically,  investigators  have  reported 
low  correlations  of  GPA  with  perform- 
ance in  the  first  two  years  of  medical 
school  and  even  lower  correlations  with 
clinical  performance.  Despite  these  low 

Dr.  Murden  and  Dr.  GiUowiy.  formerly  mcdi-'  correlation?,  GPA  in  most  studies  has 
cal  ftttuknU  ai  the.  University  of  Miiioun*Columr 
bia,  arcuctirrently  retkknt  physicians  at  the  Ifniver* 
sity  of  Texas  Medical  Branch.  Galveston,  and  the 


Annually  admissions  committees  at  each 
of  the  nation*s  medical  schools  face  the. 
difficult  task  of  selecting  a  9lass  from  a 
Jiuge  pooi.of  highly  qualified  applicants. 
1^  ,most  schools  this  process  begins  by 
screening  out  candidates  who  have  lower 
grajjje-point  averages  (GPA)  and  Medical 
Coiege  Admission  Test^(M£AT)  scbfts; 
Committee  members  then  interview  the  . 
remaining,  omdidates.  f^inally,  admi^ 
sions  .committees  se|ect  those  candidates 
perceWed  to  be  most  outstandings  using  . 
^  as.^jiection  criteria  datd  on  both  aca* 
demic.  and  personal  characteristics  ob^  ^ 


been  the  best  single  predictor  of  subse- 
^quenf  medical  school  |;^rformance  (1.2). 


University  of  Iowa  Colle|e.«l  Medicine,  Iowa  City, 
respectively  .4>r.  Rcid  is  proiessor  of  education  and 
^Dr.  Colwill  is  chairman  of  the  Department  of 
Familyand  Community  NfediciM  at  the  UnWersiiy 
of  Missouri*CoIumbia  School  of  Medicine .  * 
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1\2   JoiintulofMiiiiait  lulm^  Vol..  53,  SmtMiihi  PHH 

Ihc  grciilcsi  value  ofihc  M<  A  l*  iJRhas  Icailcrsliip  were  mh  a  fiiclifr.  an  nilmii- 

bccitUiMrrccnoUl  ihnsc  wilh  low  itcnrcs  sioiis  coinmillcc  mighl  mjIccI  a  5iudc»l 

whci  arc  more  likely  lo  have  aeademje  Wilh  slrong  leadership  characlerislies 

diflkiilly  (5).  However,  wilh  Imhiy^ssur-  irveu  Ih6ugh  his  QPA  mighl  be' low. 

plus  o(  all  bul  jninorlly  candidoles,  Ihe  Sueccss  of  Ihis  slud^ni,  in  medieal  schtHil 

issue  is  how  lo>clecl  oulslanding*candiw)  woufd  furlhcr  conlribule  lo  low  eivrela- 

dale>ralherlhan  how  lo  screen  oul  high-  lions  of  OP  A  wilh  academic  success, 

risk  applicanls.  AnoIhA  tonlribulor  lo  low  correlalj^ins 

Kelalively  few  researchers  have  exam-  islow  reliabilily  of  cilher  Ihe  prediclor  or 

*inetHhc;relarionshiiWi«f  admissioniiinler-  Ihe  crilerlon  measure.  Such  mighl  cRXur 

view  dnia  and.ineUieal  schinrf  iwrform-  when  GPAs  al  differcnl  colkges  rt-fleel 

aoce.(iollheil  and  Michael  (5)  dcscriinrd  differeiil  levels  of  achi>:vemenl  (9)  or 

ail  iiiipirblished  sludy  by  A.  W,  llurd»  when  ihe  performance  criterion  is  unreli- 

who  rep4tj[led  a  eorrelalion  of  .39  be^  able. 

lweef\inlerviewer*spereeplion»of  appli-      Thus.  Ihe  besi  assessment  of  the  im- 

cants  pers4)nalily  amt  tirsl-year  inedieal  p<iclanec  off  various  predictors  would  re- 

schiMil  grades.  Giiugh.  Hall,  and  Harris  quire  random  seleeliiin  wiihout  regard  to 

(4)». studying  81  students,  found  a  low  Ihe  predielors  to  be  tested,  high  rVliabil- 

•  correlation    ,1  T  between  overall  adniis-*  ily  in  meaftrenieiil  of  ihe  predielors.  and 

sions  inlelSfcw  riilinis  and  overall  grades  high  reliiibilily  and  validity  of  Ihe  per- 

in  medi;c4;:^chtH>l.  Richards  and  Taylor  formaiice  measye.  It  is  little  wonder  that 

(6).  using  b5,6lah  medieal  students,  re-  correlations  in  past  studies  have  been 

|)oried  correli^liiins  from  .lb  to  .32  be-  low.  ,  V 

Iween  admisskms  interview  ratings  and       While  Ihe  absence  of  a  significant  air- 

grades  in  in^ieal  scbtHil.  Johnson  (l)  relation  of  an  admission  variable  with 

obtained  a  eorrelalmn  of  .17  between  medie^il  schiKil  performance  may  not  ruW 

overall  iiirtervHsw  ratings  and  eViuiulative  out  its  value  as  a  selection  variable,  it 

medical  sehiMil  grade  average  of  399  Syr-  dv)es  suggest  Ihdl  election  of  sludeiils . 

aeAsc  siwdenls.  Mensh  (8)  repiirled  that  wilh  still  higher  scores  on  the  variable 

neitlier  inlerview  dala  nor  college  grades  *  will  mil  increase  further  Ihe  quality  of  Ihe 

eorithiled  with  elinkral  grades^  al  UCLA  class.  Ciinverscly,  the  presence  of  i^sig- 

tkhiMl  of  Medicine.  nifieai^t  correla|kin»  even  when  small, 

Al  least  lo  a  .iWgrce  these  k»w  .cor-  suggests  that  added  emphasis  on  the  pre* 

relations  may  resuh  from  melhiHkikigical  dictoV  miiy  well  ij^crcase  the  quality  of 
lUfficullies.  .For  example,   admissions    the  class. 

Aninnillees  seek  eiimlidales  with  high  Tlie  piir|xise  of  this  paper  is  lo  reptirt 
(•pa!  If  Jill  selected  applicants  had  a  the  relationships  oLjneasu res  of  perscmal 
jTiPA  of  4.0.  ^lhe  eorrelalion  for  Ihll  chnracleristies  and  of  college  academk 
groujY.wilh  any  oulc^ime  measure  would    perfonnanee  wilh  clinieal  success,  niea- 

. be  zero.  Thus,  when  selecllim  is  based  ^ured  by  internship  kllers,  of  University 
u^m  a  prediclor,  the  seietli<in  reslrkts    of  MisMiuri-Coluiiibia  medical  students . 
Ihe  range  of  Ihe  predictor.  Consequently^    four  years  later.  »  " 

later  efforts  lo  demouslrale  a  ei^relalk>n  Clmphasis  iV.given  to  the  degree  to* 
of  that  prediclor  with  success  can  only  which  Ihe  specific  persiinaleharaclerisifcs 
yield  kiwe red  correlatkms.  of  •malurily,'*  -nonaeailemk:  achieve- 

Furlhcr.  mullipkr  factors  pri*bubly  eon-    menl,"  •^rappiirl,"  and  -imitivatkm  for 
tribute  to  medieal  schikil  perfonnanee.  If    medicine./  as  judged  by  iidmissions  in- 


Icrvicwcrs^.  were  rclallnl  lo  clink'nl  per- 
furinuncc.  Previous  siitdies  of  the  impiir- 
lunee  of  Ihe  ;idniissiops  <inlcrvlew  have 
^iscil  overall  inlerview  lalings  ralher  Ih^n 
raiiiigs  of  specific  pclsitnal  charade ris- 
lies.  Significani  currcAlions  bclween  ral* 
ings  of  specific  personal  trails  and  clinical 
perfo||nancc  four  years  laier  would  sup" 
porl  Ihc  value  of  the  inlerview ing  process 
ami  luMify  ef furls  lo  develop  more  objec- 
live  measutes  of  ihese  prCdiclors,  ' 

AIm)  of  in  Ic  rest  was  w  he  I  her  measures 
'of  personal  Irails  could  assist  admission 
com  mil  lee  members  in  sclecl  Ing  the 
sirongesi  cahdidalcft  for  inlerview.  Typi- 
vally  CiPA  and  MCAT  scores  have1>een 
used  lo  screen  candidates  for  ihe  inler- 
view. However,  some  aulhors  have  sug* 
gesred  ihai  raising  ihe  CPA  level  neies- 
siiry  for  acceplance,  wilhoql  considera*' 
lion  of  personal  irails,  Will  nol  necessarily 
increase  ihe  4^uulity  of  ihe  cIm^7,  10). 
A  Screening  process  based  bi>lh  upon 
cognitive  factors  and  perS4)nal  Irails 
might  enhance  the  quality  of  sludenis 
brought  lo  inlerview!  . 

Procedure 

Admissions  dala«  including  college  aca- 
deoiiiiperforknance  and  inlerview  ratings, 
were  analyzed  for  five'  medical  classes 

•  (458  sludenis)  eiile|fing  the  University  of 
Missouri-Columbia  School  of  Meilieinc 
from  1V66  lo  IV70.  Sixteen  sludenis 
were  dropped  for  aCaUemic  reasons, 
withdrew  voluntarily,  or  had  not  gradu- 

;.aled  by  June  IV74,  \ 

.:  During  this  period  all  applicaais  frouij 
Mi^S4)url  and  a  sca*encd  portion  of  out- 
t)f-sialc  applicants  wcfc  interviewed  in- 
itividiially  by  three  members  of  the  ad- 

"Hii^sions  .committee,  liach.  interviewer 
u^d  the  students*  (otal  file,  including 
aMilicatiim  materials^  college  transcripts* 
Ml'AI'  scores',  and  letters  of.  reference. 

bach  eundiilaie  was  rated  oii  the  irails 
of  mahirily,  nunucadcfhic  achievement, 


713 

rapport,  and  nmlivalion  for  medicine. 
The  interviewer  rated  each  of  ihese  Vhar- 
acierisfics  on  a  five*poinl  scale  from  -  2 
lo  f  2  based  uptm  Ihe  degree  lo  which  he 
fell  the  churaclerislieseilher.enhanccd  or 
delracled  from  Ihe  candidacy  of  Iht^ ap- 
plicant. I  hose  admitted  fell  iin  a  ihree- 
poinl  scal^*  from  0  lo  f  2  with  VM)  percehl 
being  ralcd  cither*  0  or  Sludenis 
rated  zero  on. any  of  Ihe  foK  Irails  were 
regarded  os  having  "hAinhancihg" 
(|ualilies  Miih  respect  lo  Ih'irail,  ih(»se 
rated  from  0  ti)  1  were  regaAled  a^t  having 
"enhancing"  (|u»liiies.  and  thoM2  rtyed 
from  I  to  2  were  viewed  us  having 
"highly  enhancing'*  qualities.. 

Personal  chtinKierislics  were  mU  pre- 
cisely defined  for  Ihe  commillee.  How- 
ever, weekly  lhrce*hour  tneelings  of  Ihe 
cohimillec  lo  discuss  and  select  appli- 
cants erealed  informal  o|>craiional  defi' 
nilions.  * 
.  Nonaciidemic  achievement  was  brtiudly 
defined  for  the  conimillee  as  "leadership 
activities,  uiccomplishments,  und  olher 
measures  of  noniicadcmic  success."  Suc- 
cess in  college  exira*currieular  aclivilies 
was  usually  the  basis  for  commillee  niem- 
bers  feeling  thai  nonacademjc  achieve* 
men  I  enhanced  Ihe  candidacy  ^)f  ihe«}ip- 
plicant.  X 

In  this  paper  the  performance  crilcritm 
is  the  internship  .evaluation  letter  pre- 
pared on  Ke half  of  each  graduate  by  a  I  fV 
member  Inlernship  Advis4)ry  Commillee. 
I'his  comniiltee  estimated  a  student's  fu- 
ture, success  ift  an  intern  classifying 
the' student  into  one  of  four  categories: 
"  A**  lecommended  with  ent^husiasm, ''D'* 
sirongly  recommended.  '*C**  reconi- 
mended  with  confidence,  and  "P*'  rec- 
ommended with  reservation.  Since  only 
seven  of  tb^'  442  were  in  the  D  category, 
they  were  added  to  Ihe  C  category  in  this 
study. 

The  commillee  met  weekly  during  fall 
months  to  illiview  ami  mnlify  draft  cval- 
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uulion  Icllcrk  prepared  by  individual 
vommillec  members,  hach  x:ommiMec 
mcmlRT  advised  eight  In  10  students  and 
iflfd  responsibility  both  ti^ounsel  those 
slu'dcrits  regarding  internships  and  to  pre* 
pare  the  initial  draft  of  the  evaluation 
.lc|ti;r  The  committee  as  a  whole,  having 
availahle  t^e  draft  Ictlef..  the  student's 
file,  and  usually  a^icrsunal  knowledge. of 
the  stiidcnli  voted  on  the  level  of  rccoin* 
meiidution.  Inasmuch  as  the  committee 
usytl  clerkship  evaluations  as  part  of  the 
information  to  rate  students,  these  clerk* 
ship  evaluations  correlated  betweci^  .68 
anil  .77  with  internship  letters.  l!fie  stur 
dents  were  rated  on  their  clerkship!^  in 
the  foHowing  areas:  clinical  knowledge, 
basic  understanding  of  medical  princi- 
ples, manual  and  personal  skills,  atti- 
tudcs.  and  desirability  as  a1>ousc  officer. 

Further,  correlations  of  admissions 
iluta  with  each  of  the  clinical  clerkship 
measures  were  nearly  identical  to  corre- 
lations t>f  admissions  data  with  the  intern- 
ship letters.  Thus,  the  fmdings  reported 
/here  would  have  been  similar  had  clerk-. 
I  ship  measures  been  used  as  performance 
(  criteria  instead  of  internship  Iciters.  Cor- 
relaiitms  in  this  paper  are  Spearmiin  rhos. 

Findings  /  * 

Table  I  lists  in  decreasing  order  corrclar 
tiOns  of  personal  traits  and  academic cre- 
dcntMls  with  clinical  performance.  As 
generally  noted  in  previous  studies,  over- 
.alKorrelations  are  small. 

■u  !  li  iiMM  I  m  rnf  ^ 

.MWiiifPtiiiw  I       '\sy\\    iij  I 

<in  lOi  Iwiil  iiilili  iMiui  hiy4MM<ii»liii§> 

^Mi  flMiii  I  I  il  fil.  On 

the  other  hand«  ratings  by  admissions 
interviewers  of  the  personal  eharactcns- 
tics  of  .maturity,  nonacademic  .achieve- 
ment. m(|tivation  for  medicine,  and  rap- 
porf  correlated  significantly  iA44h  the  io- 
terrtshipletle^icatlng  ^p  -  .t)003).  " 


Maturity,  motivation,  and  rapport 
scented  to  form  a  constellation  in  the 
eyes  of  the  interviewers,  with  maturity 
correlating  .60  und  .39,'  respectively, 
with  motivation  and  rapport.  Motivation 
correlated  with  rapiHirt  .49  {p  ^  .0001 
for  iill  three  correlations),  Age  was  not 
correlated  with  maturity  (r  «  .()l).  Non* 
academic  achievement  correlated  with 
the  constellation  of  maturity/  rapport, 
^nd  motivation  .30,  .40.  and  .24  respec- 
tively ip  <  Xnm  for  all  three).  *  * 

Low  correlations  noted  in  Table  I  may  ' 
simply  reflect  the  fact  that  students  were 
selected  from  a  narrow  portion  of  the 
total  applicant  pool  on  that  variable.. 
Conseituently,  comparison  of  applicants 
rated  highest  .and  lowest  on  admissions 
variables  might  more  effectively  demon- 
strate the  predictive  value  of  the  vari- 
ables. Such  a  comparison  is  reported  in 
Table  2.  Students  with  highly  enhancing 
levels  of  maturity,  nonacademic  achieve- 
ment, and  rapport  were  two  to  three 
times  more  likfly  to  receive  A  internship 
letters  than  those  without  enhancing 
levels.  (Two-by-two  chi  squares  on  these 
three  variables  with  A  and  C  letters  ver- 
sus highly  enhancing  and  nonenhancing 
qualities  yielded-significiint  levels  of  less 
than  ^002  for  all  three.)  Nigh  and  hiw 
CPA  and  M.CAT  scores  did  not  discrim- 
inate significantly,  between  A  and  C  let- 
ters. 

Combining  two  or  mtVrc  relatively  un* 
related  predictors  might  further  discrimi- 
nate between  A  alfd  C  letters.  Because 
ratings  of  CPA  and  tfxch  of  the  p^rsiihall 
characteristics  showed  little  correlation! 
the  investigatory  compared  the  combined 
effects  of  each  of  the  personal  character-  4 
isjics  and  GPA.its  predictors  of  intf-rnship 
lett<irs.  Table  *3  includes  fo^r  t1irec-by- 
three-by-tlu^e  tables  of  internship  letter 
categiiries  tabulated  by  levels  of  GPA« 
one  table  each  for  maturity,  nonacademic 
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TABIC  I 

.    vtrtHy  of  Mtetoud^iimMt  MMNoti  8ludtnta  Enttririg  IfM  to  ItTO 


.  MatwrHy 
Ra|ipi»rt 

NiimKMkmk  Khicvemcnt 
MiHiviitkm 

'  Science  GfMk-Putiit  Average 
Medk-al  C  c>IW|tf  Admliiion  Tckl 

Verbal  AbiKty 

Ouaniitative  Abllliy 
»  Si'knct 
Age 


SpcaniiM 
f 

.22' 
.22* 
.IB' 
.I8« 

.08 

04 

-.01 
-.03 
-  04 


TABLE  2 

Impact  ol  *Mlgli'  tnd  'L6w*  Mttturta  ol  Admlatlont  Prtdlclora  on  Inlom- 
oMp  toHoro  of  43S  Unlvofvlty  ol  Mlavouii-Columblo  Modlcol  BludtiHs 
Enuring  IfM  If  1170 

CMH9My  — —  


Maturity 

Highly  enhancing 

NtMKnhancing 
Nonacademic  achievcnvnt 

Highly  enhancing 

Ntmenhancing 
Motivatiun 

Highly  enhancing 

Nonenhancing .     •  . 
Rap|K)rt 

Highly  enhancing 

Nunenhandng 
Total  CPA 

3.5  Of  over 

3.0oriin<kr 
Science  MC AT 

600  or  over 

470  or  under 
Tc»lpl  Group 

*  Lclltr  ratings:  A  «>  recommcmkd  with  enthuiiaim.^  < 
.^and  C  ■  recommended.  .    ^>  ^ 


Stwknii 

A 

B 

"  r 

I4S 

•33 

42 

23 

•78 

10 

38 

'  51 

122 

35 

40 

•  25 

MB 

40 

41 

128 

30 

41 

28 

90 

17 

39 

44 

33  • 

.40  • 

27 

34 

IS 

39 

'  46 

H3 

.  31 

33 

36 

ISO. 

.  19 

42 

39 

88 

26 

36 

38 

21 

50 

30 

442 

24 

42 

34 

strongly  recommended. 


achicvemeni,  molivalion  fqr  medicine, 
and  rapport  . 

The  following  paragraphs  describe  Ihe 
slalislical  analyses  used  lo  evaluate  Ihe 
relative  contribution  of  CPA  and  each  of 


Ihe  four  personal  characteristics  (Table 
3).  In  Table  3  OPA  has  been  divided  iqlo 
low,  medium »  and  high  levels,  and  each 
of  Ihe  (our  personal  characteristics  has 
been  categorized  as  nontsnhpncing,  en- 
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•    .  TABU  3         .  ' 
Tilt  Rtltttofi  ol  In^witWp  tiWif.  FtrtofiM  CtlirMltrliticf,^¥fKl  Qr»tf«-Po(nl  Avtrtett  fof  4JS 
Unlvtrtlty  ol  Mitt ourl-ColumMi  MM^fsal  Sludtnli*  Enltrlng  19M  lo  1970 

Intel n%hip  UUvt  I  'akiiiriirt 


Malufiiy 

.     A/-^«       •  !«• 

Non»i)Hk'titk  tichk-vcmcnl 
Nurnhvi    fiiutlcnu  .^0  82 

lVKi:iit{i]l  of  tellers 
A       .  .  16  12 

H  4A  45 

t  38  43 

MoliViilkHi 
Nuinbi  f  <»(  hiu^knU  '  3^  '89 

Pv'riviilii|(c  i»(  klicn 
A  M  lA 

42  41 

(  44  42 

K;»pp(»ii 

Numhci  f»(  Muilcnu  2^  84 

Fcrivitltigc  u(  Icllgn 

A  0  ir 

n  '  .45  40 

i  55  43 

*  hM  Iciiei  iMiin^.     Tnhtc  2  (tMtlfWtit:. 

hnncing.  iir  highly  cnhuncing.  In  general, 
the  higher  Ihu  applicunl  Wus  ruled  on 
CPA  uiid  pcrstinul  charactcrisiics,  Ihc 
higher  wjts.lhc  inlcrn&hip  Idler  ruling. 

The  enlremes  of  OPA  anii  eueh  of  Ihc 
pcrMMUil  ehuriitleriiilies  clearly  ilemon- 
slrule  Ihe  ciSnibined  impuci  (if  these  pr<^' 
dictors..  l  or  example,  only  three  percent 
(if  the  applitains  withjow  GPA«and 
linehliuiicing  levels  of  matiirity  reeeived 
.A  letters,  wliile  56  percent  with  OPA 
.  greater  than  1.5  und  markedly  enhaneing 
maturity  received  A  letters. 

To  coinpare  htutisticully  the  cumbinei) 
effects  of  (iPA  and  iliaiurity  on  intern* 
ship  letters,  the  first  part  of  Tuble  3  was 
uaaly/ed  as  though  it  were  a  tluecby 


llifMy 

liii^ 

hnranc« 

.  ^7 

28. 

25 

25 

47 

36 

28 

39 

44 

46 

311  . 

22 

34 

33 

3A 

46 

51 

36 

'24 

IV 

43 

36 

33 

44 

68 

20 

22 

35 

'  46 

3(1 

32 

35 

I  nluiHc 


H6 


MifMy 


61 


21 

48' 
31 

81 

23 
4H 
2H 

HH 

26 
48 
26 

67 

13 
52 
34 


31 
48 
21 

.48 

31 
54 
15 

51 

27 
49 

24 

86 


I  n- 
Hi  live 


IV 

0 
47 

53. 

22 

18 
.  41 
41 

18 


Medium 
HnliarKC 


38 


33 


45 
22 


17 
44 


'  8- 
42 
50 


37 
32 
32 

32 

31 
28 
41 

40 

32 
32 
35 

26 

19 
38 
42 


l.n- 
kinoe 


27 

56 
19 
26 

30 

50 
27 
23 

.  26 

50 

27 


5t 
22 
27 


oj  47.53,  p  <  .(MKM)6.  Thus.  OPA  and 
matority  combined  had  a  significant  rela* 
tionship  with  internship  ratings.  The  next 
step  was  to  test  Ihe  eontribulivo  of  ma- 
turity to  the  internship  letter  independent 
•of  CiPA  When  cells  differing  in  GPA 
^ alone  were  lAUIed.  a  three^by-three  table 
of  internship  letters  by  maluMty  raiings 
resulted.  A  e^t-S(|4iare  (4  df)  on  Ibis 
three-by-threc  table  was  21.89.  p  « 
.(MMI2.  Thus,  maturity  alone  had  a  signifi- 
cant refationshjpVith  internship  ratings. 
The  chl-square  (4  df)  oi  2I..8M  for  muru* 
rtty  when  subtracted  from  the  itverall  cbi- 
square  ( 16  J/)  produced  a  ehi-square  ( 1 2 
if/)  of  25. 66  {p*<  .(t2)  (I  I).  The  last  ihi- 

  _^  _  _  _   ^     Si|uarc  represented  the  impact  of  GPA 

nine  table.  Ihg  dutu  yielded  a  chi-stfuure  *  on  Internship  Uiteis  ufter  maturity  bad 
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hiYUgh  less 


hccii  acciiunicd  fur.  Htus, 
iiignifkanl  prcdiclur  of  Ihctint 
Icr  (p  <  .02).  Ihdugh  less  to 
rily  (/I  <  AHmy  A  belter. 
coniHKm.  icsl  in  ihissiluiilion  is  Kcndairs 
lau  fur  nrdcrcd  conlingcncy  lublcs  (12); 
il  priHlui'cd  similar  results,  but  with  p  < 
.1NMMH)3  for  the  rclaliiMiship  uf  maturity 
^anil  internship  letters. 

Analyses  of  the  effect  of  the  other 
three  perumal  variables,  mmacademk 
achievcmenl.\mitivation.  and  rapport,  to 
GPA  ami  internship  ratings  were  earried 
out  in  a  similar  manner. 

For  MonaeaJemic  aehlevement  the 
.  overall  vhi-square  (I6(//)  was  36.54. p  < 
.tKU.  ihdieating  that  the  combined  effect 
of  GPA  and  ratings  of  nonaeadeniie 
achievement  had  a  significant  relation- 
ship to  internship  ratings*  Nonacadcmic 
Hchicfemenl  had  a  signifli-ant  relation- 
ship with  internship  letter  (chi-square  |4 


A  ^as'  a  rapport  and  internship  letters  were  sig- 
nship  let-  Nilfieantly  related. 


al  traits  obtained  from 
lews  had  higher  corre- 
al siK'cess  as  measured 
r^*eom  me  nila  t  io  n  le  t  tc  rs 


Ratings 
admissitf 
la  lions 
by  iml 

than  did  eonventitmal  cognitive  variables 
such  as.  undergraduate  GPA  ami^MfMT 
scores.  Highest  corrclatiims  occurred 
wilh  the  interviewer's  juifgrnenl  of  the 
degree  to  which  the  candidate^  maturity 
enlianced  or  Octraetyd  frojiL  his  candi- 
dacy. Indeed,  enhancing  levels  of  matu- 
rity seemed  almost  a  prerequisite*  for 
outstanding  perfi»rmanee  jnasmuc^h  as 
only  Ml  percent  of  students  without  en- 
hancing levels  of  maturity  received  A 
letters.  Further.  studenls.witbJii^hly  en- 
hancing levels  of  Maturity,  nonacadcmic 
achievement,  or  rappmt-we«  two  to 


ilf\  «  14.88. p  <  .(K)5).  as  did  GPA  after  (three  times  as  likety^to  receive  Abetters 


subtracting  nonacadcmic  achieyement 
fronri  the  cn)mbincd  effect  (chi-squari^  1 1 2 
tif]  «  21.66.  p  <  .O.S).  KendallV  lau 
produced  a  significance  \*vel  of  p  <;> 
.(KK)3  for  the  relatiimship  of  nonaca- 
dcmic achievement  arid  internship  let- 
lers.  ,  ■ 

Fur  nHitivaiion  the  combined  \:ffecl  of 
GPA  an4  motivation  produced  an  overall 
chi-square  (16  J/)  of  26.44.  p  <  .05. 
Molivaliim  did  not  have  a  signifK'^^nt 
relationship  with/internship  letter  by  cni- 
squaVe  nor  did  GPA  alone.  Kcndalfs  jau 
for  motivation  uAd  internship  le  tiers 
yielded  a  significance  level  of  .1K).2.  / 
The  combined  effect  of  rapport  /and 


as  those  .w  ithout  enhancing  levels. 

The  fact  that  this  study  shows  greater 
corrclaliims  of  personal  characteristics 
with  clitvical  success  than  GPA  with  clin- 
ical success  is  not  surprising.  While  ad-, 
nfissioii  commil4ec  members  coti&ciously^ 
paid  great  aticniion  to  the  candidates* 
persithal  characteristic's  an^d  discussed 
thcni  al  length  in  committee,  most  would 
agree  subiaciivety  that  they  placed  great- 
est emphasis  cm  GPA .  Thus,  the  range  of 
GPA  was  restricted.  Ftirlher.  it  is  likely 
lhaf  the  clinical  faculty  in  their  assess- 
ment of  students'  cUnical  performance 
gave  great  weighting  to  the  personal 
.  characierislic^  of  students.  Relationship 


GPA  produced  an  overall  chi-squar</  (|6  ,  with  patienis.. willingness  to  work  fong 

hours,  organizational  skill!^  and  judg- 


i//)  of  47  . 1  L  p  «  .(MK)I .  Rapport  had  a 
significant  relaliiinship  wilh  internship 
leller  (chi-square  (4  i//)  -  21.59,  p  -» 
.0<K)2)  as  diil  GPA  after  subtracting  rap- 
ptirl  from  'the -ctHnbiwHl- effect  (chi- 
square  1 12  ill]  «  25.52.  p  <  .02).  Kcn- 
dairs lad  (p  -  .tMHMM)7)  jndicate^  that 


nieni  are  c-i^Hiimenled  uptm  in  faculty 
.cvaluationyai  jcHst  as  frequently  as  com-, 
menis  alxml  basic  intelligence  and  factual 
knowledge.  Ihc^*  characteristics  were, 
perceive^  as  highly  important  by  the  in- 
lelrnshin  advisory  committee. 
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1  his  sMuly  shares  Minic  liiitilaiit)ns  with  • 
other  studies.  It  is  eoiifiiicd  t(^  a  local 
populHtiiiil.  Students  were  seleeted  in  a 
fli)nr<iiidoiii  fashion  ai^d  represented  a 
small  propoftmn  of  the  ttMal  applicant 
p<Hit.  thus  restricting  the  range  4if  prcdtc- 
'  t4irs.  Ther^  ts  limited  knowledge  of  the 
.  reliability  both  of  grade-point  averages 
and  of  interview  ratings.  Despite,  these 
findings,  llie  fottuwing  observations  CMn 
be  made: 

1.  The  sigiiiflcant  correlations  with 
clinical  success  suggest  that  further  em- 
phasis cm  the  personal,  characteristics, 

'  including  maturity  and  nonaeademic 
achievement,  would  have  enhanced  the 
overall  clinical  ahilities  of  members  of 
these  classes. 

A  decade  hais  passed  since  the  first  of 
these  five  classes  entered  medial  sqhooL 
At  that  time  the  surplus  of  quallncd  appH- 
cunts  was  not  nearly  as  great  as  today. 

^Consequently.  40  percent  uf  accepted 
students  in  this  study  had  C4illege  CPAs 
of  less  than  3.0.  Today,  these  inth'viduals, 

.  even  taking  into  acc4^unl  grade-point  ia- 
nation,  would  be  discouraged  from  ap- 
plying by  preiiicdical  advisers  and  wuuld 
not  even  be  interviewed  by  most  admis- 
sions committees.  Nevejtheless  proper- 

.  tionally  more  of  the  students  m  this 
group  obtained  stronger  irvlernship  rec- 

^^ommendalions  than  was  the  case  for  the 
gfoup  with  low  maturity  (Table  2). 
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Laeh  admission  conunittee  has  no  dif- 
ficiilly  selecting  the  "winners/*  those 
achieving  the  highest  scores  in  all  mea- 
sures. Pntblcms  lie  in  selecting  the  re- 
maining candidates.  Hie  choice  fre- 
quently is  hclween  applicants  with  high 
CPA  but  with  few  strong  personal  char- 
acteristics or  candidates  with  high  jcvels 
of  maturity  or  nonaeademic  achievement 
but  borderline  GPA.  The  data  (Table  4) 
W(ndd*suppor4  Mecisiitn  by  committees 
to  select  applicanU  of  reasonable  CPA 
who  .have  high  rKfihinal  characteristics, 
rather  thanjhose  of  highest  GPA  who  do 
not  have  eiihancing  personal  characteris- 
tics        Jf  . 

2.^^^!islres  of  nonncademie  achieve- 
mcff|hAe>|H>tentiat  fdr  screening  candi- 


3: 


■■piiAhai 


jiwiuiMi  willrmlwi  itialhilili  ihawmgi 


The  screening  process  should  function 
both  to  minimize  the  petCentage  of  C 
letters  and  to  maximize  tbt  percentage  of 
A  leltci 5.' Measured  oJJKoth  nonaeademic 
achievement  and  0pA  can  be  obtained 


TABLE  4 

EHtramat  of  Qrad#>Polnl  Avaraga,  Maturity,  and 

Prtdlclora  of  li^tmthlp  Litttr' 

i  itHl  Ntw«c«dcmk  Achkt(»;mcnf 


(iFA    *  Mvluitly   


HiKh 
Low 


(tPA  imJ  Miiuitly 

AUmi.fctMtnt  liitcinihip  Ixiki 

PcuenI 

A  ( 

50  26 
25  2H 
0  53 


Hrgh 
IhKh 

L«iw 

t^)W 


'  fut  k'ltcf  ratitigs.  see. tablets  t(H>lnuli 
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Pndkton  of  Uinkal  Sm^e^Murdtn  e4 

from  nwdkal  iichool  applkalbns.  The 
Iwo.  measures  Idivc  low  correlalkins.  and 
each  probably  iloes  discriminalc  bclwcvn 
A  and  C  Idlers  given  an  unrcslrkled 
range.  Using  holh  variables  in  Ihe  Kreen- 
ing  proccssi  has  'ihe  puleriiial  to  enhance 
the  qualily  oi  the  applicants  broughi  lo 
interview  and  thus  to  increase  the  like- 
lihotKJ  oi  seleeiihg  outstanding  clinical 
sluilenia^. 

For  decades  admissions  coininiiiees 
have  advocated  scleelkm  oi  well*rouiidcd 
candidules  for  medical  Khool.  This  study 
projfidcs  validaiion  for  ihis  approach. 
Overall.  3.1  percent  of  Missouri  medical 
school  graduates  who  in  college  had 
CPAs  of  grealer  lhan  3.3  received  A 
level  internship  letters.  If  these  individ- 
uals also  had  a  highly  enhancing  raling  on 
one  or  more  of  the  personal  characteris- 
tics, the  likelihtMHl  of  receiving  ,  an  A 
letter  increased  to  over  SO  percent.  On 
the  other  hand,  if  thoK  with  high  CPA 
had  noncnhancing  levels  on  one  or  mor^ 
of  the  personal  characteristics,  the  per- 
centage of  A  letters  dropped  to  less  than 
20  percent  (Table  3). 

The  value  of  these  predictors  needs  to 
be  reviewed  in  other  |>opula|ions.  More 
precise  ikfiniliorts  of  thes6^  predictors 
may  well  lead  tolhigher  predictive  values. 
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AndgSelf  Ratings  of^lern  Performance 


•tgel'FionS.  Ph  D. 


4li€  work  nr  ihc  physiciun  \%  likely  l6  be  vkwcd 
vnmcwhui  difrercnily  by  his  colka|tues.  his 
puiienu.  und  by.lhc  phyMciun  himvcU.  Tuch 
"viewvr"  muy.  in  his  turn,  viinlrihule  ;i  unique 
tfnd  inenninfirul  pers|)cciivc  lo  ihc  overull  us- 
]ic$smcni  of  ibe  physician's  pcrruriiKincc.  In  or- 
der In  leM,  in  purl,  this  conienlion.  nupcrvisor«  ' 
ol^  interns,  intern  peers,  tind  interns  themuKc« 
.  were  usked  to  rute  the  perrorniance  or  nicUicul 
interna  on  four  diniensitinv  knowtcdpc  or  nicdi- 
cjI  M:icnc«\.  clinical  erTectivcneiN.  inurper^omil 
errediyenesft.  iiml  overiill  compcteiice/profcs^ 
sionul  prnmiwttsii  ph>si4:ian.  K;»tin|!N  Tioni  the 
three  MXirces  over  tbc  four  dituen^ons  were 
compared  in  order  to  determine  ekmenis  of 
communulity  und/or  diffcrentft  in  the  rjilinyv 
In  aKJdition.  the  tiuthor  questioncti  the  enteni 
lo  which  f»tin|«  of  intern  pcrrorinumx'  coukihe 
predicted  Trom  eurlkr  'mensures  nf  apUtudr. 
achievement,  und  personality.  1ti  answer  this 
qiieiUion*  an  niscMniehl  wi>  made  nr  the  cr* 
rK';icy  of  niedloil  school  qdiim^ion'.ihna  ixite- 
medical  (trades.  Medicul  Collrici:  Adttiission 
Test  tMCATI  scnres»  gnd  interview*  ratings),  * 
perMinaliiyJnventory  measures.*  ami  medical 
schmd  (trade- point  jivcrage  ((iPA)  .iml  raculty 
ratings  in  forecasting  the  internship  perrorin- 
ance  rutins.  rML^nterns  rut(!d  were  the  entire 
male  gradaati^g  class  of       ofrhe  Universiiy 
orCalirornia'Scho«M  or  Medioine]^i  San  I  ran- 
Cisco  IN  '  110)  The  interns,  in  residence  at  M 


Thit  piper  <ii  bused  on  a  dmioral  His«ciliiliofi 
cofiiplclcil  at  the  liuiiiuic  vf  reiMHUtiu  Ak\csMiicni 
fMl  Rcsc«rck,  Berkcfe).  aS  |uiri  ul  iIk  imlituic^ 
CMHinvtng  pfupriHi  uf  rc^cati'h  in  mcUk^t  cduv4liiHi. 

Ur  Kitct-l-lom  h  ■  rewardi  |>s)chi>lugisi  Miih  the 
ScImmM  of  t)pluiiietr>.  .lUivcisiiv  of  C'jlirorma. 
Berkeley  ^ 

*  Tmu  invcnlories  Mere  adnimiMvicil  dunnp  the 
nm  w«ck  uf  mcdkal  scKool  Iht  SoongJ  imtuotmt 
IniffHl  f/««4  tSVIHl.  whith  measures jlk  «lmiljrii) 
04  iHirS  lii||;rc«is  lo  ibc  imcicMs  ol  ptfriuiis  ^access- 

cmpl|>cd  In  varkMts  occapulions.  and 
CJitofiti^  Fi^xhokHticst  Imrentoev  (i  Pit,  «kKi 
11  potMkvc  ^crtooal  IrJilk,  lui  t\m 
resptmtihilhy*  lokrance.  aiid  iAicHetau.it.erricirfH' 


medical  facilities  ihrou^houi  ihe  Umtcil  Siales. 
were  r.Ued  at. the  cbtsc  of  thcit  iiiieriMhip  >car. 
June  l%9 

Halittfis  of  Inlfnis 

In  general.  su|Kru 
ance  higher  than  di 
interns  themsebes: 


hTiIm 


raied  intern  perform- 
'tltc  imc.riis'  peers  nr  the 
su|K*rvisors'  rulings  wcie 
jKo  more  variable,  ranging  fiom  a  score  ill  l  io 
12  on  ever>  dimension:  interns,  on  the  ^tl her 
hathl^  were  reluctant  to  give  very,  high  or  ^^ry  . 
low  rating^  to  their  peers  or  to  themselves, 

Ratings  hy  supervisors  on  the  four  diiiien-' 
sions  of  performance  were  highly  intercorre- 
laied*  correlaiions  among  self-ratings  and 
among  peer  ratings,  were  lower  than  those 
•rnnitg  supcrviM^rs*  raiings.  bul|,  ihey  also  . 
tended  to  be  more  highly  associated  among 
themselves  than  with  ratings  from  the  other  two 
sources.  Closler  analysis  of  the  giting  correla* 
lion  matrix  indicated  ^al  sMpcrvU«irs.  peers, 
and  interns  theiu!««1vci  had  indeed  rated  per- 
formance differently  and  that  these  rater  differ* 
eitces  were  greater  than  Itie  raters'  distinction 
■  between  the  various  wnrk  dimensions,  for  ex- 
imiDte.  between  clinical  elfectiveness  and 
kjHiwtedge  nf  medical  scknces.  Three  clusters 
emerged  in  tht^^ analysis,  the  Hrsl  based  up<m 
supervisor  ratings  alone  and  the  svcond  and 
thjfd  based  most  heavily  u|Kin  self  and  peer 
ratings,  respectively  In  sub^icquenl  an.ilsses 
each  intern  whs  given  three  criterion  "cluster"  * 
scores.  Itach  predictor  variable  was  then  tested 
for  its  ability  to  forecast  supcryisor.  self,  and 
peer  taling  cluster  scores.  '  ■ 

VrcdkiliiK  ii^effii  RattniK 


i 
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1*reiiieilkul  griMkii  di-ii|iMi!iiriiic4l  it  lnw 
ptiMlivc  Corr'v*li)l)i*.n  ^ill'  raiin|i<'or  iftlcrii  per- 
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TABI.lv  I 

ClIflRI  I  AlliINN  Rl  I  Wl  I  O^rmiKklilNS,  Pl-KSDNAIJI^.  \N|l'MllMl.M« 

Sciiiioi  AcHlVviMINi  MiASiJ^s  AM)  Kaiinia  III  Imih> 


ll4l|»|itof  Inltrn  I'rifiifnunce 


\  Super- 

Prci 

.  vcf nui  jiHiiiy 

.21 

22 

.(^anlttiilivc  iihtltl) 

•  .06 

17 

Cicncftil  inftiinitt^ofl 
5^iciH*c 

.(16 
.fii ' 

-  .16  ■ 
.07 

I'fcmcdiviil  ^imUc^ 

i 

t'tttnuiuitvm 

.14 

09 

12 

12 

OX 

15 ' 

16 

111 

^  -.04 

1M 

12 

Cnlifltffnitf  Pv%L'htlioik?uJ  lnVi*nlnik* 

-  P^MIIIHttflCC  .  * 

i)l  •. 

.)0t 

.11 

V  IJe«i6ilit)  / 

03 

2.11 

12 

.OK 

.OJ  ' 

J5t 

StfiHif  ViHijlioituI  Intel cil  Blank* 

.<  Jl 

.  .16 

07 

Priulil<*litMi  MliiiiJflt*r 

sJI 

.•  .05 

491 

2J| 

11 

.14 

16 

Hiiiincu  icdv'hcr  . 

€  'lisinihi>t  I  tiMiini*iiV  i*aV<*iHii*  • 

,         '  ''I 

07  . 

Ojl 

JiM 
■  .*U| 

-  or 

17' 

Life  iAAUMmxMitcMtiun 

•  19  . 

261 

Hanker 

*    .2J|  • 

14 

.06 

251 

21 

Libr;iniin 

.IJ 

01 

J4t 

Purchatinii  .tgcnl  . ' 

10 

2H^ 

2«| 

-  Siitt^iiiJnii^ei 

.16 

20  IL  .J5t 

Rciil  Cytale  ^Mkn  . 

0«  • 

18- 

.271 

PhuMIIHi'lM 

.02 

-  15 

Vwrl 

«t 

22 

Year  2 
YcJrJ 

.16 
2¥t 

J2t 
.IKt 

-Si 

YMr4  , 

.4lt 

.joi 

261 

^mybtiytf  priidf-poini  jicrjjEC  . 

Ml 

.46* 

..I.M 

Ftt^N)  fiiirt|t%  )eiii«  lumlf 

AtfiMkink  pcrfiirm«nie 

nt 

.2«t 

.291 

■Cliniciil  prrfiH  ill  ii  lice 

47t 

26 

Pcr«>niilqMalilH;« 

.4<t 

Jit 

^111 

R«cuinmcmluiii»n  for  inlcrn\h»p 

44t 

Jill 

M*t>f  IhcMt  tcMv  om1)i  IhiHi;  uairs  m 
filiHtk^iil  cucffWicnlt  mih  iiiic  iir  jiij^ri* 
Ml  imiliciil  M.-IHH1I  entry. . 


hich  torreliiied  «ijifiinctinil>  (PeiirMm  PrtMlMi 
i-rtteniM  ittcti^iire  rnc  lUtcU.  t^Ui  «ere  tudeii 
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'fl4  JoHfhafofMHUc^^dttfailoH' 

rnrmiifice;  adrnKftimi  iirteriricw  riAiiifft  were 
nlmoM  compldcly  MrtlRlcd  lo  raliNfs  of  iMcrii 


premcdfc;al  prtitle^.  nrtttlmiji^ 
fttan  inlcrVicw-Vilinit^. 

A  mimhcr  of  persofiiliiy  inventory  mcisvrcft 
corrcluled.Aigninoinily  wHh  one  or  mtnt  or  the 
fillings  of  inlcrf*  pcrformgnce  (Tahk  I),  Al. 
though  dirfcrenl  .periiofiility  dimcnjiiofii  cor- 
rclited  bcM  with  sypcrvhor.  %t\f,  nnd  peer 
rut iiif reaped ivtly.  IntcrtM  Kttlcft  relating  in 
h«iiinc^!i  nrnl  Mkfi  occupstlonx  tcmlcd  to  corrc* 
late  negiitivcly  with  all  ratings.  In  other  wnrdft. 
the  inleretU  of  highly  rated  interna  were  decid- 
edly unlike  Ihc  interenlx  of  personn  in.  thone 
occuptftioo«.  Iniernii  given  high  rntingft  hy  su- 
pcrvlitors  hiid  intercMn  moM  like  phy^dans: 
however.  Ihc  .fhysician  jntcrcM  Ktilc  was  not 
^iffnificantty  correlated  with  Klfor  peer  ratings 
of  iiHeiNf.^Pecr  eMeem  wns  uniquely  and  most 
si|!iir)caiilly  related  lo  the  pcrsnnulity  trnit  of 
tolcroncc.  On  Ihc  oiher  hand,  it  waii  dominance 
and  (lack  oO  ftc^ihilily  which  chariictcrired 
intern.%  who  lavelhcmxelvc^  the  higher  ratings, 
Grades  achieved  during  |hc  four  yearit  of 
medical  school  and  raculty  ratings  if  Mvdcnt 
performance  in  the  third  and,  fotffth  ytun 
cof rciaied  well  with  ratings  of  Intern  perform • 
ancc  (Tahie^  I).  SupervlMrs'  rnting^t  of  infcrn 
performance  were  bAt  predicted  by  earlier 
medkal  itchtfol  faciiUy  ratings.  Self  ratings  j|crc 
highly  associated  with  both  mediciil  9i|Ril 
grades  and  faculty  ratings.  Peer  ratings  tended 
to  he  te^s  associated  witK  medical  school  per* 
fornlance  than  were  the  ratings  by  supervisor' 
and  self,  i 

In  tirder  ..to  tleler)ni|nc  the  best  and  mini 
erricienl  eoml>ination  of  variables  to  predict 
falings  of  jotern  i^rforotancc.  a  step-wlse^niul* 
llple  regression  analysis  was  conducted  using 
Norman's  (1^  douhle*splil  cross-validation 
method  lihe  Jniern  rumple  was  divided  into 
odd^numbcrcd  imJ  even. numbered  suhsnmples 
(N|  N|  55).  ^uch  prc<lictor.  vuriable 
corrcluted  with  J(hc  intern  performance  ratings 
within  suhsamples  and  then  multiple  reffres* 
sion  amilysis  comluctcd  within  each  sMbsamptc. 
Equaiiuns  developed  to  ftirecast  ratings  in 
Group  I  (odd>n umbered  subjects)  were  cross. 
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vnlidatcil  on  (iroop  II  (even.numbcM  soh* 
jccts)iind  ec|iihlions  developed  in  (I'roop  II  w#re 
cross'Vjli<^itcd  on  Group  I.  The  nK:(n  nf  the 
two  cross»vtiltdiilion  coclHcicnls  wn^  {^thtrf  a« 
Xthe  bcM  eMim'ate  of  the  deftrce  to  which  ratin|ts 
in  the  internship  could  be  foreciist  from  linc;tr 
coiohinsitifins  of  the  predictor  variables. 

Supervisors'  ratings  were  forecast  best  hy 
cimihining  the  follnwing  variables!  Mcdicor 
school  GPA.  year  one.  medical  school  factlHy 
rating  on  clinical  perforfnancc  tn  years  three 
and  four,  and  the  physician  interest  M;ale.  In 
other  words,  the  interns  rated  most  highly  by 
their  supervisors  were  those  who  did  well  in 
Ibeir  medical  science  course  work,  excelled  in 
clinicfl  medicine,  and  possessed  the  intcrcMs  of 
physicians.  y 

The  best  combination  of  variables  to  predict 
self  ratings  wiis  ll^  JcumulaUve  medical  school'. 
GPA.  the  domln:i%e  scale  of  lh«  California 
r^ychotogical .  Inventory  (C'PI).  and  (nega- 
tively) the  Oesibility  scale  the  CPI.  In 
.summary,  interns  who  rated  themselves  highly 
tended,  to  he  forceful  and  .MiU^confident  but 
somewhat  rigid  persons  who  hud  achieved  high 
levels  in  their  medical  H'hool  wnrk. 

Personality  variables  »)onc  were  the  hcM 
predictors  of  ratings  by  peers:  prediction  wus 
not'  enhanced  by  adding  ntedical  school  pcr« 
forma  nee  meaxuresio'the  regVession  ataatioos. 
.  The  best  prediction  of  peer  ratings  was  a 
combination  of  personality  inventory  variables 
which  gave  positive  weights  to  tolerance  and 
psychological  niindedoess  and  negative  Jiveights 
to  scales  measuring  Ihc  ioteresis  ot  pharmacists 
and  life  insurance  salesmen. 

('onclaslfHis  . 

The  frnding^  of  this  study  support  the  coOjien*. 
lion  that  the  medical  intern's  perfofoiunct  is 
viewed  somewhat  differently. by  his  sU^rvisi^jr. 
hy  his  intern  peers,  and  hy  the  intern  hinl^sctf 
and  thai  these  differehces  may  nfielibe  greaii;r. 
th^n  differences  between  various  axpccU 
work  When  admissiun  dali).  pcrsortalilv  inieo* 
tpry  rtieasures.  and  niedicat  schmd  perrorniance. 
were  considered  ti»gether.'it  was  found 'th(0 
.supervisors'  ratings  of  interns  were  bej(l  fore- 
cnst  hy  earlier  medical. school  faculty  ratiogs. 
self  ratings  were  forecast  bcM  hy  a  tombirfattdn. 
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of  pcrMinjlilV  tMvcntor)  nK^^ttrc^  nml  mc<tic:ii 
<  H'tNHii  frndc^.  Mnd  peer  ratinft  nere  hcM 
"  prcdklCit  hy  »  unique  conihini^fion  af  perMiniit-, 
ily  inienltir\  mcii^orcA.  . 
V  the  fjict  ititil  p^mcdiciit  prudes.  MC  AT 
.H'Ofc^.  »nd  .idmiMinfi  inlcrview  rtilinftt  Tailed  tp 
predict  nilingx  of  Ifttcrn  pcrformnncc  ^cniirdy 
conxitleni  wiih  curlier  Mu^k%  of  mcdicai  in- 
Itrns  (2).  psycWiiirIc  rcnidcnh  (.1).  ;irHl  phy^i- 
cisiin  in  prtii'licc  (4.      The  perfornmncc  of 
ntetlkal  inlerns.  like  ihnt  of  phy^tciun^  in 
fenerid^  ^%  tippnrenlty .  ii^xocinted  more  u  ith 
.'Pcrvtnid  qiiulilie^  iind  medical  lrainin|r  thnn 
Miih  relniivc  lev^x  of  tipljlude  iind  undcrftrmlu- 
Hte  achievement. 


RfffrtiKei 

I  Ni»*%ii^s,  W  1.  t)mihtc..SrtH  CrOKvVMliilttli«m 
An  |:«len%inn  nf \lmtcf'<  Uc<i^n.  t^o  tlmk^irii 
Me -A  Hern  mo  nwl  .S«mie  Inipmfltk  Ple«iiM%  /. 
Appt  rurhttf  ,  4l^'Mn  IV.  »%V    ^  • 

l.  jiK  lUPit^.  I  M  .  Jr..  TA\iitft.  C  W  .  »nd  Ppk  i  . 
f  R.  The  rretlKlMm  of  MedicKt  Intern  rerfnrni' 
»ncc  J.  Appl  r\uhM..m\\Al  M6.  I9A2 

3  lltM  f,  R.  R  ,  Iind  l^yH»i»sii>.  L.  hnomUn  fat- 
ifrn.%  0f  ftifA/tffW»?i  (Vntvme^  I  pnd  7}.  New 
York  fln%k  BiMiks 

.4  PuKi.  r  n.  Taiiiip.  C  W  .  Rk.iumiin.  i  M  , 
Jui.  »nd  jArim^fN.  T.  L.  McMvremcnt  of  Di)^*- 
eiHH  Perform:inve.  J  Mt4.  FJ\k..  .W:2n.i  2  in. 
,  ' 

V  tlimi  1 1 ,  M  A  rtrtomil  tffettivirnru  i»f  rh>M- 
einn%  in  n  Icdcut  lletihh  Or|t;ini/aiinn  /.  Appl^ 


Michigan  Council  of  Deans 

And  Cooperalifon  in  Medical  Education 


Ralph  E.  Le}^'h 


A  new  spirit  of  coopcrtition  hiix  nppeiired  in 
mediciit  education  in  Mkhipnn  undix evidenced 
h>  the  Michigan  Medjctd  Schootx  (Council  of 
tHvins,  Allhoufh  ihe  dc»hx  uf  somb  mcdicai 
]tcho<il!(  in  other  part«  of  the  count r>  get 
together  periodically,  the  Michigan  Medical 
SchooK  Council  of  l^nns  npparcnlly  is  the  only 
xuch  urgnni/ation  with  a  full-time  paitl  Ma  ft 

(hC^othicil  WM<  organi/^  in  ^ehruary  1973 
ttith  Ihe  appointment  uf  a  fuli-lime  executive 
direvlor  ami  the  extahli^hmcnt .  of  :iiv  ofnte. 
iilthotigh  the  dean^  of  the  four  medical  whotd^* 
had  met  Mncetatc       .  ' 

The  deanx.  Iheir  a^MK'iale  deiinv  ami  olher 
key  M;ill  4ni:mher«  mCct  niih  the  council  di^ 
rector  monthh.  The  council  wpik^  ciNJpera- 
ti>isl>  on  proMcm%  and  progr^mu  and  the 


Mr  lxt»i«  it  cmuiiiT  direcim  toL  Ihe  Michigan 
Mcdkif P  Sihm*li  (  ouncil  of  l>e!«n<:  Anir  Arh»r. ' 

*Un}ver(i<>  nf  MM^hiian  Mcdicpt  fkhtx^K  Michi* 
Mn  S(ulc  UniverMtyii  (ilkge  of  llumin  Me%iie. 
Wiiyne  Stale  llniiervty  ttthiwl  of  Metlkine.  ind 
MicliiM"  ^t:ite  tlnivet^it)  C'ultege  nf  (htenpathic 
Medicine.  - 


entry  point  lor  rcqucMK  to  the  medical  H'h«Htlv 
for  information.  c(H)pcr:Mivc  prt^cct^.  and  itther 
joint  efftirts  The  admi«ion%  ofTicer^.  directors 
of  continuing  hiedtcal  education,  financial  aid 
ofricerit.  curricuhmi  officers,  puhlic  intormulion 
officers.  Mudcnj^iffair^  ufTicer^.  and  directors 
'of  coiHmuhii>  ■  medicine/ primary  -care/ family 
medicine  meet  pcriinlicalty  Milh  the  courfcitr 
director. 

AcenmgllMmirfih 

PuUu^ing  arc  «omc  of  the  accompli«hnrcnt^  of 
the  Council  of  Dcaiu  in  il5  firM  two  ycar^  ol 
operation:  .       ^  " 

I .  CoOficrution  with  the  AMocialion  of 
Americttn  Medkal  Colleger  and  the  .medical 
5choolK  in  Ctdifornia  on  a  pilot  matching  pro- 
gram for  met|)<ill  xchiwil  admix^lonfl  I  he  three 
M.D.  pfoduci.ng  Kchooh  in  Michigan  paTtici- 
.'pntcd  in  Ihe  Mudy.  whiph  Wait  conctuded  in  con- 
junction with  the  ^choidx'  regular  admiX^ion 
procedures  for  the  1974  1975  entering  cla^^ 
The  rcKultvof  Ihc  "uiatcb"  wcrcciimpared  with 
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EXHIBIT  C 


1  V  ■  .. 

EcQnomic  and  Racial  Disa3vantage  as  Reflected 
In  Traditional  Medical  School  Selection  Factory 


Bart  Waldman 


Abstnirt- Medical  College  Aclmission  Test  scores  and  undergraduate  gradp-point 
averages  show  that  both  lower  income  applicants  in  general  arid  minority  applicants 
in  particular  are  at  a  competitive  disadvantage  in  gaining  admission  to  medical 
school.  This  study  examines  the  extent  to  which  inc$lte  and  race,  viewed  independ- 
ently of  one  another,  affect  these  selection  factors.  By  analyzing  data  collected  by 
.  ^the  Association  of  American  Medical  Colleges  on  applicants  to  the  1976^77  entering 
class,  factors  associated  with  race  were  found  to  have  a  far  more  significant  influence^ 
on  applicants*  trcdentials  than  factors  associated  with  loAver  family  income.  An 
admissions  policy  based  exclusively  on  CPAs  and/or  MCAT  scores  wQuld  proportion-  ^ 
aiely  cxdude  minority  applicants  from  medical  education  but  would  have  no  similar 
(jjffeci  on  lower  incofne  white  applicants. 


Previous  data  pub|;shed  by*  the  Associa- 
tion of  American  Medical  Colleges 
(AAMC)  have  indicated  that  applicants 
to  medical  school  from  minority  groups 
traditionally  uoderrepresented  in  medi- 
cine generally  present  credentials  reflect- 
ing a  lower  level  of  achievement  on  the 
.  Medical  Cpllege  Admission  Test  (MCAT) 
and  in  undergraduate  grade-point  aver- 
ages (GPAs)  than  do  their  white  counter- 
parts (1 , 2).  Siiinilar  data  have  also  shown 
that  performance  on  these  *  traditional 
measures  bears*  a  positive  though  lesser 
relationship  to  the  applicant's  level  of 
parental  income  (1).  However.  iM^^iifr- 
liiMi  Miitml  iiMiji  hnr  nrtnrapinri  \m 

Tin       f  '  ...i^u;^^ 


MCAT 


Mr.  Waldman  i$  special  assistant  te  the  presi- 
dent. Association  of 'American  Medical  Colieges« 
Washington.  I^C.  |  • 


iilj,  lu  tuiwiHui  iiiimnu  iiiU  (i  )  iiilinrhM', 
^liliiiii.  I  giinw  iniBH  ptupi  npplinnte" 


This  study  was  conducted  in  an  attempt 
to  answer  these  questions.  Further,  the 
investigator  attempts  to  evaluate  the  an- 
swers in  order  to  reach  very  general 
conclusions  as  to  the  comparative  levels 
of  economic  and  racial  disadvantage  in- 
herent in  the  use  of  GPAs  and  MGAT 
scores  as  criteria  for  admission  to  medical 
school.  .  \ 

When  reviewing  these  data,  tHe  reader 
should  bear  in' mind  thsit  small  discrep- 
ancies, in  GiPAs  and  MCAT  scdres  are 
not  nfli^essarily  predictive  of  success  in 
medical  school.  For  example,  compara- 
tive graduation  jates  for  students  with 
scores  on4he  MCAT  Science  subtest  of 
500  »o  549  and  600  to  649  were  93 
percent  and  95  percent,  respectively, 
when  analyzed  for  the  more  than  75,000 
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Iludcnii  who  entered  U.S.  medical 
ich(>oh  during  1949*-58  and  who  were 
followed  longiludinally  through  the  fall 
Qfl962j(3).  I 

More  recent  reporti  indicate  thai  re* 
lenlii^n  miei  are  now  even  higher  (4»  S)i 

'  Ninely-rive  percent  of  all  1968-69  en- 
trant! had  received  the  M.D.  degree  by 
1^73,  and  an  additional  1  percent  of  ^he 
studenti  were  still  in  school^  for  a  net 
attrition  of  only  4  percent.  Although  the 
retention  rate  for  the  underrepresented 
minoirilies  was  slightly  lower  than  that 
for  all  entrants,  ^89  percent  had  already 
graduated  by  1973»  and  91  percent  were 
expected  to  graduatie  eventually  despite 
relatively  modest  undergradiiate  GPAs 
and  MCAT.  scores  (4).  And  first-year 
retention  6f  black  Americans  has  risen 
from  91  percent  of  1971-72  entrants  to 
95  percent  of  1974-75  entrants  (5). 

.  Thus,  the  ricader  should  not  assume  that 
lower  performance  on  these  measures 
.  necessarily  implies  that  an  individual  is 
unqualified  for  the  study  of  medicine. 

Method 

The  data  base  for  all  displays  and  analy- 
ses is  the  A  AMC  Medical  Student  Infor* 
malion  System  records  for  applicants  and 
acccpleei  to  the  1976-77  entering  class 
at  U.S.  medical  schools.  Hie  two  princi- 
pal data  cqUectidn  sources  for  these  rec- 
ords are  the  MCAT  and  applications 
submitted  to  the  American  Medical  Col- 
lege Applicaiion  Service  (AMC AS). 
Data  from  these  sources  have  been  sup- 
plemented by  routine  admissions  reports 
from  each  medical  school. 

The  study  utilizes  the  following  varia- 
bles; 

1,  Parental  income.  Those  applicants 
re|lorting  grois  combined  parental  In- 
come of  less  than  $10,000  are  differen- 
^  tiated  from  those  reporting  parcntat  fn« 
come  of  $10,000  or  more.  Incomes  re- 
ported are  for  the  calendar  year  prior  to 
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taking  the  MCAT  (in  most  cases  for 
calendar  year  1974). 

2.  Racial  background.  The  racial  de- 
scriptor is  based  on  the  applicant's  self* 
description;  aiy[)ough  some  data  dis- 
played pertain  specifically  to  black 
Americans,  all  comparative  analyses  are  ^ 
between  whites  and  "underrepresented 
minorities**  (dcHned  as  black  Americans, 
Mexican  American,  American  Indians, 
and  mainland  Puerto  Ricar^s).  , 

3;  Undergraduate  college  grade-point 
averages.  The  GPAs  have  been  con- 
verted by  AMCAS  to  a  uniform  system 
of  grading  based  on  a  scale  of  0.0  to  4 .0. 

4.  Medical  College  Admission  .Test 
scores.  Separate  subtest  scores  for  Verbal 
Ability,  Quantitative  Ability,  General 
Information,  and  Science  are  reported.* 

The  data  presented  reflect  the  total 
information  available  within  the  AAMC 
Medical  Student  Information  System  for 
the  42,155  applicants  and  the  15,774 
accept(^es  to  the  1976-^7;^  first-year  class. 
The  analyses  necessarily  were  limited  to 
those  individuals  for  whom  GPAs, 
MCAT  scores,  racial  idcntificati6n,  and 
parental  income  were  reported.  Grade- 
point  averages  were  unavailabia  for 
4,906  applicants  (1 1.7  percent  of  all  ap- 
plicants) and  for  1,298  acceptees  (8.2 
percent  of  all  acceptee^.  Medical  Col- 
lege Admission  Test  icores  were  unavail- 
able for  869  applicants  (2.1  percent)  and 
for  190  acceptees  (1.2  percent).  Racial 
identification  was  not  reported  by  2,210 
applicants  (5.2  percent)  and  by  558  ac- 
ceptees (3.5  percent).  Parental  income 
was  not  reported,  by  1,826  applicants 
(4.3  percent)  and  by  457  acceptees  (2.9 
percent).  In  addition,  the  mean  GPAs 
reported  in  Tables  1  and  2  reflect  only 
those  applicants  who  filed  at  least  one 
application  through  AMCAS  and,  there- 
fore, exclude  applicants  who  applied  only 
to  one  or  more  of  the  29  schools  which 
did  not  participate  In  AMCAS  in  1976. 
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OlherwiK,  all  data  rcRej^  ih«  total  piiol 
of  applkanu  to  the  197(m-77  firsl-yeAr 
ctasi  who  looli  the  MCAT  exaihinalipn  at 
anytime. 


FiiMNiigt 
•WH  I'll)! 


Hi 


Ma 


wmak^iu  reflected  in  CPA), 


iW 


rip 


Ml 


I  This  reUtionihip  exbU  for 
both  applicants  and  acccpteet. . 

At  shown  frapihicaliy  ;in  Figiiret  y 
through  9»  the  di^(tribution$  of  OPAs  and 
of  MCAT  Kore«  are  very  similar  for 
lower  income  and  higher  income  whites. 
Likewise,,  the  distributions  arat^ery  sinii* 
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lar  for  lower  income  and  higher  income 
underrepresented  minorities.  A  phough. 
the  tower  income  applicants  within  the 
given  racial  grouping  consistently  per- 
form slightly- less  well  than  their  higher 
income  counterparts,  the*  differeilce  be- 
tween these  two  groups  does  not  ap- 
proach the  magnitude  of  the  disparity 
between  white  applicanU  and  umterrep- 
'resented  minority  applicants,  even  in 
the  same  incomciTange. 

These  findings  are  iupf2orted«pby  the 
mean  data  summariz^  in  Tables  1  and 
2.  :These  displays  show,  that  the  mean 
total  CPAs  of  the  higher  incbfnc  and 
lower  income  wt|ite  applicants  are  very 
simitar  (3.34  and  3.27,  respectively).  The 
mean  total  OPAs  tff  the  higher  income 
and  lower  income  underrepresented  mi- 


ll    A-ltS«    i    i-ltC«    e     SflMvC  A     A-Mi*    i    i-iiC«  c 

MiiiMMiMAiitrAi  "iHiMaaMiiAnafii 

•  s       ■  FiauiK  ■  I   "         ■       .  "  - 

Undergraduiile  OPAs  of  applicanis  ami  acccptees  to  1976-77  entering  clst$  of  U.S.  medical 

idiooU,  by  race  anil  pareiflfM  income.  ^ 

^'     '       .     .      .  :     ■  ■    '  ■ 
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Fwuai  2  • 

Vcrtat  AbitUy  mi^  QuatlNailvo  AbiNty  MCAt  MbtoM  icoiot  o(  aopUoMU  omI  tccoploti  |o 
1976^77  cn^rJni  dill  of  U.S.  modlcil  icli^ 


AOfily  appllconU  arc^olio  cllehtiiilly  kkn- 
ikal  (2.80  and  2.79,  Wpoctivcly).  How- 
ever, ihc  diffcrdncc  m  mean  GPAt  be- 
iwecn  tower  inc(Hiie  Vhile  aiMl  lower 
income  MmlerrepfeMiiied  minofily  applih 
cifils  if  .48.  and  the  difi^fffHre  between 
Mfher  incinme  white  and  higher  income 
iinderrepreeented  minority  applioanU  it 
.54  (derived  fmmTible  1). 


Tabic  2  ibowt  that  the  mean  total 
GPAi  of  the  higher  income  and  lower 
Income  white  acceptces  to  the  1976-77 
fint*year  idait  are  alio  enentlally  IdentK 
€•1  (3.SS  and  3  J4.  reipectively).  Uke- 
wlie»  Ibci  mean  total  OPAi  of  Ibe  higher 
income  and  lower  incomt  iinderlbpre* 
tented ''Mi^  iocapteet  are  virtually  ^ 
the  lameTs  OO  and  3.02.  reipectively^ 
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Ocncrat  InfonMtibii  and  SciviM^  MCAT  MiUeftt  worti  of  appHcinU  ami  uoUpm$  U 1976-77 
■  entering  daw  om,S,  Medlcat  ichooto»  by  racy  and  pifcntai  inconn. 


However,  the  difference  In  tiM^n  OPAt  Incon^  underrepreMnied  minority  ac- 

between  lower  Income  v^te  ahd  lower  oepteeila  .35. 

income  underrepleient^  miitority  ec-  Similar  resiilta  are  found  for  the  mean  . 

ceptcea  is  ,52,  and  llie  idttference  be-  MCAT  scores  presented  in  Tables  1  aiM 

tween  higher  iiiQOi|ie  white  and  ll^igher  2.Forexample.themeanMCATScience 
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Mbtetl  Norct  of  Ihc  hiflicr  Income  iimI 
lower  iMDONie  wlihc  ■ppHcanli  ire  very 
lim&Ur  (519  ifid  57 1 .  respeclively)  *  Uke- 
wlie/llierr  koiiiy  a  24*poiiil  difference 
between 'ibe  mean  MCAT  Scfence  Mib- 
leil  acores  of  ilie  hlfher  bioome  ami 
lower  income  imderrepreaenled  minority 
appHcanta.  Tkit  eompares  with  a  stan- 
dard devlatkm  on  \W  subletl  of  approx* 
imalely  100  poinU.  Mc»Wever,  the  differ* 
ence  in  fiean  Noreft  between  lower  in- 
come wMte  and  lower  income  Uitderre|>* 
relented  minorky  applicanu  it  over  100 
poinU.  as  it  the  comparable  difference 
between  higber  income  while  and  higher 
income  underrepreaented  minority  appU- 
caiila  (derived  from  TaMe  1 ). 
*  taWe  2  indicates  that  the  mean  MCAT 
Science  Mibtett  scores  pf  the  higher  in- 
come and  lower  income  white  acceptecs 
are  also  very  similar  (629  and  625.  re- 
spectively). Ukewbe,  the  mean  MCAT 
SdenoB  subtest  scores  of  the  higher  in- 
come and  lower  income  underrepre- 
icnied  minority  acceptees  arr  only  16 
poinu  apart.  However,  the  difference  in 
faean  icores  on  the  subtest  between 
lower  income  white  ai^jl  lower  income 
umlerrepresented  mfnorily  acceptees  Is 
112,  and  the  difference  betweeiwhigber 
income  whke  and  higher  income  under* 
represented  minority  acceptees  ia  100. 

Table  I  also  shows  that  5,977  of  the 
40,328  applicants  with  known  scores  and 
parental  Incomes  identified  themselves  in 
the  under  SIO.OOO  income  group.  Of 
thae,  3\527  identified  themselves  as 
while  and  1,416  identified  themselves 
with  one  of  the  umlerrepresented  minor- 
ity groups.  The  remaining  1 ,034  sludenU 
either  identified  themselves  with  another 
ethnic/racial  group  or  failed  to  answer 
the  self-identification  question.  It  is  gen- 
erally presumed  that  nuHil  of  those  failing 
to  answer  this  question  are  while  appli- 
cants. 
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These  findings  demonstrate  that  an  appli^ 
cant*s  lower  economic  status  alone  results 
in  a  very  slight,  if  any ^ competitive  diK 
advantage  because  of  lower  performance 
in  undergraduate  work  or  on  the  MCAJ. 
On  the  other  hand,  the  variety  of  factors 
invoked  in  minority  racial  statuf  confers 
a  far  greater  level  of  educational  disad- 
vantage  which  resulU  in  lower  CPAs  and 
MCAT  scores  and  which  is  only  slightly 
alleviatedvin^he  higher  income  minority 
group.  Tl^se  data  do  not  permit  an  as- 
sessment of  the  social  and  cultural  factors 
-Associated  with  race  which  underlie  this 
edMcaiional  disadvantage.  . 

Figures  I  ^3  graphically  demonstrate 
the  degree  of  disparity  in  performance  of 
minority  and-maiority  sludenu  on  these 
traditional  measures  of  academk  qualifi- 
cation for  medical  school .  They  also  show 
the  high  degree  of  congruity  of  perform- 
ance of  higher  and  lower  income  students 
within  the  same  racial  classification. 

If  medical  schools  had  choico  to  admit 
studentt  based  solely  on  one  or  more  of 
these  five  traditi«mal  criteria,  the  15.774 
acceptance^  offered  in  1976  would 
quickly  have  gone  to  individuals-identi- 
fied at  the  ejttreine  high  performance 
side  of  the  curve .  At  ihis  extreme,  only  a 
very  small  proportion  of  minority  appli- 
cants could  qu^fify* 

However,  admission  baicd  solely  on 
these  traditional  criteria  would  result  in_ 
only  slight  exclusion  of  lower  income 
applicanu,  since  their  performanM  par* 
allels  lhat  of  the  higher  income  iippUcanis 
of  the  same  racial  group.  Only  to  the 
extent  that  greater*  numbers  of  lower 
income  applicanifi  also  belong  to  the  mi" 
nority  population  would  tower  Income 
applicants  be  denied  admiuion  dispro- 
portionately. What  seems  evident,  how- 
ever, is  that  those  students  accepted  from 
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CoMmmoN  or  First- Ysar  U.  S,  Medical  School  Cuss  Siucrto  on  m  Basu  or  Vauous  Modiu* 


NO  NO-     2:;^No\  No      2S      No,      22     HO     JS    NO.     5S     No.     J^J  No. 

ApptteMM  36.143    100   3U0O  8^.3* 4 Wi.  13  7  32562  90.7  29^33  «0.9  3i27   9.1  3361   9.4   1.965   5.4    1.416  39 

^MCATmpdtl  15.774  100  I4J7I  90.5  1.496  ^9^5  15.444  97.9  14,046  19.0  ^91  §.9  330  2.1  232  1.5  9^  ,0  6 
OPAaedtl  13.774  lOO  14.141  §9.7  1.633  10.4  15.326  97.2  13 J7i  16.0  *  1^1  9.2  448  2.1  263  1.7  115  1.2 
•.Amu^  appttcaMi  an  IMlil  10  dMM  «4aiM  and  u^fnpfCfciMd  atopiMti  ipM  tdMlly  pppUtd  (or  tdnktkm  to  Ui«  1976-77  tfiifftei'dMi 

t  AUHrMi«iMrtflc€ttco«^MrimwlikilMlouJ6|ura  «0 
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The  culoff  score  for  admiiskm  ^oMld  be  ^ 
•pproximaleiy  a  3.38  CPA,  Of  Ihe 
15,774  acceptaiKCi,  1,633  would  go  lo 
lower  'income  appllcanli- 1,448  lo 
whirei  Hnd  185  lo  underrepreienled  mi* 
norlltei.  Thus,  in  Ihls  model  J 1 .3  percent 
of  the  lower  Income  acceptances  and  2.8 
percent  of  Ihe  total  cIms  would  be  under- 
represented  minorities.  It  muiit  be  noted, 
however,  that  this  model  makes  no  at- 
tempt 16  weight  grades  according  to  the 
quality  or  grading  practices  oC  the  appli- 
cants* undergraduate  institution  T . 

In  bo.lh  of  Ihe  above  modeb  the  rale, 
of  acceptam^  of  lower  income  applR^nts 
falb  only  slightly  below  their  ratf  of 
application.  Lower  income,  applicants 
constitute  13.7  percent  of  the  total  pool 
of  white  and  underrepresenled  minority 
applicants  (10.8  percent  of  while  appli- 
cants and  41 .9  percent  of  minority  appli- 
cants). In  Ihe  MCAT  Science  subtest 
Kore  nuxlcl  1 ,496  lower  income  students 
were  admitted.  This  amounto  lo  9.5  per- 
ceitt  of  all  acceptances.  In  Ihe  OPA 
model,  1»633  lower  income  sludehll 
(10.4  percent  of  ill  acceptances)  were 
admitted.  Th^  data  from  these  modeU 
are  displayed  in  Table  3. 

Although  ho  school  would  be  likely  lo 
apply  a  single  ^erlon  for  admission, 
emphasis  on  tmt  two  criteria  in  Ihe 
absence  of  any  special  admissions  pro- 
gram would  lend  io  producCiesulls  in 
the  range  predicted  by  these  modeb. 
What  seems  apparent  from  these  analyses 
ia  that  while  lower  income  while  students 
generally  would  not  suffer  any  severe 
disadvantage  from  the  use  of  these  Iradi- 
tioAil  criteria,  underrepresenled  minor- 
ity applicants  clearly  would.  Further- 
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more,  yht  racial  disadvantage  refkcted 
in  these  models  and  in  Figures  1-3  ap- 
pears to  be  bised  on  factors  which  iran- 
sceml  purely  economic  considerations. 

Thus,  within  a  given  ethnic/racial 
grouping,  applicants'  OPAs  and  MCAT 
scores  vary  only  slightly  according  lo 
parental  income.  But  within  a  given  in- 
come gn>up  applicants'  CPAs  and 
MCAT  scores  vary  far  more  subsUnlially 
according  to  racc^  From  these  observa- 
tions it  seems  reasonable  to  conclude 
that  lower  income  applicanu  as  a  clau 
are  not  educalionally  disadvantaged  in 
applying  for  admiulon  lo  medical  schobi, 
while  applicants  from  underrepresenled 
minority  groups  are  dbadvanlaged  by 
faclon,  extending  beyond  economics^ 
which  lead  to  a  lower  level  of  perform- 
ance OS  reflected  In  CPAs  |bd  MCAT 
scores. 
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Primary  Care  Education  Trends 

In  U.S.  Medical  Schools  and  Teaching  Hospitals 

•  .  .  .         <  ■ 

Joseph  J.  Giacahne  and  James  I,  Hudson,  M.D.  . 


AMfftd^In  1973  Schroeder  aiKl  colle«gues  comlucted  ■  Mirvey  of  U.S.  medkal 
ichoolt  in  order  lo^bcertain  the  nalure  of  chwige  in  primary  care  educalioa  Which 
had  occuned  tyy  Mai  dale.  In  1976  the  aulhort  of  the  present  paper  ulillted  the 
tame  lurvey  irodument  to  document  trend  data  over  the  Ihree-year  period.  ^Whlle  * 
conclusions  from  the  1973  survey  pictured  primary  care  education  in  a  Iransitionat 
state,  the  1976  data  |ugg€st  movement  toward  a  general  coittolidation  of  eltforU. 
the  1976  data  indicate  a  continued  emphasis  on  education  in  the  ambulatory  care 
area  with  no  well-deflhed  locus  for  coordinating  institutlonwide  primary  care  training 
efforts^  a  leveling  off  of  interest  In  health  maintenance  organiutions  (HMO)^ 
afniiations,  no  significant  change  in  the  number  of  affiliated  programs  for  tralnij|g 
nurse  practitioners  or  physician's  assistanu,  and  a  marked  increase  in  the  number  of 
schools  with  affiliated  generalist  n;^idency  programs  in  internal  medicine  and'pediat- 
rics.  *      ■     .    .  ■ 


In  the  past  decade  new  initiatives  in 
primary  care*  education  have  been  taken 
by  virtually  all  the  nation's  medical 
schools  and  teaching  hospitals.  These 
programs  vary  in  scope  and  in  content. 
Almost  universallly,  they  have  involved 
broader  utillza^  of  ambulatory  care 
facilities  for  teaching;  and  in  many  in- 
stances Ihey  have  resulted  in  major 
changes  in  affiliated  residency  programs. 
The  changes  so  far  initiated  are  likely  to 
have  serious  implications  with  respect  to 

OiKtlOflC  Is  Mllf  SfMCiiM  Dt.  IhklMHi 
it  direciof » DcasrimciH  of  He«ltk  Servkn.  AsMi- 
■lioA  of  AmencM  Mc<Hc»t  ColkfM»  WuIOh^nIi 

DC.  • 

*  Tlic  iiMkon  km  adopicil  ike  Alpert  Md 
CliirfKy  (i)  dcftuMMi  of  pfimary  c«rc  m  flrti 
coAlKt  mcdidiic  wtiidi  ■wamx  lnii|k<i<i«ii  ft- 
ipoMlMMiy  lor  Um  Milem  itMtdkM  of  Ike  fm^ 
ence  or  ebMiice  of  iftiesM  mm  wkere  tke  proviaef 
ruiKtiofMi  M  M  *'kMe|rilkMilM**  of  kciltk  cftrvlqr 
Hie  paikiil. 


future  financing  of  medical  education, 
particularly  graduate  medical  education. 
'  In  1973  Schroeder,  Werner,  and 
Picmme  (2)  co'nducted  for  the  Associa- 
tion of  American  Medical  Colleges 
<AAMC)  a  major  survey  of  116  U.S. 
medical  Khools,  of  which  three  were  not 
involved  in  clinical  teaching,  in  order  to 
ascertain  the  nature  of  changes  in  pri- 
mary care  education  which  had  occurred 
by  that  date.  That  survey  supported  the 
general  impression  that  there  had  been 
intense  activity  in  the  ckyelopment  of 
primary  care  programs  within  these  aca- 
demic medical  centers  dMring  the  two  to 
three  years  prec^eding  the  survey.  What 
emerged  was  a  picture  of  primry  tare 
education  in  transition  with  no  dear  pat* 
tern  of  optimum  program  devekvmcnt. 
The  eventual  sliUMi  of  indivi( 
grams  Wu  projeaed  u  contingent  ^th 
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Chairman  Perkins.  Dr.  Bond,  go  ahead. 

•  Dr.  Boixd  is  the  director  of  the  Learning  Research  and  Develop- 
ment Center,  the  University  of  Pittsburgh. 

STATEMENT  OF  DR  LLOYD  BOND,  RESEARCH  ASSOCIATE, 
LEARNING  RESEARCH  AND  DEVELOPMENT  CENTER,  UNIVER-^ 
SITY  OF  PITTSBURGH 

^  Dp.  Bond.  1  would  like  to  correct  part  of  my  ri^cord.  That  is  not 
my  correct  title.  I  am  a  research  associate  there.  « 

Mr.  Chairman  and  members  of  the  subcommittee,  ""my  name  is 
Lloyd  Bond.  I  am  an  assistaq^t  professor  of  psychology  at  the  Uni- 
wsl^y  of  Pittsburgh  and  a  research  associate  at  the  Learning 
Rve&rch  and  Development  Center  in  Pittsburgh,  Pa. 

My  aOademic  training,  teaching,  and  research  are  in  the  general 
area  of  research  methodology,  statistics,  and  psychometrics. 

I  appreciate  the  opportunity  to  testify  before  the  subcommittee 
on  proposed  legislation  regarding  tests  and  their  uses  in  higher 
education.  Both  as  a  psychometrician  and  as  a  citizen  of  color,  I  am 
both  personally  and  professionally  interested  in  any  legislation 
regarding  st^dardized  tests  and  their  impact  on  minority  stu- 
dents. 

•  At  thiB  start,  may  I  say  that  I  fully  support  many  of  the  provi- 
sions of  the  bills  under  discussion  and  I  support  what  I  perceive  to 
be  their  general  intent.  If  these  bills,  in  their  final  form,  result  in 
increased  public  knowledge  and  understanding  of  tests  and  how 
they  are  used,  then  the  legislation  will  stirely  be  in  the  public  good. 

I  should  like  to  summarize  thy  perception  of  the  rights  of  stu*- 
dents  ind  the  public  regarding  testing  and  test  use.. 

First,  before  they  take  any  test  which  is  subsequently  used  in 
decisions  affecting  their  lives  and  careers,  students  should  know 
what  the  test  purports  to  measure. 

Moreover,  I  would  go  even  further  and  suggest  that  students  are 
entitled  to  a  comparable  form  of  any  test  used  for  selection  in 
order  that  they  be  familiar  in  a  general  way  with  the  kinds  of 
items  they  will  encounter  on  the  actual  test.  / 

Second/ students  aiM  the  public  generally  should  have  some  to- 
surance  that  tests  are  Ifoir,  that  they  contaiin  unambiguous  items, 
that  thev  are  reuable,^^  importantly,  that  they  validly 

predict  the  performance  mey  are  intended  to  predict. 

Thirdrstudents  have  a  pasic  right  to  know  that  test  result^  are 
accurately  scored  and  recorded. 

Finally,  studentiS  have  a  fundamental  right  to  know  how  an4  to 
what  extent  test  results  will  be  used  along  with  other  Information 
in  making  final  selection  decisions. 

Much  mformation  rele^(^tQt4p^  the  rights  outlined  above  is  al- 
ready in  the  pubUo  domabTFIdr  example,  a  recent  publication, 
'Taking  the  SAT contains  ribt  pnly  a  complete  sample  SAT  teftr 
but  also  detcdled'oiscussions  of  the  eorrect  answer  to  each  type  of 
item,  -         ^  _ 

Information  regarding  tHe  relationship  betlveei)  test  scores  and 
the  performance  the y  are  intended  to  predict  is  readily  availi^le 
from  tMtmakers  themselves^  from  college  publications  and  from 
numerous  Qther  soufos  including  the  technical  literature. 
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To  state,  however,  that  information  is  available  to  interested - 
persons  does  not  imply  that  everyone  will  avail  themselves  of  the 
information.  To  the  extent  that  any  legislation  increases  the  likeli- 
hood that  test  information  will  be  more  readily  and  systematically 
available  to  the  public,  then  it  serves  a  useful  public  function.  ^ 

I  believe  many  of  the  provisions  of  H.R.  4949  and  H..R.  3564  will 
go  far  in  answering  the  above  concerns.  I  am  deeply  distu^rbed, 
however,  with  section  5  of  the  Weiss  bill,  H.R.  4949,  which  requires, 
upon  request,  public  disclosure  of  test  items  after  each  adipinistra- 
tion  of  a  test.  *  .  , 

As  a  measurement  specialist,  I  believe  this  portion  ot  the  bill  is 
fundamentally  misguided.  It  will  in  no  way  advance  the  rights  and 
'  legitimate  concerns  of  students  and  conpi^mers,  and  I  believe  that 
it  will  eventually  militate  against  bfecljit^nd  other  minority  stu- 

Fair,  unbiased  achievement  test  items  which,  v^ilidly  predict  fu- 
ture  academic  performance  take  months  and  even  years  to  develop.. 
Such  itetiis  should  be  carefully,  guarded  rather  than  revealed  after 
each  administration  of  a  test. 

The  result  of  item  disclosure  will  lead  to  the  hasty  and  unprofes- 
sional construction  of  items  which  are  likely  to  be  ambiguous,  more 
susceptible  to  cultural  bias,  and  generally  poorer  in  overall  predic- 
tive value.  r  \  u  1.  i.-  1 
Further,  I  see  no  merit  whatever  in  the  belief  that  substantial 
instructional  benefit  will  accrue  from  the  examination  of  individu- 
al right  and  wrong  answers.  Admissions  tests  measure  knowledge, 
competencies,  and  skills  acquired  over  a  relativijly  long  period  of 
time,  both  in  and  out  of  school.  Increased  performance  on  these 
tests  result  from  sustained  effort  and  quality  instruction  in  aca- 
demic areas.  Examining  individual^  items  is  a  misleading,  superfi- 
cial, and  meaningless  exercise.       *  .,i  . 

It  is  conceivable  that  the  item  disclosure  provision  will  be  a 
bonanza  to  the  coaching  schools  since  it  will  provide  them  with  a 
ready  source  of  items  to  use  in  their  coaching  sessions. 

As  such,  it  will  be  especially  beneficial  to  those  students  able  to 
pay  for  the  facilities  of  these  schools  which  is  precisely  the  reverse 
of  what  is  intended. 

►I  ihoiild  like  to  comment  briefly  on  the  current  controversy 
^rrlunding  the  effectiveness  of  coaching  schools  in  increasing  per- 
formance on  standardized  tests.  Part  of  the  confusion  on  this  issue 
results  from  the  differing  definitions  of  .coachhig. 

TwQ-  or  three-hour  cram  courses,  I  am  certain,  will  do  little  to 
increase /performance  on  these  tests.  If,  however,  coaching  is  de- 
fined as  sustained  instruction  in  mathematiqs,  grammar,  vocabu- 
lary, tind  general  reading  skills,  then,  of  course,  such  coaching  will 
be  effective.  It  is  lA-eCisely  developed  competence  in  these^  areas 
that  the  test  measures.     ,  ,      j.  \- 

Some  have  claim^  that  item  disclosure  may  aid  ih  the  detection 
of  biased  items  on%  achievement  tests.  The  |^hnical  Uterature  is 
replete  with  attempts  by  cdnterit  and  subject  matter  specialists  anfl 
by  black  and  other  minority  educational  researchers  to  seardh  out 
an(j[  remove  culturally-biased  items  from  standardized  achievement 
tests.' 


Overwhelmingly,  the  resiilto  of  ttese  attempts  point  to  the  same 
"odhclusion:  Substantial  differences  in  the-  achievement  scores  of 
midcQe  clasis  wMte  students  anfi  various  *  minorities  remain  even 
.  after  presumably  biased  it^ms  are  rAnoved.  In  fact,  n^y  items 
which  are  not  considered  biased  show  larger  mean  differences  be- 
tijreen  white  and  minority  students  than  do  items  which  are  re- 
moved. ' ,  / 

This  result  should  not  surprise  anyone  because  the  notion  guid- 
ing 1;he  search  for  biased  items  is  i^ong.  -The  search  for  such  items 
seems  precticated  on  the  belief  that  the  quality  of  education  re-  i 
^  ceived  by  mindrity  students  is  comparable  to  that  of  other,  students  ' 
and  that  average  perfbrmance  differences  therefore  reflect  some, 
kind  of  cultural  "eictra-schpol"  bias  in  the  tests.  And  if  we  could  get 
rid  of  this  bias,  everything  would  be  OK.  That  is  absurd. 

Clearly,  biased  tests  are  undesirable,  but  I  believe  the  continued 
research  and  concentration  on  this  aspect  of  tests  'distracts  both  the 
scientific-  community  and  the  public  from  the  real  issue  here— 
namely,  that  minority  education  in  this  country  is  outrageously 
deficient.  '  , 

A  related  belief  is  that  sOm'ehow  disclosure  of  test  items  will 
assuage  the  unequal  quality  of  education*  in  this  country.  This  is 
simply  riot  true.  Quality  items  ctnsjandardized  tests'reflect  in  part 
the  intolerably  poor  quality  ofeSucatipn  received  in  niwiy  publjc 

schools*  V  ^'  ^ 

I  do  not  believe,  unlike^  my  colleague.  Dr.  Jiackson,^  that  we 
should  kill  the  messenger  who  brings  the  bad  news.  Rather,  we 
should^  use ^e  evidence  support  further. effoats  to  improve  in- 
struction and  learning. 
;  -  Mr.  Ohairmani  other  disadvantages  ipf  item  disclosure  have  al- 
V  ready  been  mentioned  before  this  committee  and  I  need  not  go  into 
them  in  detail  here.  They  include  increased  ddsts  to  students  them- 
selves,  reduced  services  to  students,  less  fleidbility  in  terms  of 
altemativeil^ting  dates,  and  less  comparability  across  forms  of  the 
tests,  Thes?are  important  consequerices  fpr  the  students  them- 
selves. Any  legislation  should  carenllly  weight  these  disadvantagepi 
against  the  pretfUmed.  advantages  of  item  disclosure; 

Tliere  are  other  aspects  of  the  proposed  legislation  which  I  be- 
lieve gpudd  be  changed  for  the  better,  inclumng  the  requirenoent 
that  ltop^bli8hed  and  tentative  research  papers  on  standardized 
tests  be  made  publicly  available.  Surely  this  portion  of  H.R.  4949,  if 
it  is  enforceable  at  all,  is**  counf^erproductive  and  may  even  increase  ^ 
public  misunderstanding  Arid  susproion  regarding  tests  And  test' 
abuse.  ^  ,  , 

1  A  longsjkandlng  practice  in  academic  circles  has  been  that  one  s 
q)lleagues  andothers  trained  in  a  pai^icular  discipline  should  have 
tfte  opportunity  to  criti^ly  review  r^earch  papers  before  they  go 
^  into  ti^  public  domain.  The  propose<f  legislation  flies  in  the  face  of 
v'  this  ci^mmendable  tradition.  k  ' 

,  III  conclusi^,  may  I  restate  riiy  frfrii  agreement  with  legislative 
V,  activity  arhich  iflcreases  public  understanding  and  decreases  the 
likelihood  of  test  abuad.  "^e  unportarice  of  standardized  ^hieve^ 
nt  tests  lflj^li0  lives  t>f  students  is  jreat:  Tests  often  cany  fnore 
■eight  th^^ey  should.  ; 
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But  in  our 'zeal  to  remedy  overinterpretation  and  oveireliance^on 
test  scores,  we  should  be  extremely  carefuf  to  ensure  that  the 
effectsrof  such  legislation  will  not  result  in  tests  that  are  leiis  useful 
and  more  susceptible  to  misuse. 

I  would  jJike  to  comment  briefly  on  some  matters  bfought  up 
earliep- regarding  predictive  validity  and  differential  predictive  va- 
lidity. /  V 

Since  1972,  the  Imiversity  of  Pittsburgh  has  started  a  very  vigor- 
ous program  to  increase  the  number  of  black  Ph.  D.'s  out  of  that 
program's  psychology  department.  Prior  to  1972,  we  had  four  black 
Phi  D.'s  there,  oince  that  time  we  have  graduated  over  20  in  such 
areas  as  sociplogy,  psychobiolojgy,  and  mathematical  psychology. 
We  continue'  to  use  test  information  in  the  selection  of  those  stu- 
dents. 

•  Therf^liave  been  as  maAy  studies  which  were  shown  to  not 
predict  perfonnance  for  a  black  student.  I  think  I'tan  citeHwice  as 
many  which  show  jwsitive  correlations  between  black  students' 
scores  on  academic  tests  and  thdir  performance  in  college. 
>I  .see*  nothing  whatever  wrong  in  asking  a  student  to  multiply 
two  numbers.  Isee  nothing  whatever*  wrong  jvith  asking  a  student 
to  define  a  word. 

A  recent  study  by  the  NAEP  showed  that  71,  percent  of  black 
students  in  this  country,  high  school  students, '  could  not  do  the 
,  following:  A  room  is  12  feet  long  and  has  a  total  area  of  96  feet. 
What  is  th^widtfi? 

That  is  not  a  biased  item  and  our  continued  concentration  on 
this  notion  of  bias  as  somehow  artificially  removing  T;he8e  absurd 
educational  deficiencies  engendered  by  Our  schools  is  a  travesty. 
^  *  Thank  you,  Mr.  Chairman. 

Chairman  Perkins.  Our  next  witness  is  Mr.  Drexeler,  president 
of  the  senior  Vjlass,  iGrreat  Neck,  N.Y. 

STATEMENT  OP  KENNETH  DREXEI^ER,  PRESIDENT,  STUDENT 
GOVERNMENT,  NORTH  SENIOR  HIGH  SCHOOL,  GREAT  NECK, 

.  N.Y.^  '  ,  : 

Mr.  Drexeler.  I  thank  you  for  the  opportunity  to  testify  today.  I 
am  the  president  of  the  student  organization  which  is  the  student 
government  of  the  school,  not  just  the  senior  class. 

I  think  I  can  bring  to  you  this  morning  a  viewpoint  which 
nobody  else  on  the  panel  can,  that  of  9,  high  school  student  who  has 
taken  the  PSAT,  has  taken  the  SAT's  and  who  is  studying  to  take 
the  SAT  again  thig  Saturday  and  hopefully  will  be  takirife  the 
LSAT  in  the  future.  _ 

Our  school  has  gotten  involved  in  the  question  of  the  testing 
industry  and- the  truth  in  testing  bill  primarily  as  a  result  of 
several  incidents  which  occurred  at  our  schools.  There  were  errors 
made  by  the  educational  testing  service.  I  described  them  in  my 
testimony  and  have  given  them  titles.  They  are  not  official  titles, 
but  are  used  to  give  identification  to  the  incidents. . 

First,  the  case  of  the  missing  paper  and  the  dupUdated  test. 

In  1976  the  Great  Neck  school  district  notified  ETsTthat  a  test 
booklet  of  £1  SAT  exam  was  missing.  It  subsequently  developed  that 
the  missing  booklet  was  taken  by  a  Great  Neck  teacher  who  made 
copies  and  used  it  to  give  students  prac^tic§  in  taking  the  SAT  tests. 
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^Hiere^as  no  question  but  that  what  the  teacher  did  was  illegal, 
but  the  teist  was  used  for  purposes  of  coaching.  Other  examples  are 
reported  as  missing  and  such  tests  should  liever  be  repeated.  The 
teacher  never  contemplated,  even  as  a  remote  possibility,  that  ETS 
would  repeat  the  same  test. 

When  ETS  unaccountably  did  repeat  exactly  the  same  tiest  only  2 
years  later,  almost  50  Great  Neck  students,  fewer  than  5  of  whom 
had  even  seen  the  earlier  test,  had  their  scores  invalidated.  ETS 
promptly  brought  a  suit  of  copyright  infringement  against  the 
teacher  which  wai9  subsequently  settled  out  of  court. 

No  justice,  however,  was  available  tp  the  50  Great.Neck  students 
whose  tests  were  invalidated  due  not  to  any  fault  of  their  own  but 
to  the  gross  inefficiency  of  ETS  in  repeating  a  test  when  a  copy  had 
been  reported  missing. 

The  October  weekend  fiasco:  ETS,  to  its  credit,  is  aware  that 
some  students  observe  Saturday  as  their  Sabbath,  and  it  gives  such 
students  the  option  of  taking  its  elcams  on  Sunday. 

On  Sunday,  October  29, 1978, 13  Great  Neck  North  students  took 
the  P$AT  exams.  Incredibly,  ETS  administered  to  them^actly  the 
daine  test  that  was  given  to  their  classmates  on  Saturday^  October 
28.     .  . 

The  results:.  (1)  The  National  Merit  Scholarship  Corp.  disqualified 
the  results  of  the  18  students  Whp  took  the  Sunday  exam,*^d  (2)  to 
make  amei^ds,  ETS  asked  the  NMSC,  which  bases  its  scholarship^ 
awards  on  a  formula  based  upon  PSAT  scorers,  to  use  the  regular 
SAT  scores  which  the  13  students  obtained  the  following  spring  in 
making  the  scholarship  awards.  ' 

This  has  caused  protests  from  others  who  claim  that  the  scores 
on  the  regular  SAT's  are.  generally  far  better  than  those  on  the 
PSAT's,  that  the  two  are  not  comparable,  so  that  in  the  words  of  a 
school  newspaper  editorial;  ''It's  like  comparing  apples  and  oxr 
anges,  or  more  appropriately,  it's  jlike  comparing' responsible  orga- 
*nizations  to  irresponsible  prpfitmaking  groups  such  the  ETS.  It 
just  cannot  be  done.''  - 

How  to  demolish  a;  student's  college  prospects:  ETS  permits  a 
student  to  cancel  an  exam  by  filling  but  a  cancellation  report  when 
he  turns  in  his  test  paper.  If  he  does  so^  ETSopromises  that  it  will 
not  grade  the  exam  nov  make  any  rep(^  thereof. 

One  of  the  better  students  Who  had  been  rejected  by  some  col- 
leges later  discovered  that  ETS  liad  rejported  to  all  colleges  to 
wfiich  he  applied  the  resUlts  of  an  exiam  which  he  had  canceled 
after  completmg  fewer  than  half  the  questions.  ^  . 

There  is  no  wajr  to  ascertain  how  sulwtantially  this  ET3  blunder  ^ 
affected  the  decisions  of  the^  colleges  from  which  he 'was  rejected. 
But  how  do  you  make  restitution  to  this  student?  One  must  surely 
speculate  as  to  how  many  times  this  has  happened  and  gone  undis- 
covered. '  . 

All, three  of  these  evente  occurred  in  o^e  school  with  a  popula- 
tion of  1»2(K)  students  in  1  year's  time. 

A  recent  article  in  the  New  Republic  described  a.  i^ore  serious 
and  Mddespread  incident:        /        y  . 

«  *  *  *  There  18  no  real'  recouroe  if  ^TS  sends  inaccurate  information  to  a  college 
about  a  student,  because  mostly  likely  the  stodent  will  never  find  out  ibout  it.  One 
suciyik^dal  became  public  during  the  1976-76  acadeimc  year.  Some  of  the  LSM" 
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score  reports  sent  to  law  schools  contained  an  asterisk  indicating  that  the  applicant 
was  an  ''unacknowledged  repeater"— someone  who  had  failed  to  indicate  on  the  test 
registration  form  that  he  or  she  had  taken  the  test  before.  Applicants  were  not  told 
that  overlooking  the  seemingly  innocuous  question  about  past  tests  risked  incurring 
the  deadly  asterisk.  Even  worse,  the  ETS  system  accidentally  labeled  an  unknown 
*  number  of  test-takers  incorrectly  as*  ''unacknowledged  repeaters."  ETS  eventually 
notified  admissions  deans  to  ignore  the  asterisk.  But  it  made  no  effort  to  rectify  the 
damage  already  done  or  to  inform  th§  Victims  of  the  error  why  Ihey  may  have  been 
rejected  from  law  schpol.  ^ 

Significantly,  Ed  Kierah  of  the  Village  Voice  reports  that  private 
citizens  have  brought  more  than  50  lawsuits  against  ETS  or  its 
clieiits  during  the  past  few  years.  Despite  the  numerous  errors 
made  in  my  school,  I  know  of  no  family  of  ^  student  affected  by 
these  errors  who  has  filed  such  a  lawsuit. 

This  certainly  leaves  us  wondering  how  mariy  blunders  have 
actually  been  made  but  gone  unpublicized  and  also  unchallenged, 
primarily  because  the  aggrieved  students  are  dispersed  throughout 
the  counti^.  ,  ^ 

'  There  is  no  central  clearinghouse  and'  therefore  they  have  no 
communciation  with  each  other  as  to  errors  that  have  affected 
other  students.  Overall,  our  unfavorable  experience  with  ETS  ap- 
pears typical. 

In  protest  of  these  regrettable  situations,  our  student  govern- 
ment unanimously  passed  ja.  resolution  strongly  condemning  the 
actions  of  ETS  and  requesting  that  an  independent  and  impartial 
investigation  be  made  of  the  testing  organization. 

Then,  last  May  I  organized  a  series  of  seminjafS  at  our  school  on 
the  entire  testing  issue,  including  discussion  of  the  New  York  truth 
in  testing  bill,  the \vaLue  of  coaching  schools,  and  the  integrity  of 
the  testing  industr^  ^ 

The  participants  were  Prof,  Banesh  Hoffman,  author  ^  "The 
Tyranny  of  Testing"  and  a  longtime  critic  of  standardized  ^  tests; 
Robert  Moulthrop,  director  of  the  information  division  at  EtS;  arid 
Allan  Nairn,  author  of  the  Ralph  Nader  report  on  ETS,  These 
seminars  received;  coverage  from  the  New  York  Times,  l^ewsday, 
and  CBS,  . 

Pfrhaps  the  most  serious  and  inequitable  problem  of  all  deals 
with  the  lack  of  security  of  the  testS,  The  aforementioned  incident 
in  which  a  Great  Neck  teacher  took  a  copy  of  an  SA'P  exam  is  not 
by  any  means  an  isolated  occurrence. 

During  the  course  of  discussions  I  have  had  with  teachers,  both 
in  my  school  and  outside  of  piy  district,  I  am  consistently  told  of 
the  simplicity  with  which  w^ich  one  can  tal^gw  tpsL^aj^Ajhat  the 
practice  is  both  frequent  and  widespread,  especially  amoif*  ^'^"'•^ 
ers  who  give  preparation  course  privately. 

Apparently,  when  the  test  booklets  are  counted  at  the  conklusion 
of  the  exams,  only  a  superficial  check  is  made,  often  only  the  top 
sheets  are  counted.  Thus,  a  teacher  serving  as  a  proctor  W  re- 
move the  inside  of  the  booklet  and  merely  return  the  covei'lsl^et 

In  preparation  for  the  SAT  exam  which  I  will  be  taking  this 
Saturday,  I  have  just  completed  a  $275  Stanley  H,  Kaplan  coaching 
course.  The  most  important  feature  of  the  course  lies  in  that  it 
Vlows  students  to  enjoy  prior  familiarity  with  SAT-type  questions 
a^d  apparently  actual  SAT  .questions  as  well 


907 


903 


A  relative  of  mine  recently  took  a  Stanley  Kaplan  course  in 
preparation  for  the  medical.,  college  admissions  test  (MCAT).  Upan« 
returning  home  from  the  ejt'am  tiie  students  in  the  course  received 
telephone  calls  from  the  Kaplan  organization  asking  them  which 
questions  they  remembered.  The  Kaplan  organization  subsequently 
threw  a  partjigthat  Saturday  night  for  all  of  the  students  in  the 
course;  during  which  the  students  were  again  grilled  on  their  mem- 
jory  of  questions.  I  have  been  told  that  this  is  a  fairly  common 
practice. 

It  is  also  thought  by  many  that  various  test  preparation  centers 
WUl  pay  a  group  of  people,  often  possessing  so-called  photographic 
memories,  to  sit  through  exams.  Upon  leaving  the  testing  site  they 
ftnmediately  write  down  the  questions  for  use  in  prep  courses. 

Thus,  at  a  recent  session  of  mjr  Stanley  Kaplan  course  the  irt- 
structor  told,  us  that  virtually  all  of  the  questions  either  are  taken 
verbatim  from,  actual  exams  or  are  very  similar.  A  report  released 
earlier  this  year  by  the  Federal  Trade  Commission  affirms  that 
taking  a  prep  course  can  substantially  increase  a  student's  score. 

The  truth-in-testing  bill  requires  the  disdosure  of  test  questions 
and  this  is  important.  For  many  years  black  students  have  scored 
consistently  lower  on  standardized  exams  than  white  students  who 
are  on  an  equail  level  of  scholastic  ability  by  all  other  indicators.  In 
most  cases,  these  black ,  studedts  come  from  poorer  homes  and 
cannot  afford  to  take  expensive^cram  courses.  With  the  adoption  of 
the  truth-in-testing  bill  in  New  York  State,  all  students  there  will 
start  out  on  an  equal  footing.  -  A 

Obviously,  the  testing  industry  does  not  wish  to  comply  with  this 
New  York  law,  hence  many  test  producers  have  threatened  to 
withdraw  their  exams  from  New  York  after  the  law  takes  effect  on 
January  1,  in  order  to  circumvent  this  new  law.  This  questionable 
tactic  must  not  be  permittecil  to  work.  _ 

Another  point  which  is  in  controversy  is  whether  that  would 
reduce  the  quality  of  the  exams:  The  president  of  the  AAMC  says 
there  is  a  limit  to  the  number  of  relevant  questions  that  can  be 
used  on  the  MCAT. 

I  think  a  New^ay  editorial  answered  this  best  when  they  said: 

None  of  these  claims  is  even  marginally  convincing.  To  argue,  that  there's  some 
limit  on  drawing  up  questions  for  prospective  medical  students  suggest  a  dismally 
narrow  view  of  professional  education.  Nor  is  it  clear  how  preparing  fresh  ^ts 
periodiqally  would  compromise  quality.  Isn'l  it  more  likely  that  repeating  the  sStaie 
•  questions  would  limit  quality  and  invite  misuse?  .  •     '  . 

I  think  there  is  a  fallacy  in  the  way  which  many  people  are 
interpreting  this  (bill.  Dr.  Howe  mentioned  this  morning  that  test- 
ing is  our  greatest  jrofessioh  and  that  he  doesn't  know  that  ytre 
want  to  attack  it/  )  ,  , 

The  m^or  poiAt  is  that  this  bill  does  not  attack  testing.  It  merely 
insists  that  the/testing  indu8tr«jr  be  required  to  conform  to  certain 
standards  of  accountability  and  tegulation. 

I  am  speakjng  to  you  today  hot  merely  in  my  capacity  as  student 
govemni^  president,  but  also  as  a  student  who  has  already  taken 
.  some  omfie^  exams,  PSAT's,  SATs,  f^nd  achievements,  who  will 
be  taking  the/SAT  again  this  Saturday,  and  who  ptans  to  be /taking 
m(jre  tests^^/the  next  years,  that  is,  iJISAT'sr 


904 


Though  there  is  undoubtedly  a  need  for  some  standardized  test- 
ing, the  testing  industry  must  nevertheless  bq.  required  to  conform 
to  certain  standards  of  accountability  and  regulation  in  the  interest 
of  protecting  the  rights  of  all  students  and  improving  the  selection 
process  for  higher  institutions,  of  learning. 

Accordingly,  I  strongly  urge  the  members  of  the  House  Subcom- 
mittee on  Elementary,  Secondary ,^and  Vocation  Education  to  sup; 
port  this  national  truth-in-testing  bill. 

Thank  you. 

[The  information  referred  to  follows:] 

■  (From  Newsday,  July  23,  1979) 

The  Medical  Colleges  Flunk  This  Test 

A  reasonably  assurate  diagnosis  can  be  made  of  the  Association  of  American 
Medical  Colleges'  threat  to  retaliate  against  the  state's  new  '*truth  in  testing"  law: 
It's  symptomatic  of  acute  arrogance. 

The  AAMC,  joined  by  the  American  Dental  Association,  says  it  will  cease  to 
administer  the  Medical  College  Admission  Test.(MCAT)  in  New  York  after  the  first 
of  next  year  Virtually  al)  njedical  schools  in  this  country  require  student  applicants 
to  take  th^t  test;  5,000  New  Yorkers  sit  for  it  every  year.  . 

How  does  the  new  law  afTect  the  medical  examinations  and  others  such  as  the 
College  Boards?  It  merely  permits  students  who  have  taken  these  tests  to  obtain 
their  grading  sheets  and  a  !list  of  correct  answers  so  they  can  compare  them  and 
"verify  their  marks.  j 

What  are  the  professional  associations'  objections?  According  to  Dr.  John  A.  D. 
Cooper,  AAMC  president,  '/there  is  a  limit  to  the  number  of  relevant  questions  that 
can  be  used  on  the  MCAT,"  Dr.  Thomas  J.  Ginley  of  the  ADA  says  making  the 
answers^  public  would  be  "compromising  the  quality  of  the  test/'  A  spokesman 
insists  that  new  questions  would  have  to  be  developed  every  time  the  test  is 
administered  and  that  this  would  be  impossible  to  do  for^some  parts  of  the  exam. 

None  . of  these  claims  is  even  marginally  convincing.  To  argue  that  there's  some 
limit  oh  drawing  up  questions  for  prospective  medical  students  suggests  a  dismally 
harrow  view  of  professional  education.  Nor  is  it  clear  how  preparing  fresh  tests 
periodically  would  compromise  quality.  Isn't  it  more  likely  that  repeatmg  the  same 
questions  would  limit  quality  and  invite  misuse? 

State  education  officials  are  meeting  with  the  the  associations  to  talk  the  matter 
over.  They  have  a  right  to  talk  tough.  The  Educational  Testing  Service,  a  leading 
lobbyist  against  the  '  truth  in  testing"  legislation  in  Albany,  employed  many  of  the 
ai^uments  the  AAMC  and  ADA  are  using,  but  it's  not  threatening  now  to  suspend 
college  tests  or  harass  New  York  students.  What  do  these  two  professional  associ- 
ations exist  for,  anyway— education  or  intimidation? 

.    (The  Nnw  York  Times,  July  24,  . 11)79] 

Truth  in  Testing 

'The  intemperate  responses  of  some  academic  testers  to  New  York's  truth-in- 
testing  law  are  certain  ^to  damage  their  cause  more  than  the  law  itself.  The  associ- 
ations  that  administer  admission  tests  for  medical  and  dental  schools  have  threat* 
ened  to  pull  out  of  New  York,  and  the  Educational  Testing  Service,  the  hation's 
biggest  testing  enterprise,>  has  said  it  might  curtail  services.  Doubtless,  the  law  will 
require  more  work  on  their  part,  and  there  will  be  addojd  co^ts.  But  their  cofiiplaints 
are  overstated.  In  fact,  the  law  is  welconie;  it's  time  to  take  the  mystery  out  of 
college  testing. 

The  law  signed  recently  by  Governor  Carey  applies  to  such  examinations  as  the 
Scholastic  Aptitude  Test  and  the  Law  School  Admission  Test  that  colleges  and 
graduate  schools  use  to  rank  their  applicants.  As  of  Jan.  1,  1980,  a  copv  of  any  test 
offered  in  New  York  must  be  filed"  with  the  State  Department  of  Education.  In . 
addition,  dat^l  on  how  a  test  was  constructed  and  validated  must  be  made  public. 
What  irks  t)ie  testers  most  is  a  provision  that  allows  anyOhe  who  takes  an  exam  to 
receive  a  graded  copy.  Questions  used  for  research  but  not  counted  in  scores  and 
Bpeciali2ed  stchievement  tests  are  exempt  t 

The  testers  say  the  law  means  an  exam  ^ven  in  New  York  cannot  be  used  again' 
because  its  contenj^  are  likely  to  be  dissemmated  elsewhere.  They  contend,  too,  that 
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the  law  will  create  problems  in  "efluatinc"  testa— insuring,  f&r  instance,  that  a  600, 
verbal  score  achieved  in  1975  is  comparably  to  a  600  in  1979.  The  testers  therefore 
project  drastic  increases  in  cost  ti^naintain  the'  present  level  of  service.  And  they're 
unhappy  that  the  law  goes  into  dlffect  so  quickly.  This  complaint  may  be  justified.  It 
takes  iNOnths  to  prebare  a  test  and  ai  slight  delay  may  be  in  order. 

Testing  services  like  ETS  haw  been  more  open  about  themselves  in  recent  years 
and  the  tests  have  improved;  to9ay,  most  are  fairer  to  minorities  than  they  were  ten  . 
yearfl  ago.  But  the  testers  stillmsiven^  faced  up  to  other  exam  limitations  or  to  the 
frequent  misuse  of  test  resulra.  Although  ^tets  caution  against  it,  some  Schools 
^stal  rely  on  scores  as  absolute  indicators  of  abi^y.  ETS,  moreover,  is  surely  exag- 
gerating when  it  contends  tlwt  the  new  law  mign^h*ive  up  costs  by  as  much  as  50 

Krcent  and  that  even  then'  it  might  not  be  ^  uphold  testing  standards, 
(velopment  costs  are  only  a  small  part  of  of  totaOosts  passed  on  to  the  consumer. 
And  some  authorities  have  a^ed  convincingly  that  at  least  four' techniques  al- 
ready used  by  ^he  industry  would  permit  "equating"  arid  validating  to  continue 
undisturbed— at  little  or  nof extra  cost. 

In  any  case,  there  is  theimatter  of  elementary  fairness.  These  academic  tests  help 
to  shape  the  course.of  people's  lives— their  schooling,  their  careers,  the  very  sense  of 
their  own  abilities.  Students  deserve  to  know  how  they  are  being  rated  and  judged. 
There  are  freedom-of-information  laws,  truth-fn -lending  laws,  truth-in-packaging 
laws.  Why  not  truth  in  toting  as  well? 

Chairman  Perkins.  Mr.  Andrews,  you  have  a  distinguished  wit^ 
ness|from  your  State  anti  you  may  introduce  him. 
Mr.  Andrews,  Thank  you,  Mr.  Chairman. 

We  have  a  witness  from  my  State  who  hsls  distinguished  himself 
there  and  whom  I  would  be  privileged  to  introduce. 
Dr.  Cahow,  we  welcome  you  from  Duke"  University. 

STATEMENT  OF  Djl.  CLARK  R.  CAHOW,  ASSOCIATE  PROFESSOR, 
HISTORY.  AND  ASSISTANT  PROVOST,  DHKE  UNIVERSITY, 
CONSOR^M  0>  FINANCING  HIGHER  EDUCATION 

Dr.  Cahow.  I  have  been  connected  Vith  the  universities  for  the 
past  25  years.  I  Have  had  the  opportunity  of  seeing  what  has 
-  happened  as  a  result  of  the  improvement  of  test  scores  and  the 
reporting  of  test  scores. 

I  have  come  tp  t^e  conclusion  as  the  majority  of  the  schools  in 
the  consortium  on  l^igher  education  haye  also  concluded  that  there 
are  some  serious  problems  with  the  proposed  legislation  and  I  wish 
to  speak  on  that  issi^e. 

We  ^ee  in  effect  with  the  previous  testimony  of  Fred  Hargadon 
representing  the  college  board  and  Robert  J.  Solomon  of  the  educa- 
tional testing  se^ce.  And  while  we  do  agree  with  them,  we  are  not 
as  concerned  with  E'TA  as  we  are  with  what  might  happon  at  the 
college  and  university  l^vel  and  with  the  students  seeking  admis-  > 
sion  in  the  colleges  and  universities  across  the  Nation.  \ 

Editorial  comment  on  the  bills  concerning  the  predictive  valid- 
ity of  the  sfindardiz0d  tests  I  think  is  sufficient  and  I  .will  not 
comment  any  further  on  those  matters.  \ 

I  had  the  privilege  of  serving  on  the  Aqiprican  Assoclalioft  of 
Law  Schools  Review  Panel  of  the  J5a^Ae  decision  wh6n  it;  was 
.icfsued,  and  I  think  if  the  Bakke  decision  spoke  to  any  issued  it 
reaffirmed  the  fact  that  schools  are  guarantee4  linder  the  first  and 
sixth  amendments  of  t^he  Constitution  to  admit  students  th^ 
choose  to  admit,  to  teach  as.  they  choose  to  teach,  and  I  would  hope  ' 
tlmt  whaikever  comes  out  of  this  series  of  conferences  and  any  \ 
l^fBlatiojl  that  might  b^  forthcoming  would  keep  this'  factor  iu 
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The  only  concern  oF  the  court  was  that  in  the  decision  process 
there  bcja  guarantee  that  there  be  no  discriminatory,  actions  taken  . 
against  Ipplicants.  If  this  is  d  Condition  that  is  protected  in  the 
admissions  process,  the  court  hag  taken  the  position  that  standard* 
ized  tests  in' fact  can  play  and  oUght  to  play  an  important  role  in. 
the  decision*  process.  i 

'  The  literature  of  both  the  ACT  and  the  college  board  speak  to 
the  fact  that  tests  are  constructed  to  assess  students'  general  edu- 
cational development  and  ability  to  compete  in  college  level,  work, 
to  require  that  a  student  demonstrate  both  problem  solving  and 
reasoning  ability.  " 

Both  agencies  readily  state  that  the  tests,  are  good  predictors  of 
performance  in  college  but  they  are  itot  precise  and  should  not  be 
treated  as  they  were.  We  take  this  into  account  as  I  think  all 
— rresporisible  admissions  officers  take^it  into  account. 

For  a  niAiber  gf  reasons,  no  test  test  measures  \yith  precision. 
The  reliability  of  the  verbal  section  is  considered  0,91  and  0.92  on  , 
the  medical  section.  We  think  publication  of  test  methods  and 
results  Would  dahiefge  this  reliability.      .  '  ; 

Because  we  khow  all  test  scores  have  .imprecision,  we  also  know 
it  is  a  generfidly  accepted  practice  to  interpret  scores  as  ranges 
rather  thah  as  precise  pointjs.  I  am  not  trying  to  imply  that  test 
scores  are  wcfthless.  They  are  riot.  On  the  contrary,  we  use  test 
scores  befcgiusA^  we  believe  they  measurably  improve  the  validity  of 
the  admissions  decision. 

It  ha3  been  demonstrated  that  the  predictive  validitv  of  a  high 
school  record  is  better  than  the  predictive  ability  of  th|  SAT  scQte 
alone.  A  copibination  has  higher  predictive  value. 

How  tests  are  used  in  conjunction  with  other  factors  is  a  matter 
left  to  the  i^idividual  school.  Nq  amount  of  disclosure  of  test  infor- 
mation will  klter  the  right  of  schools  to  use  the  tests  as  they  see  fit. 
We  know  that  unde^  this  k|nd  of  condition  test  data  can  be  mis- 
used. When  bnly  t^  SAT  math  score  of  two  individuals  differs  69 
points  on  a  200  to  800  scale,  is  there  any  signific^gt  difference 
expressed  in  fhe  ability  of  those  tvvo  students?  /  . 

Those  of  us  in  the  admissions  field  know  that  this  is  the  case  and 
we  know  full  well  thart  .the  college  board*  has  cautioned  against 
such  misuse  of  tests.      '  ^ 

Nonetheless,  wheji  a  student  with  a  550  verbal  is  placed  on  the 
waiting  list,  one  with  a  540  yerbal  is  rejected,  and  one  with  a  570 
.    verbal  is  accepted,  student$  raise  the  question  imd  testing,  agencies 
outside  the  college  board  raise  the  question  of  the  Validity  of  tl^ 
test.;  ♦         J  ^ 

\  (iecision  like  this  if  it  is  not  ba^d  on  other  factors  is  far  Irofti 
defensible.  The  commoi^  assumption  that  board  scores  are  the  pri- 
ttiarV  determinant  raises  the  level  both  of  frustration  and  suspicion 
on  the  part  of  the  applicant. 

it  also  raises  a  level  of  frustration  and  extreme  effort  on  the  part 
of  people' in  college  admission  offices  when  they  are' called  upon  to 
explain  why  it  is  that  when  board  scores  are  put  with  other  factors 
in  the  decision  process,  the  school  has  admitted  a  student  with)  a 
mid-range  800  score  and  has  rejected  a  jstudent  in  the  1100  range 
'    score,  both  from  the  same  school. 


"  This  is  a  difficult  procedure  but  one  wfe  accept  as  part  of  our 
responsibility.  I  actually  know  of  no  school  that  uses  test  scores  in 
such  an  isolated  and  arbitrary  fashion. 

The  test  score  by  itself  will  not  get  9  student  in  or  keep  a  student 
out  of  a  select^  school  Schools  that  are  not  selective— and  with 
the  population  drop  as  it  is  coming  on  us  now  in  the  next  10  years, 
more  schools  will  not  be  selective— schools  that  aire  not  selective,  in 
those  schools  test  scores  j^ay  little  or  no  role  in  the  decision 
process.  ' 

^Without  tests  we  are  convinced  that  it  will  be  harder  t(rdiscover 
and  admit  the  student  who  for  whatever  reason  of  dlfeadvantage  iff 
less  known  and  less  predictable  without  the  test  measure. 
"  We  have  found  this  to  be  the  case  at  Duke.  I  am  sure  it  is  the 
case  in  other  schools  in  the  consortium. 

You  may  be  interested  in  knowing,  for  instance,  that  the  average 
'  SAT  sfores  of  entering  freshmen  in  the  30  independent  4-year 
colleges  of  North  Carolina 'ranged  from  559  to  1,240.  In  only  4  of 
the  ^0  colleges  did  the  average  student  have  a  score  of  over  1,000. 
The  averagiB  scores  of  eiitpring  freshmen  in  the  public  senior  insti- 
tutions ranged  from  588  to  1,063.  This  is  inforipation  provided  b|r 
the  participating  schools.  — 

Only  one  university  had  average  scores  of  over  1,000.  At  Duke, 
the  entering  class  was  composed  of  a  wide  variety  of  scores  ranging 
from  700  to  1,560.  The  Duke  range,  incidentally,  is  similar  to  that 
of  the  29  selective  schools  in  the  consortium.    ■  '  'v 

Federal  intervention  in  the  matters  of  standardized  testing  when 
there  is  ncrperceived  crisis  will  not  change  the  way  schools  admit 
students.  We  believe  fhat  institutional  reaction  to  variance  in  test- 
ing and  the  unintentional,  consequences  resulting  from  hastily 
structured  legislation  will  prove  to  be  counterproductive  to  the 
<  needs  to  higher  education  and  to  the  goals  of  students  seeking 
admission  to  colleges. 

We  would  urge  caution  in  the^consideration  of^the  present  le^s- 
lation  and  a  thorough  review  of  the  results  stemming  from  the 
actions  taken  by  New  Yorl^  and  California. 

We  would  further  urge  support  of  the  testing  services  and  the 
American  GouncU  on  Education's  proposals  to  undertake  certain 
initiatives  that  will  lead  to: 

A  mutual  appreciation  on  the  part  of  allvconcerned  parties  ^  the  special  relation- 
ships among  the  public's  right  to  know,  the  universitjrs  need  for  educational  auton- 
omy, and  the  testing  organization's  o|)ligation  to  sustain  high,  professional  standards 
in  its  work. 

If  I  may  make  one  01^  two  comments  about  the  previous  testimo- 
ny this  mornirtg,  L  would  agree  fully  with  Dr.  Keller^  that  in  all 

{)robabiUty  the  testing  services  ought  to  provide  data^ased  upon 
inguistic  groupings  and  report  that  data  i|i  norm  ^oups  by  lin- 
guistic bacl^ounds.  <  ^ 

I  tWJnk  this  can  be  done.  I  think  it  can  be  done  without  legisla- 
tion. I  am  concerned  over  the  discussion  that  was  heldr^^nd  I  may 
be  muddying  the  water,  I,  will  try  not  to  do  so— over  the  issue  of 
the  vfayJeBt  scor^  are  reported  in  both  the  SAT^and  the  graduate 
record  raamination  yis-a-vis  m^n  knd  women  tesdlftakers. 

Th^  scores  are  r6|K)rted  (gainst  men  norms  and  women  norms  in 
both  the  verbal  ana  quantitative  areas  in  order  that  institution-- 
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reviewing  those  scores  will  not  in  fact  discriminate  against  either 
men  or  women.  '    ^  ^ 

The  norm  is  not  a  blind  norm.  It  is  a  norm  based  upon  men's 
pmormance  and  Vomen's  peifonhance.  This,  I  think,  is  what  Dr. 
Keller  was  asking  for  in  terms  of  reporting  scores  for  minority 
students  and  it  is  one  that  I  would  support. 
If  thei*e  is  no  differential  reporting  of  this  kifcd  for  men  and 
1,  then  schools  will  have  less  of  a  base  for  making  nonbiased 
Jecisiohs.  •       '  '  )  # 

I  am  inclined  to  agree  with  Mr.  Shanker's  y^mmony  on  the 
3sues  of  test  validity,  cost,  and  the  cram  co\irs^s^hat  we  are 
'convinced  would  spring  up  across  the  Nation. 

The  availability  of  tesrquestions  and  answers  wil^not  necessar- 
ily solve  the  problem  of  providing  a  given  individtfal  the  informa- 
tion he  needs  to  improve  hi&  testing.  Those  questions  and  answers, 
coupled  with  an  extensive  and  expensive,  in  all  probability  expen- 
sive, coaching  program  might  help.  ^ 

But  it:  is  the  minority  student,  the  economically  disadvantaged 
student,  who  will  nqjt  have  the  funds  at  the  secondary  level  to 
secure  that  kind  of  coaching.  Without  that,  for  the  students  who 
are  m^rginallv  able  and  who  can  afford  the  coaching  afid  the 
possibility  of  skewing  testing  as  a  result,  we  see  a  real  threat  toihe 
system  that  we  work  with  now  and  that  we  understand  in  that  it 
does!  allow  us  to  evaluate  a  candidate's  record  at  his  school,  is  his 
nonqualifiable  factors  that  we  are  looking  for  in  our  given  student 
body  and  a  validation  of  his  ability  to  succeed  at  Duke  and  any 
other  selective  institutions.  We  see  a  danger  posed  to  that  process. 

I  believe  as  the  queen  of  hearts,  when  she  addressed  Alice  in 
Wonderland  and  when  Alice  asked  hbw  she  should  make  the  report 
and  where  ^she.  should  begin  and  how  long  she  should  take,  the 
queen  said,  start  at  the  beginning  and  go  to  the  end  and  stop. 
Thank  you,  Mr;  Chairman.  / 
[The  prepared  statement  of  Clark  Gahow  follows:] 

Prepared  Statement  of  Clark  R.  Gahow,  Associate  Professor,  History  and 
J  Assistant  Provost,  Duke  University  • 

Mr.  Chairman,  my  name  is  Clark  Cahow.  ^hile  I  hold  a  position  of  Associate 
Professor  of  History  at  Duke  University,  my  primary  responsibilities  as  Assistant 
Provost,  are  in  the  ateas  of  undergraduate  admissions,  university  financial  s(id  and 
records.  I  have  over  twenty-five  years  of  experience  in  these  two  combined  fields. 

For  the  purposes  of  this  hearing,  J  am  privileged  to  represent  a" group  of  thirty 
collejTCs  and  universities,  known  as  the  Consortium,  on  FJinancing  Higher  Education 
(COFHE).  '         *V  ik 

I  thank  you  for  this  opportunity  to 'talk  with  yc\i  tioaay  about  the  propond 
legislation  Sponsored  by  Representative  Gibbons  in  the  Truth  in  Testing  Act  (HJt. 
3564)  and  Representative  Weiss  in  the  Educational  Testing  Act  of  1979  (H.R.  4949). 

My  presence  here  today  is  to  record  serious  objections  tO  the  legisfetion  pending 
before  this  Subconimittee.  Duke  University  and  the  other  collegdsand  ^iniversities 
represented  in  the  Cohsortium  believe  that,  ks  presently  constituted,  no.  proposed 
legislation  CQuld  have  tpore  potential  harmful  results  on  the  Quality  of  the  admis- 
sions process  than  these  two  bills.  While  we  concur  in  ^e  suDstance  of  the  state- 
ments made  bofore  this  Subcommittee  by  Robert  J.  Solomoh  of  the  Educational 
Testing  Service  and  Fred  A.  Hargadon  representing  the  Colled^^ard,  our  concern 
is  less  for  ETS  than  it  is:  for  the  institutions  of  higher  learpng  that  depend  Upon 
standardized  testing  as^one  aspect  of  thmr  admissions  procedure  and  for  the  stu- 
dents  who  seek  admission  to  coUege&ahd  universities  across  the  nation. 

Testimonv  before  this  Subcommittee  and  editorial  comments  concerning  the 
threat  to  the  quali|.y \and  predictability  of  standardized  tests  yiiat  is  contained  in 
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these  bills  has  been  sufTicient  and  does  not  )require  my  further  comment  I  do  wish 
to  speak  to  the  function  of  standardized  tests  in  the  admission  process, 
lie  Bakkeilecision,  if  it  spoke  to  any  issue,  reaflfirmed  the  fact  that  schools  are 

SaranteeAttfe  right  to  decide  how  they  will  teach,  what  they  will  teach  and  who 
ey  will  Hch  undei"  the  protection  of  the  First  Und  Sixth  Amendments  of  the 
ComtitlitioiK  As  long  as  schools  ^ake  their  decisions,  in  the  latter  instance  in  a 
^  non-discriminatoiy  manner,  the  use  of  standardized  ^ts,  in  the  opinion  of  the 
Court,  rtspres^nts  a  valid  foctor  in  the  admissions  decision  process. 

The  Utorature  provided  by  the  Adinissions  Testing  Program  indicates  that  the 
Scholastic.  Aptitude  Test  "measures  developed  verbal  and  mathematical  reasoning  \ 
abilities  ttet  are  related  to  successful  performance  in  college."  The  literature  pre- / 
'  parti  by  the  /^erican  College  Testing  Program  indicates  thatfhe  four  academic/ 
subject  matter  tests  "are  constructed  to  assess  (a)  student's  general  educational 
"^^  development  and  ability  to  compete  (in)  college  level  woik  *  *  ^  (and)  require  that 
the  student  demonstrate  both  problem  solvins  and  reasoning  ability,"  Both  agencies 
readily  stote  that  "test  scores  are  good,  predictors,  of  performance  in  college  (espe- 
ciaily  during  the  freshman  year),  nut  -they  are  not  perfectly  precise  *  •  *  and 
should  not  be  treated  as  though  they  were."  All  scores  should,  therefore,  be  U|Sed  in  . 
coi\junction  with  other  factors  such  as  high  school  grades  and  rank,  and  evidence  of 
motivation— an  intangible  quality  not  measured  by  any  test.  /  J 

For  a  ninnber  of  reasons,  no  test  measures  with  perfect  precision.  The  psychomet- 
ric term  used  to  express  the  degree  of  precision  is  called  the  reliability  coefficieni. 
This  value  which  ranges  from  -1.00  to  +1.00  indicates  "the  extent  to/ which  an 
individual  would  achieve  the  same.score  on  repetition  of  a  test"— that  is  ;ttie  chance^ 
that  John  or  Mary  Doe  will  receive  the  same  score  from  a  second  or  third  attempt 
pf  the  SAT  or  other  stendardized  test.  Although  not  perfect,  that  is  lacking  a 
reliability  coefficient  +1.00,  the  reliability  of  the  SAT^verbal  sections  is  estimatea  to 
be  approximately  .91  and  approximately  .92  Tor  the  SAT-mathematical  sections.  The 
reliability  coefficiento  of  the  ACT  are  somewhat  lower  than  those  of  the  SAT.  They 
are  between  .74  and  .77  for  English  usage;  between  .79  and  .83  for  Mathematics: 
between  .71  and  .73  for  Social  Studies;  between  .69  and  ,74  for  Natural  Sciences;  and 
between  .86  and  .89  for  the  Co^iposiie.  Because  all  test  scores  have  a  certain 
imprecision,  it  is  a  generally  accepted  practice  to  interpr^  scores  as  ranges  instead 
•  of  precise  points.  l 

I  am  by  no  means  implying  that  standardized  test  scor^  are  worthless.  On'  the 
cdhtrary,  t^t  scores  measu^bly  improveihe  validity  of  admissions  decisions.  It  has 
been  shown  that  the  predicttve  validity  of  the  high  school  record  is  higher  than  the' 
validity  of  the  SAP  gr  AC7R  alone,  and  the  combination  of  grades  plus  scores  has 
higher  validity  thaU  that  of  toe  high  school  record  alone. 

How  tests  are  used  in  conjunction  with  other  factors  iu  a  matter  left  to  the 
individual  school.  No  sUnount  of  disclosure  of  t^t  informaton  will  alter  the  ri^ht  of 
schools  to  use  the  tests  as  they  see  Ht!  The  scores  of  groups  and  individuals 
obviously  can  be  misused.  Examples  of  misuse  might  be  acceptances  or  rejections 
based  primarily  on  very  simUaf  SAT-combined  scores  such  as  1280  and  1260  or  ACT 
composite  scores  such- as  19  and  20.  The  psychomc>tric  conoept  most  appropriate  here 
is  the  Standan}  Error  of  the  DifTerenc^g,  which  is  roughly  the  square  root  of  2  times 
the  Standard  Error  of  Measurement,  /niis  value  indicates  "the  normal  variatioiv  to 
,  be  expected  JbeAween  the  scores  of  two  people  on  the  same  test  due  to  measurement 
error  alone."  Score  diiferenc^  of  less  than  ,1.6  times  the  Standard  Error  of  the 
.  Diflei«nce  have  virtual^;  no  significance.*This  value  varies  by  section  of  the  test.  To 
iilustrato  this  concept,  the  Standard  Error  #  the  Difference  for  ACT  subtests  is 
approximately  4.  For  each  composite  score.  Jit  is  approximately  2.  Score  differences 
.  or  less  th^n  1.5  times  4  equals  6  points  on  a  particular  subtest  dtnnot  be  used  to 
infer  teal  differences  in  ability.  For  the  ACT  composite  score,  the  Standard  Error  of  ^ 
the  Dmerence  is  approximately  2.  In  practice,  two  studeiltp  presenting  ACT  compos- 
ite scores  of  17  and  18,  which  is  a  difference  of  less  than  2  pointe  h^ye,  for  all 
practical  purposes  the  same  ability  as  measured  by  the  ACT.  Also,  it  \  cannot  be 
mfened  that  scores  of  17  and  19,  for  exi&mple,  on  any  of  the>ACT  subtests,  or  any" 
scores  which  differ  by  less  than  4  pointe,  signify  real  differences  in  ability. 
comparison,  for  SAT-math  scores,  the  Standam  Erngar  of  the  Diffe^nce  is  apprpxu 
mately  46.  To  use  this/alue,  our  computetion  woufll  be  1.6  times  46  which  equals 
69vThi8  means  that  omv  when  SA'^ath  scores  of  two  individuals  differ  by  tnore 
thah  69  pohito  on  the  20Q  to  800  scal^  is  there  any  significant  difference  in  ability, 
years,  the  College  Board  has  cautioned  against  such  misuse,  bjuit  there  is  still 
po^ibiUty  Of  placing  a  660-verbal  scorer  on  the  waiting  list; /rejecting  a  640- 
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verbal  scorer;  while  accepting  a  560-verbal  scorer.  Such  decisions  are  not  defensible 
unless  there  are  other  factors  in  the  application  on  which  the  decisions  are  based  ' 
.  and  which  make  the  test  Bcore  less  than  critical.  . 

I  know  of  no  school  that  uses  test  scores  in  such^ an  isolated  and  arbitrary  fashion. 
Diane  Ravifch,  Teachers^CoUege,  Columbia  University,  has  put  the  issue  in  clear 
and  succinct  terms  as  it  relates  to  the  recently  pas&ed.  New  York  State  law  and  as  I 
believe  it  relates  to  the  legislation  under  consideration  before  this  Committ^ 

''Colleg^  ask  their  applicants  to  take  standardized  tests  of  verbal  and  mathemal^ 
ical  skills  because  the  scored  are  useful  in  comparing  the  aptitudes  of  students  from 
all  kinds  of  secondary  schools— public,  private,  url^an,  suburban,  rural.  Colleges  use 
the  tests  because  they  have  some  value  as  a  pi;idictor  of  future  academic  perform- 
ance.. , 

''Qollege  admissions  ofTicers  are  professionals.  They  know  that  standardized  tests 
have*  limitations;  they  know  that  such  tests  reveal  nothing  of  a  student's  imagina- 
tion, creativity,  motivation  or  character;  they  know  too  that  some  student^  freeze  in 
test-taking  situations.  • 

"The  scores  are  only  one  element  in  the  studentV  record,  which  is  made  up  of 
high  school  grades,  rank  in  class,  extra-curricular  activities,  teacher  recommenda- 
tions, work  experience,  and  a  personal  interview.*' 

A  test  score,  by  itself,  will  not  get  a  student  in  or  keep  a  (tudent  out  of  a  selective 
school.  At  schools  that  are  not  selective,  test  scores  play  little  or  no  role  in  the  • 
decision  process.  It  will  be  harder  to  didder  and  admit  the  student,  who,  for 
whatever  reason  of  disadvantage,  is  less  known  and  less  predictable  without  the  test 
measure.  Properly  eniployed,  test  scores  are  a  critical  ingredient  in  the  evaluation 
of  a  student's  potential  for  success  at  a  given  school.  The  test  scores  provide  an 
additional  opportunity  to  discover  candidate  who  will  succeed  who  might  othewise 
have  been  overlooked.  However,  the  clear  assumption  in  the  legislation  is  that 
colleges  and  universities  use  test  scores  to  provide  automatic  cut-offs  that  pwlude 
qualified  students,  particularly  those  that  are  "culturally  deprived,"  fromTbeing 
admitt^. 

You  may  ibe  interested  in  knowing  that  last  year  the  average  SAT  scores  of^ 
entering  freshmen  in  the  thirty  independent  four-year  colleges  of  North  Carolina 
ranged  from  559  to  1240.  In  only  four  of  the  thirty  colleges  did  the  average  student 
have  a  score  of. over  1000.  The  average  scores  of  entering  freshmen  in  the  public 
senior  institutions  ranged  from  588  to  1063.  Only  one  university  had  average  scores 
of  over  1000.  At  Duke,  the  entering  class  was  composed  of  a  wide  variety  of  scores, 
ranging  from  700  to  1560.  The  Diike  range,  inrident&liy,^8  diniilar  lo  that  of  the 
twenty-nine  selective  schools  in  the  Consortiuni.  ^  f 

Many  of  the  supporters  of  the  Gibbons  and  Weiss  proposals  are  seekingC  correc- 
tions for  "abuses  '  that  these*  proposals  will  not,  in  fact,  correct.  For  example, 
students  oppose  the  tests  because  of  the  power  they  believe  the  tests  have  in 
determining  where  they  will  be  offered  admission.  If  the  tests  have  that  power, 
giving  the  students  access  to  air  test;  questions  will  not  change  how  the  schools 
choose  to  use  the  test  scores.  Minorities  oppose  the  tests  and  support  the  proposed 
legislation  because  minority  students  do  less  well,  on  the  'Average,  than  other 
students.  Again,  giving  students  access  to  tests  will  not  change  how  minority  stu- 
dents perform  on  the  tests.  The  •nly  students  whe  might  do  better  are  those  who 
can  afford  to  enroll  in  the  commercial  courses  which  coach  students  to  take  the 
tests.  These,  courses  will  become  even  more  popuiai:  once  more  sample  questions 
become  available  from  previous  tests.  The  result  will  work  against  low-income, 
culturally  deprived  students,  many  of  whonvare  minoritV^students. 

Federal  intervention  in  the  matters  pf^tandardized  testing  when  there  is  no 
perceived  ^:risis  will  not  change  the  wdy  schools  admit  students.  We  believe  that 
institutional  reaction  .to  variance  ytC  testing  and  the  uniixtentional  consequences 
resulting  from  hastily  structure^egislation  will  prove  to  counterproductive  to 
the  needs  to  higher  educatiop^  and  to  the  goals  of  students  ^king  admission  to 
colleges.  We  would  urge  cautto||in  the  consideration  of  the  present  legislation  and  a 
thorough  review  of  the  rpAiltsltemming  from  the  actions  takeiik  by  New  York  and 
Califatnia.  We  would  farther  urge  support  of  the  testing  services  \nd  thjp  American 
Council  on  Education's  proposals  to  undertake  certain  initiatives  thtot  will  lead  to  "a 
mutual  appreciation  on  the  part  of  all  concerned  parties  of  the  speoal  relationships 
among  the  publlds  right  to  know,  the  universitjr  s  need  for  educatid(ial  autonomy, 
and  the  testing^ifanizatiojti's  obligation  to  sustam  high  professional  standards  in  its 
work."        /  I 

Thank  yotK      *  *i 


Qiairman  Perkins.  The  last  witness  is  Mr:  William  D.  Geer,  Jr., 
principal  of  the  fVancis  W.  Parker  School  iii  Chicago. 

STATEMENT  OF  WILLIAM  1).  GEER,  JR.,  PRINCIPAL,  FRANCIS 
W.  PARKER  SCHOOL,  CHICAGO,"  ILL. 

Mr>GEER.  Thank  you,  Mr.  Chairman. 

I  am\ery  pleased  to  be  able  to  testify  before  this  committee 
today  andhi)ring  bfefore  you  a  matter  of  grave  concern  pertaining -to  . 
thft  rights  olF  students  taking  tests. 

I  have  consiiterable  experience  with  ETA  and  the  College  Board. 
Let  me  review  nw  background  to  give  you*' some  idea  of  where  I 
come  from  in  thisinatter. 

I  am  an  English  teacher  and  school  administra;tor,  pjrealently  a 
principal  in  a  schooKin  the  city  of  Chicago.  I  was  trained  in 
Englisli  at  Harvard  andythe  University  of  Pennsylvania.  I  taught 
English  at  the  Lawrence^lle  School  in  New  Jersey  from  1956  to 
1965.  \ 

From  1965  to  1973  I  was  tm  principal  of  tbe  Newton  South  High 
School  in  Newton,  Mass.  Since\1978  I  have  been  the  principal  of 
Francis  W.  Parker  School  in  ChicMo. 

I  first  Worked  for  ETS  and  the  O^llege  Board  in  the  early  sixties 
when  I  was  employed  to-  grade  English  achievement  tests  when 
they  contained  a  section  that  had  to  tte  scored  by  rpaders  rather 
than  machinel.  -  ^ 

From  1963  to  1965  I  graded  English  advaiced  placement  exams. 
From  1963|to  1965  I  worked  on  a  special  phgect  in  Trenton,  N.J., 
and  that  was  a  project  that  involved  special  support,  special  educa- 
tion, and  to  an  attempt  to  evaluate  what  particular  elements  on 
those  tests  were  pjitting  the  black  hig;h  scnool  smdents  at  a  tre- 
mendous disadvantage  \      .     ..  . 

In  1972  and  1973,  while  chairman  of  the  Educational  Policies 
Committee  of  the  Massachusetts  Principals'  Associatibn,  I.  worked 
with  CEEB  to  set  up  an  experimental  program  to  explore  the  use 
of  achievement  tests  to  qualifjr  high  sc^hool  students  to  take  univer- 
sity or  collie  courses  whUe  still  in  high  school.         .  , 
I    1  also  served  as  a  member  of  the  council  on  entrance  services  of 
Vthe  College  Board,  a  8-year  term  running  from  1972  through  1974. 
*  IThis  is  an  advisory  council  which  ia  given  the  responsibility  for 
making  reconunendations  to  the  College  Board  pertaining  to  the 
SAT  and  achieveip^t  tests.  ,    «        «  , 

,  Although  I  have  had  a  number  of  criticisms  of  the  College  Board 
admissiqni  testing  program  and  the  ETS' about  their  testing  pro- 
grams, fetil  refiently  I  have  alwavs  found  that  !  could  seek  redress 
of  tH*  problfemithrough  the  regular  channels  of  review  afforded  by 
the  College  Board.  ■         '     .  '  .. 

The  mattei^I  briflg  ^  yoii  today  I  do  not  feel  was  successful  in 
raising  the  is|ue  through       or  the  College  Board.  . 

The  matter  I  ♦rant  to  raise,  I  have  written  to  all  of  the  adminis- 
trators of  both  ETS  and  the  CoHege  Board  and  been  involved  in 
Correspondence  with  them  over  the  past  3  monutei 

The  issue  pertains  very  specifically  to  the  jfuestion  of  the  stu- 
dents' rights  m  a  process  oftscore  review  that  ErTS  manages  or  has, 
*1  know,  witU-SAT,  and  I  Ssume  with  others.  The  wsore  review  is 
■   ao^  attempt  to  use  coxilputers  an,d  other  devices  to  ferret  out  and 


9^2  ■  •  . 

'         ■  ,  ■       •  . 

V find  students  who  have  copied  on  tests.  Mv  knowledge  of  the  sys- 
.  tern  is  based  on  telephone  coversations  and  my  specific  experience 
with  one  student  at  my  school  that  got  "ivolved^in  this. 

Let  me  bring  you  into  the  matter  and  »1nSlfer  of  real  concern  to 
you,  because  I  do  think  it's  a  clear  question  of  a  civil  xigbt  of  a 
student  and  probably  thousands  of  other  students  who  have  been 
subjected  to  this  process. 

I  became  familiar  with  this  practice  in  January  when  a  student 
came  to  me  for  help  after  being  accused  of  copying  on  an  SAT 
exam.  I  have  given  to  you  copies  of  the  entire  correspondence 
between  myself  and  ETS,  responses  from  ETi9,  my  letters,  copies  of 
my  letters  to  trustees  and  two  letters  from  Robert  Solomon,  who  is 
yice  president  pf  ETS,  which  basically  says,  in  my  judgment,  that 
ETS  has  every  right  to  withhold  students  'scores  based  on  a  system 
which  is  completely  devoid  of  due  process. 

The  student  came  to  me  on  this  whole  question  stating  the 
student  had  been  accused  of  cheating  oh  the  test.  The  student 
professed  innocence,  so  I  immediately  began  on  the  whole  question 
of  what  could  I  do.  The  test  was  given  in  my  school  and  I,  as  a 
reasonable  person,  said:  "If  ETS  has  accused  you  of  this  there  must , 
be  some  validity."  I  was  handed  the  letter  and  could  not  tell  what; 
the  basis  of  this  decision  was. 

I  had  a  lengthy  series  of  discussions  with  the  student  and  re- 
viewed the  student's  record.  The  student  had  been  in  my  school  for 
14  years.  There  had  never  been  any  question  of  the  student's 
integrity;  and  she  had  a  distinguished  academic  record  and  was  one 
of  the  outstanding  students  in  the  school. 

I  also  talked  to  the  proctor  of  the  test.  The  test  session  only  had 
24  students  in  it;  and  the  proctor  knew  every  single  student  in  the 
room.  The  proctor  said  there  were  nowrregularities.  No  student  left 
the  room.  The  desks  were  spaced  pw^perly  at  further  distances, 
they  say  they  have  to  be  5  feet. 

I  then  entered  into  my  lengthy  telephone  dialog  with  officials  at 
ETS  to  determine  the  sj)ecifics  and, to  ask  that  they,  review  the 
matter.  In  short,  over  a  period  of  3  months  I  was  unable  to  get  a 
detailed  statement  of  charges  from  ETS.  I 
I  finally  received  one  in  a  month;  but  as*  I  look  at  that  there  are 
,  so  many  things  that  are  not  there  and  there  are  obviously  so  many 
issues  that  are  concerned  that  were  hot  covered  in  that  3-page  bill 
of  particulars,  and  it  was  of  no  use  to  me  to  enter  into  any  .ftirther 
discussion  with  ETS.  f  . 

■  A  revie>y  committee,  ruled  that  the  student's  academic  record, 
testing  history,  arid  Statement  from,  the  proctor  were  not  sufficient 
to  outweigh  the  evidence  that  they  h^d.  In  early  March  the  student 
took  the  SAT  over  £(gaijn  under  controlled  circumstances,  and  the 
score  of  the  second  testing  confirmed  the  SQore  that  ha^  been 
quei^tioned,  so  we  locked  her  in  a  rdom.  l|he  took  the  test  again, 
and  the  score  of  the  second  test  confirmed  that  the  ^"st  they  were 
y  j[uestioning  was  ^alid. 
\  It  took  ETS  over  a  month  to  report  the  validated  SAT  scores  to 

the  colleges.        ^  ;     -  ' 

She  took  the  second  iii  March,  the  first  SAT,  in  December, 
and  no  college  received  her  validated  SAT  until  April  24.  In  my 
judgment,  J^TS'  actions  almost  certaii^ly  •  kept  this  stitdent  from 

ERJC  .  ■  '  ,9/,.  ■ ■       .  ,  .  •  ' 
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going  to  a  college  of  first  choice.  THe  student  was  a  distinguished 
student  and  had  a  fine  character  record  and  has  been  able  to  go  on 
to  college;  but  in  my  judgmeilt  the  question  of  where  the  student 
might  have  ended  up  as  opposed,  to  ^here  the  student  di4  end  up 
arfe  two  entirely  (Ufferent  thi^  ;     ^  / 

From  the  last  week  in  January  until  the  third  week  in  April  a 
student's  scores  on  an  SAT  were  withheld  because  a  computer  in 
Princeton  and  a  Hfeview  committee,  using  probability  and  st&tisncs 
determined  that  /^copying  probably  occurred/'  Neither  the  student 
nor  I  a^ing  for  the  student  had  any  effective  way  :of  questioning 
the  allegation  because  we  did  not  know  the  specific  factors' that  led 
to  the  conclusion. 

I  understand  the  awesome  responsibility  of  ET$  to  exercise  all 
care  ^d  vigilance  tb  detect  cheating  and  copying  on  their  tests, 
but  given  the  importance  of  these  tests  in  determining  the  future^ 
of  a  student,  certainly  fronj  the  teistimony  today,  probably  their 
system  should  be  much  more  sophisticated  and  much  more  respon- 
sive than  it  is. 

But  given  the  importance  of  those  tests,  ETS  must  afford  a 
student  due  process,  and  it's  on  that  point  that  I  spedfically  differ 
with  Mr.  Solomon.  His  contention  is  that  ETS  can  withhold  a  score^ 
without  any  due  process,  that  their  review,  committee  which  is  a 
group  of  professional  employees  of  ETS  has  Afery  right  to  withhold  , 
the  score  and  all  their  responsibility  is  to  inform  the  student  that' 
the  score  has  been  withheld.  -  ^ 

I  am  concerned  about  the  House  bills,  because^  it  seems  to  me  one 
of  the  objectives  of  particularly  H.R.  4949  is  to  protect  the  rights  of 
students  and  I  am  certainly  not  a  constitutional  lawyer,  and  I  get 
into  the  question  of  wording  bills  and  what  would  work  and  what 
wouldn^t  woric.  -  '  .  ^ 

It  becomes  very  complicated,  but  I  think  that  spniething  should 
be  done  to  make  certain,  no  matter  what  is  done  with  the  rest  of 
he  truth-in-testing  bill,  to  make  certain  that  a  student^s  rights  in 
raiatters  oiF  tfcore  review  are  scru^lously  protected* ' 

I  thinkv what  couM: happen;  FTS*  simply  could  file  with  the- Com- 
missioner of  Educlfflwra  detailed  account  of  what  tfiey  did,  that 
they  had  a  review  conamittee  jajid  here  are  the  proceduy^es,  and  that 
would  meft  all  of  the  criteria  of  your  bill.  .  ; 

There  is  no  in^pilicit  requirement  that  a  student^s  jrights  be  pro^ 
tected.  I  also  explored  at  some  length  with  ETS  the  question  of 
breach  of  .  contract;  and  that  raises  some  v^ry:  large  issues.  In  my 
judgment,  breach  of  contract  is  between  ETS  wtd^thMiudent,  The 
st\MM;  Piaid  a  fee  ta.  take  the  exam,  to  have  tl^e  i^xam  scored  and 
,  to ISe^  those  scores  reported  to  coll^^.  /   ^  '^^ 

'  Clefifly^  in  all  of  my  discussions,  ETS'  felt  that  their  mcgor  obliga- 
tion wis  toihe  collies  and  universities.  They /would  make  stated 
mentsfckeA^e  would  be  Irresponsible  to  replpfrt  to  apy  college  a 
score  which  we'  felt  wap  in  any  way  in  question.  Now,  I  was 
interpretive;  but  I  think  4;her|  ^are  brMoh  oL  contract  issues  there 
as  weji  ^iS'NCQttsntutional  ispUe^,  bu*«Weave/that  to  you,  the  law- 
makers ana  the  lasers,  to  protect  in  some  way,  whether  it's 
through  a  specific  bill  or  Whatever  other  way  that  you  see  as 
sufficient,  the  le^timate  interests'  of  students,  tn^  question  of  evi- 
dence, which  I  tmnk  this  is^e  m<At  impbyttant  issue.  * 
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I  Would  urge  you  to  consider  rewording  article  3  specifically  and 
inaybe  something  could  be  done  to  protect  the  issue  of  evidence/ So- 
I  would  leave  it  with  lawyers/ and  others  to  look  at  th^e  areas. 

I  don't  have  a  specific  wording  to  recommend,  because  tjfat  is  not 
my  field.  The  most  troubling  aspect  of  this  whole  matter  to  me  has 
been  the  insensitivity  of  the  officials  at  ETS  to  the  impact  of  their 
practice  upon  students.   .  'V 
•    The  letter  notifying  a  student  that  ETS  has^concluded  that  copy- 
ing has  probably  occurred  is  sent  to  the  student  and  no  one  else  so 
.  that  the  school  doesn't  receive  it.  The  parents  don't  receive  it.  A 
student  receives  it.  ETS  defends  this  practice  as  a  protection  of  a 
student's  privacy- 
[The  prepared  statement  of  William  Geer,  Jr.,  follows:] 

Prepared  Statement  of  William  Qger,  Jr.,  Principal,  Francis  W.  Parker 

School,  Chicago,  III. 

I  aio^  very  pleased  to  be  able  testify  before  this  x;ommittee  today  and  bi*ing 
before'^ou  a  matter  of  grave  concern  pertaining  to  the  rights  of  students  taking 
test^. 

Let  me  briefly  'review  my  professional  background  aild  experience  with  the  CEEB 
Testing  program  before  I  survey  the  matter  of  my  specific  concern.  I  am  an  English 
teacher  and  a  school  administrator.  I  received  an  AB  in  English  from  Harvard 
^University  in  1956  and  a  MA  in  English  from  University  of  Pennsylvania  in  1963.  I 
taught  English  at  the  Lawrenceville  School  in  New  Jersey  from  1956  to  1965.  From 
1965  to  iy73  I  was  the  Principal  of  the  Newton  South  High  School  in  Newton, 
Massachusetts.  Since  1973  I  have  been  the  Principal  of  Francis  W.  Parkier  School  in 
Chicago.  I  first  worked  for  ETS  and  the  College  Board  in  the  early  sixties  when  I 

.  wa/s  employed  to  grade  English  Achievement  tests  when  they  contained  a  section 
tKa^  had  to  be  scored  by  readers  than  machines.  Following  that,  I  graded  English 

.  Advanced  Placement  machines.  Following  that,  I  graded  English  Advanced  Place- 
ment  exarp^  for  3  years.  From  1963  to  1965  I  worked  on  a  special  project  in  Tretlton, 
New  Jersey,  to  try  to  determine  some  of  the  factors  that  kept  successful  black  high 
school  students  from  performing  well  on  the  SAT.  In  1972  and  1973  while  chairman 
of  the  Educational  Policies  Coonmittee  of  the  Massachusetts  Principal's  Association  I 
woislc^  with .  CEEB  to  set  up  an  experihiental  program^  explores  the  use  of 
Achievement  tests  to  ^alify  high  scnool  students  to  tak&  univesity  or  college 
courses  while  still  in  high  school.  In  1972^1973  I  also  served  as  a  member  of  the 
Q>unpil  on  Entrance  Services  of  the  College  Board,  the  advisory  council  given  the 
responsibility  for  making  recommendation  to  the  College  Board  on  matters  pertain- 
.  ing  to  the  SAT  and  Achievement  tests  programs.  Although  I  have  had  a  number  of 
criticisms  of  the  CEEB  Admissions  Testing  ProgVam,  until  recently  I  have  always 
found  that  I  could  seek  redress  of  the  problems  through  the  regular  channels  of 
revies  afforded  by  the  CEEB. 
This  ha6  not  been  the  case  in  the  matter  I  bring  to  your  attention  today-  AI- 

rthough  I  have  written  to  all  of  the  trustees  of  both  Educational  Testing  Service  and 
the  C£EB  and  to  the  administration  of  both  organizatioimneither  organization  has 
taken  steps  to  protect  student^  from  the  clear  violation  oTtl^eir  civil  and  constitu- 
tional.rights  present  in  ETTS's  process  of  score  review.  % 
.  i  became  familiar  with  this  practice  in  January  when  a  student  came  to  me  for 
help  after  being  accused  of  copying  oh  an  SAT  exam.  I  have  included  all  of  the 
correspondence  between  myself  and  ETS  concerning  the  matter  in  the  packet  you 
have  received  and  would  be  glad- to  answer  any  s^ific  questions  that  you  might 
have  about  the  details,  but  let  met  briefly  revij/m  the  highlights.  The  student 
protested  innocence!  and  a  review  of  the  student's  record  ana  general  character  as 
well  as  lengthy  discussion  with  the  proctor,  who  had  taught  the  student,  tended  to 
support  the  student's  position.  I  then^ entered  into  a  lengthy  phone  dialogue  with 
.officials  at  ETS  to  determine  the  specifics  ai^id  ask  for  a  review.  In  short  I  was 
unable  to  get  a  detailed  statement  of  the  charges  from  ETS  for  almost  ainionth.  ETS 
ruled  that  the  student's  academic  record,  testing  history  and  stateiliepts  from  the 
proctor  were  not  sufficient  to  overVf^igh  the  evidence  that  they  had.  Ih  early  March 
the  student  took  the  SAT  over  under  controlled  circumstances  and  questioned  score 
was  cbnfirmed^  It  took  ETS  over  a  month  to  report  the  SAT  scores  to  the  colleges, 
and  in  my  judgement  ETS's  actions  almost  certainly  kept  the  student  from  going  to 
a  college  of  first  choice. 
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uier  i-ne  stuueui-  ur  i  acting  for  the  student  had  any  effective  way  of  quefltioning  1  _ 
allegation  because  we  did  not  know  th«  specific  ffictors  that  led  to  the  cohclusion,  1 
understand  the  responsibility  of  ETS  to  exerciai  aU  cfere  and  vigilance\to  detect 
cheating  and  copying  On  their  tests Jbut  givenf  the  importance  of  thes^  tests  in 
determining  the  future  of  a  student,  ETS  mustMord  students  due  process  %nd  the 
right  of  review  before  a  score  is  vrtthheld.  Thriir  present  practice  fiiidfe  the  student 
g!mty,  the  score  is  withheld,  and  then  the  student,  vrtthout  krio\^ng  any  of  the 
facts  that  led  ETS  to  come  to  its  decision,  is  mformed  that  the  student  may 
supply  information  to  a  review  committee  for  consideration.  i.  ^  ^ 

.  The  student  had  contracted,  wil^h  ETS  and  CEEB  to  take  the  test,  have  the  test 
scored  and  have  th^  scores  reported  to  colleges.  Whether  the  issue  I'este  in  a  breech 
of  contrs^ct  between  the  student  and  ETS,  a  direction  that  H.R.  4949  seems  to 
explore  or  whether  the  issue  is  really  one  of  fundamental  constitutional  rights  of 
.  denial  of  due  process,  I  leave  to  the  lawyers  and  law  makers.  There  certainly  was  a 
callous  denial  of  a  student's  rights  when  guilt  was  detentnned  without  any  due 

^Tl^e  reviewed  both  H.R.  ^564  and  H.R.  4949  ^nd  am  not  certain  that  either  or 
both  of  th^  tills  if  enacted  into  law  would  protect  students  against  such  practic^. 

Certainly  ETS  and  CEEB  could  meet  all  of  the  requirements  under  Section  3  of  H.R. 

1949  and  continue  their  present  practices.  All  that  they  would  have  to  do  is  spell 
out  the  practice  of  score  review  under  articles  6,  7  and  8  of  Section  3.  The  only  other 
part  of  H.R.  4949  that  might  pertain  is  Section  3,  article  IOC  which  I  interpret  to 
meatf  that  the  procedure  for  appeal  or  review  of  a  test  score  by  the  test  agency  must 
be  spelled  out;  I  would  urge  you  to  consider  rewording  these  articl^  of-bection  d  so 
as  insure  that  the  civil  and  bonstitutional  rights  of  the  test  tajs^jbe  gu^^  I  . 

feel  that  this  can  be  done  by  requiring  due  process  before  a  sfke  i8>ithheld  anfl/or 
affording  a  student  a  detailed  statement  of  the  evidencte  and  an  opportunity  to 
respond  before  a  review  committee  makes  its  decision  to  withhold  scores. 

The  most  troublmg  aspect  of  thjs  matter  to  me  has  been  the  insensitivity  of  the 
officials  at  ETS  to  the  impact  of  their  practice  upon  students.  The  letter  notifying  a 
student  that  ETS  has  concluded  that  copying  has  probably  occurred  is  sent  to  the 
student  and  no  one  else.  ETS  defends  this  practice  as  a  pr«te£tion_otA  students 
privacy,  yet  in  my  experience  most  students  receiving  such  a  letter  in  the  middle  ol 
their  senior  year  face  the  impossible  situation  of  going  to  either  their  parents  or 
school  officials  for  help  and  being  able  to  do  nothing  but  prot^t  their  innocence 
because  •  they  have  no  idea  of  what  the  specific  eyidence  is.  Given  the  general 
anxiety  about  college  admissions  in  the  middle  of  the  senior  year,  my  guesa  is  that 
most  students,  if.  they  can,  try  to  forget  the  letter.  While  talking  to  an  official  at 
ETS  I  was  told  that  they  are  confident  that  the  program  of  score  review  is  effecUve 
because  so  few  students  ever  respond  to  the  initial  letter  from  mb.  In  lact  bl^ 
probaWsL counts  a  honresponse  as  an  admission  ,  of  guut.  HowYmany  shattered 
innocent  students  there  are  who  received  such  letters  in  the  six  or  seven  years  that 
ETS  has  engaged  in  this  practice  and  could  do  nothing  is  a  matter  of  conjecture,  but 

^  having  lived  through  the  hell  of  on^  student  improperly  treated  by  this  system,  1 
can  speak  of  the  agony  and  confusion  that  it  creates.  /       *  ' 

It  a  legitimate  interest  of  the  Congress  to  protect  the  civil  and  constitutional 
rights  of  test  takers,  and  I  urge  you  to  strengthen  the  present  bills  or  draft  a 
separage  bill  to  dp  just  that.  / 


/ 


0 


■  i         ■    ■    .  •  . 

55tAV<l»$le/ Awiluc 
CJiica;;o,  llliniv. 

July        1979^  . 

A,  ■■ 


Dear.      .•    •       ;  ■ 

•       •  r.   .  . 

I  am  wrltif^g  you  to  call  your  attention  to  a  practice  of  Ccfuca- 
tlonal  Testing  Service  connected  with  the  SArprogram  that  I  Jucfgc 
arbitrary  and  irresponsible.    The  practice  I  question  Is  the  computer 
Identification  and  rcvtcw  of  major  variations  In  the  SAT  scores  of  a 
student* 

As  a  result  of  this  practice  a  student  at  Francis  W.  Piw^Kpr  was 
Informed,  "that  copying  probably  occurred/*  and  that  the  scores  for  ; 
a  Oeccmb'er  SAT  were  being  held.    I  am  enc^laslng  copies  of  the  tetter 
that  the  student  ^-eceJved,  a  letter  T wrote  supply Ing  Information  and 
reasons  why  1  thought  the  judgment  unfair  artd  the  formal;  documert.it ion 
that  the  "revlcv/*  conni  ttee  suppi  led  me  concernlflg  thel  r  original 
judgment.  '    ^'  • 

The  matter  was  finaljly  resolved  when  the  student  ;took  the  SAT'^ovcr 
agdin  and  the  score  was  confirmed,  but  the  whple  proccfdurc  had  a  crushirw 
effect  on  the  student.    I  object  to  the  practice  because:         /  I 

Although' the  stiidcnt.was  not  legally  charged. with  cheating,  the 
Impact  of  .the  letter  had  the  effect  of  a  formal  charge. 

Neither  \  nor  the  stpdcnt  could  adequately  respond  to  the  "charges" 
because  we  were  never  Informed  In  writing  of  their  specific  nature 

until  aftei*.  the  "rdvlcw"  committee  had  met.  ' 

■  ■     .        ,  -  .  ■■*■<. 

■        ■  ^  *^ 

The  scores  for  the  SAT  In  question  were  not  reported  to  all  the 
co^Meges  until  April  Igth  yet  the  retake  of  the  SAT  wais  scored  by 
March  J/4th. 

The  more  I  have  lea ri\ed  oyer  the  past  three  months  about  this  prac- 
tice pf  ETS  the  more  disturbed  J  become  about  It.    ETS  and  the  College 
Board  are  In  fact  servfng  Xhe  student  who  js  paying  for  the  admlnlstra- 
tlon^  scoring  and  rtspqirt Ing  of  scores  of  the.  cxanii  ^yct  In  thjs  matter  It 
appears  that  ETS  Is  willing  to  assume  guilt  without  cjear  prCfof  and^ls 
willing  to  sacrifice  a  student  to  the;  "need  to  report  rellcible  scores." 
further  the  blind  reliance  oi)  a  computer  model  to  detect  "unrcll.iblc" 
scores  represents  bureaucra^tc  arrogance  of  the  highest  oirder.  v 


■  921 


^  :       It  >ccms  tone  that  thft^conc;crr^of  ET^  c6uM  be  net  by  slrply 

informing  students,  whose  sfl|rcs  Ind^ase  by  more  than  a  certain  aiiK>unt, 
that  they  should  retake  theBett  bec^sc  most  colleges  will  consider 
*•      scbnss  that  hove  rUrn  by  tniit  amount  unreliable*    ETS  has'crcated  a  * 

•    consldcrAle  nw^han^sm'to  <ebk,  flAd,  an4  deal  with  students  whose 
V  -  -scores-  fal.l  to  pass  througlj  the  computer  screen*    lin  fact  this  system 
assesses  guilt  and  then  a  iftudcnt  must  prove  Innocenpe,  a  complete 
..contradiction  to  pur  judicial  system.    The  procedure  of  revtcw  has  the 
'Superficial  Appearance  of  <luc  process^ct  In  fact  there  Is  none. 

•  ■      '  ■  ■  "  .  .    ■  '     ■  /  *  ■*  . 

As  a  trustee  you  have  t|ie  responsibility  to  Investigate  the'prac- 
ticc  of  the  rcvifiWp  and  as  it  reprcsef^ts  a  misuse  of  the  consldcrablj 
I    public  trust  of  both  ETS  and  the-Collegc  B,oard,  see  that  It  eithlr      .  . 
f     ceases  or  is  changed  to  remove  Its  arbitrary  and  Irresponsible  elements*    ..    ,  .  4 


PI  " 

»  f        ■  .  ■       ,  . 


D(i»r;.  .  ■  -  y  ■  *  . 

Educmtlontl  Tilting  5«rvlc«  (ITS)  routinely  chicki  th«  icor«i  recoritd 
for  ch«  Stto^itlc  Aptltudt  T«it  (SAT).    Ai  •  r«|uU  of  till,!  ^MtMl 
chtckr  tli«  3o*rd  of  !l«vUu— *  panti  of  •«nlor  afiff  at  STS— li 

coniuctin^  *  dtttlltd  r«vl«w  of  th«  icortf  lf«cord«d  in  your  n*3«  for  th« 
C«c«»btr  2,  197B  adalnlttrAtlon  of  th*  SAT.  ^ 

Thi«  dttaii^^vltw  includti  tvo  oo^parlsoni.    F^r^.tr  yo«f  ^^^'f?!!? 
■eor«B  coSit^  with  •arXltr  iccr.i  and  found  to  b«  quit.  ^Iffarant. 

Such  Ut^  icora  dlff^aricai  M  Awmual  but  Urg*  dlfferencti  alona  m 
not  tufflolant  roten  for  quMtloaing  iicbrai.    Second,  your.  an»w«r  ih««t 
vai  co^parad  with  othari  froa  tha  sana  taat  car.tar.  'Your^-a^.ra  ara  In^ 
elosa  a^raasran^  with  thoia  on  ar.othar  anawar  ihaat.  ^  S^ch  .tfrt^a^  agraaa^tnt 
la  unusual  and  Indlcatai  that  ^ogylng  probably  occurrad..  rha  soajd 
d^x<laa  tnat  Uiara  ia  auiUcxanfc  raaton  to  qcaation  your.acoraa  bacauaa 
unuaual  raaults  wara  found  In  both  of  thaaa  cocparlaona. 

Tha  ancloaad  paaphlat  (ETS  Procaduraa  for  Dettralnlng  tha 
7Jaatlonabla  Scoraa)  axplalna  dataUa  of  all  tha  optlona  avail.bla  to 
^ou  in  ihia  ravlw  of  your  acoraa.    Plaaaa  laad  It .carafulXy.    tn  brlaf . 
t:i%%n  cptiona  allow  you  toi  ' 

Raquaat  a  ratttt  to  ccnArn  yau^  .qu«Jlio::td  scoraif  ' 

(Not  avail ibla  bv'aritaa.)  ^ 

Authoriaa  cJancallation  of  your  quaitionad  scoraa.  .  \ 

Supply  tha  Board  with  addltonal  Inforriatlon 

regarding  tha  validity  of  any  «f  your  acoraa.     ,  .      .  ^  . 

you  will  ba  informed  of  any  furthar  action,  onca  you  raply.  Kaanwhila\ 
your  scora  «;fport  will  read,  -Ab.eivt  or  Scoraa  Dalayad-.-a  phrasa  . 
for  all  dalayad  scoraa.   GoUegas  and  othara  dasi^natad  by  you  to  raceive 
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^   yoMK  icor^t  will  not  b*  Inforr^i  th»t  a  ravlaw  l**  in  jprogreli,  ■  Xf  you 
do  not  cbdoi«  any  of  tht  optioni  d«icrib*d  in  th*  pirphlat  or  ii(  you  do 

,    not  r*pXy«  ther*  wiU  b«  no  furthtr  action  but  your  tcorai  will  not  ba'^  . 
raportad.-  Plaaia  nott  that  in  your  ^aaa  this  ssaini  tha  qwaitlonild  '  ♦ 
jcorai  vill  nott  b4  forsalXy  ca-i^allfd  an*  tha  tait  faei  will  not  ba 
rofundad  at  atatad  In  tba  parphlat,    StewaVar,  your  F'«vioui  scorei     .^J^,  r 
any  futuro  icorat  will  ba  rap.:/t«d  at  ysur  rtqueit, .  •     .  , 

IChar.avar  tha  BoArd.  ftacc.T-Tanii  asaihst  reporting  a  cartdidita'i  icorai,.  f 

...  thar'f  ii  ona  additional  aj?d  i?a?ial  spticr.  availiblti  ^  Vou  ray  re:j|utit 
that  tha  jjuiiciontfd  scocii  .ir.4  a  »ta?ar.«n\:  ijf^tha  doaAl*i  r#»Jfcvationf 
about  chair  vaiirfity  \?a  j#nt  to  anj*  iratituticn  you  cHooia^  provided  thit 
inititution  if  both  wiXIir.j  to  »xar.ina^shi»  inJorration  and  to  rJintiln 
iti  soR'idantiaiity.  '   \  ..  *    .    .  * 

^fo^a  you  VMplf  ,  you  ray  viah,  co  wak  aivira  froa  your  paranta,  couniaXor^ 
or  6thar«>-\;;ndr  i'f  ywh^ira  Wy  quaatloni  regarding  thiV  •e!«^tiirr  call  na  "  ' 
coilact  *t  609->?X-^'i6tf;  ->i^-  .r.  •  «    •         ;  •!     v-;Jr-  --^  ^  ^f.  v 

a?*:  ''^    V  :^        J:;.  .:.         '   " 


Sinearliy  your*/  •  '^  '^'i  •  . 

{Mr*,)'iJ.*.It\ay  r,"Kaha-Orr 
.  Sacretary/Sbard  bf^^eviaw 


Incloaura  * 


...» 
4  J  - 


V  I!'  .■  I  •  . 


-  c 


.'Oil 


r.  C  *t  * 


.•.ll-lA-:.?l 

.  r  .b  lla  • 
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Fn^.vcii  V.  pAAKin  School 
^  )|0  Webref  Avenue 


Ftbrutry  7» 


1979 


h«t  t  dl 
yds  cin 
ct\jk  ItJt 


dlscustftd  ulth  you  yatttjrdAy. 
stt'  fron  htr  trantcrUict» 


Mrtt.:Shlrlty  F*  )(«nt-Orr 
StcrttAry,  Sif^ard  of  Jlavlav 
2dueatlon«l  Ttitlag  ^vrvlca 
Prlncaj:ori»  ^.J.  08341 

:Oaar  Mrs.  ]Una*Orr: 

.  Sne.toiad  la  cha  raacarlil  thai 
concarnlfig  "       ^      .    Aa  y 

har  firadaa  particularly  during  ct\jh  laat  cvo  yaara  In  Cngliih  and 
^Hiitory  couraata  hAva  baan  axcallfnc.    Includ.ad  lii  har  tranacrlpc  la 
our  racord  of  har  achlavateant  taielng  Including  cha  ESAt.    Lac  xa 
brla^fty  ravlav  what  X  fhlnk  la  tha  Valid  InforaaU^thae  abould 
pranantad  to  tha  Xavlav  Soard*  .  Ona.  har  varbal  PSAT  acora  vaa 
I  ona  hundrad  polnta  abova.t>«r  33  SAT  icora  vblch  aha  took  l| 
.  Harch  of  1974.    Sha  took  Achlayaxanc  TMta  ^ca»  dnca  in  May  of  «*7I 
and  one  a  In  Sfovasbar  of  '78,  and  a  a  you  c^tf  aM  fron  har  tranicgfjita^ 
,  har  English  Achlavateant  •ind  Llcaratura  ^^hlavamafft.  %Cjpras  hava  baan  . 
51  and  33  on'both  of  thoia  taatlngs.  '  ^i"^  . 

Aa  X  Indlcatad  to  you  on  cha  phona*  va  do  io«a  caatlng  ac 
Francla  ?arkar  4nd  ua  lava  a  oOmplaca  batciry  of  tha  California 
Taat  of  Xancal  Macurlty  to  In  cha  chlrd  and  alxth  jrada. 

Xn  tha' third  |rada  har  spdrai  ^ar»  aa  foltousi 


kaadlng 

Voo.  4.7 

CocRp*  4^4 

Tocal.  4.3 


Arlchxadc 
»aaa.  4.7 

'  rundtf  4.9 
rotil.  4.8 


Lang.  V/ 

.  :^aoh.  4.7 

Spal.  4.9 

ToraU  4.8 


Iti  addition  CO  chat  va  java  .har  California  Taat  of  Mantal  Maturity 
In  )ttVch.  of        la  har  atxth  jrada  yaar  ind  har  icoraa  vara; 


flaadinf 

Coatp . 


9.4 
8.1 


Mach^^Tactc 
^(aai.  9.0 
Fund.  3.3 


Lang . 
Mach. 
Spa  I. 


10.3 
IU3 


Aa 


X  indicated  to  you  also  oA tha  phona. 

to  Icprova  SAT  scoraa  chla  fall. 


haa  bean  workln|p 

vlth  tha  StJAlay  Kaplan  pro^raai  t^  Icprova  SAT  scoraa  chla  fall.  Al* 
though  X  havan^e  talked  to.  tha  ttachar  at  Stanley  Kaplan^ 
raflectad„to  me  Chait  thty  had  to^d  her  chet  she  wee  consistently  working 
in  Che  hljh  500  on  chair  precdce  test  ^sacerleU   My^undarf candlng  la 
chat.  la  going  co  have  che  person  che^  she  worked  wUh  et  Scantey 

Raplaa  prepare  a  tetter  for  you. 

iV-f^nat  cori^ern  haa  tp  do  with  your  tetter  of  March  lit  to  i 
wo  talked  on  ftha  ^dne  yesterday  you  Indicated  that  you    {  . 
were  net  a/cualng  of  chdatlng  on  tha  SAT«  but  th*t  your  <^oncara|  ^ 


ERLC 


7 

I.  M|tt 


921 


^•^         V   '         tnilUa  0.  CMC,  id     I  * 


Enc« 


V 
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ERLC  /  / 


eoL;CATtON.\L  rnsnsu.  SKMVIC'K         VK         PRINCETON.  N.J.  0854 
PebniU/  28,  1979 


'  Xr.  Wllll»a  D,  Ce«t».  Jr. 
Principal 

Frar.cif       Ptrktr  School 

JJOt.Webattr  Aver.u«  .  .  . 

Chicago,  XllinoiB  dC6:14 

f  ■  '        ■  .         ~      '  - 

Dear  ^t^  Gears 

Thank  you  for  ypur  ietttr  o^  February  7,  1979  wrltttn  in  behalf  of 

This  correjcor.d«r.c«,  which  included  grada  tr«nscript, 

Jcorea  for  tKa  rJovanber  and  May  1978  Achievement 
Testa  vera  given  tp  the  3oard  of  P.eview  for  consideration: 

As  1  inferred,  you  by  telephonic  the  Bo^rd  had  reaffirmed  its  initial 
decision  to  require  a  retest  in  this  instance  and  also  directed  that 
the  ^naterlaX  req^iested  b«  released  to  you.  '  . 

»  .  *  ■  _  ■  * 

I  have  therefore  .aclosed  both  th*  initial  Sujanary  for  the  Board  of 
Review  and  the  resuhnlttal  of  february  14,  1^79. 

If  1  can  ^  of  further  assistance,  please  telqphone  collect. 

7 

Sincerely,. 

(Mrs.)  i»hf*-ley  '?,  JCane-^Orr 

Secretary,  Board  of  Review  J  * 

SKOtcjs 

Cnctbsures 


SU>OURY  tOK  THt  BOAAD  OF  RKVIEU 


V  •     '  Probablft  coeauolestloa 

•  •   ;  ■  '  •  -  •  *    '  ■• 

Scorn  QHestloaed  hji  • 
.  S6^rft  Record f'  >  " 


jWry  3ljl979 
-of  Chleasoi"  XI* 
l3t/78  CBATP  CQtuputer  Scbra  Cain  Check. 


12/70 
.  3/78 


Score! 

V     H  WB 

6X0  4S0  SS 

3S0  SIO  49 


ImprovegenC 
269  -60    9  200 


Correepoftdss      •  • 


CB 


Scor^  Ktfcordi 


\ 


\DocuBeot>  In  BvldeacftS 


Data 

U/78 
3/78^ 

U/78 
5/78 


Score a 

V  M  UB 
610  530  .  56 
630  500^  Si 


Improvement 


EN  570  LR  620  FR  550 
EN  500   La  560    FH  610 


(1)  Hegiscratlbna  and  scora  teporta* 

(2)  12/78  answer  sheeta*    3/78  anawer 
ithmmt  far  CilndidAta  In  oucatlon 

^.    ■  j 

(3)  Klng'a  telephoned  report  that  docuDent 
^              tot  vera  written  by  tlfa  sama  paraon, 

(4>    Raspoaaa-  analyalai 

(1)    Book  nufflbera  uaedi 

^  J^MtyAtAmtm  in  ritAIMEg^  USed  #139046 

'  (2)    In  tha- Verbal' Sactloni,  tha  corretpond 

•       of  Incorrect  rejponsea  la/64X«  ^ 

*        *        Oandidate_  In       /  .»  . 

65  fovfmct^' 
14  /incorrect  v 
6  omit a 


(a)  jguftattotf^ 

(b)  (p/Iyn^  ((cU£i^baa  6$  correct 


12  incorrect 
6  otaitii 


.924 


> 


(c)  9  iocorrecc  anivan  coc=:oa  to  both 
papers  hav«  ldeotit«l,  refponsea*  lodcx. 
B  -  168,  FMult  6f  i  ■ 

^    candtdaf  in 

(d)  aH££ii£S  has  A  aAiivftri  correct  that  ' 
i  doet  not  have  .correcli* 

candldaf  in  ' 

(e)  9M££ii£3  has  erased  10  it«aa^and     *  * 

changed  to  9  correct  and  1  orltted  rejpoot 
ideatlcml  to.  i-fr^-'*T*''^jelectloas. 


(f)  Tt^e  longest  nm  it  4  locorrect.i 
lodex  B  "  20»  which  1j  the.  total  of 
incorrect  ipod  o^tted  respons.ea  on  both 
ansuet  sh«stt«    The  result  Is  6, 

(3)  In  th«  Vrittcn  English^  there  ii  no 
evidence  of  copying. 

.'^  cirndldate  li^ 
f  aViusition  has  45  correct 

3  incorrect 
V  ^  0  ^ts* 

-  •  ■  ^r*fs 

.  Cb).^,  _  has  43  cortect 

6  Incorrect 
1  odt 

(4)  In  the  Math  Sections,  7^  of  28  Incorrect 
answers  corre;sppnd  25X. 

candidate  In 
(ajdueitton  has  29  correct 

28  incorrect 
3  oalts 

(Wi  • . 

 Cb)'  .    ..  ha#_34,_coxMct   

*  *  15  Incorrect 

11  oaiti 

^.  cendidate  in 

(c^gueition  has  8  antvers  ciprrect  that 
I'O^  does  not  have  correct* 


CM 

a^ 


CB)  Erasures  are  not  significant* 

r>     <  * 

(5)  tn  the  Experioental  Section,  there  is  no 
evidence  of  copying* 
candidate  ig 
CaXjueitiog  hats  17  correct 
(Math)  6  incorrect 

\      •  2  oslts 


Jiruary  31,  1979 

.(b)^'.  .  hftt  36  corrtct         -  j^^: 

(Vfizbal)  5  locorrecr^rr^" 

Appareqtly  copjlng  vu  posaUTla  ^at  12/78 


(--.   .  ....... 


SAt. 


Ittconaendcttoo: .  Cocplete  aectirlty  processliig  of  the  12/79 


SAT  for       .  .  ,  ^  no' 


Shlrliey  f«  K«ne-Orr 


'  CASK  IVBSUCIITTEO 

taut. 


Februaty  .14 »  1979 


Tjpe/Progroai  ^ '  * 

Patt  of  Previous  Susaar/t 

Aecioa  Oiroetedli  * 


Addle  tonal  loCoroAticm  llQ^oivodl 


fditionat  Action: 


Recotaoqndat loa  s 


Copy/12/78  SAT 


.  January  31 »  1979 


Complete  Security  Processing 
V  ■ 


Letter  dated  February  7  fron  Hr,  Vllllaa 
.Geer»  Principal  of  Friyicls  Parkef  School.  ^.  y\ 


.  2)    Letter. fro«  authorlzlag 

releasa  of  all  information  from  flla  to 
Hr,  Oeer.  *  . 

;3).  Additional  score  report  for 

lodicatlng  scores  for  6  aehlevemerit  tesi^ 
that  the  Boar^  had  not  originally  ^con- 
sidered. .  .      .       .  ' 

1)  -  A  retest  has  been  seat  to  the  school  at  . 
Mr.  Geer's  request. 

•  Inform  that  a  retest  Is  required 

and  submit  file. to  counsel  resarding  the 
release  of  Information  to  Hr.  Geer* 


Shirley  7.  Kane*-Orr 


I  933. 


ERIC 


imu!ncm:t()N.  N:  .i 


 '  M  /  :  *  .     .     .  July  27,  1979 

t4r,  Willimm  D.  Geef ,  Jr.  \ 
Principal  ( 

Francis  Vf.  Parker  School  .  '        '  * 

330  Webster  Avenue 

Chicago,  Illinois    6.06l^  .  ./ 

Dear  Mr-  Geer : 

Your  letter  of  July  13  to  Mif.  Turnbiai  was  referred  to  me 
because  he  is  on  leave  for  several  months.    We  appreciate 
your  taking  the  tine  to  look  fnto  the  case  of  one  of  your 
students,  and  your  general  suggestions  about  the  hsmdling 
of  qu^tioned  scored. 

Ilhe  basic  problem,  I  think,  is  that  no  procedures  are  totally  • 
acceptable  to- all  of  the  parties  involved  —  students,  thfeir 
schools  >  receiving  inst^itutions ,  testing  centers  and  ETS.  ^ 
6ur  own  view  is  that  ETS  has  a  responsibility  for  reasonable 
checks  on  the  integrity  of  reported  scores.    Ii^the  prpcess, 
w.e  try  to  causes  the  least  inconvenience  oT  embej'rassinent  to    ^  • 
the  student>v4ii^have  no  direct  interest  in  identifying  or 
lalDfeling  wrongdoing  —  only  in  providing  val^id  scores. 

Vith  no  Intent  to  Minimize  the  reactions  of  the  student  about 
whom  you  wrote,  allow  nje -to  review  some  of  the  issues  that 
might  not  be  apparent  to  someone  outsidelbf  the  sysitem. 

'  •  •»  ■ 

.  The  computer  is  us^d  in  the  process  but  only  as  the  servant,  / 
f   not  the  ::>aster,  of  people  who  are  examining  the  record* 
carefiaiy  and  making  decisions^.    The 'computer  does  flag.  <; 
unusual  scor^  change^.    The  ^ercent&ge  of  cases. is  very 
small  (0-05?).    However,  thelstudent  is  not  contacted  until 
the  entire  record  has  been  studied  and  othei*  facts  raise  a 
serious  ques'tion  about  the  validity  of  the  score*  - 

Your  suggestion  that  ETS  ask  students  to-  retake  the  test  without 
•  suggesting  that  any  irregularities  exist  other  .than  a  score  gain 
soupds  plausible  and  has  been  made  before.    We  feel,  however, 
that  to  suggest  ,to  the  candidates  thaj^  an^admissioqs  officer. 


Mr,  William  D,  Jfeer.  Jr.  ■  ^-2- 


iJuly  27.  1979' 


might  question  scores  and  urge  retests  based  solely- on  a  large 
score  gain  would  be  wrong.  NSuch  action  would  indeed  endorse 
••"blind  reliance  on  a  computing  model"  and  properly  draw  criticism. 
Furthermore,  what  would  we  do  if  the  student  says  that  he.dcis 
•not  choose  to  take  our  suggedtl^o'ji?    Only  if  we  acknowledge  that, 
we  have  a  strong  indication  of  copying  or  other  irregularity  do 
we  halve,  any  right  to  wiiihhold  scores  or  otherwise  inconvenience 
\the  student,    We^Mf^r  the  student  all  reasonable  options  -^-^^ 
cancelling  the  score,  re.testing  promptly  under  controlled 
conditions,  supplying  the  ETS  Board  of  Review  with  information 
that^ would  alter  the  decision,  ^r  even  authorizing  the  scores  to 
"be  released  to  schools  with  .a -fulj  recoi'd  of .  the  case.    Note  that 
unless  the  student  chooses  .tii9  release  information,  no  public 
"charges"  are  leveled. 'agal'Tistt  him;  he  is  simply  told  why  ETS  finds' 
It  necfjssary  to  inconvenience  him..  , 

You  express  concern  that  the  student  had  no  opportunitx^to 
"respond"  to  the  Board  of  Review  until  after  it  had  met.  ^The 
initial  meeting  was  for  the  sole  purpose  ot  deciding  whether 
there  was  sufficient  reason  to  question  the  scores  or  whether  ^ 
they  should  be  released ^    As  stated  before,.Twe  do  not  consider  . 
a  large  score  gain  by  itself  to  be  sufficient  reason  to  question 
scores.    In  this  case  we  also  found  an  unusual,  close  agreement 
with  responses  on  another  person '6  answer  sheet;  the^seriaJ.  numbers 
on  the  two  answer  sheets  were  consecutive.    Thus,  in  the  context 
of  our  considerable  experience  coding  seemed  probable. 

It  was  at  this  point  that  the  student  vas^^nvited  to  respond  with 
any  information  that  would  explain  the  ^.arge  score  gf-in  and  the 
close  agreement  with  another  answer  ?heet.    The  stuident  was. 
encouraged  to  consult  others,  to  call  us  collect  or  to  write  to  us. 
The  student  did  turn  to  you  for  help  and  you  were  able  to  talk  to 
oujr  staff  and,  I  trust,  receive  all  the  information  you  desired.^ 
The  response  that  you  prepared  was  carefully  reviewed  by  the  Board 
of  Review  at  its  second  meeting,  at  which  time  the  deGisioh  was 
reaffirmed  to  ask  "for  a.retest.    We  were  pleased  that  the  student 
elected  the  retest  option, and  confirmed  the  validity,  of  her  scores. 

Your  concern  about  the  delay  between  the  retest  and  the  reporting  of 
t\ie  original' scores .  is  Justified.    I  am  informed  that  the  delay 
resulted  from  clerical  procedures  that  hiave  already  been  changed.  I 
have  asked  that  these  procedures  be  reexajained  tp  ensure  that  delays 
will  be  minimal,  .  . 


Mr.  William  D.  Ceer,  Jr.        -3-  .       July  27,  1979 


i^hen  we  write  to. students  about  questioned  scores,  we  include  a 
leaflet  de8cri\)ing  the  procedures  ^nd  student  options  In  detail. 
In  case  you  did  not  have  an  opportunity  to  see  the  leaflet, 
enclosing  one  for  your  review. 

The  issues  in  dealing  with  questioned  scores  are  coSlRlex/and,  as 
you  must  sense,  something,  we  have. struggled  with  at  length  to  find 
:th^  roost  fair  and  effective  procedures.    Ypur  interesjijis 
appreciated.       ^.  '     .     '  /"  *  • 


Vice  President 


cc :    William  W ..  Turnhull , 


»  ■ 

930.  f  ^ 


\  FRANCII         PaRKIK  StHOOL 

Chic9/:o,  IlliWi  60614 

•iUiAMD.CEERJR.         '  | 

PRINCIPAL  .      r  Augu»t  23,  1979 


\ 


Mr.  Robert:  J,  Solomon 
'Exaeutivii  Vice  Prtildent 
^ucatlonal  Ttstln^Strvlct 

trlnc^ton'i  New  Jersey  08541 


\ 


Dear  Mr.  Solomon;  y- 

I  V  . 

Itiank  you  ro  ntucfi  foV  Uklng.|the  time  to  write  luch  a  thorough 
and  .detailed  reiponse  to.  ny^etter.    Despite  the  thbroughneii  ahd 
detail  of  your  responie,'  ther^  jtill  are  several  questions  which.  *^ 
cause  me  grave  concern.  .  ■ 

■■    •    ■  ■  ^  i 

My  primery  concern  is  the  wirble  question  which  arises  when  ETS^ 

for. whatever  reason,  concludes  that  there  is  strong  indication'  that 

copying  or  other  irregularity  haa  occurred.    At  this  point  I  fefl  it 

imperative  that  ETS  treat  tha  natter  in  such  a  way  that  a  student  is 

afforded  due  process,  ^nd  tlyis  would  require  that  a  student  know  the 

exact  details  of  the  charge -and  all  of  the  information  that  has  led 

ETS  to  draw  such  conclusions.    As  I  indicated  in  ^  lettecifaifl  ditL^ot  

receive  the  detailed  ^statement  on* the  case  until  the  first  week  of 

March,  and  I  h«d  been  discussing  the  matter  with  officials  at  ETS 

since  the  end  of  January.    Also,. as  I  got  fUrthc^r  into  the  matter, 

I  found' that  each  time  I  discussed  the  matter  with  people  at  Princeton^. 

another  fact  or  issue  would  cOme  to  light.    Lengthy  phone  crlls  wCth  ^ 

someone  at  your  office  in  Princeton  is  no  substitute  tot  a  clear  and 

detailed  ^atement  of  the  causes  and  reasons  why  ETS  feels  that  copying 

has  occurAd.    I  elso  strongly  feel  that  there  is  no  way  that  people 

sitting  in  Princeton,  New  Jersey,  c^n  come  to  an  absolute  conclusion 

that  e  ftudent  in  Chicago  .has  (iheated  simply  by  analy;Biilg  answer  sheets 

and  comparing  patterns  of  right  and  wrong  answers.  .  | 

A  further  concern  about jthe  opportunity  to  respond  comes  from  my 
feeling  of  uncertalaity  aboutf  exactly  what  the  Review.  Board  was  consider* 
ing.    Wheo  I  sent  criy  leC|f|t^  including  background  infbrmation  on  the 
sdudent  in  que^Mon* IT  aiirad^mic  ^record  tind  general  testing  record,  I  had 
oi^ly  the  most  ^tittnl  understanding  of  what  the  specific  issues  were 
tHat  had  led  the  Review  Board  to  their  conclusion  that  the  student  had 
probably  copied.    Unless  a  student,  and  those  acting  as  advocates  for 
t()e  student,  know  the  specifics,  I  see  :no  way  that  the  student  can  ever 
effectively  respond  to  the  conclusion  t}iat  ETS  has  made  that  they  have 
probably  copied.* 

My  final  concern,  afdfr  reviewing  your  lettar,  is  that  I  am 

not  clear  as  to  whether  yoyr  response  constitutes  a  final ^statement 

of  ETS  on  the.  matter,,  or  thethor  ET^  will  conduct  a  more 'open  ahd  .* 
formal  review  of.  their  procedures* 


Sincerely, 


WDG:ev 

cc:  William  W.  Turnbull 


William  D.  Geer,  JW 
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931 


^  .  .        ■       ■  ' 

Chairman  Perkins.  I  am' going  to  interrupt  you  at  this  time  so. 

will  have  an  (opportunity  tp  ask  Mr.  Shanker  questions. 
He  must  leave  aX  1  o'clock;,  I  understand.  Mr.  Shanker,  I  will 

star^  off.  ;  ^  ,     .  , 

You  have  been  before  this  cbmmittee  several  times  and  you  have  ' 
had  a  wide  experience  in  the  educationa^rea.  '  , 

You  referred  in  your  testiir(ony  to  thrlaw  ^hich  the  New  York  ' 
Legislature  recently  enacted,  and  I  understand  a  lot  of  the' people 
who  were  ^backing  that  law  tpday  have  some  misgivings  about  the 
.  W£^y  that  it  has  turned  out.  L 

However,  that  is  just  hearsay.  But  what  do  you  thm  c  that  we 
can  learn  from  New  York:*s  experience?  Assuming  that  the  Weiss 
ball  is  enacted  and  implemeiiited.  What  do  you  think  j  bout  that 
sftuation?  '  '      v  '  i 

Mr.  SHANKEiR.  I  think  it  is  too  early  to  s^  what  We  can '  learn. 
The  law  was  just  signed  a  matter  of  a  few  moMhs  ago.  The  impact 
is— with  the  exception  of  what  the  publishers  have  said  they  will 
'do— the  impact  of  that  is  still  in  the  realm  of  cbnjeCture,  which  is 
what  all  of  us  are,  to  some 'extent,  engaged  in  here. 

I  would  cerfiihly  thinjc  that,  given  the  fact  that  such  a  law  Is 
there,  that  one  of  the  things  that  might  be  worth  doing  is  to' wait  a 
{ ■*  little  bit  longer  here  t^'see  what  the  effect  of  that  is,  because  righlf 
now  with  the  exception  of  the  thfeat  of  the  publishers  not  to  give 
some  of  the  examinafions  .  there  or  release  scores  within  the  State,  I 
don't  think  New  York  is- in  any  better  positior\  to  know  right  now 
wJiat  the /impact/ of  that  is  than  we  are  here  in  dis9ussing  it. 

We  have  got  a  series  of  conjectures  and-that  is  what,  they  have 
got  there,  but/we  Will  know  pretty  soon  and  it's  probably  worth 
waiting  here/to  take  a  look.      .  - 

Chairman  Perkins.  What  if  this  committee  suggested  a  study,  as 
■  suggested  this  morning  by  Dr.  Howe,  the  first  witness  that  testi- 
'  fied;  do^ou  think  that  that  might  be  helpful? 

Mr/SHANKER.  I  think  continued  studies  of  the  issues  raised  here 
,     and^rhat  will  happen  in  New  York  would  be  very  worthwhile,  yes. 
^Chairman  Perkins.  Do  you  feel  that  the  enactment  of  this  l^w 
Would  bring  about  higher  costs,  insofar  as  the  testing  is  concerned? 
A  Mr.  Shanker.  Yes;  I  believe— I  am  not  an  expert  in  this*  field- 
/  but  there  are  pepple  at  this  table  who  are,  but  I  have  not  only 
heard  them  but  I  hay^  met  with  others  over  a  period  Of  time  Bnd 
tried  to  listen  to  the  different  points  of  view.  "  * . / 

I  am  convinced  that  it  Svill  increase  the  costs  and  will  result  in 
times  on  the  examinations  which  are  not  as  good.  '  , 

It  wili-  result  in  a  rush' to  action  to  create  more  and  nidre  and 
more  tests  and*  test  item*  rather  than  better  items,  and  that  the 
cflinsequences  of  the  publication  and  release  of  the  items  Will  be 
negative  rather  than  positive.  '  ; 

Chairman  Perkins.  Mr.  Weiss?  '  ' 

}Mr.  Weiss.  Thank  you,  Mr.  Chairman.  ,.  ^  _  , 

/First,  let  me  express  my  personal  welcome  to  Mr.  Shanker  for 
'  .  '  his  presence  and  participation.  We  are  - associates.  I  am  losing  my 
voice.     ■  -   '       •  '       .  ' 

Mr,  Shanker.  Associates  and  friends. 
Mr.  Weiss.  Right.     _  f    ^  ; 
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I  am  sure,-  ;6r'if  you  don't,  let  me  tell  3j^u  that  the  area  of 
greatest  concern  about  the  New  York  test  and  the  New  York  law 
and  its  effect  on  tests  refers  to  the  small  volume  tests  and  the 
requirement,  burden  that,' would  be  imposed  on  making  or  publish*- 
ing  new  tests  in  those  instances. 

Our  legislation,  I  think,  almost  totally  cures  that  problem,  be- 
cause we  exclude  tests  which  are  given  to  a  few  of  the  people  over 
•^he  years.  That  bears  cause  to  be  reassured  on  that  ground,  but  let 
ask  you,  and*  I  ask  you  these  quffitions  only  because  when  >ye 
were^in  the  process,  my  office  withNShirley  Chisholm  and  George 
Milleran  preparing  this  legislation,  and  we  tried  to  touchf  base  with 
all  elements,  of  the  educational  community  who  would /be  affected 
by  this  legislation  or  would  have  a  natural  interest  in  it. 

One  of  th^  groups  that  we  touched  base  with  was  the  American 
Federation. of  Teachers  and  its  components  at  that  time,  and  you 
correct  me,  let  me  ask  the  question  first,,  but  isn't  it  a  fact  that 
your  union,  the  AFT,  had  in  July  of  this  year  adopted  a  resolution 
at  its  con ventiojn  supporting  both  the  New,  York  law  and  national 
efforts  to  reform  t^ing  procedures?  ^       .  , 

Mr.  Shanker.  \Vell,  that  is  going  a  bit  Itoo  far.  Let  me  revifew 

■  that,    .  .  ■  \       '  "  .     ■    .  i 

You  are  certainly  right  in  saying  that  you  had  more  than 
touched  bases.  You  h^ui  met  with  and  sought  to  find  out  what  the 
views  of  both  our  State  affiliate  and  national  organizations  were, 
withtespect  to  the  issues  involved  here.      ^,  • 

In  New  York  3tate  our  affiliate  did  support,  was  not  the  prime 
mover,  but  did  supportUhe  law  which  passed  there.  It  has  not 
changed  its  position.  It  ^  in  the  process  now,  as  some  of  these 
consequences  come  out  ojE  examining  its  position,  that  I  can  only 
say  while  on  the  books,  me  ^position  is  there  and  it  m?iy  end  up 
being  exactly  the  same  as  k  wag  before;  it  may  also  be  a  few  weeks 
from  now:  "Hey>  we  movefl  a  littliB  quickly  and  we  wish  we  had 
given  ourselves  sonie  breatmng  time,'  so  I  am  reporting  the  policy 
in  the  State  is  there,  and  thqre  is  ^Iso  a  reconsideration.  , 

The  national  resolution  wnich  was  adopted  refers  to  no  specific 
piece  of  legislation,  nor  doe9\it  call  for  a  specific.  It  does  6all  for 
greater  scrutiny.  It  is  a  one-s6ntence  resolved  )jyith  some  whereases 
whiclv  point  out  we  recognize  ihere  are  problems  and  abuses.  There 
is  no  question  about  that. 

I  indicated  in  my  statement  before  that  I  am  not  here  to  take  the 
position  that  nothing  needs  to  be  done.  1  am  here  to  s^y  that  I  am 
impressed  with  the  complexity  \of  the  issues.  I  lam  convinced  that 
moving  very  quickly  on  these  is\going  to  result  in  a  lot^  of  damage, 
and  I  would  say  that  our  organization,  after  there  is  enough  either 
the  same  differences  in  pur  organization  that  exist  6n  ttie  other 
panels  that  you  have  had  and  this  panel,  I  don't  come  here  repre- 
senting a  half  million  people  who  have  (got  unanimous  opinions.  I 
don't  even  have  that  many  people  that  have  looked  at  the  issue. 

I  need  sonle  time.  We  have  asiced  fjor  and  teceijved  a  grant  from 
the  National  Institute  of  Educatio^  1 
ences  for  teachere  aroilnd  the  counm 

on  this  panel  "^nd  .  bring  teachers  1  , ,   

debate  can  go  on  all  across  tUe  country,  and  we  would  like  some- 
time to  educate  oUr  people  and  involve  them  in  this  process. 


to  conduct^|i  series  of  cohfer- 
>  to  bring  people  like  the  ones 
iround  this  country,  so  this 
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We  did  tke  same  thing  a  year  ago  on  the  question  of  reforming  ,4 
the  "tax  base  for  education.  We  found  most  people  in  education 
around  the  country  really  were  not  aware  of  what  the  taxpayer  « 
and  equity  issues  were*  We  ended  up  publishing  a  booklet  and 
running  a  series  of  conferences  and  developed  a  good  deal  of  qual-. 
ity  leadership  in  this  fieldr 

I  just  am  worried  about  conclusions  at  this  early  point.  NoW,  yoii 
are  right  in  your  opening  statement  that  so  far  as  the  only  conse- 
quences on  these  special  examples,  they  are  given  to  smaller 
groups,  but  I  don't  think  we  have  seen  what  the  consequences  of 
that  legislation  are.  We  won't  uniil  it  plays  itself  out  for 'a  year  o^ 
two.  .  I 

Mr.  Weiss.  I  just  simply  wanted  the  record  to  reflect  our  past 
involvement  in  eoming  to  a  conclusion/  and  also  one  further  item  I 
o^ght  to  mention  for  the  record. 

There  was  a  representative  of  your  organization  that  participat- 
ed in  the  announcement  of  the  introduction  of  this^  legislation;; 
support  of  our  efforts,  and  I  assume  that  that  was  done  with  the' 
authorization  of  you? 

Mr.  Shanker.  I  have  not  come  here  te-complain.  I  haven't  been 
consulted,  and  I  will  even  say  that  you  had  strong  re^on  to  beliey^ 
that  you  would  have  much  more  immediate  support  than  you  arfe 
getting  from  me  at  this  moment.  I 

Mr.  Weiss.  That  is  all  that  I  wanted  to  establish.  \  i 

Mr.  Shanker.  I  will  be  very  glad  to  acknowledge  that.         '  ^  • 

Chairman  Perkins.  Mr.  Goodling? 

Mr.  GpoDUNG.  Thank  you,  Mr.  Chairman. 

We  have  so  little  time  that  I  don't  believe  I  better  ask  all  of  the 
questions  that  come  to  my  mind. 

Mr.  Perkins.  Six  or  seven  minutes.  1* 

Mr.  GooDLiNG;  Just  listening  to  the  most  recent  conversation,  / 
there  was  a  mfention  of  Excluding  tests  given  to  5,000  individuals  6r 
.  less.  I  suppose  Russian  and  Hebrew  might  qualify  for  such  an 
exclusion.  Beyond  that,  I  can't  imagine  what  other  e2j:ams  would  be 
excluded,  because  when  you  talk  about  5,000  nationwide,  that  is  a  *  | 
y     drop  in  the  bucket.  ^Jm^  ' 

/  *  You  answered  the  question  I  was  going  to  ask  you.\Jap  a  foot 
dragger/I  siippp^  that  is  the  way  it  is  termed.  So  many|pmes  we 
have  such  wel^meaning  inteittions  and  quickly  write  legislation,- 
whiqh  we  think  is  going  to  cure  a  number  of  problems.  But  instead, 
we  sometimes  do  an  injustice  to  the  people  we  were  trying  to  help. 
This  has  been  mentioned  many  tim^s  today. 

So  I  ask*  you  the  question  that  I  have  asked  so  many  times: 

Do  you  see  such  an  eimergency  that  we  cannot  wait  until  we  see 
what  happens  with  the  California  and  the  much  stronger  N^w  . 
York  legislation,  or  the  Natiofial  Science  Foundation  etudy? 

ils  the  emergency  so  great  that  we  cannot  wait  and  see  before  we 
d||^mething  wrong  in  attempting  tQ  eure  the  ills?/ J 

Mr.  Shanker.  Well,  as  I  indicated  before,  l  aoii't  think  the 
emergency  is  in  the  legislation  that  the  people  of  the  United  States 
haite  this  feeling  that  the  testing  is  horrible  and  uilfair  and  (hot 
valid  and  accur^j;^  I  d9n^t  think  that  the  overwhelming  m^ority,  I  • 
think,  the  emergency  is  in  another  field. 

■  ■  •■■  ■  ■^•„...-'  .^r 
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I  think  that  tie  pebpleMeel  they  are  paying  an  awful  lot  for 
.  education  and  tl^ie  scqres/are  going  down  and  the  standajpds  are 
loosfening,  and  what  we  see  at  ioe^l  and  State  levels  all  across  the 
coUntpy  is  a  way  to  figure  out  how  we  can  tighten  the  standards, 
.  and  Fwould  say  :at  the  sajme  tinie  also  use  these  results  on  some  of 
.  these,  the  information  onl'sotne  of  these  tests  to  realize  that  we  are 
-  n^t  doing  afn  adequate  job  in  eliucation,  to  try  to  figure  out  what 
we  should  be  doinc  thjerei 

My  \yorry  is  tnat  <  v^e[  have  some  instruments  now.  There  are 
plenty  of  problerhi^  ass«iated  wik^  the  use  of  those  instruments, 
and  I  think  that  Congressman  Weiss  and  his  associates  who  have 
introduced  theMegiislatiqn  have  certainly  served  a  great  purpose  in  . 
"bringing  to  light 'manjl  of  these;  problems.  But  I  think  that  on 
.  balance,  it  is  a  lot  better  to  try  to!  improve  an  imperfect  instrument 
than  it  is  to  open  things  up  to  the  point  where  you  may  very  \yell 
\yeaken  the  instrument  make  it  less  sharp,  less  useful  than  it  is  at 
the  present 'time.         f  *  ' 

You  say  you  are  a  fc^t  dragger.  Well,  Ldon't  accept  your  evalua- 
,  tion  of  yourself.  This  ^s  an  unusuql  stance  for  me.  .1  am  usually 
here  to  say  the  foilowjing  things  ought  to  be  done  and  I  am  con- 
vinced, but  I  do  a  lot  ojF  thinking  and  I  do  a  lot  of  reading,  and  you 
[  have  heard  af  lot  of  evidence, , and  there  is  sufficient  gimount  that 
has  been  placed  before  you  to  show  that  the  case  has  not  been 
proven  ana  that  if  yoij^  go  ahead  with  this  and  the  opponents  are 
right,]the  consequenceslare  pretty  serious. 
'Mr.'GooDLiNG.  ThanWyOu,  Mr.  Shanker. 

I  have  no  other  questibris.  > 
Chairman  Perkins,  mt.  Andrews?        ^  I 
Mr.  Andrews.  Thank  krou,  Mr.  ^Chairman.  J  . 

If  I  may  digress  fromi  the  subject  1  minute  and  ask  it  wry  briefly 
,  of  your  friend  from  Kentucky,  what  happened  to  Dr.  R^guson  who 
left  the  University  of  ©reensboro  and  went  to  the, University  of 
Kentucky<in  abQu^  l971t.Is  he  still  Ihere?  m  i 

Dr.  ClaWson.  If  he  isjthere  1  don't  know  him.         •   .     ^  • 
Mr,  Andrew^.  lie  wis  president  of  the  University  *pf  Kentucl^ 
,  Dr.  ClAwsqn.  Not  in /recent  year^.  It  is  now  President  Singletary. 
'    Mr.  Anprews.  l  beg*^our  pardbn.  It  was  Singletary. 

Dr.  ClawsoN*  He  is  still  president  and  doing  very  well.  .  \ 
Mr.  Andrews.  vThere  are  so  many  questions.  ^ 
Chairman  PermnS';  All  right;  we  will  let  your  Witness^go.  , 
Thank  you  very  m^uch!     ;  ^  ,  ,  - 

Mr.  SttANKfiRivI  -would  like  tb  thank  you  for  thi$  opportunity  and, 
\  if  I  may,  I  ahi/  go^ng  to  run  away,  but  one  jpoJnt'that  keeps  refbur- 
<  ring  hei^e  is  the  belief  that  if  somehow  we  throw  the  tests  away* 
■  .that  this  is  ^qing  to  result  in  better  admission  standards  insofar  as. 
the  admissions  .of  niinoritips  are  concerned.     ^  '*      '  * 

'  I  think  >ylien5you  eltofnate  standards  of  a  core  of  objectivity^ 
recognizing  th6t  this  ie  orily'  one  of  the  pieces  of  legislation  and  n 
you  iujse  these  tests  on' theiV  own  it's  wrong  and  stupid.  If  you  throw  i 
it  away  you  are  either  lefjt^o  local  tests,  and  there  is  no' evidence 
they  are  going  to  be  aiiy  l)etter,  or  you  move  bVer  ta^Varioj^ 
subjective  standards.,  ,        '     ^  '         >  , 

Npw,  subjective  standards  niay  very  well  produce  greater  a^jjiis- 
sion  of  minorities  duting  a  period  of  time  when  that  is  a.  pedlar 

'    ■■  •    •        \     '     ■  '■  \-       ^    "  7 


cause.  Then  when  that  cause  *becomes  less  popular  oi?  ^^npopular, 
and  all  we  have  to  do  is  see  the  swing  of  public  opinion  ^n  various 
political  issues  and  how  quickly  that  happens^  the  abolition  or  the 
destruction  of  standards  that  move  through  different' periods  could 
lead  to  periods  when  there  are  greater  admission  of  minorities 
than  others  when  the  subjective'  standards  result=i in  massive 

discrimination.  #  - 

»    So  one  of  the  reasons  for  my  support  of  standardized  testing  and 
objective  testing  and  its  improvement  is  a  belief  that  in  the  long 
run  minorities  are  advantaged  by,  a  rule  of  law  rather  than  by  a^^ 
sway  of  opinion  or  pppularity  at  any  given  time. 
Thank  you  very  much. 

Mr.  Weiss.  May  I  comment  very  briefly  on  that? 
The  conclusion  that  you  just  made  bothers  me,  because  there  is 
no  effort  on  my  pai^t  or  anyone  else's  part  supporting  this  legisla- 
tion to  ' 

Mr.  Shanekr.  I  was  responding  to  Dr.  Jackson,  not  to  you. 
Mr,  Weiss  [continuing].  -Throw  away  standardized  tests.  Quite  to 
the  contrary,  I  happen  to  believe  that  standardized  testing  has  a 
ce  in  the  educational  field.  'i 
ly  concern  is  the  slipshod  way  which  it  is  operated  now,  both  as 
Validity  ahd  as  to  security  which  has  destroyed  the  credibility  of 
__Jse  tests.  I  want  to  undertake  a  systejn  ofj3pening  it  up,  so  it  will 
regglin  credibility  ami  sometimes  tliere'i^  a  confusion  as  to  whether 
in  fact  who  is  in  fact  more  likely  to  secure  acceptance  of  valid  .tests, 
those  who  want  to  reform  the. process  or  those  Who  are  willing  tp 
stick  with  the  proce  ss,  which  everybody  admits  is  .terribly  foolish. 
Chairman  Perkins  .  Let  Mr,  Shanker.  respond.  - 
Mr.  GOODLING.  I  vrant  to  respond  to'thrat  in  relationship  to  this 
conversation.  '  *  ' 

I  would  ilike  to  read  a  sentence  from  Dr.  Bond's  testimony,  be- 
cause I  think  this  is  the  key.  _  . 

The  result  of  item  disci ofsure  will  be  to  the  hasty  and  unprofessioTTHfWnstruction 
of  itemB  which  are  likely'  to  be  ambiguous,  more  susceptibly  to  cultural  bias  and 
•generally  poor  in  overall  predictive  value.  ^ 

I  believe  that  is  what  the  legislation  ^  it  is  presently  written 
will  do  and;  therefor^/ 1  have  to  agree  with  most  of  what  you  have 
to*  say. 

Chairman  Perkins.\A11  right.  Let  the  gentleman  finish  his  testi- 
inony  now. 

Mr.  Geer.  Let  me  pi^k  up  the  point  ^tgain. 

The  point  was  that  there  are  clear  civil  rights  issues  as  ai  princi- 
ple; and  as  a  person  who  personally  kneW  this  student  I  was  most 
appalled  at  the  iffcpact  of^the  letter  and  the  action  taker^T)y  ETS  on 
the  student.  ^       \  r^L 

The  letter  v/as  releived  ir^  the  middle  of  the  senior  year.  There 
was  really  no  way  for  the  stVident  to,quegtion  or  to  haye  any  idea 


Thinking  about  that,  the  question- 
liddle  of  their  8en|or  year  do  if  they 


of  why  this  decision  was  ma 
of  what  does  a  student  in  the 
receive  such  a  letter? 
Do  you  go  to  your  parents?  ^ 
Do  you  go  to  your  school  guidance  counselor,  your  school  princi- 
pal and  say,  '1  received  this  lette^r;  what  do  I  do?  '  " 
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'Obyiousfy,  a  student  a^ne  has  little  <)r  no  access  or  ability  to 
questioh  the  de^sion  or  to  |ev0n  asl^  for  ai>  effective  review. 
'  I'  Given  the  general  anxietjy  ^bcut  college  admissions  in  the  middlie 
of  the  senior  year,  my  gue$s  is  that  mpst  students,  if  they  can,  try' 
to  forget  the  letter.  I  was  told  that  their  program  of  score  review  is 
effective,  because  i?o  few  stud|lents  ever  Respond  to  the  initial  letter 
:  from  ETS  and  in  those  conversations  i^y  understanding  is  that  this 
"  practice  has  be^ij  going  on  for  ,6  or  7  years,  and  probably  involved 
.thousands  and  thousands  olj|  i^udents.  { 

ETS  probably  counts- a  inonresponse  frpm  any  studeift  as  an 
admission  of  guilt,  and  in  iheir  evaluation  of  their  program  they 
assume  every  time  they  '«end  a  letter  like  that  out  and  receive  no 
response  from  the*  student,  \the  student  is  admitting  that  the  stu- 
dent is  guilty.  \  i 
How  many  shattered  innocent  students  are  there  who  receive 
.  such  letters  in  the  6  or  7  years?  ETS  has  engaged  in  this  practice 
and  could  do  nothing  about  it  is  a  matter  qf  conjecture;  but  having 
li^ed  through  the  hell  of  om  student  improperly  treated  by.  the 
system,  I  can  speak  of  the  agony  and  confusion  that  it  creates.  It  is 
a  legitimate  interest  to  the  Congress  to  protect  the  civil  arid  coristi- 
tutional  rights  of  test  talcers.  / 
:  would  urge  you  jj,o  clean  the  present  bill  or  draft  separate  bills 
to  do  just  that  to  deal  with  the  right  of  the  civil  rights  of  students 
in  jthe  matter  of  the  specific/review  of  tests  and  the  accusations  of 
copying  or  cheating  or  irregularities. 

Chairman  Perkins!.  Let  me  congratulate  all  of  you.  Now,  I  will 
try  to  hold  our  ^questions  to  5  minutes  the  first  time  around. 

I  would  like  to  ask  the  distinguished  doctor  from  my  own  State  a 
question.  Dr.  Clawson. 

Ejefore  the  national  tnedical  school  admissions  \  test  was  devel- 
opeji,  how  did  me^iical  schools  choose  students,  and  do  you  see  any 
danger  in  going  b^ck  to  those  practices  if  the  national  test  must  be 
made  public  after  it  is  given? 

Dr.  Clawson.  1  will  try,  because  each  college  obviously  has  dif-  • 
ferent  admissionsWandards  and  havfe^had  for  many  years,  but  L 
think  the  fact  tJi^t  American  medicine  has  underrepresented 
groups,  and  it  speaks  for  the  fact  that  the  previous  practice  was 
not  the  Jbest  practice  and  for  the  most  part  it  was  a  matter  of  your 
knovVjng  an  alumnus  or  your  daddy  went  to  the,  school  or  you  had 
soma  contacts  with  people  on  the  admissions  committee,  and  the 
proceWs  was  l^sst objective  than  it  is  with  the  MCAT. 

I  hold  no  grief.  The  MCAT  is  still  a  better  tool.  It  is  a  better  tool 
now  than  it  was  in  1975,  and  my  concern  is  in  listening  i  to  people 
discuss  ii\  as  a  bad  tool.  What  is  going  to*take  its  place?  ' 

I  am  v^ry  much  concerned  that  what  would  take  its  place  is  not 
a  better  test,  but  going  back  to  more  subjective  ways  of  admitting 
students  which  then  there,  are  inherent  biases  withiii  the  admis- 
sions committee,  that  I  thinV  would  be  (^amaging. 

The  comment  by  Mr.  Gastfriend 'about  the  role  of  the  MCAT,  I 
believe,  he  testified  most  on  MCAT  as  I  did,  stating  the  MCAT 
position,  stating  this  was  a  great  and  good  predictor  of  practice. 

I  havec^been  With  that  organization  in  one  way  or  another  for  a 
long  time,  sitting  on  its  council  of  deans  for' 4  years,  and  I  don't 
believe  that  that  is  the  perception  that  niost  of  us  haye.  It  is  only  a 
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tool.  I  am  surprised,  hearing  the  amount  pf  weight  that  admissions 
committees  put  on  the  standardized  testing. 

I  don't  hegu:  that  much  weight  bdng  put  on*lt,  unless  it  seems  to 
Idghlight  S(^mething  tl^at  we  are  musing  frdm  the  other  criteria  for 
Admission,  and  so  my  concern  is  that  without  an  instalment  that 
we  haie  reliability  or  validity,  or  feel, we  do,  and  >ye  will  go  back  to 
some  of  the  previous  practices  of  either  giving  aii  examihiition 
locally  ii^  .the  school/ Or  using  some  of  the  i)ther  criteria,  so  that  is 
myytoasic  concern  in/this.  * 

V  feel.tr^  we  haive  in  the  voluntary  sector  put  a  great  deal  of 
money  inio  trying /to  make  the  examination  better.  We  do  publish 
a  booklet  l^hat  is  a/vailable  to  everybody  as  to  what  the  exam  looks 
like,  hoyv  the  questions  are  structured;  and  we  have  answered 
many  of  the  things  voluntarily. 

The  question  mat  was  rs^ed  to  my  left  here  about  an  editorial 
that  appeared,  heavens,  there  are  plenty  of  questions.  Surp;  v/e  can 
construct  questions  forever.  You  can  construct  questions  in  chemis- 
try that  will  test  the  mind  of  a-^Ph.  D.  I'hat  i^Wot  our'  desire  in 
constructing  this  examination.  \ 

That  is  why  the  pool  of  questions  is  very  liipited  and  those 
writing  the  editorials  did  not  recognize  that  we  do  not  want  to 
force  students  to  take  5  or  10  years  preparing  themselves  to  get 
into  a  niedical  school  by  the  way  in  which  the-test\is  constructed. 

We  have  purposely  limited  the  poof  of  qfuestioris  to  a  very  small 
number. 

Chairman  Perkins.  Mr.  Goodling? 

Mr.  Goodling.  Thank  you,  Mr.  Chiiirman. 

I  don't  have  enough  time  |o  ask  all  the  questions  I  would  like  to 
ask.  I  am  scheduled  to  meet  with  a  group  of  my  constituents. 

prr^ackson,!  would  like  you  to  send  to  me  a  response  to  a 
coiiple  of  comiri^nts  that  Pheard  you  make  during  your  testimony, 
which  I  interpleted  as  pretty  much  antistandardized  testimony. 
You  said  at  the  end  of  your  testimony  that  at  Howard  University 
the  standards  are  going  up  and  up. 

Would  you  respond  to  me  in  writing?  I-got  the  impression  that  j 
you  also  were  inferring  that  there  were  some  other  tests  involved, 
:  piit  thg  stfloidards.  ajre  going  up  JtndiULat  Howard.  Can  you  explain 
as  measured  By  what  or  by-wnom  and  ajte  they  going  up  in  rela- 
tionship to  sttme  testing  tool  that  has  beeip&eyeloped  there? 

Then,  is  theref>4ny  poi^sibility  of  teaching  the  testing  tools  or 
anything  of  that  nature?  It  will  take  to9  long  to  respond  to  these 
questions  now,  but  if  you'  could  respond  in  writing.  I  would  bft 
certainly  interested.  If  you  have  a  better  tool  I  would  want  to  get 
behind  a  better  tool.  [  m 

David,  vou  present  an  interesting  picture  as  I  was  thinking  or 
pre-World  War  11.  I  don't  know  your  background  £^nd  family  situa- 
tion,'but  prior  to  Wond  War  II  you  wouldn't  hay6%)tten  into  the 
institution  ypu  attended  unless  you  had  preyioudy  attended  some 
prestigious  prep^  school  or  soiyieone  in  your  family  had  the  proper 
cojinections. 

.  However,  you  also  present  the  interesting  nicture;  in  all  probabil- 
lity  prior  to  pre^World  War  11  that  instituuon  wasn't  prestigious 
enough  *to  get  vou  into  dRot  of)  medical  schools,  and  that  is  one  . of 
tMe  concerns  I. nave. 
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Now>  (here  is  no  question  v/Y^n  you  talk  about  feedback.  Stu- 
dents should  have  feedback.  However/  if  that  means  releasing  these 
tests,  then  I  have  a  problem  \^|th  that^  because  you  go  on  to  say 
equal  opportunity  to  prepare.  If  i  thought  there  was  any  way  we  on 
the  Federal  lever  could  provide  equal- opportunity  for  all  young 
people  to  prepare  for  tests,  I  would  certainly  g^t  100  percent  be- 
hind it.  But  to  do  that,  1  would  have  to  make  sure  that  they  haye 
an  equal  opportunity  for  all  the  cultural  experiences  as  they  are 
growing  up  that  many  do  not  have. 

I  would  have  to  make  sure  that  they  have  an  equal  opportunity 
to  have  a  stable  family  situation.  If  I  provide  them  test  j releases, 
theji  what  I  am  doing  to  them,  I  think,  is  making  it  even  more 
difficult  for  thenl,  because  then  all  of  those  agenciesi  that  want  to 
make  a  quick  buck  get  involved  in  this  business  of  tutoring,  et 
cetera,  and  they  can  afford  it.  . 

Mr.  Gastfriend.  I  will  t'espond  to  that,  because  I  assume  that 
you  are  asking  me  a  question.  I  am  here  to  give  testimony  . rather 
than  hear  it.  a 
"  Mr.  GoODLiNG.  Yes,  but  you  are  also  here  >yithout#too  much 
experiences  and  so  we  want  *td  share  our  experiencesf  with  each 
other,  because  it  will  make  us  both  better  people.  > 
Mr.  Gastfriend.  I  am  all  for  good  people. 

The  question  about  what  happens  with  the  releases  of  the  scores 
can  be  answered  pretty  easily  by  looking  at  a  college  bookstore  in 
which  you^fmd  Books  with  compilations  of  questions,  some  of  whiph 
have  been  gotten  through  the  means  of  the  Kaplan  courses  and 
others  made  up  by  educators,  people  who  have  even  been  involved 
in  the  test  preparation  industry;  that  is^  working  with  ETS,  the 
MCATR,  and /things  like  that  who  later  go  and  write  preparatory 
books.  '  *  ♦ 

You  find  that  students  do  go  out  and  purchase  those  books  and 
review  these  things,  but  that  is  not  the  same  thing  as  finding  out 
why  you  scored,  a  400  or  a  520  when  you  thought  you  did  well,  and 
it's  not  the  same  as  ,  going  through  and  seeing  where  you  flawed. 

Looking  at  the  exafet  questions  that^ou  answered,  and  you  mgiy 
feel  that  that  is  not  significant,  but  I  Ibll  tell  you  in  the  minds  of/ 
students  ij^  is  significant,  and  they  ma\be  inexperienced,  but  at 
present  these  are  people  who  do  not  have  a  representative  voice  in 
the  powers  that  produce,  utilize  and  make  policy  on  these  tests, 
and  that  those  students  could  not  obtain  such  a  voice  through 
conventional  means  such  as  receiving  appoiritments  to  those 
groups,  but  one  way  in  which  xhey  could  have  a  sense  of  ownership 
« over  t^ie  contract  that  they  are  making  with  the  schools  and  test* 
ing  se/rvices  is  just  to  know  what  other  people  think  they  are  doing. 

It's  curious  to  me  that  some  of  the  'members  of  tne  committee 
who  have  asked  some  speakers  to  respond  jpive  not  asked  or  not 
commented  on  the  factual  accounts  of  problems  in  the  score  rJ^ort- 
ing  and  the  security  problems  that  we  have  heard  factual  accounts 
of,  and  we  have  not  heard  you  que^iofi  further  the  data  of  the 
•  flaws  in  the  predictive  ability  of  the  teffsts. 
*  .    I  sense  a  bias.    '  / 

Mr.  G(^ODLiNG.  You  are  going  to  take  all  of  my  5  minutes  in  your 
response.  , 
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Mr.  Gastfriend.  Perhaps  you  would  bp  interested  to  respond  in 
writing  to  me.  j 

Mr.  GooDLiNG.  I  am  sure  Mr "  Geer  didn't  expect  us  to  throw'  out 
the  baby  with  the  bath  water  because  of  seyeral  isolated  incidents. 
You  have  to  look  at  the  overall  picture. 

Dr.  Bond,  may  I  merely  say  that  I  thought  your  testimony  was 
outstanding.  If  I  haa  any  influence  in  the  White  House>at  all  I 
wouldn't  be  so  scared  about  a  Department  of  Education,  because  I 
would  make  you  the  new  Secretary  of  the  Department  of  Educa- 
tion. Then  I  know  that  we  wpuld  work  at  the  problems  we  have  in 
education. 

Kenny,  I  would  only  say  I  )iope  if  you  have  the  profit^making 
information  about  ETS  that  you  get  it  to  IRS.  I  am  sure  IRS  would 
be  very  pleased  to  have  any  information  about  ETS  as  a  profit- 
making  organization.  ' 

I  think  you  should  make  sure  and,-^  second,  I  would  hdpe  if  you 
have  not  visited  ETS  that  you  would  spend  at  least  2  days  there. 
You  appear  to  be  someone  who  wants  to  be  very  fairminded,  so  you 
should  want  to  ha  ye  an  overview  of  the  whole  situation. 

Two.  hundred  seventy-five  dollars  is  a  complete  waste.  You  are  an 
intelligent  young  man.  You  can  get  this  free  and  the  books  that 
David  talked  dbout  for  less  than  $20.  j 

Mr.  Geer,  I  do  want  to  ask,  you  did  not  have  the  idea  of  throwing, 
the  baby  flut  with  the  bath  water,  did  you,  when  you  werel  giving^ 
'^^^ypwr  testimony?  / 


You  cited  a  very  serious  case,  and  certainly  something  should 
done  about  it  when  you.  look  at  the  o^verall  picture  of  the  ^>^peri- 
^liQe  you  have  had.  /  j 

Mr.  Geer.  My  concetn  overall  witji  testing/  is  that  you  have  an 
instrument  like  SAT,  which  is  the  on^  I  am  most  faihilair  wi]^  and 
which  was  designed  to  do  certain  things,  has  been  extraordinarily 
carefully  monitored  and  protected  now  over/35  ye^rs.  I.thiiafk  the 
largest  problem  with  the  SAT  is  not  the  exarnple  itself,  biit  the 
gross  misuse  of  the  SAT.  / 

That  test  was  never  designed  to  evaluate  Americ^  high  school 
education!  and  yet  the  annual  report  of  the  declme  in  SAT  scores  is 
nov^ being  viewed  as  a  measure  of  American  hi^  schqol  education. 
Mr.  GooDUNG.  Our  legislation  doesn't  tohch,  that.  ^ 
Mr.  Queer.  As  a  person  serving  on  councils,  N(  protested  as  loudly 
as  I  could:and  told  the  College  Board  and  EJTS  they  had  no  right  to 
use  that  information  in  that  way,  ,^d  they  wereVusing  information 
that!  was  on  an  exaniination,  information  that  they  had  collected 
ov^r  35  years,  and  they  w^re  using  it  in  incorreict,  improper,  and 
manipulative  ways,  in  my  judgment* 

Th^se  are  the  issues  that  I  am  perfectly  willing  and  very very 
capable  of  arguing  within  the  Councils  of  the  College  Boara  and 
ETS.  I  aiifji^also  the  president  of  the  Illinois  Advisory  Committee  on 
Non-PublicNSchools  apd  represent  1^00  public  school^,  370,000  chil- 
dren, and  I  don't  want  the  Peder^  Government  too  involved  in 
education.  > 

I  do  not  waiit  a  school  board  sitting  in  Washington*  We/have  a 
,  very,. very  thoughtful  and.  a  verv  successful  relationship.ttetween 
'  thk  nonpublic  schools  and!  the  State  school  board  in  Ilfmpis,  and 
that  is  complicated  enough  for  us  in  educating^the  scnbol  board 
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and  making  sure  they  understand  the  rights  of  nonpublic  schools 
and,  therefore,  the  rights  of  the  students  in  those  8chOoJ[s  in  terms 
of  testing.  \ 

Mr.  GoOdlinq.  I  agree  wholeheartedly  with  what  you  said. 

Mr.  Geer.  It's  tinie  for  a  major*  revision  of  the  SAT.  You  Are 
perfectly  right  in  saying  the  system  that  the  SAT  replaced  in  the 
later  thirties,  6arly  forties  did  fibt  serve  American  education  and 
was  cleanly  discriminatory.  ^ 

The  SAT  was  designed  in  the  middle  thirties  and  is  an  instru- 
ment that  has  served  the  education  well,  but  is  no  longer,  in  my 
judgment,  the  kind  of  instrument  that  we  should  have  ifer  college 
admissions  and  for  placement. 

Mr.  GooDUNG.  Does  that  take  Federal  legislation? 

Mr.  Geer.  No;  it  certainly  should  be  possible  through  the  College 
Board  and  ETS  and  that  instrument  ^could  be  designed.  One  oiF  the 
things  that  Dr.  Howe  talked  about,  as  long  as  the  SAT  was  a 
totally  closed  and  stcret  instrunieiit,  students  didn't  even  receive 
their  scores  until  the  middle  sixties,  there  would  be  no  way  any- 
body would  have  access  or  understanding  of  SAT  '^eveft  question 
it. 

The  testing  and  issues,  the  fact  that  much  more  information  is 
now  available*  has  been  positive  on  the  question  of  whether  all  the 
questions  on  all  the  SAT's  should  be  published.  I  don't  know,  Every 
time  a  student  takes  a  SAT,  they  contribute  to  the  verification  and 
experimentation  with  valid  scores.  I  don't  know  how  many  thou- 
sands of  val;d  questions  ETS  has.  They  talk  about  having  24,  25,  26 
valid  versions  of  the  SAT.  My  guess  is  they  also  have  literally 
thousands  of  other  individual  questions  that  are  valid  and  I  am, 
having  served  on  the  Council  on  Entrance  Services,  a  little  uneasy. 

I  think  that  is  a  somewhat  definitive  argument.  I  wish  they 
would  talk  about  whether  that  examination  really  meets  the  needs 
of  Aiti'6rican  education.  In  my  judgment,  it  does  not  and  that  it[s  an 
instrument,  a  good  instrument,  an  interesting  instrument,  but  no 
longer  as  useful  as  it  was  in  1938,  1940,  when  it  was  designed. 

Mr.  GpODLiNfG.  I  am  sure  you  would  g^ree  with  me;  we  tried  to 
get  teachers  to  use  standardized  tes£s  as  a.  tybl  to  improve  their 
teaching,  to  help  young  people  with  their  shortcomings.  Again  I 
don't  believe  We  n#Bd  Federal  legislation.  '  * 

Chairman  Perkins.  Mr..  Weiss?  ^ 
•    Mr.  Wejiss.  Thank  you,  Mr.  Chairman.  ^  ^ 

I  happen  to  be.  one  of.  those  old-fashioned  people  who  thinks  that 
the  educational  process  ultimately  works.  On  the  othgr  hand;  hear- 
ing some  of  the  questions  froni  this  side  of  the  tal5le  and  some  of 
the  comments  after  the  days  and  days"^  hearings  that  we  have 
had  on  all  sides  of  this  issue,  I  tend  to  doubt  tny  own  judgments 
and  conclusions. 

Mr.  Geer,  you,  h^ve  beerfl  working  with  students.  What  is  your 
opinion  as  to  the  effectiveness  of  coaching  sessions? 

Mr.  Geer.  Well,  I  ftlluded  to  my  experience  in  Trenton  which 
involved  a  kind  of  coaching,  and  I  would  agree  that  you  have  to 
define  what  coaching  is.  T  thinlj  that  experience  with  the  SAT  is 
extremely  beneficial  to  a  student,  and  you  see  this  reflect  in  SAT 
scoring  matrix. 


They,  adjust  the  score  downward  every  time  a  student  takes  a 
test,  because  the  more  familiar  you  be^come  with  that  instrument 
the  better  your  scores  are  going  to  be.  You  haVe  to  look  at  sorne^- 
thiiig  like  the  SAT  which  is  a  modified  intelligence  test  and,  there-*, 
fore,  the  more  experience  you  have  with  that  particular  kind  of 
-  test  the  more  you  will  be  able  to  respond  to^it. 

Students  do  benefit  considerably  from  experience  with  tlj^t  test. 
Understanding  the  \yay  they  normally  opera^te  iii  schpoHs  not  the 
way  that  you  can  operate  on  that  test.  If  you  .  have  a  student  ^fi/)|^o 
reAds  a  reading  comprehension  pass,age  and  is  interested  in  under- 
I  standing  the  material  and  wants  to  find  the  right  answers^  that 
I  student  puts  himself  to  an  enormous  disadvantage  of  that  test. 
You  must  develop  the  capability  to  move  rapijflly  and  quickly  and 
^^ccurately  and  efficiently  from  item  to  item^  and  not  thinlcAabout ' 
^an  item  5  minutes  ag^r  that  you  may  have  missed  or.  you  may  be 
thinking  about.  There  are  special  kinds  of  concentration,  and  there 
'  are  special  kinds  of  mental  disciplines  that  are  necessary  for  the 
SAT.  .  ; .  .. 

Unfortunately,  they  are  not  the  kinds  of  mental  disciplines  that  I 
as  a  person  running' a. school  would  want  my  teachers  to  do  in  a 
normal  classroom*  They  are  contradictory  to  standard  classroom 
proceedings. 

Mr.  Weiss.  When  the  pamphlet  that  the  Educational  Testing 
'  Service  &|^nds  out  as  being  an  indication  that  all  you  have  to  do  is 
read  this  and  that  and  that  really  takes  the  place  of  the  coaching 
schools;  you  don't  agree  that  that  benefits  us? 
Mr.  Geer.  It  certainly  helps  us.  The  fact  that  a  student  can  take 
^  a  test  and  have  experience  with  the  pacing  and  the  timing  that  you 
have,  there  are  6  half-hour  sessions  on  that  t^st.  One  is  a  test  of 
standard  written  English.  Qne  of  th6m  isn^t  even  going  tp  be 
scored,  probably  three  match,  or  three  verbal,  and  how  a  student 
paces  himself,  moves  from  .section  tq  section  in  that  3-hour  period 
wwks  under  considerable  pressure. .  |* 

Mr.  Weiss.  Would  you  tell  your  students,  for  example,  who  are 
considering  taHing  any  of  thet  established  coaching  schools,  that  it 
would  be  a  waste  of  $275  if  they  took  that? 

Mr.  Geer.  No;  I  am  very,  very  uneasy  ^ibout  an  issue  that  Mr. 
•  Goodling  did  talk  about.  There  are  lots  of  unscrupulous  people  that 
T  prey  *on  students  and  parents  ai^  citizens  and  present  completely 
unprofessional  and^etrimental  experiences  in  programs  to  prepare 
students  for  iSATs,  and  I  am  opposed  to  that.  There  isVor^  that 
can  be  done,  experience  ^nd  practice,  familiarity  with  the  exam  for 
a  student  to  be  able  to  know  what  his  strengths  and^  weaknesses 
.  are.         '  -^^.^  ^  "    .    .  '  ' 

That  is  qjKicial  tha^  a  slftident  Know  when  he. can  take  a  reason- 
able choice  between  two  answere^r  when  \i  is  probably  a  waste  of 
•  ;time.  They  are  not  going  to  dd  very  well  in  that  i^ection,  so  ft  is  best 
to  cut  their  losses ^nd  moV&  dk  The, other  issue^witK  the  SAT  is 
the  fact  that  ttie  srudent  has  to  d^elop  the  skill  in  knowing  .wh^n 
/not^  answer  a  questioh,.  because  every  question  that  you  finswer 
V  and  get  wrong  redjices  by  a  quarter^sually  a  quarter,  reduees  the 
number  94£(uestion8  that  you  have  fifght,  so  a  student  mu^t  develop 
skills  in  knowing  when  it^s  reaaortablei,' when  thAy  hHve  a  good 


chance  of  getting  the.  question  right  and  when  they  are  doing 
themselves  a  disservice  to  ansvver  the  question. 

We  don't  teach  thdt  in  school.  You  don't  get  that  your  daily 
classroom  experience.  My  feeling  working  with  minority  students 
in  Trenton,  that  is  where  they^  killed  themselves.  They^were  duti- 
iful,  hard  working,  thoughtful,  'earnest  students.  They  would  start 
on  that  SAT  and  get  every  single'  question  right.  They  got  about 
two-thirds  of  the  test.  They  answered  questions  they  have  no  busi-. 
ness  answering.  They  had  a  terrible  time  not  answering  any  .  ques-  ^ 
tioh,  because  they  felt  it  was  an  irftult  to  their  intelligence. 
.  How  could  they  give  me  a. test?  I  am  a  good  student  and  work 
hard  and  if  I  don't  apswer  this  I  am  somehow  paying  spitiething 
about  myself?  All  of  the  qualities  that  made  them  superb  high 
school  students  destroyed|fl^|L-on  the  SAT.  They  had  Xp  "practice 
and  go  through  the  expeiwhce^f^hat  is  that  instrument  like,  how 
is  it  scored,  .and  the  studBi^j^na  did  that,  worked  through  that, 
their  scores  increased  inCrecli|yy|r  m 

There  were  some  studerits^^^oin.  that  kind  of  practice  never 
made  any  difference  •  iijfi^  theii\scores  at  all.  You  do  need  in  my 
experience  to  have  somebody  that  can  lead  you  through.  Some  very 
bright  students  can  pick  nip  that  practice  book  and  you  have  the 
explanation  of  the  questions,  the  scoring  explanations  in  that  SAT 
book  which  are  materials  that  the  Cofiege  Board  has  never  ^pro- 
duced before  and  is  extraordinarily  useful. 

It's  H  beginning,  but  I  would  like  to  see  a  lot  more  information 
like  that.  I  would  like  to  see  the  College  .Board  put  out  a  book  with 
three  or  four  SAT's  in  it  with  the  kind  of  explanatory  information 
they  began  to  put  in  the  book. 

Mr.  Weiss.  Thank  you  very  much. 

First  of  all,  let  me  commend  you.  pn  the  presentation  you 
made.  Listening  to  you  it  was  hard  to  acknowledge  and  recognize 
the  fact  that  you  are  indeed  a  high  school  student.  You  were  one  of 
the  best  and  most  self-assured  witnesses- that. we  have^had,  not  only 
in  this  hearing  but  in  Jthe  hearings  that  I  have  sat  through  oyer  the 
course  of  these  past  3  years  or  so,  and  I  want  to  thank  youior  your 
testimony  as  well.  '  """"^ 

I  want  to  start  off  with  a  comment  that  Mr.  Goodllog  made,  if 
you  want  to  take  a  trip  to  the  ETS  Center  at  Princeton^  you  mighP 
indeed  find  it  interesting.  I  acconipanied  him^  on  that  trip,  and  I 
found  a  300  or  400  acre,  very  modern  center,  with  a  model,  mW 
modern  imaginable,  very  nice.  They  hava  a  mail  order  system^ 
whifch  makes  a  working  politician's  .mouth^ater,  because  I  would 
love  to  be  able  to  have  that  kind  of  eapacitj^.  - 

Mr.  Drexeler.  Not  only  ani  I  going  to  go,  but  our  student  gov- 
ernment is  going  to  sponsor  a  field  trip  to  look  at  this.  ^ 

Mr.  Weiss.  Don't  expect  that  that  is  going  to  one  way  or  the 
other  tell  you  how  the  system  works.  It's  a  value  judgment. 

Let  me  ask, you  as  to  the  coaching  schools,  hoNv  large  is'your 
.  senior  class?  '  ' 

Mr.  Drexeler.  My  sfenior  plass  is  about  350  students. 

Mr;  Weiss.  Whaf^ercentage  of  those  students  do  you  think  have  * 
been  or  are  taking  any  of  the  ^coaching  courses  Ihat  you  referred  to 
thatyou.afQ. taking?^    '  ,  ;  ** 


Mr.  D^xeleraI  would  say  probably^,  about  one-third,  but  beingi^ 
from  Gr^t  Neck,  whicli  is  reputed  as  a  \#ry  affluent  community, 
to  be  able  to  taHe  a  fcourse  like  Kaplan  is  much  more  easily 
afforded  ^an  in  a  conltnunity  whioh  is  not  as  afflufent,  and  that 
puts  the  students  in  Great  Neck  who  can  take  it  at  a  big  advan- 
tage: •  ^  ofr    ^  ' 

Mr.  Weiss.  Dr.  Bond,  in  the  course  of  the  testimony  today  and  in 
the  course  of  testimony  on  this  ^legislation  throughout  the  past  five 
or-sfic  hearings  that  we  have  held,  J  keep  leafing  commeftts  about 
^wha^.is  really  required  is  improvement  to  the  basic  educational 
p|bclss. 

1  tnin,k  you  addressed  yourself  to  that.  I  have  no  fault  to  find 
with  that  as  being  the  major  thrust,  but  focusing  on  improN^ng  the 
educational  process^dpes  that  preclude^ fakirjg  other  steps  like  re- 
forming the  proces^^  the  standard  aptitude  tests  that  are  given? 

Isn't' the  arguJJkent  that  we  hear  about  really  the  problems,  one 
of  continuing  education  very  much  like  the  argument  we  used  to 
hear  before  the  Supreme  Court  decision  in  1954,  that  separate  but 
equal  is  OK?  , 

That  is  not  the  problem.  The  problem  is  improving  education. 

Dr.  Bond.  Exactly,  and  the  country  is  still  desegregated.  You  are 
absolutely  right  that,  yes,  there  are  other  things  that  t:an  be  done. 
My  concern,  however,  is  with  the  notion  that  item  disclosure  will 
somehow  result  in  lessening,  if  you  will,  of  the  consistency  91^ 
standard  deviation,  the  differences  that  wfe  find.  * '  \ 

I  predict  that  if  there  will  be  any  change  in  th^  consistent 
difference,  it  will  tend  to  increase  any 'percent.  My  pef'sonal  opin- 
ion is  that  those  who  will  benefit  from  this  particular  s^^tion  of  the 
bill  will  typically  not  be  black  students.  T]  ■ 

I  think  the  basic  notion  that,  oh,  I  got  this  one  wrong,  and  the 
reial  answer  was  No.  5.  If  it  does  not  involve  concomitant  construc- 
tion in  the  underlying  principles  of  that  right  answer,  that'  is  kind 
of  a  superficial  exercise. 

J  would  like  to  comment  briefly,  if  I  may,  on  Mr.  Geer's  testimo- 
nx,  which  I  found  rather  enlightening.  I  hkve  also  had  other  in- 
stances at  the  University  of  Pittsburgh  where  that  has  occurred 
which  tiends'to  protect  the  rights  of  students,  \ 

I  have  seen  this  happen  in  the  past,  and  I  cannot  be  in  any  more 
agreement.  ' 

Regarding  the  deficiencies  in  multiple  choice  testing,  I  would 
agree  that  there  are 'certain  pressures  and  certain  problems  in- 
volved in  multiple  chqice  testing  which  are,  for  example,  dismissed 
or  obviated  when  you  consider  onen-end  questions,  where  the  stu- 
dent actually  has  to  provide  tMfe  right  answer. 

It  is  this  kind  of  thingjthat  I  am  talking  about  when  I  say,  OK, 
let's  go  to  open-ended  quistions.  I  don't  believe  that  will  solve  the 
problem  either,  at  least -technical  problems  will  not  solve  the  fun- 
damental causal  agent  here.  \^ 

I  am  currently  involved  ii)  research  which  involves  an  alterna- 
tive to  miiltiple  choice,  dichotomously  scored  items..  It  essentially 
involves  the  idea  that  students 'Shpul4  get  partial  credit  for  any 
information  they*  have  regarding  a  particular  item.  '  ♦  " 

"  i  would  be  glad  to  send  that  reseiarc|i  to  the  committee. 
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•  Mr.*  Weiss.  Dr.  Cahow,  isn't  your  experience  that  earlier  on  wher 
we  have  a  situation  like  that  which  Mr)  Fofd  referred  to  and  the^^e 
seemed  to  be  so  many  more^people  applying  for  admission  to  col- 
leges and  universities,  that  he  said  at  that  time  perhaps  Ihe  tests 
were  used  to  keep  people  out  because  tKey  had  to  have  some  of 
doing  that? 

Is  it  your  experience  that  perhaps  thje  tests  were  used  that  waj 
or  10  years  ago? 

Dr.  CAHOvy.  I  cannot  ^sume  that  that  has  not  been  the  case  in 
institutions  where  pressures  were  severe  for  admission,  but  I  don't 
know  of  any  cases,  but  perhaps  there  could  have  been  an  overem- 
phasis on  the  scares. 

Mr.  Weiss.  You  commented  in  the  course  pf  y6ur  testimony  on 
Dr.  Keller's  earlieA  testimony  as  to  the  norms  used  in  relation  to 
distinctions  between  male  and  female  and  scoring  them  separately, 
and  that  noting  at  the  admitting  schpols  as  to  what  was  happening. 

*  Do  you  think  that  ought  to  havje  been  done  in  relation  to  other 
*areas  of  differences,  be  it  race,  etjinicity,  or  geographical  differ- 
ences, rural  versus  urban^differences? 

Dr.  Cahow.  Yes,  I  do.  ,         -  n 

Duke,  along  with  the  consortium  of  schools,  have  been  asking  for 
this  information  for  several  years  because  we  think  it  is  critical  to 
our  marketing  routine" to  discover  where  these  students  are  that  we 
think  can- benefit  from  our  school. 

The  question,  who  owns  the  data?  ETA  takes  the  position  .that 
the  test  score  belongs  to  the  student  and  is  released  ^o  an  institu- 
tion upon  permission  by  the  student  and*  may  not  be  released  to 
the  outs  ide  world  and  ETS  cannot  release  it  to  the  outside  world. 

I  havii  reason  to  believe  because  of  my  conversations  with  the 
college  board  and  at  ETS  that  they  probably  could  release  the  data. 
They  haye  been  reticent  to  do  so  because  of  the  incorrect  interpre- 
tations that^might  be  m^de  because  lower  scores  are  achieved  by 
one  ethnic  group  than  a  nonethnic/group. 

^  Mr.  Weiss.  According  to  Dr.  Keller's  testimony,  if  I  understood  it 
correctly,  what  he  was  .saying  with  regard  to  the  GRE  was  that 
there  is  in  fact  a  skewing  done,  there  is  art  additional  credit  given 
to  men  because  they  are  not  expected  to  do  as  well  on  the  basis  of 
past  experience  on  the  verbal  part  of  the  test  and  that  therefore  in 
essence  the  men  get  an  advantage  because  they  have  a  certain 
position  given  to  them  within  the  test  scores. 

That  seems  not  to  have  required  anybody's  approval.  Why  should 
it  require  anybody's  approval  to'  do  anything  in  the  other  areas  of 
differentiation?  •  ^         f  ^ 

Dr.  Cahow.  The  men's  scores  are  based  on  the  men's  norm  and 
the  women's  scores  based  on  the  women's  norm.  So  there  is  not  any 
skewing  to  give  men  or  wo^en  an  advantage  or  disadvantage.  You 
iare  merely  comparing  men's  scores  with  all  other  men^s  scores  so 
yoil  can  see  where  he  ranks. 

^  I  don't  believe  it  would  require  ETS  to  get  any  kind  o£  special 
clearance  to  release  this  information  in  aggregate,  I  thinR  it  cer- 
tainly would  for  an  individual  student's  scores.  to\be  released. 

The  information  that  is  released  on  the  GRE  is  aggregate  infor- 
mation. I  don't  think  we^  are  breaking  any^  laws  if  ETS  decided  to 
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do  tl^i^  in  terms  of  linguistic  Jaackground  or  economic  background 
£1$  Dr-'^eller  asked;  ^  •  / 

lAr.  Weiss.  Dr.  Clawsoh,  do  you  know  how  long  the  olAMGAT 
tesfe  were  in  effect?  How  long  iver^  th6  old  MCAT  tests  usecl  before 
the  new  onfes  were  created?      ,       '  /     •  * 

Dr.  Clawsqk.  16  years.  They  were  not  in 'effect  when  I-  wenlrto^ 
./  miBdical  school.  They  were  put  in  subsequently,  but  they  were  in 
i  effect  for  many  years.      -  *  •  v 

Mr.  Weiss.  I  asgunle  that  since  the  new  phes  have  only  been  in 
effect  since  1977i  that  ;-eally  it  Sb  too  early  to  tell  as  to  whether  in 
fact  the^  will  or  will  not  prove  out  to  be  any,  judged  to  be  any 
better  or  any  more  valid  by  eveiir.the  medical  college  community 
than  the  old  MCAT? 

Dr.  Clawson.  I  think  it  depends  entirely  on  whether  the  test  is 
.  used  appropriately  or  riiisused;  Almost  everything  I  have  been 
hearing  in  the'  testimony  this  morning  are  misuses  of  tests.  If  it  is 
>-imisused  and  if  it  is  thought  that  it  will  be  thCskey  predictor  in  the 
Success  of  a<^person  going  into  medicine,  then  it  is  going  to  not  be  a 
good  test. 

Tlie  only  bask"  thing  that  went  into  it  was  a  conceptual  one  in 
which  it  involvai  some  150  faculty  and  students.  I  might  say  the 
organization  of  student  representatives  worked  and  had  great  input 
into  the  construction' of  the  new  test.  In  the  past  the  concept  was 
that  you  tested  in  copsiderable  depth  in  the  subjects  that  >«efe 
being  tested. 

The  concept  of  the  new  MCAT  is  that  you  limit  it, to  very  specific 
types  of  coursei^vthat  is,  the  courses  that  would  normally  be  taught 
in  the'^flrst  ye&r  of  college  jsmd  the  questions  were  selected  by 
student  faculty  panels  as  being  the  best  questions. 

It  does ^not,  though,  ajm  to  be  the  predictor,  if  you  will,  in  terms 
of  who  is  going  to  be  a  gopd  physician.  I  think  that  is  quite  clear. 
Thaii  is  not  the  poinLof  it.  It  is  tdihave  ain  objective  measurement 
t6  >^  able  to  better  equate  the  grade*  point  averageib  that  students 
are  presenting  toVpu  wfien  you  come  in  with  the  studejnt's  ability 
in  those  courses  that  we  are  testing  in. 

That  is  the  point  o£  it.  The  grade  point  average  has  got  to  be 
looked  at  as  variable,  depending  upon  the  college  that  the  person 
goes  to.  It  is  not  an  absolute  term  at  all.  This  is,  I  think,  the  great 
"atdvantagejjf  the  MCAT  and  the  new  formula.  ^ 

Mr.  WeisSb.  You  -torrectjne^ifJLa^  wrong-^there  is  not  Just  one 
single  hew  forni,  is  there?  There  musti)e  a-swies  of  new  forms.  It 
is  not  just  Dne  test  of  15!)  items  orf  questions.  TherelnuStije^a  ha 
dozen  new  forms  of  ISp^questicjps,  I  would  assum6. 

Dr.  Clav^c^.  Thrfe  are  far  m^e  questions  than  *1 50.  The  150 
were  the  ones  workw  on  by  the  people  putting  the  test  together. 
Therelire  far  more  t^:  thai)  that,  but  not  the  exhauistive  school. 
It  is  not  large  enough  to  prevent  the  students  from  memorizing  the 
answers.  ^  • 

Mr.  Weiss.  Suppose  you  relate  it  to  what  happens  to  those  tests 
and  the  experience  that  they  had'at  his  high  school  in  the  course  of 
1  year.  Is  there  any  reiison  to  believe  that  in  fact^there  will  not  be 
people  sent  in  by  the  lao-called' cram  sdhopls^  who  give  courses  on 
MCAT  to  memorize  tl^ose  questions,  that  there  will  not  be  m- 


stances  where  inadvertently  or  unintentionally  ^(tme  of  those  forms 
will  end  up  reaching  the  outside  world?        '  ' 

What  shapp^ned  in  those  instances,  assuming  that  those  are  real 
^possibilities? 

J)r. .  Claw§on.  That  is  a  possibility- that  concerns  all  of  us,  not. 
only  a^rpossifeility  but-^  probability  that  that  will  happen,  I  think 
\ye  have  td  leave  it  to  the  board  of  MCAT  to  be  sure  that  they  can 
over  time  adjust  the  questions  enough  over  time  so  as  to  get  some 
Jeyel  of  predictability  as  to  the  degree  of  what  is  happening. 

•  I  have  great  faith  in  that  particular  testing  institution  as  being 
totally  fair,  trying  very  hare}  to  look  out  for  the  student's  interests 
Jas  well  as  getting  a  standardized  school.  * 

•  I  am  sure  th^t  questions  Will  be  changed  on  an  annual  basis.  But 
I  think  the  testimony  here  of  Mr.  Bond  is,  to  me,  strikes  home.  It 

stakes  too. long  to  put  together  a  whole  new  test.  That  is  why  we. 
want  to  be  able  to  use  questions  over  again,  but  we  will  use  them 
in  different  pattern^. 

Mr.  Weiss.  Of  course,  you  know  that  the  testimony  that  we  have 
received  from  the  American  College  Testing  Service,  for  example, 
which  I  think  oprepares  the  MCAT,  stated  that  on  their  college 
admissions  not  the  medical  (jollege  admissions,  but  that  they,  I 
Xhink  four  out  of  five  sections  on  any  particular  test  are  composed 
of  100  percent  brand  new  questions  and,  therefore,  overall  80  per- 
cent of  their  questions  on  any  particular  t^t  given  are  in  fact  new 
questions.  So  that  I  am  not  sure  that  in  fact  it  is- that  kind  of  a 
burden. 

But  my  question  to  you  is:  I£in  fact  it  is  reasonable  to  pursue  the 
kind  of  thing  Kenneth  was  testifying  to  will  occur  with  the  medical 
college  test  as  well  as  the  others,  aren't  you  in  fact  giving  an 
advai^tage  automatically  to  those  students  who  can  afford  to  go  to 
the  cram  schools  to  the  disadvantage  of  those  students  who  cannot 
afford  to  go  to  the  cram  schools? 

Dr.  Clawson.  Yqu  are  bringing  up  an  issue  that  is  really  rather 
foreign  to  me  where  I  happen  to  be  working. 

Well,  different  courses,  if  you  want  to  call  them  cram  courses,  or 
that,  to  .any  student  who  comes  to  us  who  wants  to  spend  the  time 
and  efforts.  ,  V 

We  have  faculty  that  hire  to  Work  with  groups  that  feel  for 
whatever  reason  they  may  be  underprivileged.  We  do  give  courses 
for  any  student  that  wants  to  come  to  us  on  test  taking  on  how  to 
take  standardized  tests.  It  is  an  open  thing.  It  is  not  an  expensive 
thing.         .     \        '  . 

So  in  my  area  of  the  country  I  do  not  hear  this  as  being  a  great 
problem.  We  have  ah  open  door  policy  and  we  will  help  students 
who  want  ta  prepare  themselves  to  take  the  MCAT  tests.  We  put 
on  night. courses  and  do  everything  to  open  it.  . 

So  this  is  something  that  I  must  say  I  had  heard  about,  heard 
about  in  particular  sections  of  the  country.  It  is  not  a  big  problem 
for  usl  The  answer  is  clearly,  if  the  school-  that  a  student  is  apply- 
ing tolputs  tremendous  weight  upon  the  MCAT  t^st,  yhiph  ours 
does  n6t  unless  there  are  other  factors  ^hat  make  us  want^to  look 
at  it  in  great' depth,  then  students  are  going  to  try  to  take  any 
advantage  they  can  of  anything  in  order  to  make  ^heir  MOAT^ 
better. 
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So  I  think  you  have  Set  something  in  motion  and  I  don't  think 
that  the  bill  and  the  release  of  tne  questions  as  such  is  going  to 
really  be  of  that  much  benefit  to  the  ^tudents  over  the  opportunity 
to  work  with  faculty  to  help  them  develop  the  skills  necessary  for 
both' taking  the  test  and  Answering  the  questions. 

Mr.  Wfiiss.  Mr.  Gastfriend,  did  you  want  to  comment? 
.    Mr.  Gastfriend.  Yes.         J     Ji  ^ 

First  of  all,  I  think  again  it  is  to  Efr.  Clawson's  credit  and  to  the 
credit  of^  his  school  that  he  can  say  these  kinds  of  things  about  his 
medical  fcollege. 

I  think  that  by  and  large  that  is  in^the  minority  of  medical 
school  setups.  I  want  to  point  out  that  what  I  was  quoting  about 
our  position  about,  the  MCAl"  I  had  taken  from  an  AAMC  press 
release  quoting  from  John  A.  D.  Cooper:  "The  t^sts  are  essential. 
They  are  designed  to  predict  how  well  student  wHH)erform  in 
medical  school  and  later  as  a  practicing  physician." 

Mr.  Weiss.  Indeed  that  press  release  was  sent  to  us  on  the  first 
day  of  the  hearing. 

Mr.  Gastfriend.  OK;  . 

Another  thing  I  want  to  point  out  as  to  preparation,  the  national 
board  exams  which'  are  given  to  medical  students  and  postgraduate 
training  physicians  issue  a  series  of  tests  in  subject  areas. 

They  also  issue  what  spme  schools  call  a  miniboard  prior  to  the 
tests  which  are  given  after  2.  years  of  medjical  school.  These  tests 
are  very  commonly  used  for  the  purpose  oif  preparing  the  medicSal 
schoors  sophomore  class  to^  take  the  boards.  They  are;  given  4 
weeks,  in  advance  and  scored  quickly  and,  given  back  to  the  stu- 
dents and  they  use  this  to  practice  the  testing  situation. 

So  I  think  medical  schools  at  least  are  well  aware  of  the  need  of 
preparation  and  learning  the  system  of  test  taking. 

The  last  thing  I  should  mention,  I  am  sorry  Mr.  Goodling  is  not 
here,  being  from  Pennsylvania,  but  last  week  in  the  Pennsylvania 
State  Senate  a  bill  similar  to  the  New  York  one  I  am  told  was 
introduced  with  10  out  of  18  members  of  the  education  committee 
cosponsoring\  the  bill.  I 

Mr.  WEiss.jThank  you,  Mr.  Chairman. 

Chairman  rERKiNS.  Mr.  Andrews? 

Mr.  Andrews.  Thank  you,  Mr.  Chairman. 

Obviously,  the  hour  is  quite  late  arid  the  .  subject  very  complex.  I 
would  jiist  comment,  first  of  all,  that  I  have  been  tremendously 
impressed  an3  confused  by  the  opinions  that  the  witnesses  we  have 
had  today  and  numbers  of  those  we  have  had  previously  exhibit  in 
my  estimation,  both  tremendous  comprehension  of  the  subject  and  . 
in-deptn^^ommitment  to  hold  it  as  it  is  and  the  best  intere8t&  of 
what  they  consider^  to  be  the  right  perspective  or  to  change  it  for 
the  same  reason.  ^ 

And  to  try  to,  as  a  member  of  the  committee,  look  upon  this  in  a 
rather  judiciaf  way,  having  a  great  deal  of  respect  for  the  people's 
ability  and  their  motivations,  £(nd  then  to  have  to  decide  on  one 
side  or  the  other  when  they  differ  sO  •extensively  is  quite  difficult 
for  *me,  knowing  less'  about  it  probabR  than  any  witness  herJ: 

But  I  can't  help  but  conclude  that,  as  isl  the  case  with  most 
l(BgisIation,cthat  apparently  whether  the  given  witness  cohelupes 
that  thii^  is  a  good  biiror  whether  it  is  not  doesn't  seem  therefore 
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tb  rest  upon  the  irtftn-mation  the  various' witnessies  have  or  thei;* 
.commitments  to  whaiis  right,  but  rather  the  perspective  they  have 
as  to  what  the  mission  of  the  school  is.  ,  V 

Now  that  i§  the  only  conclusion  I  can  come  to.  It  seems  that  each 
has  a  perspective,  depeitding  upon  where  that  person  comies  from. 
One  group  seems  to  see  the  mission  of  the  schopl  as  having  a  social 
beneHt.  But  what  soqal  benefit  can  the  school  give  to  society  as  a 
whole?  . 

Other  witnesses  seem  to  think  theft  the  primary  mission  should 
be  the  civil  rights  of  applicants  for  admission  to  a  given  school. 

Others  don't  seem  to  think  it  is  a  matter  necessarily  of  civil 
rights  in  terms  of  neciessarily  wm)  can  score  the  best  and  by  the 
fairness  measurement,  but  rather  if  they  are  minorities  or  women 
or  not,  et  cetera. 

But  I  can-t  but  go  back  to  mf  own  experience  just  as  I  think 
most  witnesses  go  back  to  theirs.  The  only  mention  that  has  been 
ipade  just  in  passing  that  relates  to  my  own  was  riiade  by  Dr.  / 
Clawson  when  she,  I  think,  just  parenthetically  said  that  a  certain,  f 
number  of  years  ago  it  was  determined  that  in  eastern  Tennessee 
more  doctors  were  needed  ajid  that  is  why  the  medical  school  was 
iestablished  in  the  first  place. 

^  In  my  experience  which  with  this  subject  is  rather  brifef,  but  as  a 
member  of  the  North  Carolina  Legislature,  I  can  remember  so  well 
the  fight  as  to  whether  there  should  be  a  medical  school  added  at 
east  Carolina  because  doctors  were  iieeded  in  eastern  North  Caroli- 
na, the  more  rural  areas  rather  than  in  the  Piedmont.  Hence,  you 
should  geographically  have  a  school  in  the  east. 

I  can  well  remember  th^  fight  to  double  the  entrance  to  the 
medical  school  at  Chapel  Hill  because,  as  you  say,  it  was  conceived 
that  more  doctors  were  needed  generally  back  then  which  was  in 
the  sixties. 

So  I  can't  but  conceive  that  the  schools  basically— I  think  that  all 
perspectives  here  are  valid  and  they  should  all  be  considered.  The 
schools  are  publicly  si^pported,  Individual  members  of  the  publifc, 
be  they  students^ or  parents  or  whomever,  have  a  legitimate,  I 
think,  rrght — and  I  agree  with  that. 

The  total  distribution  can't  just  be  the  school  or  the  need  for 
doctors  in  a  given  area:.  But  I  still  think  that  has  to  be  paramount. 
I  think  that  is  really  what  the  schools  are  paid  for  primarily  by  the 
l)ublic  to  accomplish  and  that  ^  to  afford  doctors  or  lawyers  or 
whatever,  the  social  workers  or  whatever  is  sought  to  be  accom- 
plished ultimately,  or  people  who  are  trained,  not  necessarily  the^ 
civil  rights  of  those  to  be  trained.  \ 

I  dor\'fr  say  that  is  not  important.  I  think  it  is  a  legitimate^ 
^Conce^ilABut^  don't  think  that  is  the  end  unto  itself.  That  is  not  to* 
say  it  should  hot  be  given  due  and  fair  consideration,  but  I  believe 
tr^  real  objective  ultimately,  not  the  only  one  but  the  principal 
one,  is  that  the  schools^  should  produce  for  the  community  not 
;  necessarily  social  improvement  or  %  civil  rights  but  instead  the  mis- 
sion of  the  schools!  think  primarily  is  to  produce  people  who  in 
•  turn  <;an  produce  whatever  goods*  or. services  are  desired  and  hence 
'  t^at  is  why  the  school  was  established. 

';  Frdjn  thatpoint  I  have  to  be  tremendously  influenced  bv  the  fact 
/  tlji^t  fhe  schools,  tl^ien,  I  would  think,, should  themselves  dfitermiiie 
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.  whether  tests  should  be  given  and  under  what  circumstances  and 
whether  they  ^oiild  made  public  and  to  what  extent,  if- any, 
they  shbuld  be  made  a  criteria  in  the  determination  as  to  whether 
a  given  applicant  i^hould  bie  enrolled. 

If  that  is  the  case,  I  don't  see  how  that  the  Congresi^  as  repre- 
sentatives of  a  total  public  can  fairly  or  adequately^-and  I  as  a  ; 
member  give  due  and  equal  Consideration  to  student  rights,-eivil 
rights,  social  qh^&ige  in  terms  of  minorities,  and  all  the  other  many 
things  that  we  as  Members  of  Congress  are  supposed  to  be  account- 
/able  for. 

I  think  instead  we  have  to  consider  that  we  are  basically  dealing 
with  schools  and  it  just  seems  to  me  that,  therefore,  the  resolution 
pf  this  problem  has  to  primarily  rest,  thierefore,  with  the  schools- 
tather  than  to  be  usurped  by  we,  the  ret>resentatives  of  the  total 
^  public. 

That  is  about  as  good  a  way  as  I  can  describe  thje  situation  in  a 
short  time,  felt  som^  obligation  to  attempt  to  enunciate  the  Way  I 
felt  about  it.  *       .  S 

Thank  you. 

.  Chairman  Perkins.  Let  me  thank  all  of  you  distinguished  wit- 
nesses for  y|ur  appearance  here  today.  I  know  that  this  is  very 
controversial  and  it  is  receiving  considerable  thought  from  the 
committee  and  it  will  continue  to  receive  considerable  thought.^ 
'  But  you  have  been  mogt  helpful  and  I  hope  that  we  can^ome  to 
the  right  conclusion  when  we  do  commence  to  mark  up  the  legisla- 
tion. You  have  been  most  l^elpfuL  I  appreciate  your  coming. 

Mr.  Weiss?  '  "      .  ■ 

Mr.  Wbsss.  Thank  you,  Mr.  Chairman. 

I  would  simply  lite  to  ask  unanimous  consent  to  have  entered  in 
the  record  an  article  that  was  referred  to  in  an  earlier  hearing. 
This  is  by  Dr.  Michael  Wallach  of  Duke  University. 

Chairman  Perkins.  Without  objection  the  article  will  be  entered 
into  the  record.  *     .  — 

[The  information  referred  to  above  follows:]  • 
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Michael  A.  3Vaiiach       Tests  Tell  Us  Little  about  Talent 


.Although  measures  of  academi^^ills  are  widely 
used  to  determine  access\o,tonLest^^ducational 
jP^^'^  opportunities,  especially  in  their  uppc*;  ro>?</r.s  they  . 

w//  {    r'^^  r^f^cf^  utility  for  predictinj!  professional  'achievement  /i 


QuoliLy  ecfncfttioniil  rc^uurccs  nre 
an  iiievilahly  Rcarre,  ctiinmtKUty^, 
and  t)io  dccisiunf;  a^  to  uliich  younK 
men  and  wv.  ten  will  gjiii  admi<isinn 
to  highly  I  ('Carded  rollcK^ii  and.iini' 
vrrHities  and  ipccivc  Mhuiai^hips  ur 
fpiltm'^hj)  Vwhdc  tlipy  ure  there  ore 
difficull  ones.  HowRlionld  these  de- 
ci!;iV>u«  he  nuidc?  The  relative  merit 
of  candidnles  ix  the  usu'ul  criterion, 
but  the  d(>rniition  of  r.erit  is.  prub* 
leinalir.  Typically,  "merit  *  is  do* 
fined  OS  scores  on  lesl&  of  intcllet  tii- 
al  abihtieK  and  yjtdts  in  the  Ciis< 
Comary  types  of  aiMdemic  cottrKe 
urk.  which  ihemnelvcH  are  usually 
eternn'ned  liy  snme  kind  uf  Icsl. 


or  course,  test  i^coreR  and  cnidcfi  nric 
not  indices  of  4nerlt  in  their  iiwn 
right;  they  are  .it<  iij;lil  tu  prmide  a 
shorthund  indii.tUitn  uf  a  &tudi'nt*R 
rompelencics  in  the  world  outride 
testing  and  clas$r(Htin  iiitliatiuni». 
Keren t  rcsrar^h  oi»  the^  nature  of 
(alrnt  indicut  .  however,  that  Ihe 
premise  that  la  -eilcct  the  puien- 
lial  for  nchii  v-n  ei^t  is  luUv  fur . 
scores  aerosK  the  jpper  piirt  uf  the 
range  on  customary  aske^iAr.ients  of 


Mhrharl  A.  Walforh  i«  Vrofrnor  of.PfyyUol-^ 
ffy  at  thihr  tlm"rr^t  y.  tit  hot  oho  htid 
ftxtuUy  pitMtiuuM  rt  llatvotd,  MlV,  oml  thf 
UnifrrtHy  fif  Vhi»  x»  Hr  Hid  htt  under-- 
graduair  uKtk  at  .*M»off*Mnofr  oMrf  m  o  //o'r 
twd  t'h  I)  ttr  Uni/ni/i.  uhu  t»rfcd  at  rdi- 
ti>^  i'f  Ihr  Jiiurn^  uf  Hifrwtiuttly  ff»i»» 
t9l^t-72,  ii  0  iMtf^prrmtdfiit  of  thf  Itiv^iofi 
i>n  t*iVrh>U»Ht\  «»k/  lA.Mr*<  the  Ati},  'u  uii 
t'^\(h>'ftiilital  Aumtvltmi.  Un  m  war</i  hot 
tnthdtd  thr  ilutfy  ii'Xt/trfi-ii- 
tirt,  lah'tils,  mud  id  cKtUrvn  nttd 

fduU^.  Htth  tK%ttu  ut'ir  irfcrrHc^tt  iMptna- 
It»¥l0  ft>r  ti*iitntrtthl  rdutolitnttlt  $>t»hni-i'  tmd 
|ff#rl|rr«.  Ur  i*»  ct^^ulhor  uf  o  ati^k  ttt  t  vnt' 
f»fA%otiiry  rdtootont,  'l>«i:ittit|;  Al)  Chililreil 
bt  lUiiJ,  if  /(fV7i  '>*■  tuihhJtrd  III  idr/y 

lUTtihythr  thiurrtllyttf('huajtiit'rt'h».  AH' 
Itcikittmcnt   tif  I'ixrhtifti^y,'  fhkf 


academic  kkilU>~preciKely  Uiat  part 
uf  thrir  range  in  which  Mich  i^corcR 
are  most  oflen  used  for  seleclir.^  re- 
cipienia  of  the  most  cnnle^ted  edu- 
cati(mal  «i»portui>itips.  The  answer 
ia  nm,  a%  I  and  fiume  others  f\ni 
thought,  lit  ^feplacc  ie^ia  aimed  al 
awseKsiiig  academic  skills  with  tesls 
that  would  reflect  a  |>er$)(Mrs  "cfe»< 
tivity";  rather,  tests  should  be  uiird 
oiijy  t(-  Rcreen  out  candidate);  who 
M'ore  luu  low.  1\t  make  diKtinelinnK 
amonK  l*ie  candidatrs  who  reinniii. 
we  f^hould  rely  nut  oh  te^li^  hut  on- 
KumpK-H  of  prufessiunal  cumpcieu- 
cie£  themftclvea.  ' 

Uiseuchantinent  wilh  the  utility  uf 
teKls  in  their  upper  rallge^  for  nfe- 
(lictmg  the  fiuught'fur  rompet"Ocie9 
i*}  not  limited  to  the  study  of  talent 
but  has  bee>k  increasing  nmuiv,  imK.t 
pfiychologLsts  \,  ho  nttt^mpl  to  device 
wa>'s  of  iiK^essing  human  behavior. 
M'raditionally.  after  ti.eorizing 
ohuul  the  relatively  ah<:tract  dispn- 
sitiun*<  !hn;  presumnlily  underlie 
the  di<;pl»y  uf.the  belinvior.  the  psy- 
chologist attempts  tc  develop  leMx 
that  would  i;igttal  tht'  pperatron  of 
these  dir;pt»5;itions.  Sirnl^  the-  con- 
nection from' lest  to  criteiion  is  me- 

'  diatod  by  complex  theorcticajLcon- 
atruclions,  the  former  need  ftave 
nothing  in  common  hchavinrally 
with jt he  latter.  A  psychtilogi.  t  could 
try  to  cvahiule  the  chancex  that  a 
pnrticulni  therapeutii  trenlmeill 
would  Buci'eed  with  a  subject  by 
Koinethiitg  qh  tnirehited  i\h  the  way 
in  whlMi  (he  hul/jeet  cnViiplcled  i^n- 

^terux  Meinf^  or  interpreted  tiilibigu* 
ous  pictures 

With  enough  negative  evidence  in 
hand  fi^nn  atteippla  uf  that  surt.  we 
DOW  knew  (he*  e.g.  Mischel  VJT2) 
that  i^ore  reliable  nm^wem  afe  pro- 
vided  by  afisensing  what  thn  subject 


dues  in  a  aample  ofMhr  treatment 
tdlgatioii  itself.  The  pYohlem  is  that 
the  test  responses,  even  if  they  |k>s- 
^ss  a  miidicum  of  "ciilerion  valid- 
ily"r— that  is,  give  resuha"  t>ettor 
than  Vlunce  at  predicting  the  be. 
havior  of  direct  inler^t — inevitr.oly 
renc*ct  other  foctors^  a%  well  'see 
WallHch  I971fl;  VVallach  anu 
Ix'ggett  1977).  And  the  greater  t*  .e  ." 
conceptual  distance  ^'****ft^n  ihr 
test  and  the  performarico  lu  be  pt^ 
Hii'ted.  the  less  rvrson  th^re  is  'a* 
.l><>lieVL'  that  the  test  will  *oU 
«dial  you  really  want  to  knuw.  It 
will  tell  you  about  the  pers<in's  la- 
tponfie  tendencies  in  situations  ihnt 
pesemble  the  lest  rather  than  in  «'ii-  . 
vations  that  resemble  the  eriierion. 

Academic^kills  tests  " 

Ahovc  inle/inedrale  score  leveU.  ac- 
.  adernic  skills  aAses<:ment5  are  found 
(b  hhow  su  little  criterion  validity  at 
tii  he  quesliorinblt!  bases  on  which 
tr  make-  consequenlinl  dectsiont 
jii\ntii  students'  ftilO-es.  What  the 
trru<^i'iniC.  tests ^c/o  predict  are  the 
!i«}tMltH  a  person  will  o'lt.iiii  on  other 
UHt5  of  the  same  kiiidi  Some  <)f  the 
tMUIence  for  this  etateinent  ia  Itased 
'itii  accomplishments  uf  direcily 
'imrtUirious  kin  da  during  tho''  ttu- 
ditit  years,  and  we  shall  consider  tl 
iml.  After  that,  we  will  turTi  1o  ac- 
(uinplishmenls  in  m'cupulioiia'l  and 
pRifessional  roles.  Tlie  research 
klir^lC  both  lines  i^  exteuiUye  enough 
iUit  we  can  6nly  suinph*  it  here — 
bii  the  Mirnple  i»  iepr<s<'nLalive. 
TuKther  amplification  of  tliis  evi- 
dnute  and  its  meaning  can  be  found 
in  Wnllneh  J9Vta,  Ii)7Ih,  and  in 
pma;  Wing  and  Wallacli  1071;  and 
VVUtach  and  Wing  19G9. 

M»Kt  uf  what  ^onatttutes  I  he;  trsuat 
neM£cinic  rtiurM  work,  with  it5t  di> 
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(fMlini:  of  a  mor0^-kts  fnrrnal  cur- 
rifikliiin'  wliich  \n  Ihcn  chfct^H  by 
mfmury-oritntCHl  fxnminiilitin 
qufftliuni.  <liffcrs  Hi  kind  fritm  nHwi 
vocntionii)  Tlie  cramming;  ^nd 
te«(-tiiktnj(  kkills  nrrdrci  to  nlitain 
lEiiod  K'*<f^  |n  "uciv  cnurKrs.  htiw- 
Mr,  hnve  mu<rh  In  rumnMin  with 
the  akilk  (hal  ahtiuld  hcJi^carn  high 

.acorea  oii  te^U  of  iniellertMnljihili- 
ty,  an<l  it  Khoiihl  iinl  ^<trpri'-o''tis  tn 
find  scnrCB  on  "inlelliKenri-"  tests 
r<irrc«latin{>  ratlWr  well  wKh  "aca- 
dcinSc  achifvcmcul**  iiulicM— a 
point  that  hat  liccii  Ihormifjhiy  dcic- 
umcntrd  (''rylcr  lOGri;  Wallnch  and 
Kiigan  I96!5;  Win;r  ond  Wnllurh 
.1971).  By  the  lalcr  hi)^h  school 
y^ara^  hovvfVci^>  iludrnU  arr  cop.i- 
bic  of  producing  work  of  irrtrin^ic 
tignifiraiicc  in  n  vocatinnal  f^enm;. 
SoiT.etimw— thouph  i-.ol  mIWh!^— 
thik  work  ift  accoiopli.  hcd  uuUidc 

-  the  school  curriculum. 

In  a  atudy  by  l^arluff.  Datta.  Kle- 
man.  and  Handlun  (1968)  the  nov^ 
t\iy  ai)d  effectivfn«»ts  ol  resi-orch 
projects  cnnducled  by  hif.h  r;clio<il 
students  iyciependenl  of  course 
wnrk  Vivrt  evaluated.  Oifrereiices  in 
quality  omonjc  the  projects  were 
\  subatanliftl— but  were  >inrclaled  to 
intenectoal  aptitude  test  scores  or 
to  bigh  school  i;rfldeis.  Even  cnurse 
grades  in  firaduale  schotil  oflcn 
se«m  unrelated  to  llie  cnmpetencies 
associated  v. Mi  professiouBl  perfor- 
mance. Usi.np  a  jmlgmenl  scale 
taken  from  Taylnr'K  (lOr>B)  wurk  nn 

.  the  quality  nf  ro«earih  hy  prufos* 
aional  scientists,  Medntck  (19(>.'0. 
asked,  faculty  meml>ors  io  evahiale 
research  projerts  conduclcd  »ndr»- 

'IKyndently  by  psyche iltj}iy*KfH<Junie 
students  (or  the  imnj;cnoJtveness  of 
the  proj^^  and  the  degrre  to  which 
il  xoostitiiled  a  <rontrihiition  to 
kti6wlcdge— rensonable  criterio  of 
conf)pe(ence  for  professional  work. 
The  judged  quolity  of  ti»e  projects 
ranjjtd  widel.v,  but  diffpreutt-s  .in 
quality  had  nothing  to  do  with  the 

'  grnden  received  by  the  bludentj^  in 
tlieir  cnursfR  nr  with  tlu-ir  stores  on 
the  Miller  Analngici^ Test. Snires  on 
Ibiii  test,  biiwevcr,  predicted  the 
course  graded. 

These  results  typify  the  findings  of 
a>  wide  array  nf  studies  tif  higli 
schiMiK  college,  and  graduale* level 
stttdeots  concerned  with  a^essing 
acc<>mpli«dimenpt  that.  iArieip<ite 
,  pot;t  M-luHiling  a^'bi^^'^'inc^^^'^-  ''"b- 
lie  recognition  by  khowiedj^eable 
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evaluatonr  .{s  a  major  criterion  of 
quality  in  this  rr^arch>~and.  while 
admitiwlly  imperfect,  il  is  reason- 
ably cliMie  tn  I  he  way  in  which  pro*  " 
fesMinnal  excellence  is  judged  in  life. 
Atloiumet|^  science,  literature, 
art,  music,  anci  dramatics  have  all 
hern  studied,  and  indicniinns  of 
qualil^jipcbid^.  fnr  example,  publi* 
cation  ot  a  srirntific  paper  in  a  pYo- 
fps«i"n,il  )i>urnnl  or  nf  nri*!ina)  writ- 
ing ih  a  n/itiunallv  circubtcd  peri- 
odical or  a  iKvik.  While  so*  ietimt*s 
direct  evidence  nf  Mich  nttninmeuta 
can  bo  obtoined  (eg,  Morri^jn 
1963.  where  direct  judgmenl.H  of 
competence  in  dramalics  ore  made), 
it  also  has  laen  found  tbnt  studrnl 
re|>orls  oo  th^e  mattey  nre  suffi- 
ciently aceu/ate  to  provule  a  unable 
Miurcr  c»f  d.ila.  Maicey  and  (icmsby 
(1971).  for  example,  demount  rale 
high  agreement  between  student  re- 
ports on  nut-nf-sclitxil  Hccompiish- 
menls  and  infnrm.uinn  provided  by 
^he  sch(Kil — even  whe*.  cnlbge  ad- 
mission is  at  issue  for  the  siudents.- 

The  results,  nf  these  studies  show 
t  h;it,  fnr  ioslflPH.  fnr  the  more  than 
,'iO0  underf.rHdiiates  ■  studied  by 
.  Walbeh  and  Wing  (lOfiO).  nccnm- 
plisbmciils  nutside  the  classroom  in 
e.ich  nf  the  seven  fields  exjilored 
were  about  a!t  frequent  ampng  stu- 
dents iri  the  Inwer  tbirc^  as  among 
tb(>*>'  the  u|)per  third  on  the  Col 
lege  knt ranee  Kxaminutiim  Jto.ird's 
Scbiilastic  ApCilude  'IVM  (SAT), 
The  fields  chosen  were  intended  to 
span  a  representotive  array  (If  the 
ACCt^ipli^hment^i  Iteyond  Ihc  class- 
room for  which  scluiol  is  exp(*cleJ 
to  ferve  as  a  preparnlion,  -Some  nf 
these  MctiviticA— Work  in  I'ttcrnture 
nnd  scWme — are  close  In  trndilinti- 
al  acaoremic  disciplines,  witile  oth- 
ers. liktLniusic  arid  art,  thnuith  not 
irmtitionally  academic  fields,  are 
still  witjbin  (be  ctKtnmury  purview 
-of  most  ^jtiglicr  (^ducution-al  institu- 
tions. Still  others- '^Iraui.'ilics.  for 
instance — may  of  may  not  be  in- 
cluded in  n  ctiMegC-s  curriculdr  spec- 
Irum.  K(ir  noneoftbeiireasstUdied — 
liternlure^  science,  arl.  music,  dra- 
matics, politjcHl  rendpr>ih>p,  and  su- 
cial  service  niiiyities^  was  act'tnn- 
pbsbment  rrl.ite«l  Io  SAT  scores.  ti« 
iher  considering  the  Riunhtt'  of  stu- 
dents as  a  wlude  <tr  taking  men  tuid 
w<tuu*n  separately.  Kurlbermure, 
thjp  extent  to  which  sltOentii  exhib- 
ited .icbievi'iuents  in  uuiri*  than  ime 
nf  the  seven  areas  was  likewise  un- 
related to  SA'i'  scores.  These  find* 


Ingt  hardly  supiKirt  ^he  idrn  thai 
the  SAT  in  this  upjler  range  rellectH 
hrigbtnesa  bro;tflly  defined.  On  the 
othef  har\d.  sluioents  with  the  high' 
•er  J^AT  score!  wct^. found  tn  have 
higher  course  |[rades* 

Even  more  compe  lling  f^ntn 
pointing  in  the  aame  direction  ctfme 
frnm  Wing  and  W^tl^ch's  (1971) 
Ktuflies  nf  nil'ejie  n|\pli'*'>nts  In  ibnt 
work,  the  subject  |HKil  whs  broad- 
ened  ^l  include  not  jjusl  uud<  rgtiid  ■ 
oales  but  high  scIkioI  studenis  wim 
lind  applied  for  admission.  Drlmi-. 
linAs  of  accomplishment  outside  the 
clossroom  ware  restricicti  to  rela* 
tively  rare  ochitvcmenla  of  merit — 
for  example,  piddieation  nf  original 
v>Yiting  in  a  regularly  circidaleil 
nnnschnol  publicniinn  or  lln*  reci'ip' 
of  an  award  fnr  such  writing;  havin:*' 
wnn  tnp  pri7.es  in.  state  or  region.d 
science  comoetitiimsor  biiviog  b.  rp 
chnsen  to  attend  a  slimmer  scicnr«« 
program  spons<ired  by  the  N'ationnl 
Science  Foundation;  having  vvon  a 
prize  in  a  musical  com|>etition  or 
having  done  professional  work  in 
performaticc  or  cnmposiltim. 

The  SA*i  scores  nf  the  more  tlwin 
4,(^00  rtpplica'nu  of  b^ilh  ^exes  slUd- 
iftd  loour  resear<  h  on  this  (pietttiiut 
o^very  litllr  abnut  who  is  more 
likely  ti  excel  at  accnmpliobments 
1*'  kinds.  We  found  ihnt .  if 

<-<lndida1es  are  spIccJI<  d  from  ihe.Hp- 
.  plit.int  pnpulati<in  according  to  ii 
hypothetical  decision  ride  ibnt  fn- 
Vois  applicants  wh<i  scored  bigh  on 
SA'J"  tests,  appiicanis  with  the  sorts 
of  nccompbshmen«.<  just  nnli-d  re. 
ceive  little  nr  no  diiferenti.il  benetii 
Vet  the  seleriions  actually  iiiadf 
through  the  admissions  pMices.s 
were  found  tn  be  pi<'dnniin:uuly  u 
functinn  nf  I  be  SA'J'  ^rore  rcsidts. 
.Similar  results  liaVe  been  Tound  in  n 
Klu<ty  by  Holland  an<l  Uichards 
^IflGO) 'among  others. 

An  impliaitinn  nf  tbo  ritregoing  is 
that  score  distincliouH  vitbin  the 
upper  range  should  fail  (n  predi  t 
the  peftple  who  have  demon^lr.it^d 
mpoiiiKfut  aVbicvemenlj*  in  ikcu- 
prtliyinal  and  prnfcssicmaj  roles  after 
li'Win^:  sclirHti.  and  ttiiv  Iimi  seems  t«i 
liO'ihe  ,*ase.  This  outciime  is  so  un* 
comfort ablv  that  evidence  idung 
these iiiu's can  meet  with  resistance. 
I  ^'nke,  Itir  examfde.  .t  careful  study 
'by  Harmon  (19,(01^  in  which  the 
proresKinnal  conlributioMs  i\f  some 
pbysicislfi  And  biologists  were  e^vnl' 
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uatcd  by.  mricntift^  judnos  on  the 
biisiftpf  »urti  rrilffiK  as  pAhiicatibns 
und  patehU  f^rH.nted.  The  eviilim* 
tton*.  hy  iKrcc  or  m«>re  fxprrU 
wurCini;  indi'iHrndenlly.  wrrc  iiU^ul 
•o|>htsUcAli'd  and  nte/inin^fu)  as 
auch  judgintnls  •ouW  Iw.,  They 
•yfctr  with  cfMitfjelcw) 

liradolnic  pruficiency  dntn--ru»- 
tomnr>  kih(k  of  vcflifll'Brxi  rrtnlhe-. 
matir.il  njUiJudc  lest  srdrr^.  ^].r 
tcotc  oorn^d  on  an  aiKaiKvci 
arhievcniolU  Ic*  •  in  ihf  Ktiidchrs 
fteUl  (»f  rouce»lr'nlion»  and  ^'rudos 
otituined  in  Kcit-DCe  C\>ur>t».  lltAv 
ItOixi  a-  profc!U(ioiiat'  i|ci^h(isl  ih^ 
|>erw)n  bprrtme  ciiuld  n(»t  4>c  pre- 
dicted hum  any  of  Academic 
priifirieiicy  infoniiAlioii— ^nd  ,\\\- 
deed,  for  n^nrly  half  mrrcla- 
t'iou%  compulcd;  ihe  direct  ion  of  (hp 
rplalicinship  whs  nef^nU'vc  rather 
than  positive.  Vft  ll.lr<nitin'i;  r^ai- 
tion  to  (Ur^  finding  is  lo  qiMstinn 
not  th<^  prcdjclorti  but  ihc  'critcrio! 

The  wtnc  result  hp?t  emerped  in 
Kludy  nf! rr  ftludy,  whether  inlclli- 
genre  Irsl  scores  or  coijrsr»  );rades 
arc  iii>e<l  pre(hrtor4.  M%')hc»n  .>n(i 
Ci«tchfit-ld  (197n)  fdMiKi  for  r.ath'*- 
maltci^ns,  for  ex.in<))Je,  tha'  liic  IQ 
scores  of  those  rhoRen  knoUl- 
edpi-iible  peers  ns  doing  partirtilnrly 
Rood  research  work  *^*t*e  nu  d»ffftr- 
<^i^l  from  those  oreonUols.  CheinUU 
and  mathematician!;  chuseit  hy 
peers  fittAlw  quality  rtf  their  contri- 
hiili'tns    v^frty  fbind"  \yy  liloom 

"(I<ir»3)  to  RCore  no  hitther  th^n  ccn- 
troN  (>r>  n  variety  of  ii>tcllectu;d 
ability  lests.  Kiirt|ier  (lat.i  on  re- 

.Vearcli  scienlists  from  MdrKiiinon 
(J9/^a>  yi"ldc'd  the  h(\rr>i'  tjottAme. 
and  -coin parahia  refinlts  .eni^'rtte 
from  Kti^tJies  o^iJLyrhohVists  (Mnr- 
Kt^M  ftftisiK-.g^.  on  lUlV.W, 

ah?;^an-^iLv(1s  t^^^l'K^nno^•  UHiH). 
as^wejl  Ml  ftoiw  'h  ^Dn/}i'<<  cytdmi*** 

.  r*vieiv(d  by  l%t  (i*lbri.  l«n4{^Lon' 

.^'cupationnl  activkicR  -  ;  Mienlifrc 
ret^carch,  enj^irieerinj;*  mcdicinie. 
a  od  b  u  j.i  (H  '^s .  1  n  G  r  e«  t  I  ir  i  I 
iiiuhuv  (l>[r)t)*^invilrtrlyTiMds  uit- 
drr|;rhdij;tl<?  ac'hft^nji*.  <lU^^ioc^Ui»'^5 
hnvih^  Httle  n'lHi~i(Wishi|h^lN  nlbse- 
qiient  .occupational  ^  cnurtciifi.* 
an>on({  seiehthU.        ^  , 

AKhouKh  .  critics  like  WeiOman 
(I!i7!<!)  seek  tc»  q|i("4lti»n  Mich  Tnid* 
in(;s  on  the  ^rotnxl  that  ttuse  ^tuff- 
ies  con*^ider  Ichi  nnfrcAv  a  'iMijie  <if 
ac^dennc  Rktlls  diffi-rerirt^.  ti^e 
TaUfiC  Ivoad  i'ootir.h  lo  include 
initny  more  individuals  who  ^eeA* 


auperior  c^iip^rtunitiM  for  eduta-' 
tional  advHMfemei^l  (fniim  can  be 
((ranted  them,  and  the  question  of 
how,  within  this  ran>;f,  *eleclioru 
are  to  be  m««He  ii  a  renl  one.  1'hc 
lack  uf  prediclabilit,.  wcms  all  the 
more  htrikint{  when  wc.*  consider 
thp'.^  a  K<tf-fuifilHnf{  prophecy  wfcct 
no  douht  ■  exi^U 'in  jionie  dci;rre.. 
'leading  Modentii  with  supirinr  test 
.worcs  ;ui'l  prsides  In  l>c  prifer'Cfl 
for  sujiriiur  i>ccuputtna<d  slot*  iver 
thiK^  with  in)prcs$ive  uChJi  luic 
credcnliaU.  'fho  •  evidence  wotdd 


e.g.  AVollnch  and  Kogan  10e^  Wal. 
hich  and  WinK  1969;  Wallach  1970. 
1971a).  Mriri:  unusual  ideas  ten<l  tu 
come  later  in  the  M^quencen  of  ideas, 
fin  thiit  untisualn^s  seems  to  ride 
ihe  bacl/.  a«  iV  were,  of  the  tendency 
to  prcKluce  longer  ideational  strin|;s, 
and  re<<pondcnts  are  rHatively  con*  , 
ais*cnt  iii  their  degree  of  ideational 
fluency  ocro&s  differer^t  Mnds  of 
losks. .  "  ■ 

Kxplioiaiions  ftir  .Ih*  nli«#'r^jkJ'(jd|f-^ 
rereiice.s  in,  ideational  fltiehe^^  irt«— 


see  0  t(i  be-all  the  HrjMiRrr,  since  Uv  ctuded  varyin'^  tej^dencies  to  f  nlC^- 
mu;.t  be  emerging  ih  spjtc .  of  Q%tatn  ^tho    hypolheticni.  (Wallach 


prophi'cy^bius  of  that  bind.  •  <^ 
/'Crcaiivily^teRts  ' 

Kxtensive  atlcitipts  to  a  icss  "crea- 
tiyiiy"  or  "orit!inalil'y"  i^ained  mo- 

.  nicntuni  in  tho ,  lUOtK,  Wadmg 
quickly  h»  the  need  \C  i^ml^edislinc* 

•  lions  between. t*i,ts  that  wcrc-aim- 


1967)' or  \o  pick  up  n-.forjniatioti 
from  the  peri, iliery  oC  on<*s  Jtten*. 
tional  fic^cl  tWajInch  19'70).  Inirrt-: 
apcctive  accnujits  by  highly,  ^iil-  . 
enteJ  writers,  sicitntisls.  mothema-?^ 
licians.  innRiciart\ljtid  flrtisls  of  lh> 
importance    for-,  tJieir"  creative 
Hcbievempnts  of  letttnj*  Idcns  flow 
abumiaiiHy  iu  an  asK6ciat?ve.  mai^ 


ply  assessing  fcr  intelU;'encv  tmce  ,iier j^rc  aUo.in  eVid^^ncQ. 'fhev/Were 
a^nin  but  uhder  a  more  fashionable;  far  frorn  dci^ive.  of  co^irs^;  sinfre- 


label  and  (rsls  that  correlated  mini«K  tdcati 
tnaily  v\tib  conventional  iesl^  of'in* 
tellectual  skilK  (see  Wallmh  and 
Kogan  il»C'.;  Wnllach  lUr.H).  Thn. 
tcfcts  that  feeioed  best  to  mprt  this 
.cquirement  -iWalbcli  ?lPl>  pro- 
vidofi  au  f^x^n<ive  siflint;  oi  ;!u  evl-' 
dence  on  tbi$  question)  focoi  on  the 

"abibty  to  prodqce  in  re*«|)onse  to  a 
given  jtask  a  large  nUml>er  ol  ideas 

"  that  are  reasonably  appi^fp''^"-** 
jnd;  at  lenst  partly  because  ••f  l)w?ir 
number,  include  a^rMber  larjfe  pro- 
fKirlioh.  of  relatively  uttosumI  re- 
Bj)onpcv  ■  Surprisinply^  "ideational 
nuc4icy**  in  iRift^seribe  showeil,  ftjr 
those  i*lM»vc  '^n  wfenpediate  level 
on  academic  tkiMs.  liLlif  toF7<^ntion 
with  iitaii^KlingVft  intelligence  ivnis. 


flue  net:  could  fllsft  char  * 


'actcrize  le**^  iaienled  cOntnbutyrs  > 
to  tne  (irts  and  sciences.  All  i»f  tbls/-^ 
did  seri'i*  to  r^i«e  hopes  that  idea*-- 
lional  fluejicy  tests  would  V  siore 
holpful  'hah  academic  slj;,iUs  tesU 
^f(>r  minking  prngnuses  nbou'  ^t^^re^ 
accornplAshnienis.  . 

> 

Some  bniited  evidence  can  }ie  found 
fciT  tbe  Roccess  of  fht^e  tcsti..  In 
>Vall»H»  and  Winj^s  ()l»i'J)  coji-g*' 
student  *^aln|dy.  ihin^c  scofinK  in  the 
highest  tlurdon  iHeationfll  fluency  • 
»bowe<l  more  oni'(if*scbool  attain'' 
m^aiLsin  literature -and  science  than 
"*^V*?tf  scming  In  the  bnttoin  ihfrd.' 
At'  \j€^A  ';  tlio  hn.Kages  Were  (enijous. 
^t»owevi:r.  ftnd  for'sonie  kinds  of  lal- " 
'  enlci*b4jhavi<^rno  linka^o  jdviititm- 
''Theld^aticiHid'll^eiicy.lt^^^  sJ.flueney  were  foundr^at  a71  Anoth- 

•■^y  nf  ke<l4h^:rPsD<infrerty4^^  Rhred  of  positive  evIdr^Hce  is 

I)ossib)tt'  ways  Tn  ">vlMcIi%pi;<*itie'd. 


^mii'^  iVriiljji<'4A  are  siMilar-'f^qch 
.  n  Cat  ikfi^ju  iiunUi'i'.^fT  p  iR?»rtdf  usdb 
ofyr  ro'rne  ordinary  (ibief<-.(«»it^i^s 'a . 
-n<r\\>jinhcr),' |jf  |}tiss-t>lc  iiV^.-Vnd*.  yf 
0.  siM?'tific(l>jUegt»ry  (suth  iW^  tlifing^ 
that  incnp  ;on  \vheels),  or  )u>s^ii)te 


Singer  nnd  \VbitOn'M1971)  firtdtng. 
rtt.  a  h\i  'Of  ^lirtk«*tg^/bet%^Ten  'chib 
dfren's  ideAfi/inaf  1  flueney  .  lest 
^^rores'— Imt  n«»t  ttfir  inlcliigencc 
l^  'BC«»r(;s-  and  Ahe'  judtW^d  -^x*  ■ 
press) ve/i e>.<  of > t h w r  d r a w i n;t» .  \n  Ik 
telAtfed    study.  'W.allbrouiVr  and 


intcrprel/ilions  fo'r  vafioth  prCMinl-  ^  HtieJsnijrtu  <t!«76/  fmind  oimpariible.; 
•ed  absiract  line  forms  (Mii  h  V*  a  "  |KMit?\^b,eV*idence  for  «  clby  firdiUirl. 
^>i^tiaoi?t<- ■  ^urfiiiittfft'4  bv^  ifiruf  ^ir-    btt  nji^  To^^^^^i.  /Irautngs 


,  cliffy  Time  «!mI  a^airi*  it  •  luis  lljuqh 
denVglwl Fiittd  ltlat'siHiT|>h'!4  iart^{i»n 

;Jroin  intenni'dlite  to  hinh?<»n  CnMh. 
loMirtry  »rifelli}:(^re  indices  show  til^ 
tic  or  no  febUM>n1<»  ilk'  ninid»ot,or^ 
Upusu.dne  'S  of  the  ideatujil.il  tvJ- 
B|>ortsfs  on  tests  of*  this'..k^^»rf'"(^« 


!.ifriftil»'  UujchiMren,  Ai(empt><  U>i»rot* 
.  vide  rdterio*!^  validation  f/»r  ;itfca- 
tionel  nnfncy  ?est5?T>l>y  Oropley^ 
{1972;  tn*t  also 'the  reatnil\Tits  oCCro 
pley's  datrt  by^J  j'da;!.  I97rir&n(j  by: 
Kogan  aftd  P^w'  >ve  U974),,  neenu 
quite  hegativp  in  th^ir  jigttconiei.  • 

'\  '■■ '  - 

y  -  ^  IB76  J«nu4ry.*Frlrf(»'<ry  ^ 
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tdeMlmtal  llucncy  mnv  had  pwvrrf  In  |h*n«w  Ihf  h<»pf<i.  «f  mrrit  irhifWrnfiiU  in  whalwr 

inlnliiwlly  rfblcd  lo  inlclliicnce  fur  crilfriiin  valiHiiy.  mnkini:  ihfm    ptirAiln  «  o»«fRf  iui>fi  »  luepirr^ 

tetK  iHil  ihfy  lire  liillo  if  nnv  l»ot-  nOfficii^nlly  >mpcrvmu*  li)  direcl    il*  fliulf oi*  Ici  follow,  reslnd  pin- 

Itr  lit  luHictinK  the  nchiove'tnentf*  coaching  lo  be  uwful  fcr  wiiclicnl   »Mlprnli<m  lu  achii  vemfDls  of  hxj^h 

^  fftre  alKHit.  Subjfcis  vnry  widely  purpt»vi»  would  have  bwn  dimcull    qurtlily.  and        prmrily  ^oj^^^' 

ami  nyfiUmniicnlly  in  Ihoir  attain,  if  not  impo^ihlf . 
mentK— >ol  mile  if  any  of  thai  nyn-  . 

tf malic  variation  is^captiufd  liy  in-  Prom  t€StS  tO  attainments 

dividual  differencira  on  idinlionfll  ^  .  •  j- 

Ihifiicy  li^U(ahhou^bthctc«Ut(m         ipn^jrnirf  talent  from  the  <1iv 

jLw  wide  and  consiMenl  differ-  piny  of  e*«.-ellencc  al  viK-alionnl  .pur. 

~     #_   .....11  fni'ii^,  and  ii  in  these  cicoificanl  ^c- 

CfMnpit>haients'aV<ucli  lh:U  offer 
thd  ivu>>l  4ejii'tiinnU'  lttsitt--fmee 


ence>  ff«on  person  to  pri  <iTn  -  well 
beyond  Avholewr^  small  piytitiii  of 
thW  rfinircucrvroay  relaU*  to  m^* 


daleii  Ailh  noteworthy^  achieve- 
menta  hi  more  thno  one  realm. 

Two  clawea  of  evidence  ph<iiild  be 
f;athere<h  vetitinble  uiJfhB  nf  public 
rec<»pnitic»nJflroj;iHed  Uy  Moalified 
jtidgea  anil  wjffic  iamjile^  lo  l»e^val- 
untcil  by  the  5eU'Ctioi>  con>it>iU<^  it- 
•nelf.  C^ndidate^  in  lilemtorr  wirtild 


«m«uit  *t|^inmeiiU).A|!nio>Tare   certain  academic  ^^ilU  i|Ttiahfic«.    ba.as|(e(^to  pruvMle  verilied  infor: 
S  tho  n^Luip^  determM.na.  T?m.:havc  bec"  ^'\^''      i"'^^^^  ;  mition  on.worlj  they  have  bad  p^.b- 
of  X  te>t  T4w>osQS/i<i^  fbt)-  meoii;  of  meririhal  nftst  nccoinpi-    i»heil  intjon.cbool  puhbn,P«n«.  on 
Inferential  KOP^ tt-.        \be  allctmMOrt  of  t^Ucjtbnal  fr- 
•pwi*r?i  1ind.?^riliuR  or  ^e\m^r%^  ^oiircS^  ifal  4yW  covM ; ^bw  apv 
^  iammerity,  tay.  WUiiitr'Vis  \po   proBoh  l)c  impleffl^ore.d?'  My 
*^>«ky  tor  othyjplElora  uiireIi?(H  to  om mend*i Iftiv    u»»<\lo/  a.l  «>ii^ on  Itt- 
.the  «lti«ijM»inTawf^^      to  predfct„w3!0on'^l'*»bij,lty^  HeMnKiri  |;r«des.  hul 
^  to  infli/occ  Otf  tea  rei^lKinsTj^r^  ..Iq  loojl  tbeir  role.y  the- fcc^^^^ 

'  flu^thnnlnverwlielininzlv.     '  OOt  of  tlm^«^>lu)  Wr(*  Ukv  low,  lo   ,witn  o,., mo.   — 

.pefhop^ovewl.elin.ngiy.  Wiok'^ml  AVhIW^^  of  Ibr  woMb  of  J  be  re.v»..oi.oo. 

•  Crt'UcAtine  r-^*r  o  otil>ers  of  task.    atrCQl  ufent  as/«m«:nt*  m\oll^e  ^^X^^  "k"  be  ^ked  to 

anorJo^f^Wesnoof;.  and  reacbirtc  admi^^ions  <fhrlii)staocC.  wi»  my.  P"'«*U-  n  »;a>nple  «f  ihcit  beM  NXrit- 
'Z'Xmnre Thai  atV  ^U^if^ltc^llJ    cut  off,  ibat  reject  c^iod.datea^fxom  .ten  worK.  to  ho  by  appropr. 

-iofrequcM,ean^impl>  rcnKi«rcaU   furtlM.r  consideration  Af  their  SAT 
'"^  -^niMmfbrinily  to  the  ibiplirit  .\dr    ti<otH  ivlace^lhem  in  ihfc  lower  half 
^fVen  expbctl  ^uMtCHti«»n?»     ah  uU-    of  the  jffiMribation  iot  bi«h  fichool 
'  thority  fy^it--'lttiete*1>t^'lhat  tbi^^dnmri  who^nto  uiy  tn.ciilleiie  of  if 

.\JnHnrbehasuorbci)rovid«IJl'al^  -  their  Efftdetf place Jhcnr. lot bfi  p"".»   .w^^..    ^   

^J^^  M^^^  tl!^r4 -Of  ,ti.e,r.cra«.  tboia.' ot .  veriru  d  inlonna0on  on  resevch 

tSrmnk1ng<^rmer.KrabuUoi^^^^^^  4W  p^rticula^  tuLoffs  was  bj«d  pubbsbod  ,.i  sc.enhf.c  jo urnaU  or 
uinrrmonrreipo^^^         ^^nme-    o<i  projections  MdicaUnc  that  Jho^    ot^^^  publ.ration.  on 

upns  JironnB.  rei»ppR^.  ^     ^^^^^       .^^^.^^  ^hould^bn  able  lo    tht^  ijatnw.of  iHcfte  pnbbcatio))*.  <in 

do  t>ie  acftdemic  \\-ofk  ex|>ecled^f 
etud<nits  at  a  bijjhly  «ele<^tive  col- 
tege.  For  those'  aoove  tKe  rut-nff%. 


'  .tlie  natiire^of  tho8«  publicotinn^,  w* 
,  tbftt  the  kind  of  nppralsal  ihni  went 
into  the  puhlicntion  d^^sion  c<in  bo 
*aise*KC*^  awDr4?r*mi-y .  bnxv  re- 
ceived fur  written  W'Ork»  and  on  the 
nature  of  t'i.e  awnrdink  HU'encie*, 
,thn\  Hf  ftin  an  appraiKnl  can  be  londe 


atp  farulU" members  o:,  the  wlec- 
\hf\  c6mniitt«e. 

.For  proR]>ectivc  Mti^nti^Ut^  %\iLns  of 
public  reco^nitinii  would  include. 


6n».el«Q  it  AWare  oCbut  Minply  ig* 
norcfi,  a*,  fof  example,  in  emnociat. 
Jog  tbc  kinds  o."  iWnjR  a  c:p8i  ha»K- 
er  could  be  uHJ.-for.  'I  boR,  HoNvcrs 


'er  could  be  uMti: lor.  imiR,  mnvcrs   w^v.  rwi  .m-j'^  0.-1.^.^  ....   r» 

and  van  dcr  K^^Utep  (1970)  fouod  ^  SAT  ^corefi  and  r.tadeh  receive  no 
witlTcoHtnc  ModeivtA  tk*Ai  ipdiy.idur    further  allentiun.ni  P^^^' 


with*col1tn'^  ModenU  tk*Ai  iodividu,    further  atlentwn.ni  niawnt!  .preier-    jrnur.s  "7  '1'  :    Ji  1.5 

^diffe  eScoMn  Ideational  Ruency  <erttmt  ^Ivction,  for  -adm^saion  or  fcaTf  rouductcd.  to  l^^vab.M^  by 
f' 7  A™  \^„«Uf-wl  :.w>.iiivMv.  tt^icjtfrybin  sUDPurU  for.  m  W^  have    i^uOiU' seUclion  cominiKei.  f«vultv 


5  in  laeniiuiiui  iiin;M»jr  ^v...—.  —  

te&t  ftcorea  cor^d^teil  posit  ivcly-  >rb«»jfrKbip  s\ippitrl.  for.  m  ive  have 
with  wroreh  on*a'«cale'prwiuioed  in^r^t^mil  'i^  (Wl bin  wicb  upper  ranpwr 

tliaiie* 


•,me(i8Ure  ^usfeptibilil^'  to  hypno<;in. 
;^  V-"Th«  firitiiop  tbat  iHim^  who  seem 
•  rfirirc  nii^jS^tible  irt  n^iHirtse  to  an- 
"  iljqHty^  ftfiur«iV-#tbQ  liuswplibility 
„tp  hypaw^in^  mcaMir*— iil»o  .earn 
.     ohij(bar  »coro»^'a)»  ideational  (tuency 
teM*  ^•^mJf' to  indicflte  tffal^lboije 


.•.aJtevi  jtcpre  find  course  {^radeditk 
tiiiafon^v  wem  to  be  without  varicj.i- 
ty  fv  predicting  accompli^bment: 
'fJlicre  i*  nut liin);  absolute  nboul  lite 
pafticobr  cni  off  n*''"^^'  wnbe. 
MC%  tbrwholdfi  should  bc*i»|»ecilti*<4 
atul  furthft  incrf;mcntfc  alM>v<?' them 


higher  '  hv.  ROiiiestMit Uy.  bf  der  iK^iarc^ 

provide  ^  hot  lWle«iQf>i<virt  vto  .  ,  .     .  .„ 

^  W*nton \\\^  idcatbHial  nuenev-  IwU.    l  oX^lect  »li>onR  ttndeiits  wbo  iali 
V>t  I  be  MitborK.tOking  idejttional   ^bi>ve  .the*  academic  nil  offa,  we 
nuoW*siiTei».a8*f«oeti«M»u^^^  mnu  .^IH-ctfy  the  kflid^  of  ^Ufe 

fclciH  for  creativT^oMaioioJ'"^^.'^-  detmed  meritorHUw 

ternret  tha  data  to  ift<faft  that  erea-  3^  tboif.4mi^  ri>tht;  ibe  jmi^  cbmen 

•  tlv<j|H»opU^aro*m6r(JSujjKCxtibUr^  '^o^  Hie  pu'- 
\  V ^                                       piifreii  oTtbKKeloCtionvlt  v;.ilU»eea*. 

•  irieildqtrtc -iliilli^  te^U  In  (bel\^ii^r'ii>>e!A'»  for.K^^^ 
upwr.fft  ineli^tcll  KHW,.alH«it  viica-  ^feMbn\tt4  ftcbm»ls  th;>n  for  ctilUiie 
ilonol   diiftp^leoei*^  'Vreotivriy'»-^«bniwi«»ni;.  wrictf  «  inure.  d<lmile 

 ^  bfyv^Wotlr.   '-^---^^.-5  

rol  ata'itit  to 
rcati 


'•    ,  leiice  <Xcofe  rauR^  arc  i*ol  ata'ait  to  jiresem, 
fdl  ihf^nnp^  n^tn  if  iJeatWiiy  twUs    beijji  apn 


.   <iO  ArteH 


J    .  ..  How  arc  cantJIHateii  to  bo  .a|>p»»r-' 

\     V       '  ' '  •      .|irine(l  nuumf'J'drfferent  fiiitOfs?-  Al 

Ihe  j;rRtInate  levjfl,  the  answer  ^t»- 
ftndft  ^1  '»«ch  depnrlnient>  jjtMiK 
sidf  rcMi'trceK.  Af  the  updernrad. 
wait  level,  one  iVuRiblr  plno  v^uuld 
Ac  ftH  follows  (Wing  aiul  \Vall-»ch ' 
^1971  J^DfToic^ nil  tbellebUan  \ns\l- 
iution  wonth  to  r*y«0reRent  in  il» 
SittHOii.  List  nppii('anl)«  (alaive  the 
■cndenoV  ^killB  c'ot  qff)  in^lesi^mb 
mfi  o^der  of  jvork  kionlity  witllfin 
Tn'JKPt  «'»f  1>rof<f>iionnl  com|M^tence  in   ^och  fivhl  but  uive  )iri.irity  nMhj 
*  uiul'erKradnatc<  the   llitliiiM  t'Cijm^ 


Research  awards  r^iceiS-ed  to  science 
coropeXition*.  and  on  Ihr-hhtnre  of 
Ibi  awarding  «jiencic$.^Caiuli'>lvit«^ 
wwld  (\l5n  be  rct|ueAted  to  Kubn)lt,  : 
ufcrlK  on.  KieBtiG.c  projt'Ct*  thcy 


tU|bU' »elvclion  cominiKee  fnvulty 
FTub(*|».'  T he;fti^bi(  vcincnts  may  w 
mAy  not  )»a\e  tht  ir  point  of  ori)dn^ 
mftliin  If  f^Mioola  curriculoin:  f<ir 
CTlteKi'  iipplicantH  the  work  lhat* 
^lifti^  i<i  more..like1J^t»»  be  extra- 
Mrfidiln^  than  for  apulicantf;  for, 
g^duale  ftchoo|r  't 
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field.  Tt>6n  proceed  •rmind  the 
fields  in  csriHi^l  fn^hio^r  tnkinii  the 
'pcrMtv  tmthi  qunliricd  fmm  the  Hrnt 
fiej^'ft  list,  then  (nim .  the  next 
field'a  list,  and  bo  on,  remfivin^;  • 
ctfndidnle  from  ahv  niher  hsl5  in 
Wliich  he  or  bhc  m^y  aiiponf  boon 
«ji  the  candidate  ins  hocn  chu^en 
from  one  liM-  .  After  rhiK^ing  the 
matt  qualified  pi'rson  in  rxich  field, 
Kclect  the  noxt  mnst  qur^lified  |>er' 
ton  in  carli  field^nnd  continuo  until 
the  Avatlubic  »luU  have  Ih?cii  filled. 

An  i-Y9titlition  ran  u^fine  fields  aft 
hmadly  or  as  narrowly  i  it  wishes. 
It  may  have  unly  (wo  car  kj^vI  |H»i' 
t'ona — My,  the  wienccR  and  the 
humanitii^;  or  it  may  ho\e  poM' 
tioiis  for, crtt iri^mi'in  lltyVatci-e  and 
the  arts,  hif^ttiricnl  cssayis  crtnlive 
wrilir.*:,  phjsin;,  hiulopy,  chcmiUry, 
p»ycholr»i:y,  and  sociult»};y.  It  i.iay 
include  |)^rfnr*naiirc  ii^  art  and 
muittc  or  rchtritt  ^t^velf  w  lu&tury 
and  criticism  in  these  fields.  It  inav 
weight  khe  fields  in  bny  proptirtion 
it  find^  apprnjiriale,  taking  two 
people  wliti  qni  lify  in  literature  iiiid 
the  arts,  n^y,  for  ev<  ry  nnc  in  the 
sciences,  or  vicc  ver^a,  ba&in^  the 
decision  on  its  feelings  olj<*ut  its 
stren^tthy  and  mandate  bh  an  in^iti- 
tutioii.  what  higher  rdncation 
ahould  concern,  or  what  t!ic  kociety 
nee  *».  Hilt  il  niust  make  its  choices 
cJrar  both  to  it<t'lf  and  tu  il&  poten- 
tial applicants,  m)  that  the  forms  of 
competence  it  o^drrtake^  to  sclti  t 
for  and'nouri<»h  will  be  reavmably 
ex|  licit  and  hence  availnbic  for  ex* 
Bmination.aiid  critiquq. 

obirctiiin  might  be  ipndn  thnt 
prot)o^ois  ^X-oul(l  l>e  time  cun- 
tij;  Ijj  put  into  t  ffecl  Rdt  f.clec- 
tionxominittet'S  already  f;pend  l.ifge 
ttiiiouiits  of  time  and  erfur^  in 
reaching  their  decisions.  Tbe  differ- 
ence is  that  most  of  their  present 
pr'v^pi^ j,c8  nre  relatively  nnsys- 
tciTiatit.  and  the  apjiarent  nlijectivi* 
ty  of  lest  tcnres  can  influence  lliem 
more  than  il  shtmld— and  more 
than  tlieyilielieve  it  docK. 
M      ■'  ■ 

It  mkhl  mIf>o  Ix'  objected  thut  bome 
RtudenU  will  (ry  to  develop  rerUi:n 
competencieR  in  order  to  ^nin  ad- 
iiii%>i..iii  or  scholarship  f^uppnrt  \\\  a 
more  selective  n»lle|te  or  ii.iivers^l«. 
Hut  this  crilicir^m  brin|'.s  Inline  the 
impoAaiJce^f  fonrenlrntinj;  nHsess* 
menl  effort*  on  inherently  nifrtlnri 
ouH  activiiieK  rather  tliini  oi^  men- 
Kurei  that  take  (lieir  jublification 
frRm  the  bope  that  they  can  predict 


thm  iictivttiea.  StudenU  will  al- 
wa,v»  feel  Kome  preksiiro  to  dn  the 
thi  1^  thnt  will  increaM*  their  edu- 
cationni  chances.  Our  idiligation  is 
"to  mnke  the  sources  of  such  pre*.* 
sure  as  valid  ns  possihle^to  reward 
students  for  rneujnhnful  displays  of 
Cfimpctence  rather  th.in  for  excell- 
ing on  jji^aninglesstesU. 

Bekidrt^hfir  intrinsic  significance. 


And  the  avat'lab^eevldence  fuM 
MacKinnon  l%HfKSggesta  that'ac 
vomplishments  outside  the  dam- 
room  during  the  student  years  pre- 
dict who  will  be  making  sulistantinl 
contributions  in  professional  wnrk 
later  on — the  information  this  Uwt 
cornintt  from  what  adult  professioni- ' 
a)s  say  about  their  past  l>ehavi(ir.. 
Evidence  of  hinh«qtiality  proffa- 
lional  conlrihutiniis  at  an  early 


do  tho  accomplishments  we  have^^oint  in  one*R  carer r.  in  Uirn,  givers 
con.idereil  niso  pnini  Ic.  whni  peo     ^»od  basis*for  predicting  thorn  Intet 


pie  will  do  in  the  future?  Kichird*. 
*Hi)!liind.  and  UH7.  (inr,7)=  give  a 
'dearly  afOrmative  nnswer  to  this 
question  acro^dt  the  years  from  hig^ 
school  tfi  college.  In  a  stvidy  'if  near- 
ly 4,000  hi{;h  schtnil  Ktudeht*'  of 
both  sexe.,  who  were  fiillowed  «up 


as  well  (j>ee  Albert  1975) — so  from 
high  schiKil  on^  coni|>elenc«  secma 
to  be'get  competence. 

Would  it  make  a 
difference? 


after  one  or  two  years  at  (five rse  col-  ''t'ho  cntaloKues  of. the  selective  eol 


lege*',  d;ila  on  c»ut-of-schoiil  ncliieve- 
nieiits  in  liloratiirc.  sricnco.  iirt.  and 
music  were  collected  for  the  hinh 
&cKo<d*and  college  periitds,  alon;; 
wiUi  dnla  on  hij:>i  scho<jl  ni^  college 
grades  and  scores  on  conventionar 
academic  f^kills  tests  Inkiii  at  the 
end  of  high  scIkkiI.  Once  ngiiin,  hiph 
school  grades  and  lest  scnre*.  teiiJ 
to  intercorrelnle.  and  liolh  lend  to 
predict  college  j;r,'»dt*s.  Neilhei  test 
scores  nor  prades^  oii.  tlic  other 
hand,  pre^lict  which  sCudi-nts  have 
excelled  in  nonclassrttom  projects  in 
the  sciences  and'  the  hiniimiittV  ■  in 
high  school  or.  in  cotlcKe.  uut 
jKJiievenients  in  some  field  while  in 
high  school  tend  to  ^ive  a  n»»<»d  buMb 
for  predicting  thai  Ihe  person  will 
continue  to  manifest  arc  .miplisl}' 
liient  in  that  field  while  in  collet;^. . 

A  recent  siudy  by  .Monday  and 
Davis  (1371)  giver,  resiilts  conipara- 
■  hie  to  those  ol  Kieli.'trds  ( t  nl.,  but 
.this  time  compiirisons  Aiiere  mndit^ 
across  a  longer  ti.ne  spah~fr<iiti  ihe 
end  of  higli^cliofil  to  six  years  after 
■>thnt,  typic.illy  two  yenrs  nft4.*r  col 
lege  graduation.  Academic  skills 
lest  scores,  high  siliool  grndes,  and 
tollcge. grades  re  late  to  one  nn*»tlier 
but  do  not  rc^kite  to  out-nf  school 
achievementa  during  the  high 
schmil  years  and  do  not  predict 
such  achievements  six  years  Liter. 
But  oDt  of-i^chodl  ncliieveinent  in  a 
giwn  field  durnig  li.;;h  kcIio^I  pre> 
dicU  ach^vei'iient  in^hc  s'.ii6r  field 
sii  years  hence.  It  diK-s  mi.  furllier- 
ntort\  lo  ottout  the  same  degree  as 
acadeinfc  iiu*:i<ures  ut  the  end  of 
hijjh  S(ho(il  prnlii  (  iitilU^'.e  griules — 
even-though  in  thcforinei  case  we 
are  tnlking  about  n  six  year  sp(in 


leges  claim  to  seek  sfuCents  who 
have  expressed  tlipir  talent  outside 
the  classroorji  in  the  ways  we  have  ■ 
iK-en  uin^idering.  To  determine  l(* 
wliHl  extent  actual  practice  matches 
iliis  jdeolojiy.  Wing  and  W'^llacli 
(1071)  conducted  studies  of  actual 
admissions  decisions  which  includ- 
ed cmisideration  of  highly  selective 
colleircs — institutions  where,  if  any- 
where, out'of  scliool  Hcliieveincntft 
could  in  pri  *  :iple  ploy  a  role  in  se- 
lection, since  tlr.'se  colleges  are 
heavily  overapplil'd  and  most  appli* 
cants  are  re.isonubly  well  qualified 
in  terms  of  academic  skills.  1'he.re* 
suits  indiratetl  that  even  At  there 
eollfges  selection  decisions  tend  tn 
he  monoiithically  ^iriented  toward 
c(mv4'nlioMal  academic  standards. 
Knowkdge  of  as  simplistic  an  index 
as  an  iipplic<mt*s  «^*...re  on  the  verbal 
aptitude  section  of  the  SAT  lels<ine 
predict  rather  accur.itely  the  likeli- 
jiiiod  of  the  candidate's  being  ac- 
cepted (ft  rejected  al  (vitli  felediv^ 
and  uobeteclive.  institutions.  Tlte 
differeine  between  the  two  kinds  of 
college*^  seeins  not  f>o  nunli  whether 
they  de|»eirt4  on  fy^T- verbal  scores 
ill  miakinp  admissions  decision.^,  but 
on  the  leiel  of  score  required  for  ac-  . 
ceptnnce.  '  ^  *- 

Kor  iii<it^nce.  AViPg  and  Wallach 
(107 1 1  found  that,  nl  a  raiulom  sani' 
ple^ii  Ati  collep  prolialiility.of  ac«  • 
cepin'nce  inrreflses  inor;*  l!.uii  four- 
fold wlW'M  cninjiirini'  applicants 
with  SAT' Verbal  RMres-  faljing 
within  s< ore  interval.*  of  350  *199 
and  .O'tO  .MKJ  (soires  can  range  from 
'im  to  K(KM;  while  at  a  nnuple  of  It) 
highly  selective' colleges,  the  wuna 
order  of  increase  in  iTikehliood  of  aC' 


aiitj^  in  thp  latter  a  four-yenr  spkn.    ceplajQce  is  fouad  when  comparing 
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•p|>ltrnn|ji  whciKf  SAT.yc;ha!  wrn 
tnW  wllhin  troll  inlrrvnU  o*^  MV)- 
MO  mid  m  7VX  SAT  vwbn)  )xore$ 
tn  Iht  inli-rv(il  put  o  cMnU- 

Hiile  <i»  ii|i|iroiiMrt«U'1y  Ihr  WVh  i^rr. 
<f  Mlih*  nf  hijjh  f c  hiNil  smi^rs  w  hn  jjo 
nn  Ui  fn|lr)*c.  Yd  likc)ili(HK)  (if  nc- 
CPplnnor  hI  \Ui>  hlplily  wleclive  Cii)» 

grcal  if  the  fijiplicAhl  h  <;rnrp  f^lk  in 
llir  7flO  7t?l  ♦rliTViit  ihnn  iji  i^t; 
ready  Hi}»h.  in  UTval  ufjM)  .-ilM  Jin*. 
fni*oit&  llwt,  ^fcl.^W  rehjlivciy  unit  • 
Icclivo   cuMntin   it«c   SAT  vcrhjl 
sct^roi  an  u  l>.Kis  fof.nrrcnio".  ciul 
cnndidntrs  whi»M*  *.c«icsy<rc  li»oliiW 
.  fnrtlhcin  Ui  t-o|H'  vvilh  ci>)Ut«'  wnr\, 
the   hi;'l»ly  fclrclive  collirvS  ikc 
tbt'iii  to  dij;criininalc  Binonj,  np)j)i 
Cdhltt  who  nircndy  duller  nrniiiid 
"the  l>igh  and  of  iht'  nusisurc  Mnr- 
^iiinl    iiicri«mr«ls   in   SAT  vcrl'il, 
tcuren  vvilhm  ihi-.  iipprf  pflr*  i>f 
diilriliulion  d<*lrwninc  miccpUhko 


applying  a  hyp«HhclirJil  drcislon 
rule  thai  j;«vc  prnfrrcnvc  U\  ^nlld^• 
d;ilc«  wh(i  hiti\  dpniiinMralrd  Mih. 
Mrnlinl  nimnipli«i)iincntH  in  l)ie 
firlds  (luMinrd  KirliiT.  The  rule  alMt 
|»avT  prrf(*rcnrc  \tt  c.Tr'did*«tc%nfi  a 
funrlii>n  (if  Ihf  niinihef  of  fields  in 
uhirli  Mich  nrroinplishnipnU  hnd 
\wvn  deinoii>lr«U;d.  KiiijUy.  il  ]^ 
milled  ciindidnleR  lo  he  ncrepled 
ihi-  vva»-  onl\  if  Ihelr  VAT  ♦vrore*' 
and  ytH  .x  .  wt  rv  Im.M  eiMi»i;h  (SA  T 
j»ci>r(  r  in  iht-  hip  .lml^  nAlinsuIV  ff»r 
hnah  srh.MiV  •;eninr»  whn  p(i  on  lo 
OiDfRe.  and  y.rnfW^  in  l)ie  lop  IWo 
Ihudft  <if  Ihi*  hi)th  hcliiK)!  rlns^).  If 
^int-  Rcl'A^ts  by  l|ie».e  ciHerja.  iho  b>- 
pnlhc'irni  ncfopled  cIu'^h  o-erbip*; 
oirly  •lO  fii^'  x^ilh  Mir  class  nrluully 
ncci'ptHl  (){(iii(ndii'r,  liy *tt»:ilriist, 
ll.iit  f>pi<^clinj;  f»ir  iai»did'Me«i^vvilb 
Ibi-  liii?hcsl  SAT  HCi'tvs  mid  urAtlcs 
in  Iii'.h  <.cli"r»l  rp  aiil«i  io  no  jirtepled 
clftfr-i  ibiil  oNcrl.ip^  n1m  :'l  H^V  w'ilh 


versus  reject  ion: 


^  lbe.claVia<'*"'j"y  nccepled.) 


Indeed.  Winp  and  NVallach  fu/lber 

diMNimed  that  predMlio;?  f«)niis 

tions  artiohs  at  h  typiidi  lii,Mv  K- 

lective  college  m  lerin.^  of  cntriliined 

OiiiiVidcViition  i-o  an  ipi;.l  wt  i^.jhiiR 

baitU  of  the  CAiididnle*^  verbal  nnd 

tnalbeiiialiiut  scores  on  i\\9  SAT 

along  wilb  hi«  academic  arhievo* 

h.ent  l&vel  In  hlRh  school  led  lo  hucb 
■  a  hij:h  degree  of  accuracy  in  ac* 

counting  for  acceiAiiiiceiv  and  rt  jec- 

(ioitf«  as  to  leave  lillio  riM»m  even  in 
'  principle  f«»  other  farUirR  In  pinv  a 

rule.  Almut  8(V.v  <if  nil  decihions.  and 

altout  B0%  of  all  BCcepl«Mce?i  n<  well. 
.  were-c«;rectly  prcditfrd  lliis  wfiv— . 

even  tbough-the  jhi^siblo  ])rediclive 
>  accuracy  in  the^  bilunlions  l(»vver 

'than  10(1%  berauRe  Ibe  deiisio;>s  lo   ^ 

be  predicted  are  lliemseKc^  made  acliviiy  |hn(  were  a^'a»>.*;ed;  these 
witl;^  less  than  perfect  rebabillty!    aibieveinenl*;  ore  represeided  wilh 


WhnI  are  Ihe  wpplitanlv  like  who 
ire  nrceiucd  liy  lb"  rule  ibiit  em  ' 
phasizes  prufessmnal  ncrnmplKili 
mwilv'  III  ibe  Winit  nnd  \VaIl*irIr 
ri/ulU.  nul  cif  b.Kil  '  Rciena* 
•A.ievemenUi  of  bij:b  cpiably  are 
found  for  nf  (be  aceepud 

innV>i  compared  In  K  •!>  of  ibe  male 
npplicatiifi.  and  fnr  1 .%..'»%  of  tbe  ac- 
rep'ed  femflleA  compared  lo  7  A%  ot 
Ihe  female  appiirnnrs.  Oiil  nf- 
Rch(.ol  writing  acbii  veinenls  cf  high 
qualily  are  fmioil  fur  19.:i%  of  ibe 
accepted  males  coiajiarc^^  Ui  t'.>*»  of 
ibe  male  npplieenls,  and  for  n:VH"«*' 
of  the  accipled  fenmlcy*  c<'imiiartd 
lo  U.VfS*  of  Ibc  female  applicanls. 
Tbe  acii'pted  gr»ii|>  is  comparably 
accomplKlied  in  lb;*  otlicr  fields  of 


Tbi«  general  residt  was  repHcaled 
•cro!^»  two  succefutiv'dBrcent  year*' 
applicants  Tor  ndM^Kioii  to  I  he 
freabmon  cla*«.  willi  more  I  ban 
4,200  upplicanu  one  year  and  more 
jlban  4.CP0  the  next,  in  Kpile  iif  Ihe 
facl  that  one  year's  applicnnU  were 
requiriKl  lo  provide  more  I'XIenBive 
iliforiitotion  on  uut«of>»cbiHil  ac- 
compli^bmenta.  • 

,  Admisnioi)^  praclicea  aeein  to  lie 
•ubslantinllV  at  variance.  »i<?n..witb 
tbe  diversity  of  tulentn  that  highly 
tclerlive  InKtilutitui!;  Miy  llie>*  reek. 
CouU'  wlrrlinn  l)c  carried  «iut  in- 
stead in  a  wi|\Mhat  wnViM  genuinely 


fnr  bibber  incideiu-is  lh»yi  llieir 
rotes  of  ncturronce  in  Ihe  applicani 
po«d.  Hft^nij:  4b'Ctums  on  Cnnvrn- 
tinnal  acudeinie  crileria.  on  tbe 
other  band,  i/r  considering  llie  se- 
lectitm^  made  by  the  arlunl  adm:..* 
liinns  cdinmltleo.  yield';  im  acoeplvd 
grou)>  far  le»<s  distingiii^bed  in  its 
Acbipvei.u»nls. 

One  defence  of  tbe  u^e  of  Mtfitdard- 
i/ed  li*>;|R  like  Ibe  SAT  fnr  ndrftis- 
Mniw  purpiiseti  i^  that  ihey  are  mm- 
divcriminatnry  aK  sucb.  nnd  perlinpjt 
less  di«:crirpinalniy  than  any  aller- 
native  cibjeetivt  for  pelection 

wuubl  Ik».  Tbe  Wing  and  Wallaeb 


implement/  this  goal?  Win^  and  ^daUi  givu  u&  an  0|ip<»rlunily  In  cimi- 
Wfcllach  ejtpl^red  tbis  question  by    pare  fur  an  op\)!ic4int  puid  tbe  ef- 


fecla  on  '  niinwhile  candidates  of 
using  a  hypnlbelicjil  dei'isimi  nile 
based  un^SAT  scnre<  and  one  ba%4-d 
on  acconiplisliinenW  nnee'  terlAin  . 
minimum  ciiieri.a  an  lo  SAT  »M*t»re> 
iind  high  ^c.lMHl^  grades  are  Mli*fic<l.  . 
I'se  of  ibe  SAT  decision  rule  w^as 
found  1(1.  be  drii^^lirally  discriiniii.i 
Uiry  in  ils  eonsf  «pieiues:  alii)i»<l  all  • 
ujmwbiie  inndul.iUs  in.  ibe. .ippli- 
cnnl  |KMil  Uoubl  be  Mtcllidcd  Irrni 
ibe  ^I^•uJ•  nm  |'  «     I  »«e  |.I  l!n      i**  ^ 
based  or.  acconM>b»ihnien|»»,  liv  c^n-  ^ 
traM.  was  found  In  It-ad  U*  ii  fpi:le  • 
diflerent  unlcoioe;  noimbite  candi- 
daliN  vvmiuM  Im  atcrpled  in  hIh>iiI 
llu'  Ram*?  ))ropcirli».n  as  ll«eir  imi  ^ 
dence  in  ibe  ;ipi>licant  p«ip!iliili"». 
TliiK,  usin,:  ijc^tiinpbsbmenis  riilb* 
er  Ihpn  lesi  sctuc'R  ah  I  be  b.vis  f  i»r 
.selrciioii  Sli  ms,  if  aiiylbiiig.  U>  jie 
lesh  di>cr.i|iiiial«iry  in  its  consp. 
(piemes  frtr  iioiivvhiies. 

I  believe  ihni  (lur^iiropnsJil  would 
produce. a  college  class  *ioalllalive!y 
diflfiei^t  frooi  Ihiisr  selccli-cl  bv 
cnnvtnliomibnu  .Ills.  Dues  lb"  dif- 
ference liobi  inipiicn'ioii5  Inr  Ibe  ^»»- 
ciely?  Darwin  argued  llial  .|\i«.! 
ctA  cl  inirleri*  I'C^  pT^*per  iifrn^-s 
■  geiipralions  lo  ih'^  dnjir^  e  tbnl  ihey 
are  ieprehenu  <!  ui  ibe.  Jirgani^ins 
that  breed.  Si.nielbing  im,ili«;!i'ns 
may  pu  on  mi  ednralnmal  sel  -iKm; 
\f  conventional  us| -taking  skills 
nuire  llian  sij'iiificani  cOtnpetencii  s 
govern  accfcRs  to  |oni eMed  odura- 
liortal  oi>iMirliini(ir-,.  tbeie  cttm« 
pelencies  will  he  nnilerr».pr«senT<l 
in  lh»»  pi'opjr  wh»  win  more  ■  abi- 
able  edue,  lijipal  cretleiilials  in  the 
MKiely.-  Having  ibr  credenlinU 
.lend*  Id  opin  diMirs  to  rul--s  of. 
greiler  innnim  e.  sn  llie  allribnl.^s 
(if  tbe  \\Virf)U-  holding  «aii  b  roles  will  - 
Ire  iiinre  likely  Ici  influence  lln'  over- 
all  diteclion  <if  I  he  Roriety. 

PerhapK  ibe  reiison  why  ibe  mtiro 
selective  c<dleg<s  aiul  ,  grado;ile 
i^cliools  eb'iin  in  seek  sUubnts  who 
demonslAlc  divir»«e  tolenis,  while  ■ 
in  reality  ilnWising  iJn'  rev"r*^e.  is. 
tbe  ckteni  to  which  neademir  s»;tlls 
telu  and  yiur>;e  rxMniiinilioii**  arc 
rather  au<iiinali(allY  i^ipislrued  by 
faculiy/aiid  Hdnitnislrjlorrt  ""^  ^ 
flecUiig  a  persun'-.v  '•iiilelligenin*"  or 
"hi^litiiesH*"  ill  idl  Ibe  MMisrs  u{  llie 
.  term.  Obtaining  tbe  liriglilesi  sUi. 
denlH  posHililr  la-i  Lines  a  Wiiy  uf  de-^ 
fining  Ihe  <|iuilily  of  aii  infililMliim, 
and  when  colit'ges  and  ijjjfversilies 
judge  imi»  iiii>lher's  l^<»l"'"^'  s|and« 
ing  in  teiina  <if  the  iivemgc  SAT 
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%cotH  of  ihe  inctimfoR  ^CRhmon 
c\nft  or  the  averfi^c  (iKK  nptilude 
tefil  Kcnrcft  of  the  iitcuminu  gmdunte 
>tudcnl8,  the  hrnvy  uie  of  ^uch 
yurdslickn  irt  ndiiiissum^  Klmuld  he  i 
no  fiur;iH«se.  W'ipu  nnd  Wallnch 
(1971)  nnd  Cninpbfll  tlUTI)  have, 
painted  ou,t,  furlhcVm»»fe,  Ihe  frtiid- 
iy  members  ijr  unrh  ir>|iluliiini 
■  KaVi*  ihenuelves  been  si-lpficd  fi»r 
cdticiiiionfil  ndynnrrmpnl  lirrrlv  hy. 
ihf  vrry  c  rilcrJrt  vvUmm'  u-r  \M-h.i\T 
qiicijioni'd.  1 1  is  nnlurni  for  ihcin  In 
pcfpeliinte  nnd  \jrtni-  in  the 
>t|iyrnf  definins  incril  (hi»(  Ird  m 
their  own  rise— even  yhcn  fflc<?d 
with  contrary  evidi-nce. 

The  role  pinvpd  by  leRlinr  ar.eiicies 
in  pre^eivinp  Ihr  r>.in!>li'h(il  \v«vs 
nf  d(»in|:  t'  iniiK  inu'H  nl  •>  he  mow 
liuncd  'I  hov  hf>\c,  «fipr  hIi.  «  vcrI 
ed  iiilcrofti  in  ihe  c»>nu»  :iMr  nnd 
evn>  fti..jdn"i(d  use  of  imc  Usiinj; 
device  Ihcv  kiinw  hc»»rv  inoLo.  To 
juUify  rnnlinUL-d  I'lnphav^nLirsIs 
hkc  ihp  SAT  and  Ihi.  the 
gruundji  thai  ihey  prc-djtjr  cnnr^c 
grndes,  whti*  ncilhrr  lh<^*'vl  >;f(irc 
•  ittir  ihe  Cfitirsf  grode  diUVr'-ncen  in 
their  n|»i»'.*r  rnnj'.t'H  |>rio>vi  'hcIu«1 
0ccom|llishinont,  iv  qui'sii<*i)flhle  to 
Koy  the  IcRsL 

The  irony  is  cnm|ninn(h*d  wh'en  cd- 
ucaliniiHl  commentators  hke  Jentks 
nnd  K»cRinan  -(^168)  urjce  evon 
heavier  UKe  '*f  nctnlvmu  aptitude 
test  icoTVs  in* 'rod  of  ^rAihu  in  se- 
lection on  the  rround  thil  ll.ie  fur* 
mpr  arc  cul;jecl  th;in  :lie  latter 
to  irrelevant  fotirce^  nf  b.j\  Mich 
Icochers  ,;u-In|:  hiKlu-Ji^«"rtiV<i  In  Rhi- 
deiiU  who  BTV  more  pnliu*.  Kor  it  is 
their  corr'ctntiun  wilh  gi.ides  thut 
provider  the  aptit^ido  tc:»t£  with* 
.their  baiic  juKlificalion  in  I  ho  firiit 
place.  Hut  to  deal  wilh  t/  .d  aecouv 
pli^^hirtents,  mice  cerlitin  nrademlc 
ability  thr('f>liold&  h.ive  been 
cruf^scd,  is  to  reMr ir|  th»  uko  of  le^U 
to  a  much  more  eircum^rribed  func- 
tion than  testing  ai^enrips  piui^ion. 
TeKligi^  Oiieiirie<i  i^hotild  perhaps^ 
dcvole  less  rlfiiH  In  \  vA<  and  mnre  ■ 
to  helping  edneatt^rt;  a(«ses&  n8^{.* ve* 
ment  in  nctivilioK  thai  we  value. 
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•  «.  ••  .  957; 

■  ^  .  ..■ 

.  Chairman  Perkins.  Do  you  have  something  to  put  inHhe  record?  * 

Mr.  Drexeler.  Yes.  I  referred  to  an  Article  in.  Newsday  before 
and  there  is  also  one  in  the  New  York  Times.  ^  .  . 

I  thimk  you,very  much. 

ChktrfnVii  PieRKiNE!.  I  thaiik  you  very  much. 

n/^ereUpon,\at/2  jpi.m.  the  subcommittee  adjourned.]  . 
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^  APPENDIX 
Prepared  SxA^rEMENx  of  Gordon  M.  Ambach,  PraaiDENT,  the  U^iver- 

'  SITY  O^  THE  StAT^  C|f/NeW  YoRK  AND  COMMISSIONER  OF  EDUCATION 

t  am  Gordon  M.   Ambaqh,   CommlBsioner  of  .  Education  and  President  of 
the  University  of  the  State  of  New  York.     I  appreciate  this  opportunity  to 
submit  a  statement  for  the  record  on  the  subject  of  admissions  tes^ng  , 
legislation*  • 

-The  New  York  State .  Education  Department  is  often  ,  vtewed  as  the  nation's 
Icfl^dlng.  publisher  of  "open"  teffts,  which  Is  the  label  currently  attached  to 
tests  that'become  availably  to  the  examinees  and  tho  general  public  after  th<? 
tests  hav*  been  administered.     Open  tjea ting  has  characterlz.ed  our  oldest 
testing  program,   the  Reg.ents  examination  program,   since  its  origin  in  1865. 
During  the  current  school  year,   the  New  York  State  Education  Department  will 
pul^llsh  36  Regents  examlnatione,  16  o*fher  high  school  achievement  festfi,  and 
10  competency  tests  ^a  total  of  6i  examinatiorts  ^^that  are  completely  open 
and  available  to  anyone,  who  w^nt^s  them.     In  addition,  8  other  tests  will  be 
administered,   as  a  pai't  of  our  pupil  evaluation  and  competency  programs,  that 
are  "seml-opeV'  In  the  sense  that  they  iire  available  for  Inspection^  in  thousands 
of  school  buildings  throughout  the -state/    AH  of  these  tests  are  published  for 

use  In  New  York  StJite.  schools,  as  a  ni^ns  of  maintiining  acaderrtlc  standards  ^ 

■  J  ■ 

*  and  providing  grist  fof  the  MU  of  accountability, 

.  Nevertheless,  we  find  It  necessary  to  oppose  the  enactnrtent  of.  HR,  4949, 

\he  Educational  Testing  Act  of.l979i  as  drafted  presently.     The  essence  of  the  , 

bin  la  dlscloaure  of  tests,     \Vhlle  It  may  be  desirable  to  have  sucK  disclosure 

for  those  who'would  want  to'aee  their  papers  and  results,  the  cost  to  all.  of 

those  tested  because  of  tho  jpa/tlcular  disclosure,  provlsior^.  in  HRM949  seems 

to  outweiRh  * 'the  benefits,     ThV  blir  is  concerned  With  all  tests  which  are  used  fo 


i  960 


many  foi*eigh  trained  piedical  studen 
interpreted  [to  apply       our  Regents 


poatsecondary  or  proXesiional  school  admissions  or  tests  used  for  preliminary 
preparation  for  Auch  te^ts..    Suth  teste,  will  include  the  Scholastic  Aptitude  Test, 
the  American  College  Testing  Pf6grJ^  assessment,   the  Graduate  Record         *  . 
Examinations,  the  Miller  Analogies.  Test,   the  MedlcaKJoUege  Admission  Test, 
and  the -Law  School  Admission  Tests.     As  V/e  are.  learning  in  New.  York,'  the 
law  may  include  tests  not  designed  for  or,  iin  some  cases,  inappropriately  being 
used  for  admissions.     An  example  is  a  portion  of  the  medical  licensing  exatnin- 
Ation  which  is  used  for' admission  of  many  foi*elgh  grained  medical  students.  It 
is  conceivable  th&t  HR  4949  could  be  ir 
epcamlnations  because  posts econdary  institutions  use  them  as  part  of  the 
admissions  process.     Mthough  these- teats  are  already  Open  and  offered  free  of 

charge  to  students,  other  provisions  of  the  law  would  create  a  severe  financial 

»  ■       *  •» 

.      (/         ■  ,  • 

burden  for  the  .state*  and  no  benfrfit  to  the.  atudents.-  . 

•  As  I  .indicaf^d,   the  Wcw  Y^ork  State  Education  Department  publishes  many 

opftp  tests  each  year.     They  arc  educational  achievement  tests,  and  they  are 

open  becfiuse  they  serve  as  a  means  of  communication  between  the  Education 

"Department  and  the  classroom.     Theyv  te^l  teachers  and  students  exactly  what 

■  ■  •  y- 

outcomes  of  instruction  ire  important,  and  they  accomplish  this  task  much       •  / 

more  effectively  than  any  of  the  other  forms  of  communication  that  v^e  us^^. 

including  the  publication  of  syllabuses,   course  outlines^   study  guides,  l^Uetins, 

•  .  ■  '  -  ■  -■  ■  ■■  • 

and  newsletters.     The  educational  benefits  of  having  open  Regents  examinations 

and  competency  tests  clearly  outweigh  the  drav/backE  of  producing  d^ftens  of  nfw 

examinations  each  year.  ^  /  \ 

have  also  ha^^perlcnce  with'  secure  te^ts..^  For  npiany  y^ars  We 
,      '       .  '  -         '  ■/ 

administered  a  secure  examination  for  the  purpose  of  aelecting  winners  of  the^ 
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more  than  18,001},  Regents  college  scholar shljj's  that  are  awarded  annually  to 
high  Bchool  seniors.     Curi*ently,  the  Pepartmehk's  College  Proficiency 
Examlnatlon-Program  us«^-^^oure  exairtlnatlons  a^.a  service  to  Individuals 
who  wish  to  earn  college  credit  for:  knowledge  and  skills  acquired  outside  o£. 
Ivy-covered  walla.     Many  o£  our  professional  licensing  examinations  are  also 
•secure.     Because  of  our  need  to  use  secure^ests  for  Qomc  purposes,  I 
understand  many  of  the  problems  facing  the  test  publishers  ap^  sponsors 
affected  by  the  bill.  .      ♦  ' 

Looking  only  at -the  cost  lmpllqatlor\s.  of  HR.4949,  thero  c;in.be  nH 
question  that  the  publlshei-s  of  admissions  tests  Wuld'  be  required  to  increase 
their  expenditures  for  test    development  in  order  to  maintain  their  current 
testing  schedules.     Assuming  that  about-.Z^of.  the  items  used  on  each  secure 
tests  are  new  ifcems,   the  cost  of  developing  open  tests,  would        five  times' 
greater  than  the  cost  of  developing  secure  tests.     Assuming  again  that  the 
actual  total  direct  and  indirect  cost  of  secure  terft  development  represents 
25^of  a  . publisher's  total  expenditures.   th«  total  expenditures  would  double  wi 
Open  testing,     itjsing  a. different  set  of  assumptions,  on«  may  forecast  a  small 
or  larger  Impact  on  the  publishers  of  admissions  trsts.  hut  it  Is  difficult  to 
•avoid  the  conclusion  that  the  impact  will  be  ^significant.     The  greatest  effect 
will  be  on  publishers  of  tests  taken  by  relatively  small  groups  of  applicants. 
It  is  'a  realistic  Vo8sibH|ty  that  some  of  these  tests  n-iay  bo  forced  out  of 
existence  because  the.  applicants  will  be  unable  to  absorb  the  cost.  In 
par|lcular,   I  am  ^thinking  of  tests  whlch.are  used  for  admi9sion  to  highly 
competitive  graduate  level  professional  programs.     Which -ippllcants  would  be 
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•     \"  . 

.  hurt  the  most  if  6n6  of  these  tests  was  withdr&wn?     I  doubt  .that  it  Would 
hurt  the  ciUte  students  from,  the  most  prestigious  colleges^     The  lack  of  a 
supporting  test  score  wtllvhave  the  greatest  impact  on  the  adult  learner  wiibh. 
a  ^'sUle''  undergraduate  background,  the  economically  disadvantaged  student  Who^ 

■was  forced  to  attend  a  less  prestigious  institution,  and  the  student  who  obtained 
lower  grades  in  the  first  year  or  two  of  college  because  of  a«  disadvantaged' 

.  background.     In  other  words,  the  law  may  ht|rt  .some  of  tbe  ntudcnts  It  was 

;  ■  r  ■  ■ 

designed  to  help. 

'  ^         Unfortunately^  there  is  another  step  that  publishers  could  take  to- 
minimize  the  impact  of .  the  proposed  legislation.     They  coivid  simply  reduce' 
•the  number  of  tests  administered.     For  example,   instead  of  offering  the  SAT 
on  B  even  Saturdays  and  seven  Sundays,   its  publisher .  could  administer  the*  test 
only  twice  a  year,  thereby  reducing,  the  optional  tdsting  sites  and  dates  for  the 
student.     The  greatest  impact  will  be  on  applicants  who  arc  given  the  opportunit 
to  tatcd' special  administrations  of  these  major  tests  because  they  cannot\;attend 
the  regular  'administrations  ,for  various  reasons  including  Illness;  physical 
handicaps  or  religious  beliefs.     We  estimate  tbat.spocial  administrations  of 
some  major  tests  are  actually  given  on  nearly  one  hundred  different  dates 
during  thc»  year.     No  publisher  can  be  expected  to  continue  this  practice  under 
the  p^ropo.sed  law.  ■  ■         .  ' 

Our  general  concern  for  New  York  State  residents  is  heightened  by  the 
fact  that,  six^f  the  admissions  tests  affected  by  the  proposed  legislation  are  use 
as  the -basis!  for '  awarding  scholarships  and  fellowships  in  eight  different 


scholar  ship  and  fellowBhlp  programs*  admloiaterc*  by  the  State  Education 
D^artment.     The  major  Argujnent* for  u»lng  th#?8e  tceta  ia  to  avoid  the  needless 
'  duplication  of  testing  which  would  result  from  the  u^^e  of  D«partment-propared 
exa^mlnattons,   tfa  the  extonit  that  our  own  tests  would  parallel  the  various 
admlsslon/^osts.     Thus,   the  negative  Impact  of  the,  ptopo»e«  legislation  Would 

be  mom^acute  for  scholarship  and  i^Uowshlp  candidates*  nnany  of  whom  have  the* 

,     ■#  '  ,   -»  .    .     ^  -'' 

least  ability  to  pay  the  increased  fees  and  trivycl  to  oth>5r  Igcations  to  taVe 

.    ,         ■     i»  .  ■    •  , 

the  examlni^li^ns.  ^  '   ^,  ' 

^       The  use  of  admissions  •  t.&8ts  for  .sqholal-shlp  and  fellowship  purposes 
•  f    '  '  ■ 

introduces  an  additloViaV  concern  ar\d  pb^iential  source  of  increased  fees.     As  * 

convenience  to  candidates,    th«y  nirt^/  ^iubmlt  bcoVep  obtained  on  any  testing 

date  prior  to  thcs  filing;  dfadlinr  for  the  acholarshlp  or  followbhip  application. 

*X)>i8  avoiis  many  administrative  problons  associated  with  a  single  testing  date. 

■  *  ■  «        .  ■  <  '  . 

At  the  aa'me  time,   it  creates  a  need  for  test  scores  that  have  idontieal  scale  ^ 

■      •  '        f  ^  -  *    *  •  <  ■        .     .  . 

•  values  regardless  of  the  form- that  is  taken.    ^    ■  ^  ■   '  . 

c    •  ■  .  — •  -  ■  ^ 

A  major -criterion  for  admissions' tests  is  that  the  scores  be  comparable 
■        •  '  ' 

between  different  forms  of  the  test.     This  required  a  benchmark  or  standard 

for  equating.     There  are  two  basic  strategtep  u^ed  for  this  process.  The 

first  Involves  simultaneous  administration  of  a  ^ew  and  old  form.     This  cOmmonly 
ff 

used  alternative  v^fill  be  eliminated  by  tlie  proposed  1^1,4949  bill.     The  second  r 
strategy  in^^olvei^  the  use  of  a  few  equating  questions  on  each  new  form. 
.   Although  these  equating  questions  may  be  kept  secure,  thU  is  riot  a  simple 
solution  to  a  complicated  problem.     I  urge  you  to  reconsider  the  equating^ 
problems,  which  have  been  cited  In  other  presentations. 


*.        .  Many  of  the  problems  oi  equating  are  made  acute  by  thq  short  time 
period  impOMd  before  im|>l0nientation.  ^Test  development  ie  a  long  and 

complicated  proi^ess.     Many  of  the  tests  to  be  ^admlnlst^^red  several  mpntha , 

.I.  .  ;      •.    •       '  \  \  . 

.       '*'*•  •      »  ,   *  •"*... 

irovcK  now  have^  already  been  developed.     M^^y  of  these  have  been  djeycloped 

using  the  first  strategy  mentioned  above.     Can  thoy  be  changed  within  a  few 

weeks  to  provide  accurate  and  consistent  scores  using  a  'different  strategy? 


weeks  to  ^rovUe 
I  doubt  lt«  U\ 


new  and  unproven  equating  prpicedxire  is'used,.  oi)ly  the  test 


candidates  will,  suffer  if  It  fails: 

There  Is  also  a  potential  ttiVeat  to  the  ijicluston  of  non^o  per  a  Clonal  items 
'  on  a  test  foi'm  solely  for  use  In  equating  and  {>rete8.ting.  .  In  thie Scholastic    .  t 
Aptitude  Test,  •cxamlneotf  sf>er^d  one-sixth  of»thelr  testipg  'time  answering 
questions  that  have  no  bearing*  on  their  scores,  and  they  havq  no  idea  .  . 
which  Items  these  are.  .   If 'this  test  becomes-  open,  one  -can  anticipate        *  ✓ 

considerable  pressure  on  its  publisher'  to  eliminate  the  non-oporatlon^l  ite^s* 

•  ■■  ...  ■  ^  "  ■ 

This  will  for cje  the  publisher  to,devlse  new,  more  costly,  and.  less  accurate 

>  .      :  \  -■ 

metiiods  for  equating  test  forms  and  for  pretcvttlng  questl9n8. 

*.        test,  like  any  other  product,  may  contain  /a\\\ts.     No  reputable 

■   .  *  ■  .  •  •'■  ■ 

test  pubUsheV  would  i:laim  that  Its  test  Is  perfect.     Xhe  dependability  of  a 

■  •  r    .  ■  .     .  ^.  /  , 

complex  industrial  product  ls^b(L8c4*in  part  on  the  use.'of  trlqd  and  proven 

*t  .      ■         ■  * 

components.     A"  bxan^ination  composed  of  previously  used  and  proven  questions 

Is  no  different.     If  all  of  these^  questions  must  be  replaced  by  new  and  untried 

questions  for  each  administration,   the  quality  of  the  product  will  decrease. 


With  reference  to  the,  beiveflts  that- are  claimed  for  1^^4949.  it  may  be 

One  \ 


worthwhile  to  cxamrine  them  more  closely.     One  benefit. is  that  it  would  make 


•  ■ '  '.  •»..• 
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te&ts  avaUable  for  all  to  Inspect,  fevaluale  and  administer  In  Independent 
teacar.ch.    Aa  It  ^  now  stands,  howevej,  sonrie  publisher  a  have  released 'forms 
of  their  tests  for  thtese  very  purposes.     Further,  this  benefit  could  be  realized 
J>V  •imply  requiring  all  publishers  to  release  one  or  tw6  forma  of  their  secure 
tests.  .   It  is  unlikely  that  this  would  force  publishers  to  redesign  their  -entire 
systems  of  test  development  and  increase- fees  or  decrease  service!. 

A  second  benefit  cUlmed  for  Hp,M949  is  that  it  would  allow  examiitees 
to  review  their  answer  papers  In  o/dor  to  verify  the  accuracy  of .  the  scaring 
and  challenge  any  questions  that  ate  poorly  written' or  incorrectly  keyed. 
Assuming,  that  this  Is  neZ^n9,Vf/or  desirable,  it,   too,  could  be  accomplished 
by  less  radical  surgery,     Aopifcs  of  anawer  papers  and  scoring  keys  could  be  - 
furnished  and  the  publishers  ciuld  be  required  to  designate  certain  locations 
in  which  examinees  could  review  diuestion. keys  under  secure  conditions*  This 
is  the  procedure  follov/od  with  New  York  SUte  Civil  Service  Examinations,  and 
it  works  well  without  any  adverse  effects  upon  the  cost  and  quality  of  the 

examinations.  <l 

In  sum,  whilb  the  State  Education  Dc par tment' aggies  with  the  Intention 
to  assure  that  the  purposes,   procedures,  and.  use  of  adtnisslon  tests  are  made 
available  to  the  public,   I^.  4949,   as  drafted,  is  not  an  effective  meana  toward 
that  end.     Since         4949  is  patterned  after  the  New  York  State  statute,  we 
urge  a  delay  in  the  enactment  of  any  Federal  teatlhg  legislation  until  the  full 
Impact-  and  raifftf ications  of  the  New  York  SUte  statute  are  reali.^.ed.     In  this 
i«ay,   any  adverse  effects  |rom  .the  New  York  State .  a^peri'once  can  thereby  be. 

prevented  In  future  Federal  legislation.     If  a  delay  is  nOt  possible,  we  urge 
that  aUernatlvus  Is  developed  which  will  not  have  adverse  effects  upon  the 
cost,  quality  and  iccessibillty  of  the  exan^inations.  .  , 
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TNB  MNIVKMirY  OF  THB  ITATB  Of  NEW  YOUK 
^  TMB  STATB  OMJCATION  DIPANTMBMT  <  ^ 

Ornet  op  tnv  PntfiDiNT  or  tmb  Univbmitv 
ANo  Commimionkh  op  boucation 

ALBANY,  NlW  Y01IK  11114 


/ 


> 


October  17»  1979 


Dear  Mr.  Chairman:  '  '  . 

On  Auguit  13,.  1979,  I  aubmlHed  a  statement  for  the, record 
opposing  enactment  of  HR  4949>the  "Educational  Testing  Abt  of  1979." 

Governor  Carey  on  enacting  the  Ne^r  York  State  Standardized 
Testing  Law  (Educatlbn  Law  Article  7-A  as  enacted  by  Chapter  672  . 
of  the  Laws  of  1979)  asked  the  Department  to  prepare  &  report  on  the. 
impact  of  this  law.  I  have«  recently  submitted  to  Governor  Carey  our 
initial  report  tad  wish  to  include  it  as  a  part,  of  my  earlier  statement 
submitted  to  you  for  the  record.  I  hope  this  will  be  helpful  to  you  as 
you  further  deliberate  HR  4949. 


If  I  may  be  of  any  further  assistance,  please  do  not  hesitate  to 
call  upon  me,  * 

Sincerely, 


Honorable  Carl  D*  Perkins 
Chairman      '  ^. 
Subcommittee  on  Elementary,"  Secolidary 

and  Vocational  Education 
Committee  oh  Education  and  Labor 
Washington,  DC  20515 

cc  senator'  Javits 

Representatives  Biaggi,  Weis 


s,  PeyserplChisholm' and 


Goodling 
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.THE  MNiVKHWTy  ofWmk  »TATK  OF  nkw  vouk 

TNI   StATC   KOUeATION  VKFAfltMtNT 

ornei  or  tm»  FuMioiNt  or  tnt  Univcrsitt 

AND  COMMI^IOHIR  or  COUCATION 
AkBANV,  NKW  town 


Octotjer  16,  1979 


Dear  Governor  Care: 


I  am  pleased  to  transmit  an  initial  statement^ concerning 
the  anticipated  iittpact  of  Chapter  7A  of  the  Education^  Law. 
This  report  is  submitted  in  accordance  with  the  request » in  your 
afpproval  message  of  July  l3,  1979. 

.•  .      .    ^  i  ■  ^ 

I. will  shortly  send  this  report  to  New  York. colleges 
and  universities  asking  how  they  plan  to  deal  with  the  antici- 
pated changes  occasioned  by  the  legislation.^   An  ana,lysi&  of 
the  responses  from  the  colleges  will  furnish  information  for 
a  subsequent  report. 

*  ,..In  November,  I  will  bring  to  ^he  Regents  propoAed. amendments 
the  Regulations  of  the  Cominissi^ner  of  Educajiion  xo  implemeat 
the  Law.    Both  the  proposed  Regulations  arid  commonly  asked  question 
and  answers  about*  thero  are  included  as  part  of  thJLs  impact  report. 

•  SljiQar01y,  ' 

s 


3 


The  Honorable  irogh/l.  Carey 

The  Oovernpr.  of  |the  State  of  New  York 

8ta^e  Capitol 

Albany,  Ney  York 


TM«  UNIVKRftiTV  Of.  TH«  »TAT«  Or  NKW  VORR 

THE  STATE  EDUCATION  DEPARTMENT 

*•    ALBANV.  NKW  YORH 


Initial  Impact  l^eport 
.  ^  \         '^f  the 
Admidsioxv  Testing  Legislation 


Introduction^  r  .  ^ 

.    Debate  oVer  the  proposed  adpi^sioh  testing  legislation  generated 
nu^rojie -Btatemente  of  support  l^ij  opposition.    In  hia' in^randiMn  p£ 
approval  of        bill,  the  69ve\»nor  acknowledged  thdse  conflictipg 
.  B^ateMnts  and  asked  the  Cpmmissipner  of  Educa^ic^  to  report  pn  'tM 
impact  Of  tih«?  legislation  apd  on  any  adininis}:rative  problems  caused 
by  it<  iinpletoftnj:ation.    This  repcftt  ^uUi^es  the  potential  impact 

ojfi^^ctiona  being  considered  by  the  test  agencies,    ^he  full  impact  of 
V      "  *  .    .  ■  ,  ..." 

tha  legislatioii  will  riot  b^  known.  fdr  lntMiy  months  and  a  more  complete 

^H^*^  ''^^^  ^  g^ner^^ted  after  the\majbr  test  agencies  liave  complcfi^ 
their  .-plans  .' '  ^ 

.•^  vThe  impact  of  the  ^dittission  t9st|Hg  legislation,  is  inflMencdd  by 
^the  decisions  of  .individual,  test  spohsOrs.  ♦Thif^  report  is  dividj4,/*; 
into  several  lied^fions.    A  bri^|  background  discussion  is  followed  b/  .; 
a  discussion  of  th$  Asts  beii^g  withdrawn  from  use  in  the  Si;ate.  llift 
probable  reasons  for  wiifhdrawal.  of  these  tests  as  j^ell  as  impacit 
on  'students  ^re  included.    Next,  thcjediiction  in  services  for  other 
test  programs  i^  described  in  terms  of  its  ^pact  «n  candidates.  llie 
last  sectioiis  of  thi«^  report  ^discuss  technical  and  administrative  prob- 
lemsi  one  of  which  may  have  severe  impact  on  testing  during  the  pecond 
half  of  the  i979*-^0s^academio  year." 
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Background       -     >  *  I 

•  ■■ 

On  August  1,  a  few  days  after  the  admission*  testing  bill  was  ♦ 

*■  ■  ■  .       '  # 

signed,  the  Education  Depai^tment  fnailed  a  copy  of  the  Law  to  over  sixty  * 
test  sponsors,  and  publishers.    A  covering  letter  (Attachment  1)^ asked 
these  agencies  to  identify  the  tests  which  come  under^rovisions  of  the 
Law,    The  test  agencies  were  also  asked  to  provide  their  plans  for  test- 
ing  after  the  effective  date.    As  a  result  of  this  letter i  the  namea  of 
twenty-six  admissions  testing  programs  have  been  identi^fied.    In  most 
cases  a  prx>g1ram  consists  of  only  ^  single  test,  howeVer,  in  soflle  cases 
.a  program  contains  several  individual  tests.  ^ 
At though  the  names  of  admission  testing  programs  were  provided, 
the  sponsors  almo»t  uniformly  stated  that  it  wa^  premature  for  them  :t6  P 
make  pjLans  for  tests  to  be  given  after  the  effective  date  of  tile  legis- 
lation.   They  exp^sse^  concern  about  the  ambiguity  of  some  sect ^pns^  ^ 
of  the  Law  and  ^e  possible  consequences  of  various  interpretation  of 
the  Law,    Meetings  and  telephone^  conversations  were  held  with  individual  ' 
sponsors  t©  discuss  the  interpret^on  of .  the  .Law.    The  sponsors  wanted  ♦ 
all  aspects  of.  t^e  L,aw  $^  be  defined  by  Commissioner's  Regulations,  The 
Department  takes:  the  position  that  interpretation  bf,J:he  law.  can  only 
be  made  by  the  6ourts;    The  Department  has  expressed  its  opinion  about 
various  sections  of  the  Law  in  a  series,  of  questions  and  answers.  These 
opinions  as  well  as  proposed  Commissioner's  Regulatibns  will  be- circu- 
lated within  a  few  days.     Copies  oie  these  two  documents  are  included  as 
Attachments . 2  and  3,  ^  .  . 

Most,  sponsors  now  haVe  provided  the  Department  with  an  iiea  ot 

the  testing  plans  they  *re  considering.    Although  the  pl^ns  ace  tenta- 

■      '..  ■  "  •■  •  *  ^*  . 
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tlvoi  they  provide  a  basis  for  reporting  on  the  probable  impact  of  the 
.  law*    Attachment  4  lists  the  various  admission  testing  programs  identi*- 
fled  by  the  sponsors*    These  programs  are  divided  between  those  which' 
Ate  expected  to  continue  providing  some  services  in  New  York  State  aKd 
those  which  are  expected  tp  withdraw  services.    In  reviewing  the 
list,  it  is  critical  that  two  important  considerations  be  .kept  in  mind.' 
[  First,  the  Ximt  includes  only  tests  identified  by/Uie  sponsors.  Other 
testing  programs  probably  will  be  added  to  the  list  during  the  next 
feK  months.    Second,  the  claasificatflon  of -a  testing  program  into  one 
of  the  two  basic  groups  must  be  ' considered  ^tentative*    The  sponsors  of  • 
all  of  these  tests  appear  to  be  working  to  overcome  obstHcles  which  are 
forcing  curtailment  or  elimination  of  services  in  Neif  York  State. 
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TESTS  TO  BE  WITHDRAWN  PROM  USE  IN  NEW  YOUK  STA*E 

•    ■  .  ••  ■ 

A  review  of  Attaclfunent  4  reveals  that  twenty  of  the  twenty-six 

test  programs  may  be  withdrawn  from  use  in  New  York  State.    Most  of. 

'        ■       .  *  • 

these  tests  are  given  to  small  numbers  of  persons  compared  with  the 

larg^  number  of  candidates  taking  the  Scholastif  Aptitude  Test  and^ 
the  ACT  Assessment  Prograirt.    Small  numbers  of  candidates  is  the 
Reason  cited  by  the  sponsors  for  withdrawal  of  most  of  these  tests. 
In  a  few. other  cases  the  flexibility  of  tes/  administ;ration  pro- 
cedures was. cited  as  the  major  obstacle  facing  the  sponsors. 

The  a6t:ual  development  co^t  of  a  new  test  form  is  relatively 
•independent  of  the  number  of  candidates  to  be  tested,  Although 
Wis  cost  may  vary  considerably,  $25,000  is  a  conservative  estimate  ^ 
of  development  cost  for  many  halfrday  tests.  /This  figure  includes 
the  cost  of  question  writing,  review,  and  validation;  it  does  not 
Include  other  costs  such  as  test  administration  and  overhead.  These 
development  and  administrative  costs. are  borne  by  the  candidates 
taking  the  test.    When  thef  nirfnber  of  candidtffcs  is  small,  the  cost 
per  candidate  is  high  unless  it  is  possible  tlP  reduce  the  total 
cost  by  the  reuse  of  individual  questions*    U|ider  the  new  legisla- 
i:ion,  the  release  pf  questions  after  use  will  require  development 
of  totally  new  forms  for  each  administration.    Such  development  Vill 
be  rea;|^8tically  impos%ible  for  the  sponsors 'of  many  of  those  tests. 
At  least  si3^  of  the  tests  are  administered  topless  t^han' 500  New  York 
State  candidates  each  year.    One  sponsor  provided  the  ^xample  of  its  \ 
.graduate  school  admissions  test  which  is  administered  three  times 
each  year  to  a  total  of  300  candidates  in  New  York  ytate.     Utting  the 
estimate  of  $25,000  tp  simply^develop  each  form,  the  sponsor  stated 


V 
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that  thi' total  develbpriliii^  coat  would  be  $75,000  6ach  year  or  $250 
per  .candidate.    Reducing  ti^e  i^umber  of  administrations  to*  once  each, 
year  would  still  result 'ih  a  ^evei^bpment  cost  in  excess  o£  $80  ^er 
candidate.    On  this  i^hanci^l  Isasis  alone  the  sponsor  sees  no 

I    .     -  ■    '   ■  : 

alterjiat&ve  other  than  ta  withdraw  the  test  from  use  in  New  York. 

Some  of  the  other  tests  in  this  group  are  igiv^h  o(i  locally 

scheduled  dates  set  by^independ(Efnt  administrators  or  individual 

institutions •    Although  a  few  of  these  tests  are  given. to  large 

numbers  of  candidates,  thii/^rob-lemo  facing  sponsors  are  illustrated 

In  the  following  statement^ submitted  hy  one  sponsor:^ 

•  «.*'The  problems  of  usingV^Kis  flexible  administration 
procedure  und#r  the  LaValle  Act  delate  to  its -require- 
ment that  after  a  single  person  is  tested  in'any  Mew 
York  State  Center  in  1980  (oxs  in  an  6ut-of-state  Center 
but  with  resulti  reported  to>  New'' York  institution)  we 
would  be  obliged  to  ittake  the  test  content  public  after 
thirty^  days,  with  the  resultin^r  lo9s  of  test  security, 
and  need  to  create  new  secure^  forms'. 

For  us  to  phange  from  this  fle^cible  arrangement  to  a 
fixed-testing-date  pilan  in  New* York  State  only,  would 
Require  the  determination  of  tHP  to  four  dates  and 
negotiations  to  set  up  e^2unining  sites,  since  some 
exiating  Centera  may  not  be  intatested  in,  or  capable 
of  ,  changing  thei^  sbyle  of  operation.    We  would  haive 
to  alter  our  methods  of  scoring  and  reporting  of  results. . 
Hhereas ^at  present  tie  tests  are  scored  and  initial 
reports  are  sent  outyby  tl;|e  local  examining  Center,  the 
change  for  New  YQrk  would  require  a  scoring  and  report-.  '  . 
ing  system  operating  tout,  of' our  .offices.  ** 

'   "        \  *  t) 

Many  of  the  administrative  problems  alluded  to  in  this  state*^ 

*  .  I    •*'*..  ■ 

ment  could  be  overcome..    Tado  a(>,  would  require  time,  however,  and 

■  "      ■  •   *   1  S    \  •■ 
changes  would  be  made  at  th^  e^cpens^of  the  very  flexibility  which 

has  made  the  tests  to  tjisef^llto  tjil^e^ colleges. 

Impact  of  Tests  to  be  Withdra 

If  only  a  majorit^  bf  the  t|st^s  in  this  grbup  ar<i  actually 
withdrawn,  there  will,  still  ba  a'ol^air  impact*  on  the  State* 


'  SiKtean 'Of  the  twenty/ tests  are  de8ig;ied  £or  use  by  health 

related  prograniB.    Thi^s  fact,  by  itself,  is  of  major  concern.  The 

greatest  negative  impact  will  undoubtedly  result  from  withdrawal  ' 

of  teste  nised  by  programs  v^th  highly. competitive  admissions  p^oce^ 

dutes.    Loss  of  the  tes.^s  will  not  hurt  the. elite  students  from  the  . 

most  presl;igipus  college^.    As  the  dean  o^  one' medical  school 

«.    ■  .  J. 

.retried,  it  is  ea^y  to  pick  only  the  top  studeinbs  froiQ  the  top 

undergraduate  programs.    His  \»chool ,  and  oth^r,  also  review  the 
applications  of  many  other  individuals  who  would  not  have  been  con- 
sidered except  for  their  good  performance  on  the'  admissions  test» 
This  group  often  includes  the  economically  disadvantaged  stiji^nt 
wt)o  was  forced  to  attend  a  less  prestigibus  college  or  the  student 
who  obtained.  low4r  grades  in  the  first  year. or  ^wo  of  college  because 
of  a  disadvantaged  background.    In  some  'programs  this  group  includes 
the  adult  learner  with  a  "dated*;  undergraduate  Jbackground.    The  per^ 
centage  ht  students  admitted  from  this  group  may  be  no  more  than  ten 
to  twenjSy  percent/ however,  the  numbers. are  still  significant.  .  Al* 
though  specific  data  is  unavailable^  this  group  appears  to  contain  a 
high  proportion  of  minorities  and  economically  disadvantaged  students* 
During  the  last  few  years  considerable  effort  has  been  made  to  increase 
the  representation  of  minorities  within  the  professions.    The  loss  of 

the  admissioh  tes^  as  anv independent  measure  of  ability  presents  a 

■'  .  ■        *    .        .  . 

partial  roadblock  to.  correction  of  this  inequity.    The  disadvantaged 

•.      .     ■  ' 

student  with  superior  undergraduate  grades  is  likely  to'  be  admitted  . 
even  with  lower  admission  test'^scor^.    On  the  other  hand^  the  stu* 
dent  with  equal  ability,  'but  le^i^mpressive  credentials  may  never  be 
coijeide red  without  the  benefit  of  a  test  score.  '      .  ' 


Lese  significance  will  result:  from  withdrawal  of  the  tests 
designed  for  use  by  practical  nursing,  programs.    These  programs  are 
able  to  accommodate  most  applicants  who  have  achieved  satisfactory' 
high  school  grades.     In  most  other  health  related  jprogr^s,  the  ^ 
competition  for' •admission  is  keen* 

The  Regents  Scholarship* Program- for  Medicine,  Dentistry  and  Optometry 

Each  year  the  Regents  award  a  total  of  135  scholarships  in 
medicine^  dentistry  and  optometry  on  a  competitive  bhsf 8  as  required 
by  Educatiph  Law.    Medical  and  ^dental  scholarships  were  originally 
based  on 'the  results  of  a  Departme;it  developed  test  designed  specif- 
ically for  this  purpose.    However,  this  tei^t  was  eliminated  by  the 
19^7-76  Budget  as  was  the  test  used  for  undergraduate  scholarship 
awards*    The  admission  tests^used  by  medical  and  dental  schools  were 
then  accepted  as  the  alternative  for  * determiAincf  scholarships. 
In  1977,  optomietry  scholarships,  were  created  by • the  legislature  and 
the  Optometry  College  Admission  Test  was  selected  as  the  only  appro- 
priate test  to  use' in  making  awards.  . 

The  sponsors  of  these  three' tests  have  informed  the  Department 
that  the  testis  may  be  withdrawn  from  use  in  the  State*     If  this 
occurs,  the  Regents .yill^  have  no  appropriate  method  of  making  the 
.awards.  ^ 


TEST  PROGRAMS  TO  BE  CONTINUED  .  IN  NEW  YORK  STATE 

At  least  six  admis^idn  testing  programs  are  expected  to 
continue  serving  New  York  State  students  and  institutions.  In 
ail  cases,  however,  services  ard  expected  to  be  reduced,.  The  follow- 
ing is  a  brief  description  of  the  tentative  plans  which  have  been 
provided  by  the  sponsors. 
ACT  Assessment  Program 

/       The  sponsor  has  provided  no  specific  plan  for  reductions  in 

•         •  .  ♦ 

the  number  of  regular  administration  dates,  however,  continued 

availability   with  some  decrease  in  services  is  anticipated.  Telephone 

ponyersations  iiHicate  that  special  administrations  probably  will 

be  sharply  reduced  or  eliminated.*    Most  significant  in  terms  of 

numbers  of  candidates  is  the  probable  elimination  of  residual 

(on-campus)  testing.    Secure  forms  of  the  test  are  currently  available 

to  colleges  for, use  in  evaluating  applicants  who  did  not  take  *  ^ 

regular  form  of  the  test.    Approximately  2,200  students  were  tested 

in  thijB  way  during  the  last  testing  yearj  many,  if  not  the  majority, 

were  adults  who  needed  the  dcotes  for  placement  gather  than  admission. 

Over  300  other  students  were  tested  on  non-Saturday  test  dates 

(usually  the  followin^^'^SuW^ay)  due  to  religious  reasons.    To  avoid 

anj^  questions  over  the  Validity  of  scores  caused  by  a  compromise  in 

security,  these  students  are  given  a  different  form  of  the  test. 

In  pie  future^  the ^number  of  spetyLal  non-Saturday* test  dates  may  be ^ 

drattticaXly  reduced.    Handicapped .  i^tudents  are  now  permitted  to  take  a 

form  pf  the  test  on  virtually  any  day  in  the  ydar.    This  practice 

probably  will  be  eliminated  and  the^e  candidates  will^be  expected  to 

JbaKe  the  test  on.  the  regularly  schedtUled  administration  dates^ 


Graduate  rtAnag^ent  Admla^lona' Test 

ThiB  test,  1^  normally  administered  on  a  Saturday* and  on  the 
following  Noivda^in  the  mo^iths  of  October,  January  f  March  and 
July.    The  January  and  March  I9B0  dates  will  be  continued  but. the 
Monday  administration  in  July  will  probably  be  cancelled.  'This 
will  affect  approximately  140  sabbath  observers.    While  the  sponsor 
has  not  determined  its  New  York  testing  schedule  for  the  following 
year^  it  states         While- It  may  be  possible  to  maintain  the  same 
nuKi&er  of  Saturday  test  dates,  it  may  be  necessary  to  reduce  the 
number  of  times  the  test  is  offered  on  Monday.*!    The  sponsor  had 

'A  •  ■  ' 

.  planned  to  introduce  special  forms  (large  print,  Braille  and  |^ 
cassette)  of  the  test  in  July  19B0.    Because  of  the^time  and  money 
required  to  produce  these  forms #  their  introduction  will  be  post- 
poned.   Thereafter,  testing  using  these  formats  may  be  limited  to 
one  or  two  dates  a  year.    Make-up  testing  for  administration^ 
cancelled  due  t^  unfe>rese^n  emergencies  will  be  available  only  when 
the  same  form  of  the, test  giyen  on  the  regular  date  at  other 
locations  can  be  reused  before  public  disclosure . 
Graduate  Record  Examination  Program  - 

The  Graduate  Record  Examination  Program  consists  of  one  general 
Aptitude  Test  and  numerous  Advanced  Tests  in  different  subject 
areas.  .The  Advanced  Tests  were  specifically  excluded  from  the 
disclosure  provisions  of  the  Law  and  it  is  unlikely  that-their 
availability  will  be  reduced.    The  availability  of  the  Aptitude 
Test  ^probably  will  be  reduced  from  the  current  six  times  per  year  , 
to  four  or  possibly  fewer  times  per  yfear.    Also,  Monday  adminis- 
trations  for  sabbath  observers  whlcn  are  now.  hd^ld  after  five  of  the 
six  Saturday  dates  will  be  reduced^     It  is  ^ikely  that  the  sponsor 
may  cancel  the  administrations  already  scheduled  for  Monday'  in 


^  ■ 

■  / 
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January,  Saturday  in  February  (na  Monday  date  was  scheduled)  and 

both  the  Saturday  and  Monday  ^ates  in  ^une«    Thie  only  remaining 

test  dates  will  be  the  Saturday  administration  in  Jariuary  and 

the  Saturday  and  MondAy  administrations  in  April.  Approximately 

5,660  potantial graduate  students  will  be  affected  by  these  probable 

cancellationsv    Further^  the  sponsor  states  that: 

"Until  the  effective  date  of  t^he  legislation,  it  will  be 
possible  to  continue  past  .GRE\  practice  of  reusing  secure 
forms  (or  editions)  of  the  Apkitu^e  Test.    Ais  flexibility 
has  permitted  the  development \of  h  variety  Je  special 
services  to  meet  the  needs  of  dirsduate  insti^tipns  and 
their  applicants  Who  are  required  to  submit  GK  iBcores* 
The  requirements  of  the       Valie  law  ma)ce  disclosure  of 
each  test  after  small'  administrations  prohibitively  expensive 
because  of  the  increase  in  the  ntimber  of  new  test  forms 
that  would  be  required  to  ensure  secure  testing  conditions* • 
"Currently,  handicapped  students  m^iy  ta)ce  the  Aptitude  Test 


on  any  scheduled  administration  4,ate  (national  or  **special") 
and  nay  use,  as  appropriate »  testV presented  in  large  print, 
braille r  or  on  cassette  tapes,    fiaqause  of  the  high,  costs 
of  producing  test  versions  in  by^ille  and  on  cassettes, 
these  two  options  wil9  not  be  provlj^d  in.New  York  in 
April  1980.    Thereafter,  testing  using  either  of  these 
formats,  and  p(>3sibly  large  print  as  well,  will  be  restricted, 
^  if  available  at  ail,  to  one  or  two  dates  a  year.** 

In  addition,  the  Aptitude  Test  is  available  to' military  personnel 

through  the  Defense  Activity  for  Mon-traditional  Education  Supports. 

s  ^ 

Because  many  of  the  military  personnel  might  want  results'  sent 
into  t^ew  York,  the  DANTBS  testing  will  be  temporarily  discontinued 
on  J^uary  1,  1^80,  except  for  testing  during  the  week  following 
the  April  national,  test  date.  ^  I 

Law.  School  Admissions  Test  .    '      *  ^  . 

*    /      The  sponsor  has  conveyed  its  dear  de'bire  to  continue  t»roviding 
-services  within  the  State.    It  has  not,  however,  determined  the  ^'^ 
specific  actions  it  Will  take  for  test  dates  already  scheduled 

and  for  idate^  tq  be  scheduled  in  subsequent  test  years.    In  developing 

.    •  ... 

its  scheduler-  the  sponsor- Jhatf  particular  concern  over  how  to 
accommodate  the  reia%veljr  ^r^e  number  of  sabbath  observers  who  > 


require  special  testing  dates. 
V  Prelireinary  Scholastic  Aptitude  Test/National  Merit  Scholarship 
Qualifying  Tyst 

The  first  administration  of  this  test  subject  to  provision^  of 
the  Law  would  be  October  1980.    Although  regular  admiJistrations  on 

,  a  Tuesday  and  Saturday  in  October  are  still  envisioned,  it  is  lik^y 
that  arrangements  for  alternate  testing  will  have  to  be  discontin.ued. 
Scholastic  Aptitude  Test  and  Achievisment  Tests 

The  College  Board  Achievement  Tests  as  well  as  the  GRE  Advanced 
Test^  mentioned  earlier  are  exclil&ed  from  disclosure  provisions  of 
-the  law.    For  this  reason,  ho  major  long  term  test  administration 

*  ch^ges  are  anticipated.    The  Scholastic  Aptitude  Test  (SAT)  on  the 
other  hand,  is  subject  to  all  provisions  df  the  law.    On  October  10, 
'We  College.  Board,  sponso]^  of  the  test,  announced  cancellation  of  the^ 

^  January  administration  and.  two  other  scheduled  Sunday  adfltipistrations. 
The  January  Achievement  Tes^: 'administration  was  also  cancelled  because 
of  the  high  cost  of  openiiL  tejt  centers  for  a  comparatively  siwlll 
volume  of  candidates.    As  J^any  as  five  of  the  Sunday  administi?4tion8, 
affecting-  1,800  sabbath  observers,  may  be  cancelled  in  1980.  In 

o 

addi'tion,  the  sponsor  is  considering  the  cancellation  of  all  January 
and  November  dtttes  which  would  adversely  affect  an  additional  28,000 

.  "^students  t  * . 

A  very  limited  number  ot  forms  of  a  Spanish  version  of  the  SAT 
(P^eba  de  Aptitud  Academicaf  are  developed  in  Puerto  Rico.  The 
sponsor  does  not  feel  it  i»  possible 'to  identify  even  one -form  of  the 
test  for  disclosure  in  New  York.    Thi^  decision  will  affedt  approxi-  ^ 
matel^  400  New  York  students. 

Alternate  and  make-up  testing  as  well  as  institfitional  admin- ^ 


982 


Istrations  probably  will  bm  eliminAed.    The  number  of. students  , 
•f feotttd  nay  vary  from  a^out  350  to  75a  each  year.  ^ 

•Current  P*acticfc  perraits.^isting  of  handicapped  students 

6H  virtually  any  date  and  at  any  place-- mutually  convenient  to  ^ 
tha  atajjitt  and  teat^dmJLnistrator,.    Because  of  the  high  cost  of 


conv*^i[^«8ts  into  Braille,  large  type 'And  on -^udio-cassettes, 
and  tha^Pfcuent  disclosure  of  each  edition  of  the  test,  handi- 
capped testing  in  New  York  State  will  be  restricted  to  a  very 

limited  number  of  scheduled  test  rfates."    Approximately  .400  Ne* 
Vorfe  students  will  be  affected  by  this  action.  ft 

■  •  a    .  w 

~The  tentative  plans  described  above  do  not  Include  reference  . 
to  two.  other  important  factors  on  which  the  sponsors  have  not 
reached  final  decisions.    The  first  is  fee  inc^iaseB  to  cover  the 
costs  incurred  in  meeting  the  provisions  of  the  law.    All  sponsors 
anticipate  an  increase. in  the  test  fees, ►  however,  no  indicatioT; 
of  thW  amount  of  change  has  been  given.'  Thus  it  is  impossibi^e  to 
predici "the  cost  impact.  ,The  aecond  concerns  the  current  practice/ 
lof  providing  statistical  reportiT to  institutions.    This  factor  wjAl 
b«  discussed  in  the  following  section  on  impact.  ^  ^ 

Impact "^of  Tests  Offered  on  a  Reduced  Schedule 

The  .ix*te8.t£ng  programs  mentioned  above  are' taken' by  thousands 
of  students^ each  year.    Most  postsecondary  institutions  use  the 
.results  as  part  of  the  admission  selection  process j  the, results  are 
s- also  used  for  several  scholarship  pro^/ams.    For  these  reasons 

cbinges  in  availability  which  appear  relatively  minor  stiVl  can^^ 
...  have  a  serious- ljnpae.t  on  thevlarge  population  of  potential,  candidates 
-        Sabbath  observers  may  be  the  specific  group  most  adversely 
affected  by  the  law.    The  regular  administrations  of  these j tests 
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are^given  on  Saturdays  tq  avoid  school^  employment  and  religious 

copflicts  for  the  vast  majority  of  test^  candidates,.    Alternate  tefst 

dates,  usually  on  Sunday  or  Monday^^  have  been  provided  after  virtually 

every  administration  for  those  canaidates  whose  religious  beliefs 

preclude,  iffaturday  testing,  ^The  exact  num)>er  of  sabbath  servers 

tested  during  the  last  year  is  believed  to  be  between  4,0Q0'  and 

SyOOO.    Unfortunately^  this  very  significant  total  appears  small 

when  distributed  among  the  various  adpinistratior^^'o^  the  different 

tests.    The  ipeduction  in  the  number  of  iiiinday  and  Monday  adminis- 

tratigns  is  expected  to  be  drastic,    Som%  tests  may.  be  made  available 

to  sabbath  observers  o^only  oi|e  or  two  dates  in  the  year.  Candi- 

datosMifho  miss  this  date  or  dat^s  for  legitimate  reasons  will  have 

j^o  opp9^rtunity  to  be  tested  in  the  reasonable  future.    These  candidates 

will  be  at  a  disMvantage  when  applying  to  postsecondary  institutions 

and  they  may  be  ineligible  for  scholarship  competition.  ' 

'Physically  handicapped  students  are  provided  with  varfous  extra 

services  incfudiag  administrations  held  in  hospitals  and  the  candi- 

*    ♦  *. 

dates'  homes  on  virtually^ any  date.    The  sponsors  which  provide 

•    ■  «  ■ 

testing  at  these  special  locations  have  indicated  that  they  will  . 
continue  this  practice  but  only  on^the  regularly  scheduled  da^^". 
The  majority  of  physically  handicapped  candidates  have  visual 
handicaps  which' require,  special  forms  of  the  tests*    Based  on  the 
tentative  plans  of  the  sponsors  it  appears  ^hat  ''large- type**  ^ 

Cditions.  of  i6o^t  - tests  will  be  generally  available,  but  Braille  and  * 
_assette  formats  will  be  available  for  orjily  a  limited  number  of  test 
dates.    Ttie  high  cost  and  limited  usage  of  these  special  forms  is 
the  reason  given  by  the  sponsors ^    This  decision  will  affect  over 
500  handicapped  caiididates  luinually.  ,  ' 

Other,  special  test  administrations  are  h^ld  annually  for 
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3,000  to  4,000  candldatej^  who  c^uld  not  Ibe  tested  on  the  regular 
dflttes.    Many  o£  these  candidates  take  the  test  through  the  post- 
'  secondary  institution  to  whic/ they' hav^  appli"fed. This  special  service 
is  expected  to  be  eliminated  by  the  sponsors  yho  now  make  it  available. « 
The  result  is  th'at  some  candidates  may  have  their  enrollment. delayed 
for  a  seinester  or  a  year  and  other  candidates  may  be  denied  the 
Credit  or  advanced  standing  which  the  tqst  would  validate.    This  ^ 
latter  faotor  pai'^icularly  affects  candidateii  seeking  undei^graduate 
admission  and  placement-  ^ 

-All  candidates  are  likely  to  feel  some,  effects  of  the  anti-  . 
cipa^d  reduction  in  test  administration  dates,    h  reduction  i^i  r 
the  number  of  administrations  iill  increase  the  numl^r  of  cartdidates 
tested  on  the  remaining  dates.    This  will  burden  Bom4  administra- 
tion centers  and  necessitate  the  need  for  new  centers  run  by  in- 
experienced personnel.    ;5uch  necessity  may  in  turn  adversely  affect 

■{ ' 

the  quality  of  the  administrations, until  adequate^ test  sites  are 
■  ■■  *  ■  ■  "  ^         '  '    .'  *  ■  " 

located  and  personnel  are  traiipd*;  To  help  compensate  for  this 

potential  problem,  a  few  sponsors. have  indicated  that  it  may  be 

necessary  to  ^reduce. special  setvices.  These  services  are  likely  to 

.  include  the  provisions  for  late  r^^stration  and  "walk-in"  candidates. 

All  candidates  may  be  indirectly  affected  by  the  sponsors^ 

action  relative  to  the  provision. of  the  Law  regarding  disclosure, 

of  statistic^' reports.     Institutions  generalj.y  receive  reports 

figom  the  tc^st  pponsors  summarizing  test 'information  about  ciindidates 

applying  to  the  institution  and,  in  some  cases^  comparing  these  * 

-  ; Applicant 8  to  all  applicants  for  other  institutions  cQihbihed.  This 

<  f  J  \  type       iiQformation  gives  the  institution  an  estimate  of  the  quality^ 

»      of  its^ applicants  compared  with  the  , quality  of  applicants  in  general. 


eric; 
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Test  sponsor^  .also  provid^validity  studies  used  by  the  institutions 
to  establish  and  Vefine^their  selection  procedures.    These  various 
reports  and  studies  are  consid«-ed  confidential  documents  for  the 
individujil  institutions.    The  Law,  however,  requires 'that  all  sta- 
tistipal  reports  be&ome.  public.    To  avoid  being  placed  in  a  potential 
legal  conflict  between  the  Law  and  the  iWfetitutlons'  irighta,  the 
test  sponsors  have  indicated  that  they  probably  will  stop  routinely 
providing  this  service  to  the  institutions:*    Although  these  data 
'still ^Could  be  generated  upon  request^ro^it^e  institution,  very  few 
institutions  are  likely  to  request  this  pervice  since  they  will  not 
want  this  information  made  .public.    In  the  long  run,  the  loss  of 
validity  data  will  adversely  affect  the  selection  process  and,  thus, 
the  applicants.      \    '.        ^    '  ■ 
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ADMIHISTRATiVE  PROBLEMS  RESULTING  PROM  THE  LAW 

Th<  Effective  Date      ,    .  .  # 

Most  admiflsion  tests  are  uidministered  on  dates  during  the  school 
year.    For  this  reason,  in  paj^t,  most  teiyt  sponsors  use  ah  academic  year 
rather  than  a  oalendar  year.    Registration  materials  are  prepared  in       ..  f 
the  spring  for  use  by  candidates  planning  to  b9  tested  on  any  of  'the 
dates  scheduled  during  the  following  school"  year*    These  materials  for 
the  1979*-.80  year  haive  already  been  distributed,  to  many  prospective  can«^ 
didates  through  local  high  schools  and  colleges,  ^%he  sponsors  of  scfvetal 
admission  tests  including  the  Scholastic  Aptitude  Test  and  the  ACT  Asb^bs- 
mentrl^rogram  repor|  t)>at  several  thousand  candidates  haVe  already  filled 
applications  for  testing  dates  after  January  1,  1980.    This  places  |Lhe 
sponsors  in  a.  serious  legal  dilemma.*  I  ' 

TAe  Law  requires  test  agencies  to  provide  specified  informaticm 
"i..  along  with  the  registratior^  form  for  the  test,,."    Although  the 
majority  qt  this  information  is  already  provided,  no  registration  booklet 
contains  all  the  necessary  infondation.    Further,  thjere  is  no  guarantee 
that  distribution  of  supplemental  material  would  reach  every  prpspebtive 
candidate  who  has  already  obtained  the  registratiop  material.    For  tjhose 
candidates  who  have  already  filed  applicatlo;)s,   it  is  clearly  too  lata 
for  test  sponsors  to  comply  with  the  provisions  of  the  Law.    The  spoi^- 
sors  roust  make  a  difficult  choice  even  if  their  long  ^rm  intention  Is 
to  dproply  fuliy  with  provisions  of  the  Law.    Fl^t,  they  can  continue 
with  administrations  scheduled  between  Jan\iary  and  Jun^  1980,  even  thougli 
they  are  technically  in  violation  of  the*  law^ and  subject  to  a:$500  penalty 
for^abh  -offense.    Second,  they^can  cancel  thesa>^administirations  and 
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schedule,  new  dates  after  the  registration  materials  have  been  revised** 
tast  year  approximately  15,000  candidates  in  New  York  State  completed 

th4  January  1979  administration  of  the  SAT.    If  the  January  1980  ad- 

•  X  .      ,  .... 

ainistjration  had  befn  .held,  the  ColI,ega  Bpard  would  have  been  subject 
ta  a  penalty  in  excess  of  seven  million' dollars.    Although  this  is 
the  most  dramatic  example,  other  sponsors  face  comparable  pr'bt^lems..  ^ 
Interpretation  of  the  Law 

Several  different  provisions  of  the  Law  have  evoked  major  quea*. 
tions  oiP  interpretation.    Test  agencies  and  Qther  interested  parties 
have  asked  the  Department  to  clarify  and  interpret  the  Law  through 
Cbmnissioner^s  Regulations.    This,  use  of  Regulations  is  sometimes 
appropriate  when  the  Commissioner  is  empowered  by  a  law  to  determine 
•violations.     In  this  case,  however,  the  Commissioner  is  empowered 
only  to  collect  information  which  must  be  furnished  by  the  test  1 
agencies.    As  a  result,  interpretation  as  well  as  the  determination 
of  violations  must  rest  with  the  Courts.    Num^ous  lengthy  court 
cases  could  evolve  which  would  be  detrimental  to  all  parties.    In  all 
likelihood  the  test  candidates  would  be  the  major  victim^  of  these  delays. 
' Impact  on  the  Department 

The  probAble  loss  of  the  ^Sts  used  to  award  scholarships  in     ^  , 
medicine,  dentistry  and  ojptometry  has  {Already  l)pen  cited  as  a  problem. 

*  The  Law  gives  the  Commissioner  and  the  Education  Dejpartment  certain 
administrative  responsibilities  but  no  appropriation  for  this  specific, 
purpose.    The  Department  believes  that  significant  resources  may  be 
needed  to  meet  its  responsibilities  under  the  new  Law.    Since,  the  bill 
was  signed,  it  has  been  neicessary  to  have  one  management  level  emp^yee 
devote  virtually  full  time  to  the  topic.    In  addition,  numeroijh  other 
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devote  virtually  full  time  to  th^  topic.  In  addition,  numerous  other 
Mnagament,  professional  t^nd  support  staff  ha vl  been  imvolved  oh  a 


paFt'^timv  basis,    l^hls  Involven^nt  Is  exjj^^d'to  Increase  until  well 
after  ttie  effective  date.o^  the  Law.    Theree^ter,  the  Involvement  of 
management  level  staff  may  decrease  but  It  will  be  .offset  by  the 
'Involvement  of  other  staff.;  The  catalogltig  of  thousands  of  pages  of 
Statistical  data  will  req(Ulre  the  use  of  trained  professlojial  staff. 

i.. 

This  and  other  required  related  functions  will  require  many  hours  of. 
%lork.    A  specific  example  is  the  heed  to  commuitbcate  with  test  fsandl- 
dates  who  disagree  with  the  test  agencies  over  the  Interpretation  of 
t^ist^ques^lo^s .    Thousands  of  candidates  are  expected  to  file  complaints' 
with  the  test  agencies  ^over  the  questions  and  answers  for  each  test. 
Most  of  these  candidates  will  bie  Informed  by  the  test  agencies  that 
their  complaints  are  without  merit,  and  then  many  of  the  candidates  . 
will  turn  to  the  Department  for  assistance.    Although  not  mandated  by 
the  Law,  the  Department  believes  It  is  obligated  to  communicate  with 
the  candidates  and  serve  as  an  ombudsman. 

The  Department  has  an  obligation  to  monitor  comp^lanc^^th  the 
Law.    Apparent  Violations  will  be  brought  to  the  attention  of  the 
test  sponsor  an4f  If  necessary,  the  itttorney  General.    As  a  first,  step, 
all  postsecondary  and  profe3slonai  schools  In  the  State  will  be  asked 
to  Identify  a.11  tests  used  for  admissions  purposes.    This  Is  likely 
to  result  In  the  identification  of  other  tests  which  are  actually  be^g 
•used  for' admission  selection  purposes.    It  then  will  be  possjLble  to  alert 
students.  Institutions  and  test  agencies  that  the  Law  applies  to  these 
-tests.  .  .  I 

other  types  of-  Involvement  and  infterventlon  may  also  bo  needed. 


SUMMARY 

Twenty-six  postsecondairy  school  admissioi^testing  prpgramft  used  in 
New  York  State  have  beeA  identified  by  \he  t6st  agenciel^.    Based  on  very 
tentative  information  available  by  October. 15,  about  twfenty  of  these  pro- 
grams may  be  withdrawn  from  use  ia  the  State.    Postsecondary  Insliitutions 
will  be  surveyed  within  the  next  few  weeks  to  help  determine  the  current 
use  of  these  test'prograivs  and  to  identify  other  testing  pitograms  being 
used  by  the  institutions  for  admission  selection  purposes.    It  is  likely 
that  other  t^^ts,  not  designed  for  admissions  purposes,  are  actually 

'being  used  in  this  way  by  the  Institutions. 

.    ■  ■  ■  *  -  . 

Five  of  the  six  programs  exp^cted  to  continue  in  the  State  are 

published  by  the  Educational  TeEfting  Service  for  various  sponsors  includ- 
'ing  the  Colljage  Board.    The  sixth  is  the  ACT  Assessment  program  Sponsored  " 
by  The  American  College  Testing  Progr2un.    The  sponsors  of  these  six  test 
programs  hav^  all  indicated  their  desire  to  continue  testing,  however,  ^  , 
they  all  expect  to  reduce  services,    The  number  of  regular  administrations 
is^  expected  to  be  reduced  somewhat  and  special  testing  will  be  curtailed 
sharply..    This  step  is  likely  to  have  the  creates)!:  effect  on  the  physi-. 
cally  hahdicapped  and  sabbath  observers.  *  . 

About  half  of  the  twenty  test ^programs  which  may  be  withdrawn  have 
very  limited  usage. in  the'^tate  and  their  elimination  may  not  produce  a 
severe  impact.    The  other  half,  however,  include  several  test^  used  foe 
admission  to, highly  competitiye  "health  related  programs  such- as  medicine 
^d  dentistry.    Also  to  be  withdrawn  are  te^ts  such,  as  the  Miller  Anal- 
ogies Test  which  is  used  by  many  graduate  level  programs  in  the  State. 
Withdrawal  of  the;;»e  tests  is  expected  to  have  the  greatest  impact  on 
applicants  with  prior  acflidemic  backgrounds  which  are  qutstionable  or 
^nfamiliar  to  the  institution. 
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TIIC  UNIVCRtlfir  or  THC  tTAtC  or  NCW  VOHK 
THE  STATE  EOUC'ATION  DEPARTMENT 

eULTURAL  CbUCATION  CKNTKR 
-    (  AL0ANV.  New  VOHK  U>90  . 


ASSISTANT  COHMiSSIONKR 
fiOR-IIIOHCA  KOUeATION  SjKAVICBS 


;ERJC 


August  1,  X979 


Dear  Test  publisher/Sponsor j 


As  you  may  kno^,  legislation  hais  recently  been  enacted 
in  New  York  which  r^uiros.  fijting  with  the  Cocnmi,ssioner  of 
Education  and  disclb^ure  to  the  pilillic  of  certain  information 
^ncerning  tests  used  in  th^  process  of  th^  admission  of 
students  to  post-secondary  and  professional  schools  in. New 
York.  ..A  copy  of  the  l«w,  which  was  enacted  on  July  13y  1979 
and  becomes  effective  January  1,  1980,  is  attached  for  your 
infojn^tion. 


^  .       The  provisions  of  the  new  law  apply  to  any  test  Which 
is  given  at  the  expense  of  the  test  subject  and  is  designed 
for  use  or  in  fact  used  ih  the  process  of  selection  for  »post- 
secondary  or  professional  school  admissions,  where  the  test 
is  administered  in  New  York  State  or  the  results  of  the  test 
are  provided  to  institutions  located  within  the  State. ^ 

The  New  York  StJte  Education  Department  is-  compiling 
a  list  of  the  tests  which  ar6  subject  to  the  flaw  indicating 
the  planned  adraihistration  date^'for  each  test  during  the 
period  January  1,  1980  through  Rceiriber  31,  1980.    This  in- 
ibrmation  will  be  used  to  plan  our  administration  of  the  law, 
•*lSd-  to  prepare  a  report  to  the  Governor  ^nd  the  Legislature 
bn  the  anticipated  imipact  of  the  law.     :  - 

May  I  ask  that  you  provide  us  with*  a  list  of  all  tests  . 

devoloped^ponsored.or  admlnisterdd  by  j^our  agency  for  use  by  : -  ^ 

post-secSndAry  or  professional  schools  in  the  process  of  se-  »ij 

lectioW-of  students  for  admissions.    Please  indicate  which  of  j  < 

those  tests  will  be  administered  in  New  York  State  in  1980  or,  j 

without  regard  to. the  placo  of  administration^  those  tests  the  ^  | 
results  of  which  will  be  provided  to  institutions  located  in 
New  vYork  State.    Mill  you  also  indicate  your  pl^ns  and  schedule  i: 


V 
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for  4he  aaministration  of  such. tests  in  1980.    We  will/ 
greatly  appreciate  your,  transmitting  this  information  by 
August  15,  1979.  ^  ' 

The  information  requested  above«  and  all  information 
and  materials  which  must  be  filed  with  the  State  Education 
Department  in  accordance  with  the  n^w  law  should  be  addressed 
ao  follows^  '    •   '  . 

Mr.  David  R.  Bower  * 
Aduiinistrator  of  Posts econ^i^y 
Test  programs         -  • 
'_  _^  New  York  State  Education  Dfcartment 

Room  5D28  \  '  .  "     ■  ' 

'     .    -  Cultural  Education* Center 

Albany^  New  York    12^30  \ 

.  .    Thank  you  for  your  assistance  and  co6{teration.  ,  | 

Since 


iVttachmcsnt 


•  STATE  OF  NEW  YGKli 


S.  5200— A  A./eCB—A 
Cal.  No.  f215  -         .  / 

1979-1980  Resplar  pesBlons 


LNATE- 


IN  ASSEMULY-rlnlrmlucnl  I 
M.  ot  A.  Vnnn,  Lif'TuyrUi 
■    Fnrrdl.  Klnniinwt.  rorliinc,  ,  ,  .        ,  . 

liirtich,  Hprhlinltrkner,  lUmiird,  Jnrolw,  Jrnkiiisi,  Kp|ii«ill,  l-ciilol,  Uwi^.  l.ip- 


April  26. 1979 

'   •   •         '  •  v 

IN  SENATK-InlraUicrd  by  Srns.  UVALLIS,  ACKKRMAN,  HAHIUISII. 
UAHTOSIEWICZ,  liEAlTY,  HERMAN,  nEllNSTElN.  liltUNO.  CAEM- 

MEUEIl,CONNOIl,KtV    " 

LEICHTEll,  MAIlKOWl 

AVAN.  PISANI,  PIlliSEU..   w  ^  

VOLKlSR,  WINIKOW— rcttd  twice  nnrf  ordetfd  printed,  mid  whun  printed  to 
lie  conimiticd  lo  tlift  C-omniittre  on  Educntion^rpportcd  fiivortilily  from  s:iid 
coromtttcc  Hiid  committed  tu  tlie  Cominnlne  on  Iliglicr  Education— rc|)ortcd 
favornbly  from  luiid  vonimiltce.  ordered  to  fii'sit  and  Rccond  report,  ordered  to  n 
third  rending,  nmeiiilinl  and  ordicrcd  n?prinlrd,  nitnining  itsplncein  tlic  order  of 
*  \  tidrd  rending  ^ 

iceil  by  COMMiri  Eis  ON  HULI-S-Cnt  reqMcut  of 
te,  Btrtnchl,  I)oyl:uid,  Co<|iiani\  CtKi|M!rmun.  Evr, 
p,  Oottrricd,  t'.rftnni.'*,  t^iiffilli,  nHrcnl>erg,  lliiirlitjy, 

 ,  Jtnviird,  Jnrobn,  Jrnkiiiy,  Kppi«<ll,  l-enlol,  UirwivLip- 

nchiiU^  McCnbe.  0.  W.  Miller,  Nine,  riL<^nnnnnli;|  Vincr.  Pruud.  Bermno  ' 
Siegei;E.  C  Sidlivnn,  Viigllio.  !)•  II.  WidMi,  Yttvoli,  Ztigamc)— riwl  oim?  niid 
referrctl  to  the  (:onimiUi«c  on  llipher  Etlurntion— rrpprlcd  find  referred  lo  tlie 
Commltlccon AVnyiniid  Mrnn3— committee  di^clmrgcd^  bill  nirivndcd,ord4'r«d 
^         rqirintecl  i»  Amended  find  recommitted  to  Rtud  cummitlee  ? 

AN  ACT  to  amend  the  education  taw.  tn  relation  to  standardised  teslinp 

.  ~ *  ■  \ 

f    The  Ptopk  of  tHt  Slule  of  Ntw  York.  rtprt^niUd  in  Senate  and  A  wmbbj.  d& 
enact  cKfoUom:  *  '  ^\ 

1  Section  t  Tlw  nliirnliofilnw  b  nmcmled  by  adding  ffnRwj)|]^!cltt  seven- A  to 

2  rend  w  follow*: 

H         •       •  X     /  AHTtCLKlA 

S  Section  940.  ikfinitumn. 

0  S^i^  ttarMgroHml  itiHnLi  and  ^tntMind  data. 

8  .         94S,  Notice. 

0  S44j/tU$tl'Kvire  of  tt'M  Mt^K  #  ; 

10  .  jUpi  tltgutntion^.  y  0^ 
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<  K.  A2II0-A 


A.  7(inR-A 


f 


ikioner  of  educntwii  oj  Ihr  $tnte  oj  Nm 


3  S  *V0'  Pr/iiulintin,  An  uncriin  thin  nrlirlr:  /.  *\'<tnnilnriUictlU:iror  "Irnr  mrniin 

4  nny  (ml  Ihtit  in  giirn  al  Ihr  riiirMne  nf  Ihrlrnl  nuhjvrljnnd  rirsignrd  Jor  ii^r  nrjMr*/ 1  ii 
h.  Ihf  prtK€^n  nf  Hrkriion  fnr  fHtnl-nrrnndnry  or  prnjof^ional  nrjionl  nfbninnjnnn.  finrh 

0  IrttiM  nhnll  indudr,  hnl  nrr  nol  limifrd  lo,  ihr  I'rdiminnry  Srholnnlic  AidHnth  TrnU 

1  Srhotnstir  Aplilnde  TrM,  ACT  AnsennnienI,  GmHitnIr  Htcvrd  Kinnunniion, 
:6  :  Affflical  Collrgr  Aflminnion  7rj«f,  Uw^chdnt  Adniinsinn  Tent,  Df.nlnl  Adniinnion 

U    Trnti9ig^  PrOgrnm,  Crninalft  Mnnogrniftti  Adminnioh  TcnLand  Millrr  Annhwin^ 

10  7      7*11  arliclr  fhnli  not  apjdy  to  any  nlutr,  Jaleral,  or  local  civil  service  Irnt,  any 

1 1  i^Unt  denigned  and  UAtd noMyJor  nori-ndminzion  lilncemtnl  or  credildty-cxami nation, 

12  or  any  ten(  dtttloptd  and  ddpnininlered  by  an  individimal  nrhool  pr  innlitntionjor  iln 
own  purponiM  only,  \ 

£,  "Commisnionrr'*  meann  the  comnmsi 

york 

9,\  *'Trni  Bnltject"  nhnll  mean  an  individual  h  v^hm  (i  leH  in  ndmininlrrcd, 
4-   ^'Ttnt  agmry*'  nhnll  mean  nny '  organiitilion,  annocinlitnu  corfmalion, 
$Hirliter$hip,  or  inJiMunl  or  jternnn  t^uit  dr^rhpn,  nitonmtrH  nr  adihininlrrn  a  Irnl. 

I  34i^  Onckgroutyl  reportn  and  nUitinliral  thin,  /.  H7#riirivr  any  lent  ngrnry 
preparcn,  cniae*  h  h4^^prcimrrd  or  proridcn  thr  dnla  which  ate  n  W  in  anynlndy, 
evgluoiton  or  ntaliniieal  rr.porl  pertaining  hn  icM,  Such  nludy,  cinluation  or  rcpnrt 
fAfftt  bejilfd  toilh  the  comminnionrr, 

t.  ij  any  teporta  or  other  dncumrnln  nuhmillcd  pnrnuant  U>  thin  section  eonlainn  - 
ihjormntion  idenlifialde  with  any  individualdent  nnhjeet,  nueh  ii^nrninfion  shnil  In, 
deleted  or  oldiierated  prior  to  nubniinnion,  4  ■ 

'  3.  All  dnta,^  rcporfn  or  other  dacunxenb^  nnlnnititd  purnnant  to  Ihin  ncelion  nfinlt  he 
pid^lic  reco/ib,  j 

%  942,  Diselonure  ttj  leM  contents.  I.  Within  thirty  daifs  after  the  renntin  af  nny 
ninndardised  teM  are  reltaned,  the  test  agency  nhatl  file  nr^cnu.'il'  to  he  filed  in  the 
office  oJ  the  commhnioner:  ^ 

.  a,  a  copy  C(f  all  test  quef  lions  used  in  talcuindng  Ihe  lest  ndijitCn  raw  score: 

b,  the  corresponding  ncrxptahle  answers  to  thone  questions:  and 

c.  M  rules^  for  tr^9\^f erring  rav>  scores  into  Ihosf  nrjuren  reitortrd  to  the  tent^nnhjeei 
logcthcr  with  an  ezplanatioH  of  such  rules,   ^   *     '  . 

t  After  the  test  fins  been  fiM  with  the  commi:inione,r,  and  ufion  tl^c  rrqnentof  the 
test  subject,  the  tent  agency  shati  send  to  the  lent  nuhjrcl: 
a.  a  copp  of  Ihe  tent  qucntionn  used  iii  dctcr'nining  Ihe  suhjirl'n  raw  score: 
.  6.  the  subject's  individual  answer  sheet  ttigether  with  ri  copy  of  the  correct  nnnwcr 
slieH  Io  the  same  kst  iOith  quenlillnn^^e4^tttttiny  lounrd  the  sitltjecCs  raw  score  so 
marked:  and 

C  a  statement  of  Ihe  raw  score  wed  to  cali  ulntejhe  seoren  already  sent  In  the 
subject,  praniiled  that  sUeJi  reqnent  httn  Iteen  made  ivifhin  ninety  dnijn  of  Ihe  r#  /rn.v  of 
the  lest  . score  to  the  lent  nidtjecl,  ^  . 

•  The  agency  may  charge  n  nominal  fee  for  neiiding  out  nneh  iitftirmalion,  not  to  ' 
exceed  the  direct  cost  of  providing  Ihe  if^arinuiion,  '  ■  ^ 

5.  This  seclian  shall  not  npply  h  Colhve  Hqard  AchievcinenI  Tests  or  GHH 
Advanced' Tests,  ^  .  * 

4>  Dpcumenis  snhin*illed  tn  Ihe  coinmissioner  pursuant  to  this  section  shall  be 
puMi'c  records. 

I  $43,  Notice,  L  Bach  test  agency  shall  proviile,  along  with  Ihe  regin\ration  farin 
/pr  a  test,  the  folloUnrtg»t9\formalion: 

a.  The  purposes  for  uJnch  the  test  is  constructed  and  ik  intended  to  he  uned.  t' 

b.  The  subject  inntlersinrlnded  on  such  test  and  the  u»!iichthe 
test  purports  to  measure* 

.  '     /  •  '       .  •  .    .  .  ■       ■  /'j^- 
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1  c.  S(o/ciMfnM  drAigned  V}  provide  inffirmniimi  f^r  intrrprrtwq  trsi  rrmtla. 

2  inctwivighut  noi  limilrd  In,  fijdanatwivi  o^thr  frst  .vorr  ^^nifr.  ihr  rliiwhirdfrntr  of 

3  mtaiurerncnt  of  the  IrM,  <ind  a  M  of  nvaiM*U.  corrriUwn.^  lirlHmi  h-^t  srffrr*  nud 

4  gnda,  tnrcmnful  tomplriinn  of  o  courn  of  ntvdtj  ond  ittinnint  wcomr. 

ft       d.  Ihm  the  M  ^rorfA  wdl  be  nported,  uMhrr  thr  rnvt  (rM  3f«rr^»  will  he  oUrrcdin 

0  an\f  v-nu  before  bnno  rrpnrkd  to  ^/^e      vibjcrA  hnd  vhrth^r  and  Lnw  ihr  (cH  atinirij 

1  ynll  Uit  the  <f*l  jcore  in  rnwnr  tran,yfonHfJfortn  by  itMlfor  hgrthcr  luilh  tmifolhrr 
8.  informaihn  Qboni  the  te$l  /lutjVcl  lo  prrdici  in  any  uny  lhc  sUihjcrA  V/iilicrr  ucademir 
0  . pcrformonre  for  arty  p09t  iifrondary  cducaiioual  i9i9iitntwn.  > 

10  t.  A  xompUle  dturription  of  any  promizvt  or  covtnanh  Vmt  the  (pi  <wciir.v  iimA  w 

11  10        tt$i  nubjeci  with  rrgard  to  accuracy  vf  aroniip.  limrAy  fotiwrditig  of 

12  if\fprmalion,  policies  for  uotifyiny  tat  $ubjec(9  regnrding  iimrxHrncif^  imcoring  nr 

13  $eort  ftpofiiftg  att/l  privacy  of  information  relating  to  the  frM  ^idijrcl. 

H      /  WKelhtr  or  not  the  trst  $core9  are  tiie  property  of  thetc.^l  ^iubjrct,  how  tang  tttry 
ift   will  be  retained  by  the  trM  agency,  and  poUcifi  regarding  t^Utrage,  c/is/**""' 
10  future  m9  0f  teat  ncore  data, 

17  r  Any  institution  which  i*  a  If  at  nore  rreipirnt  Ml  br  provided  mth  the 

18  infortnation  ^pfir\fied  in  thin  Mrtipn.  The  tent  agency  Ml  provideMtrh  informntinn 

19  prior  to  or  coiucideni  with  theJirH  reporting  of  n  ti'AtfrKUf.nr  urnrr^  to  n  rrcipient 

20  institntiun.  Such  institution  shall  be  encouragrd  io  proi  idt  intrrprvtive  pntrey^iing  by 

21  qualified  personnel  uhere  such  personnel  arc  utMiUihle, 

22  1541  DiscloMire  of  test  scores.  ThescoreofnnytrMsubjrrlMlnotlfnrrlen:irdvr 

23  disclosed  Ipy  Uu  tcsi  ngeney  to  any  person,  orgrttxitation,  rnr/x/.rofio/i,  nsnnrintton, 

24  college,  uniuersily,  or  gonmmental  agency  or  subdivisipu  tudcss  sprrificnthj 

25  *  authorised  by  the  tfM  subject,  A  test  agency  may,  hou  rver,  release  all  previous  srnrrs 
20  received  by  a  test  subject  on  a  tet^t  to  anyone  designated  by  the  Ust  subject  (o  rrrcive  thr 
^7    current  score, 

28  This  section  shnU  not  be  const(tted  to  prohibit  rclem^e  of  scores  nnd  other 

29  it\formntion  in  the  possej^sion  of  a  tcit  agency  for  purposes  vf  research  lending  to 
39   studies  and  reports  cortcerning  the  tests  f/iemie/iM.  Such  slndies  and  rej*nrts  mu^t 

31  contain  no  information  identifiable  iuith  any  individual  test  subject 

32  .  1 346.  negntatioyts.  The  commissioner  shall  promulgate  rcguluHons  to  implement 
.33  the  provisions  of  thin  article  -  l  tit 
'.  34  {  346.  Viotations.  Any  test  agency  which  violnlr.^  nny  ncriion  of  this  artirlr  shnlV 
*  35   6e  liable  for  a  c\\H  penalty  of  not  more  than  five  hnndrrd  dnlbirs  f*ir  cor.h  vinhtinn. 

3C       {  347.  Se^ternbitity.  Ifuny  ptomion^f  thin  article  shall  bedutand  unrnnMutio^ 

37  nat  or  inwtid,  the  other  /•rvmiVnis  shall  rcmn in  in  effect  mduHhstnnding.  \ 

38  •  J  2.  This  net  nhnU  iJiko  dfrrt  on  Uip  first  tiny  uf  J  auuiiry  ncxl  .<iii:o  i  ilmn  tliti 

39  dtilc  on  winrh  it  rfiiiH  Imvc  Iutoiiio  n  Inw. 
49 
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ACtacnmeni  «. 


TMI  UNIVCRtlTV  or  THI  STATI  Or  NCW  VOAK 

THC  STATE  EDUCATION  DEPARTMENT 
ALtANV.  HIW  VQflK  IIIM  '  '  . 


New  York  State  StandfrdiEed  Testing  Law  ' 

(Bduoation  Law.  Article  7-A  ae  enacted  l^y  Chapter  672 
.        of  the  Laws  of  1979) 


QUESTIDKS  AND  ANSVfERS 
October  1^  1979  * 


Below  are  #omi  conoonly  asked  questions  concerning  the 
Standardised  Testing  Law*    The  answers  reflect  th#  opuiion  of 
the  State.  Education  Department.  , 

Section  3<kO  ! 


1«    Question:    To  what  tests  doeis  the  L^w  appi; 


Answer: 


2.  Question: 


Answer: 


)    3.  Questions 


Answers . 


4*  .  Questions 


The  Law  applies  to  any  test  which  is  given  at  the 
expense  of  the  test  subject  and  Is  designed  for 
use  or  inifact  is  used  in  the  proceds  of  selection 
for  postsecondary  or  prbfessional  school  adnissionsi 
whether  the  test  is  administered  in  New  York  3tate 
or  the  results  of  the  test  are  provided  to  institu- 
tions located  within  the  State. 

The  definition  of  "testf  agency"  contained  in  the 
Law  includes  individuals  who  administer  a  test.. 
Does  this  mean  that  proctor^  and  organisations 
which  simply  provide  testing  space, are  obligated 
^to  furnish  test  Information? 

No.    One  who  simply  provides  space  or- proctor ing 
services  is  not>  considered  a  test  agency*  <n*ii«iry 
responsibility' for  compliance  with  the  Law  vests 
>A.th  the  sponsor.    Speqfific  responsibilities  mkf 
be  delegated  by  the  sponsor  to  the  test  publisher 
or  another  agency. 

Does  the  Law  apply  only  to  machine  scorable^ 
multiple-choice  tests? 

N09  the  Law  also  applies  to  any  form  of  test  which 
meets  the  definition  in  Section  340. 

Is  a  lest  which  is  in  fact  used  in  the  adroiesions 
process  subject  to  the  provisions  of  the  Law^  even 
if  it  was  not  designed. or  validated  for  ust  in  the 
adKbiesiona  procees? 

*#  ■  ' 
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Answers 


Yes*    The  Law  speolfloallv  applies  to  tests 
designed  for  or .  usajd  in  tne  aamlsslons  process* 


$•    Question:    Does  the  fact  that  a  test  . score  is  included  in=  an 
applicant's  admission  folder  automatically  eubiect 
the  test  to  the  Law?    Fo^  example  a  high  school 
rscord  submitted  to  ..a  college  might  contain  test 
results  "hojb  required  ,  by  the  postsecondary  school* 

Answers  ^  No*    The  Law  applies  only  to  tests  required,  and 
useiLin  ^he  admissions  process*  .  ^ 

6*    Questions    Icyft  test  administered  and  used  outside  the  State 
m|D;)ect  to  the  Law  If  it  was  taken  by  a  New  York 
S€ate  re^dent?  i 

Answer;    No*    The  Law  wo\ild  not  apply  simply  because  the 
test  was  taken  by  a  resident  of  the  State  or 
sinmljr  because  scpres  wers  mailed  to  a  candidate' 
living  in  the  State*  ^ 

7*    Questions.  Does  the  phrase  *'***at  the  expense  of  the'test 
subject*****  include  tests  for  whiph  fees  are 
paid  indirectly  by  the  test  subject? 

Answers    Yes*    The  Law  does  not  differentiate  between 

.   direct  fees  paid  to  th^  test  publisher  and  in- 
.  direct  fees  which  may  be  included  in  an  applica-v 

^  tion.fee  required  by  the  school. 

♦  ■ ".  ■        ■  '        ■   '       '  ■  ■    ,  ■ 

Section  341  '  '    .  * 

6*    Questions    Are  test  agencies,  obligated  to  release  reports 
a|id  data  prepared  for  individual  institutions? 

.Answers    Tes*    The  Law  does. not  exempt  any  type  of  report 
.  6r  data*    However,  information  identifiable  with 

^    .  an*  individual  test  subject  must  be  deleted* 

9*    Questions    Are  test  agencies  obligated  to  obtain  a)qd  file 


studies  prepared  1>y  others? 
,  .  Answers    Under  certain  circvuiistaneeb»  yes*  ^Test'agi 


are  required  to  file  those  reports  which 


prepare  or  cause  to  have  prepared,  or  for  wl 
they  provide  the  data*    Test  agencie^vare  no«. 
required  to  file  studies  prepared  by  others  wkioh 
are  based  solely  on  data  available  to  the  genjs^al 
public  unless  such  studies  are  undertaken  at  tl 
request  of  the  test  ageiiby*  i| 
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Section  3k2 
'  10»  Question: 


AnsKeri 


11*  Question: 


12«.  Question: 


/ 


Answer: 


33 »  Question: 


\ 


Answer: 


Are  test  agencies  required  to  return  the  original 
answer  paper  to  the  test  subject? 

N0|  a  legible  copy  Is  sufficient.  However,  a 
ponqmter  generated  JLlst  r of  the  test' subject's 
answers  would  not  be  acceptable. 

If  a  test  agency  furnishes  the  raw  score  with  ^  . 
the  original  standard  score  r^poH.  is  the 
Agency  obligated  to  provide  the  subject's  raw 
score  a  second  time  if* asked  to  do  so? 


Answers  No. 


Subdivision  2  of  Section  342,  which  requires  that 
certain  inforination  concerning  a  given  test  be 
sent  to  each  test  subject  upon  request,  provides 
a  90  day  deadline  for  the  making  of  such  requests. 
Doss  that  deadline  apply  only  to  requests  for  the 
subject* fit.  raw  score  (paragraph  c),  or  does  it 
apply  as  well  to  requests  for  x:opies  of  the  test 
questions  (paragraph  a)  and  the  subject's  answer 
sheet  and  the  correct  answer  sheet  (paragraph  b)?  ' 

The  90  day  deadline  for  making  requests  applies 
to  all  of  the  infermatlon  specif led  in. paragraphs  " 
a,  b  and  c.  , 

Do   direct  cost**  include  the  salaries,  of  extra 
staff  needed  to  comply  with  the  Law? 

Tes»  direct  costs  are  those  additional  costs  which 
a  test|lng  agency  will  incur  in  meeting  the  mandates 
of  the  Law. 


14*    Question:    Must  the  test  agency  provide  a  test  subject  with 
the  Infpnhation  specified  in  Section  342.2  even 
'■   "  '         if  the  test  subject  does  not  appear  for  testing 
or  orders  that  the  test  nolf  be  scored? 

Anewert   No  * 


Section  343 

QuSstii 


.^: 


Kust  the    statements**  mentioned  in  Section  343«l»c 
refer  to  the  specific  form  of  the  test  to  be 
administered?  . 


A)(iewer: 


16.  Questiont 


knsmort 


No.    The  statements  my  be  based  on  information 
oolleoted  from,  other  fornia  of  the  test. 

Subdivision  o  of  Section  34*3  requires  the  filing 
of   available  oorrelaiion^***    Are  test  agencies 
obligated  to  prepare  and  provide  correlations 
between*  test  scores  and  other  factors  if  such 
correlBtionib  would'  not  be  prepi<red  ei!)ccept  for 
the  provisions  of  the  Law? 

No.    Test  agencies  are  obligated  to  provide 
correlations  only  if  prepared  f<f/r  other  pur- 
poses*    r  . 


Section  JkK 
17;  Question: 


Answer: 


Section  344  provides  that  tfw^score  of  any.  test 
subject  shall  not  be  released  ^o  others  unless- 
specifically*^  authorised  by  tne  ^test  .si^bject. 
Does  that  mean  that  a  sep&^4te  and  specific  ' 
reqfuest  must  be  ioade  by  the*  teat  subjecttfor  . 
each  scpre'  release?        ,  .  t 

No.    The  test  subject  must  specif icai;Ly  authorise 
the  release  of  scoreSf  but  this  authorisation 
^would  permit  the  release  of  scores  to  all  insti- 
tutions which  request  them,  unless  limited  by 
the  su!t)jeot  to  apeoific  institutions... 
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THI  UNiysfliiTV  OF  TM«  IIJaVi  OF  NKW  VORK 

THi^  stAtc  cduoation  oepartment 
^  ALSAfiv,  iuw  vonK  iaa>4 


iittactunehc.  ;> 


MffiNDMENT  TO  REG0IATI0N8  OP  THE  C0MNI6SI0NER  OF  EDUCATION 

»         '       '  . .    .     •  ■ 

I^ursuant  .to  Section  345  of  the  Bducatidn  Law 

The  Regulations  of  the  Commissioner  of  Education 
are  amended,  effective  January  1,  1980^ 
.  By  the  addition  of,  a  new  part  56' to  read  as  followiBi 


Sectiqn  56.1  Definition^.  .  . 

Sponsor  as  used  in  this  part  shall  include  any  organit^tion, 
,      association,  corporation,  partnership  or  individual  respon- 
sible for  creation  of  a  test. 

Section  56.2  Responsibility  for  compliance.  ^ 

Coiupliance  with  the  requirements  of  Education  Law  Article  7-A 
.        oiia  of  these  regulations  j^hall  be  the  responsibility  of  the 
sponsor.    A  sponsor  whibh  deliegktes  specific  responsibilities 
to  the  test  publisher  or  atiother  agent  shtfll  so  advise  the 
Department  in  writing  within  15  days  after  making,  such  dele- 
gation. •  % 

Section  56.3  Filing  of  test  information  and  materials;  ^ 

(a)    On  or  before  Jahuary  15,  1980  and  the  fifteetith  day  of  each 
\  subsequent  tes^ng  year  used  by  the  spqpsor,  the  sponsor 

9hall  filewWith  the  Commissioner  of  Education: 

..■**? 

•  />  .  . 

(1)  A  list  of  the  names  of  i:he  tests  of  stich  sponsor  which 
are  subject  to  the  provisions  Of  Education  Law  Arti- 
cle 7-A,  and 

■  ».  .  .  • 

(2)  The  begiiuiing  and  ending,  dates  of  the  test  year  used 
by  the  sponsor,  and*  . 

.        ^3)    A  calendu:  of  the.  regularly  scheduled  administration  ' 
dates  and  anticipated  score  release  dtites  for  such  I 
.  ^  administrations  during  the  test  year,  and  .  ^ 

(4)    A  copy  of  Mch  general  publication  prepared  for  routine 
distribution  to  test  subjects,  and 

■  ^         J5)    A  list  of  the  speelff ic  duties  required  fqr  compliance 
with  the  law  which  the  sponsor  wishes  to  delegate  to 
another  Agent.    The.  names  and  addresses  of  the  agent  or 
^      agents  should  De«spe^fied. 
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.    (b)    Background- reports  and  statistical  dat Acquired  by  Education 
Law  Section  341  to  be  filed  with  the  CP«nissioner  of  Education 
shall  be  filed  within  thirty  days  after  completion. 

Section  56.4  Tx^nsinittal  of  information  to  test  Subjects. 

(a)  .  Each  request  by  a  .test  subject  for.  the  material  described  in  '  . 

Education  Law  Section  342 ^  Subdivision  2  shall  be  in  writing 
and  signed  by  tlxe  test  subject.  .  Such  material  shall  be  * 

•  transmitted  to/the  test  subject  within  30  days  after  receipt 
of  each  such  request  by  the  test  sponsor  or  the  sponsor's 

^  designated  agent,  . 

(b)  Bach  test  subject's  answer  sheet  shall  be  considered  to  include 
any  documt^tits  or  materials  prepared  or  produced  by  the  test 
subject  during  the  test  administration,  provided  such  documents 
or  prq^cts  ax:e  evaluated  by  the  test  sponsor  or  the  sponsot's 
desighated  agent  for  purposes  of  determining  the  subject '9  . 
8co^  or  performance  on  the  test.  ^  y  . 

<c)    The  test ^sponsor  or  the  sponsor's  designated  ag4nt  may  provide 
the  test^subject  with  a  jphotocjopy  of  the  tdst  subject's  answer 

•  sheet. 
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Postsecondctry  and  Professional  School  Admission  Testing  Programs 
Identified  by  Sponsors  or  ^blishers 

Grouped  by  Tentative  Pland  of  Sponsors 

September  20,  1979  .  . 


Programs  to  be  oontinued  with  710  reduction  in  services 
None  ...  . 


doraiBB  to  be  continued  with  some  reduction  in ' services 

'       ■  '  * 

ACT.  Assessment  Program  ^ 
.  Graduate  Management  AdmiVsions  Test  ■ 
Gradufl^te  Record  Examination 
X^w  School  Adn^issions  Test' 

Prell;minary  Scholastic  Aptitude  Test/National  Merit 
,   ^     Scholarship  Qualifying  Test*      .  ■ 
*    '  Bcholadtip  Aptitude  Test . and  Achievement  Tests 

Programs  to  be  withdrawn  from  use  in  New  York  Stat6 

Allied  Health  Entrance  Examination 
Allied  Health  Professions  Admission'  Test 
Aptitude  for  Prac^tical  Kursing  Examination 
Aptitude  Test  for  Allied  Health  Programs       '    .  ' 
Dental^  Admission  Test  ^ 
•  DoppeXt  Mathematical  Reasoning  Test 

"Entrance  Examination  for  Schools  of  Health-Related  Technologies 
Entrance  Examination  for  'Schools  of  Nursing 

"Entrance  Examination  for  Schools  of  Practical/Vocational  Nursing 

Health  Occupations  Aptitude  Examination 

Medical  College  Admission^  Test  ,  - 

Miller  Analogies  Test 
•   Minnesota  Engineering  Analogies  Test  . 
'  Nursing  School  Aptitude  Exainination 

Optometry  College  Admissions  Test     .  •  . 

Pharmacy  College  Admissions  Test 

Pre-Admission  Assessment  ,  fott  Practioal  Nursing  ' 

Pre-^Nursing  and  Guidance  Examination  ^ 
^        Pruebas  de  Aptitui^  Academioa  and  Pruebas  de  Aprovechamiento  Academico 
I        Veterinary  Aptitude  *Test 


*The  ^SAT/(}MSQT  is  specifically  nfimed  in  the  law.  According  to  the 
.publisher,  however,-  it  is  not  used  for  admission  purposes. 
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'   .  FEDERATION  OF  ASSOCIATIONS 

OF  SCHOOLS  OF  THE  HEALTH  PROFESSIONS 
.  Ono  DURont  Circle.  Suite  810  '  WMhIngtoo.  D.C.  20036 

■        ■  ■■     •  .'  *  I  "  ^  ■     •  ■ 

OITICE  Of  CMAIRMAN    .     "        "  • 

r  .    ■  " 

STATEMENT  OF  THE 

.    FEDERATION  OF  .ASSOCIATIONS  OF  SCHOOLS  OF  THE.  HEALTH  PROFESSIONS 
.  ON  PROPOSED  TESTING  LEGISLAII ON 

(H.R.  3564  and  H.l^.  4949)  .      "  ^ 
Submitted  to  the  House  Conmlttee.'on  Education  and  Labor 
Subconmlttee  on  Elementary,  Secondary  and  Vocational  Education 
.    ■  On  September  25,  1979  ' 


Mr.  Chairman: 

AS  educators  In  health  prAfesslbns  fields,  we  uphold  the  |"st1tut1on  of  standardized 
testlria    While  they  should  not  be  the  sole  factor  In  evaluating,  a- student,  test 
Su  tl;  cSbl  ed  with  otter  academic  and  soclologlcal.  data,  ^elp  to  give     e  c^^pute, 
Dicture  of  the  student.    The  demise  of  such  testing  would  negate  many  benefits  that 
Sir  schools  --.and  all  higher  education  -  have  been  realizing  over  ttte  years. 

Fair  treatijent  and  equal  rights  for^ll'examinees,^we  believe,  are  essential.  Ijie 
share  the  doncerns  expressed  by  many  that  the  testing  procedure  be  a  fair  one,  that  • 

SJSldS^ls  b"n  'exa'm^ned  be  'fully'lnformed  »bout  the  tests'  natulan   use  and 
that  some  mechuilsm  be  In  place  to  assure  the  examinees  that  tesj^res  accurateio^ 
•report  performance  on  the  examinatloni  .  I 

•  Nationally  endorsed  standar^  and  safeguards Vegardlng^standardl zed  test  development, 
and  administration  have  be^Lln  place  for  a  number  of  years.    These  standard.,  devel 
oped  by  testing  and  iMasurSit  specialists  through  their  P-^^ff^lona  associations, 
hdve  fostered  develotfhenti  of  reliable  test  Instruments  as  well  as  sought  to  P^oP^«-  ^ 
S  r  Shtftexamln^.    This  program  Is  dynamic,  ""^^-J^'lly  ""^f'/fJ?"  ' 
Vision  to  assure  that  standardized  testing  iirograms  /"enialn  responsive,  to  thesc^  J 
standards    This  historical  pcecedaret  has  convinced  us  that  such  a  program  Is  the 
.app?opr1ate  mechanism  to  cmitf nue-  to  assure  that  the  rights  of  examinees  be  Pro  ected. 

;  Thus!  St  the  present  time,  it  has' not  been  demonstrated  that  government- regulation  In 
this  area  Is  neceissary. 


We  woullstrongly  oppose  a  new  law  thai  would' allow  public  disclosure  oV^f^SH^nJ!-!!' 
Sd^ns"ers.  sin^e-tfirhould  destroy  Lny  of  the  Important  advantages  of  standardized 

testing.   .  . 


....Continued 
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A  major  rafson  d>etre  Of  standardized  tests  is  that  they  provide  a  standard  mAsJIe 
through  time  and. thus  provide  a  mechanism  to  evaluate  Individuals,  programs,  and 
Indeed  who  e  educational  systems.    If  a  new  examination  had  to  be  written  for  each 


•  wstea,  these  advantages  of  staodilrdlzed  testing  would  be  lost:  Such  a  requlremer 
T    also  make   t  mpraQtlcal  for  the  companies  to  Improve  tests  by  eliminating 

,mt\y  of  the  jiatlstlcal  procedures  available  when  the  same  test  questions  are  used 
a'  This  would  decrease  the  power,  to  differentiate  those  students  who  have 
knowledge  or  ability  from  those  who  do  not;  it  would  decrease  the  high  reliability 

which  cnarArforl  70C  moef  na4-*/»«f»T  f.i.*«J,-Ji  i  l-uj.-  '  ..—^iiiuj 


^m«>4>  ^A^i         Zi  -j-*^n.-.    *i  a  iicn  cAaiiiiiiaLiun  ridu  to  oe  written  tor  eac 

test  administration,  as  would  be  the  case  if  public  disclosure  of  the  test  items 

!5L*?!^?^*9®^?^  staodilrdized  testing  would  be  Ibst:   Such  a  requirement 
1^1*    »  ^   i.  J  ^_  .         improve  tests  ' 

J  same  test  qu 
itiate  those  $ 

»..uj-u   u"      —  ^"^"^  iiuL,  iL  nuMiu  decrease  the 

Which  characterizes  most  national  standardized  telsts. 

■  Another  problem  with 'disclosing  test  items  arises  in  connection  v/ith  the  more  special- 
ized academic  areas  in  which  the  writing  of  an  unlimited  number  of  test  questions  is 

5^^^^  the^re  narrowed  field.  .It  is  likely  that  within  a  relatively  short 
period  of  t  m«  neaPy  all  the  most  desirable  test  questions. would  have  been  given, 
.  thus  providing  the  akvantage  of  knowing  the, questions  In  advance  to  future  examinees. 

"Cost  is  another  factor,    in  the  health'  tield.the  number  of  examinees  is  generally 
small.   Any  Increase  In  the  costs  of  test  development. and  administration  must  be 

sijall  audience;  representing  for  some  students  an  additional  artl.ftciat. 
nonacademic  barrier  to.  admission^  ^  «  • 

?pcf?nl^^i^^*?^P°^"^?"^^"?uP^^^^  P^'^^^P^  unforeseen/ effects  of  proposed 

testing  legislation,    Firjit,  the  unrealistically  high  price  tags  that  would  result  for 
tests  given  to'^mall  numbers  of  examinees  would  catjse. many  testing  firms  to  discon- 
tinue their  testing  programs.    Only  the  largest  firms  adwlnlstering  tests  to  large 
numbers  of  students  woul^  be  able  to  Jceep  their  ex^imination  fees  reasonable  enough 

■  to  continue  their  testing  programs.    ThisV  unfortunately,  would  h?ve  a  tendenC:,  to 
create  a- monopoly  ^situation.  -  cm  cih^j 

Second.,-wi.th6ut  the  aid  of  standar^zed  tests,  student  admissions  decisions  would  be 
based  upon  more  subjective  informatfbn.   Contrary  to  the  belief  of  sonie,  standardized 
test  scores,  when  properly. used,  actually  have  afforded  institutions  the -opportunity 
to  diversify  their  student  bodies.   These  objective  and  standard  measures  of  students 

■  rrom  ail  educational  institutions  have  allowed  admissions  comnittees  to  evaluate  can- 
didates independent  of  blasds  and  suspicions  of  grades  earned  at  known  and  unknown 
jchoois.    Alfo,  when  used. as  a  diagnostic  indicator  of  student  abilities,  standardized 
tests  nave  allowed  institutions  'to  develop  academic  support  programs  for  groups  of 
stujlents  desired  by  the  institution  yet  previously  disqualified  because  of  records  of 
poor  performance.  .     .  -  . 

We  appreciate  the  opportunity  to  present  this  statement,  which  was  unanimously  endorsed 
by  the  current  membership  of  the  Federation  of  Associa-tions  t)f  Schools  of  the  Health  . 
Kl^Hnn'nJTli*"  ^"^fit^^^^  0^  Colleges  of  Osteopathic  Medicine,  American 
^H?r  o^^Colleges  of  Pharmacy,  American  Association  of  Colleges  of  Pediatric 

m!h  rl?  1^  American  Society  of.  Allied  Health  Professions /  AssociatiorofAm^r  can  ' 
Medical  Colleges,  Association  of  American  Veterinary  ftcdical  Colleges   A^c  at Ls 
?L  Optometry.  Association  of  School    of  PUb"c  hS  Associa-* 
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Prepared  Statb^pnt  of  ^k:  Cuff  Sjogren,  Director  of  Admis 

SIGNS,  tTNIVERSITY  GF  MICHIGAN— AnN  ArBOIR 

1  submit  this  statement  for  the  record  flr^t  as  the  Director  of  Admissions 
at  the  University  of  Michigan,  a  large  Institution  of  Wgher  learning  that  consists  . 
^  .  of  eight  undergraduate: schools  and  colleges  and^tfeT*  gradbete  and  professional  schools, 
f      each  of  which  employs  selective  and  competitive  admissions,  . 
-  ^         !  also  write  on  behalf  of  the  M»er1can  Ass«ic1at1on  of  Collegiate  Registrars  ' 
and  AtNlsslons  Officers  (AACRAO).  a  national,  non-profit  l^cetlonal  association 
which  1$  composed  of  approximately  1|^|||accred1  ted  colleges  and  universities  that  . 
are  rept'esented  by  over  6,900  IndlvidM^nembers  from  the  field  of  recruitment, 
adraisslons,  registrant  ion  and  records,  student,  financial  aid,  and  institutional   .  . 
research  at  the  undergraduate,  graduate,  and  professional  levels. 

Hy  coHeaguei  and  .1  share  with  the  sponsors  of  HR  4949  and  HR  3564  their 
>   basic  philosophy  of  providing  equal  end  the^best  possible  higher  education  opportun- 
ities for  all  of  the  youth  of  bur  nation— and  I  might  add      support  Jthese  opportun- 
ities for  all  tduUs  as  well.   We  <Tb  wt  share* with  the  sponsors  and  the  proponents 
of. this  proposed  legislation  the  thesis  that  tests  are  the* sole  or  primary  criterion 
V     for  admissions  to  higher  education.   Nor  do  we  believe  that  the  enactment  of  Federal 
legislation  wl%:h  will  cause  nationally  recognized  and  respected  testing  agencies  to 
.divulge  test  booklet's,  answers,  and  associated  data  to  examinees  or  to  private 
researchers  will  give  greater  or  easier  access  to  higher  education  for  those  who 
seek  admissions,  ' 
'      ^      the  professional  and  gradiiater schools  have  already  voiced  their  concerns 
before  this  comnittee  on  problems  they  will  encounter  if  the  bills  are  passed.  We 
support  them. and  their  positions  on  handicaps  that  will  be  Imposed  on  trilose  schools 
wi^h  the  pending  disclosure  requirements,^ 

'  The  undergraduate  recruitment  and  admissions  process  and  the  outreach  programs 
well  established  through  the  nation  in  higher  education  to  embrace  the  economically 
and  educationally  disadvantaged  and  the  minorities  are,  we  believe,  in  equal  jeopardy,. 
The  possibility  of  expanding  educationarbpportunities  will  also  be  drastically 'reduced 
if  such  a  law  is  enaqted. 
/  The  concerns  I  wish  to  place  before  the  committee  in  this  statement  are 

limited  to  the  possible  and  probable  Adverse  impact  such  a  .law  would  have  on  the.  • 
undergraduate  admlslsons  process.  •  ' 

Te  elucidate:    At  the  University  of  Michigan  the  schooTs  and  colleges  are 
selective  as  they  enroll  only  students  for  whom  a  high  probability  of  success  can 
be  predicted.   Because  all  qualified  students  c(m  not  be  admitted  dueto  space 
limitations*  admissions  are  ?lso  competitive, 

I  • 


\ 

•  0 
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Adillslons  t<y  the  University  Is  based. on  a  complex  and  Interrelated  set  of 
factors  that  coiiblne  to  provide* evidence  of  acadenlc  potential  and  educational 
readiness.  The  secojidaVy  school  experience,  which  Includes  grades,  class  rank, 
.quality  of  courses  fleeted,  and  the  success  pattern  of  previous  graduates  at  the  ' 
University,  provide  the  most  significant  Influence  on  adijilsslons  decisions.'  The 
Scholaitic  Aptitude. Test  (SAT)  Is  also  an  Important  factor  In  the  decision  of  severail 
candidates.   No  stngte  criterion  will  mrantee  either  admission  or  rejection.  The 
•  im^wrtance  of  thef  te$t  score  diminishes a^evefi  as  consistency  and  quality  are 
revealed  in  the  iecondary  school  record;^^jr  example,  an  applicant  to  Michigan  who  *  • 
attended  an  aecnedtted  high  school,  earned  a      average  and  had  completed  a  rigorous 
pn^grai^  of  studies  w411  be  admitted  regardTess  of  SAT  performance.  Of  further 
significance  isf  the  example  of  an  applicant,  frequently,  a  minority  or  rural  student, 
who  attended  alschool  of  marginal  quaility  and  achieved  a  C+  average,  but  who  presented 
strong  SAT*s,  jbr  a  commendable  standard  on  a  biology  achievement  test  would  be  given 
a  close  look  ^ince  there  is  evidence  that  he/she  is  capable  of  learning  even  though 
his/her  educational  environment  might  haVe  retarded  scholastic  achievement: 

.  Thejbest  predictor  of  academic  behavior  is  previous  academic  behavior. 
Reliable  testi  data|  therefore,. gives  the  applicant  the  opportunity  to  demonstrate 
competence  eJen  though  his/her  previous  record  was  mediocre.  The  University,  as  Is 
true  at  nearly  alU  if  not  all  ifistitutlons  ofYerlng  undergraduate  courses,  does^not 
employ  "cut-iff*  scores  nor  do  test  scores  prevent  an  otherwise  well-qualified  candidate* 
from  being  aknittbd.   Test  scores  sQpplemeht  the  more  Important  factors  of  classroom 
performance.   High  test  scores  generally  have  more  relevance  in  the  admissions 
decision  thai  do  low  test  scores. 

Reliable  test  data  help  hold  back  the  negative  Influence  of  grade  inflation, 
would  be  Impossible  for  Michigan  to  assess  the  qjrllty  of  the  estimated  1 ,000 


secondary  sciools  from  which  appl1ca(l6ns  are  received.   Standardized  measurements 
are  heeded  to  maintain  our  efforts  to  provide  fair  treatment  to  all  candidates  for 
admissions  a^id^to  not  rely  solely  on  subjective  teacher  evaluation.   The  admissions . 
process  at  H^chigan,  theref6re»  depends  on  reliable  and  secure  standardized 
exam1nat1pns.|that  are  frequently  administered  at  low  costs  to  the  students.  We 
feel  that  HR  (^949  greatly  reduces  our  efforts  to  service  all  applicants  fairly. 

Previous  testimony  on  HR  4949  suggests  that  tests  are  particularly 
descriminatory  against  minority  and  low  Income  student^.'  At  Mirhigari,  the  opposite 
is  true.   As  previously  stated,  reliable  test  jdata  will  assist- us  in  identifying 
studeHls  with  Academic pfHKnlse.   Further,  as  we  attempt  to  Increase  the  diversity 
of  students  represented  on  campus,  we  seek  td  find  the  best  students  possible  from 
a  variety  of  grH)ups  of  people  with  similar  characteristics,  'in  a  .sense,  these  students 


•  ■  eo»ptte,w1tMn  theljowa  groups  as  we  swk  to.  enroll  the  most  qCiallfled  students  from 
Mch  of  several  9r<vs  that  Include  nonresidents,  rural  students,' foreign  students, 
black  students,  Michigan  residents,  native  Americans,  and  others.   Until  a  satisfactory 
/representation  has  been  achieved  for  each' group,  we  extend  admissions  priorltles'for 

that  group.^  Test  scores  are  an  Important  means  of  Identifying  the  most  capable 
'  candidates  from  each  of  the  populations. 

^  \    I  W(Mild  itiow  offer  some  general  comments  on  the  proposed  l«g1slat1on.  Having 
reed  car^uUy  th4  statements  of  testimony  and  having  completed  nineteen  years  as 
an  admissions  off^er,  served  periodically  as  a  consultant  to  several  prestigious 
institution  of  hisiher  learj^lng  and  served  five  years. as  a  secondary  school  teacher 
and  counselor,  I  b^lng  th«  foilowjng  observations  to  the  attention  of  the  connlttee: 

;  ^.  1.   At  this. undergraduate  level,  most  Institutions  use  multiple  selection 

factoids  for  admissions.   The  position  is  fully  supported  by  valid  research  released 
this  month  In  a  Wvey  of  our  AACRAO  membership  which  revealed  that  only  1.7X  of 
responding  institutions  reported  that  test  scores  were  the  single  most  Important 

■  '  .  factor  in  admissions  decisions.   This  does  t|ke  from  tests.their  significance  as  a 

singular  Important  factor  and  disputes  their  use  for  discrimination. 

■  ^  .  2/  The  prc^pose  legislation  will  incraase  test  costs  to  students,  reduce, 

the  number  of  test  administrations,  and  reduce  the  number  of  test  sites, ^11  of  which 
will. work  to  the  disldvariUge  of  the  student,  particularly  those  whojare^poor  and. 
who  reside  in- geograj^hically  Isolated  areas. 

3.  A  single!  teit^tem  that,  has  been  df«c1j^sed  In  the  past  and  is  used  on.  a 
hew  form  damages  thewalidfty  of  the  test  and  will  give  special  advantages  to  those 
who  enroll  in  proflt'-nSkIng  test;  coaching  schools.  * 

4.  College  ahd  juniversity  personnel  today  are  much  more  knowledgeable  and 
sophisticated  in  the  u^  of  tests  for  admissions  purposes.   The  Improvement  la  this  j| 
respect  since  the  1960 and  iarly  1970.*s  has  been  remarkable.  .  " 

5.  Reliable  standardized  tests  more  often  work  for,  rather  than  agalTist,  an 
applicant  who  has  academic  pbtehtial. 

6.  Because  '*cuvo^^'*^cores  are  jiot  arfd  -should  not  be  used,  uncontaiplnated 
research  on  the  dejiree  tb  which  tests  predict  academic  success  would  be  Impossible.  . 

^     Indeed,  tests  should  be  u$ed  only  to  supple«nent9the  itfore  reliable  secondary  school 

achievement  record.  Cons^uently^  it  would  be  impossible  to  indicate  the  percentage  . 
of  improvement  tests  provide  in  predicting  acadefpic  success  as  required  ^  HR  4949^ 

7.  N1nor1ty»^urali  and  low  Income  studenti  who  have  academic^otential 
can  6ften  be  Identified  by  reliable  sUndardized  testt  where  they  might  b6  iissed 
by  evaluating  school  performances  only.   Test  agenciel  now  compile  oata  at  the 

:  request  of  an  institution  to  enable  tha  Institution  t(^,  reach  these  students. 
Institutions  wITT  tend  to  drop  this*  ty|e.  of  j)rQflram  rather  than  risk  the  chance  ^f 


h<v1n9  their  data  how  supplied  In  confidence  to  testlng^agencles  released  to  the 
*  public  and  tdkeh  out  of  context  to  ranV  them  agatlnst  other  Institutions,  for  example. 
The  disclosure  provisions  In  the  proposed  law  would  make  th^s  possible  under.the 
FreeikNt  of  Information  Act.   Many  institutions  would  hesitate  to  provide  Information 
on  students   tests  scores  for* fear  that  personally  Identifiable  data  might  be 
possible  to  ascertain. 

^     8.   The  requltenieht  of  the  pending  legislation  for  documentation  of  the  ability 
of  tests  to  predict  carreer  success  1$  questionable.   While  the  bill  places  the  onus  on. 
the  testing  agencies,  the  basic  data  would  have  to  come  from  the  Institutions.  There 
Is  no  available  evidence  that  tests  can  predict  career  suice^s,  If.  In  fact,  we  can 
adequately  define  what  "career  success^'  Is. 

9.   The  proposed  legislation, *1f  enacted.  Into  law,  leads  to  a  dangerous  and 
real  possibility  of  excessive  Fedei;^  controls  of  the.  admissions  process. 

Id.   test  agencies  (The  College  Board,  thi[  American  College  Test,  etCiAhave 
substantially  iMproved  and  are  continuing  to  Improve  their  literature  and'other*  * 
communicative  devkes'^on  the  proper  uses  and  limitations  of  their  tests.  Professional 
associations  (AACRAO>  ACE,  NACAC  and  others)  have  also  monitored  the  activities  of  ; 
their  nwfflbershlps  and  "statements ,  of  good  practices"  have  been  written  a njd  wl^iely  ^ 
circulated.  '  ,  to 

The  concerns  I  have  cited  are  not  just  at  the  University  of  Michigan. ^  They^ 
are  the  concerns  of  adiillsslons  officers  throughout  the  United  States.    I  submit  thut 
the  major  undergraduate  admissions  programs  now  offered  by  the  colleges  and  universities 
of  this  Nation  have  been  designed  and  have  been  proven  successful  In  reaching  out  to 
many  more  of  the  youth  of  America — the  future  leaders  of  our  ^at1on--than  was  previously, 
ithought  possible..  ^'Great  strides' have  been  made,  with  the  help  of  the  testing  agencies; 
to  encourage  n^ny  young  persons>  who  had  previously  been  without' hope  of  a  college 
education  ^  participate.  A  look  at  a  college  or  university  campus  today  will  show 
you  a  mix  of  America  hardly  dreamed  of  even  two  decades  ago.   To  destroy,  through  the 
enactment  of  Federal  legislation,  a^system  knowrv^.to  be  effective  wlthOUC^a  tested 
alternate  system  In  place  will  weaken  the  affirmative  action  programs  considerably. 
A  tria]  and  error  period  to  replace  the  present  system  will  deprive- many  pf  our  capable 
youth  of  a  college  education  Unnecessarily.   It  will  cause  a  hardship  to'matiy  citizens 
and  to  Institutions  of  higher  learning  who  would  like  to  help  them. 

In  summary,  I  urge  the  tonvnittee  to  either  cease  further  consideration  of 
irf  both  HR  4949  and  HR  3564  or  delay  any  further  action  until  the  full  effects  of  the 
New  York  law  can  be  properly  evaluated.    If  the  bill  Is  enacted  Into  law,,  the  fa1r4( 
and  educationally  sound  proces^s  of  adml^lons  as  nj^rw  practiced  will  needlessly  be 
changed.   Institutions  and  test  agencies  ane' eagerly  and  effectively  meeting  their 
responsibilities  to  their  constituents;   Ue  would  In^lte'a  closer  examination  of  our 
practices  before  serious  damage* occurs.' 

'f  '. 


Prepared  Statement  of  the  National  Board  of  Medical  Exam- 
.  iNERS,  Philadelphia^  Pa. 

The  purpose  of  this. document  is  to.conment  on  the  legislation 

concernli^g  educatidjo^  and.  oacupational  admissions  testing  (H.R*  3364 

.and  H*Rjf  A949)  nov  before  the  Subconanittee  on  Elementary,  Secondary,  and 

Vocatioaal  Education  of  the  U.S*  House  of  Representatives.    The  National 

Boart^  .at  Medical  Examiners  views  these  two  bills  with  concern  because  they' 

contain  provlBlons  which  pose  serious  threats  to  the  quality  of  educational 

and  occupational  testing.  *      f  .  . 

the  National  Board  of  Medical  Examiners  is  a  private,  nonrprof it 

V  drganlzatlon  which,  since  1913,  has  developed  examinations  leading^ to 

'   licensure  and  certification  in  medicine  an'd  more  recently  in  certain 

.allied  health  professions.    These  examinations  a^e  accepted  by  state 

"    regulc^tory  agencies  which  are  responsible  for  the  licensure  and  oertif Icatibn 

'  of  phy  si  claims  and  allied  health  personnel.    As  such,  they  provide  the 

■  >  '        *  ■ 

only  external  evaluation  of  professional  qualifications  for  practice  that 

:  -  "i^ndependent  of  bbth  the  educational  institutions  ai&d  the  licensing 

■    Authorities.    Successful  performance  on  the  requir|^d  qualifying  exmRlnation 

,T^sultB  in  licensiite^or  certification  and  thereby  in  legal  authorization  to  . 

1.'  practice  the  healing  arts  in  this^country.    Because  consistent  and  nubstantial 

liiproveiDents  in  these  exaodnat ions -have  been  achieved  over  the  past  63' years, 

the^ public  has  come  to  expect  that  satisfactory  tel^t  performance  indicates 
S  ■         ■  , 

^  that  a  candidate  for  professional  practice  possesses  the  knowledge  and 

problau^solvlng  skills  required  for  safe  and  effective  health  care  delivery* 

With\  respect  to  occupational  testing  in  the  pr&f0ssions,y some,  provisions 
of  H.R.  SWA  and  H.Rl  4949  Jeoj^ardize  the  capacity  of  such  t|sting  propams 


■/ 


In  fulfilling  Its  responslblXlty  to  examinees »  the  National/Board  pjtovldes 
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^o  evaluate  accurately  the  qualifications  of  candidates  for  professional 
^|nicensure  an^  certification. .' These  provisions  thereby  weaken  the  degree  ^ 
to  which  these  testing  progriams  can  protect  the  public  welfare  ^  and  the 
Nat lonali  Board  feels  It  must  oppose  such  provisions  In  order  to  fulfill/ 
^   its  responsibility  to  the' public*  v  '     ^      ■  '  / 

^    ;In  addition  to  Its  responsibility  to  the  public  welfare,  ;the  A 
National  Board  of  Medical  Examiners  also  recognizes  Its  responsibility 

to  those  who  take  its  examinations  to  make  those  examinations  fair  and 

■   <  /  • 

valid  teats  of  relevant  ptofesslqnal  and  sVilentlflc  knowledge/and  skills. 

detailed  descriptions' of  its  examinations  which  are  revised  annually 
.  ("Bulletin  of  Information  and  Description  of  National  Board  Examinations*^ » 
and  a  reference  book-  is  available  which  describes  all  of  the  operational 
procedures  and  research  and  development  efforts  of  the  National^  Board  of 
Hedical  Examiners  (Hubbard,  John  P.,  *'Meas<jrlng  Medical  Education;  The 
Tests  and  the  Experience  of  the  National  Board  of  Medical  Examiners/*  .  j 
Second  Edition,  1978.)    These  two  publlcatioris  provide  detailed  Information 

'    to  examinees  c^^ceming  thensubjects  Covered  in  each  National  Board  . 
examination,  th^  types  of  professional  capabilities  that  are  tested,  the 
Sjcoring  and  standard  setting  prpc^dures  employed,  the  standards  required 
to  pass  each  examination,  the  National  Board's  policy  regarding  .the 
reporting  of  examination  scores,  arid  the  rights  of  examinees  to  determine 
which  agencies  will  rtfcelve^ ^hese  scores.    Examinees  are  sAso  given 
Information  that  is  helpful  in  interpreting  their  scores  on  the  individual 

.  subjects  covered  by  each  exaiplnftlon^    This. enables  examinees  to  identify/ 


areas  of  relative  strength  and  weakneas.    In  addition^  examinees  are 
advised  of  their  rights  to  have  their  examination ..scoves  rqchecked  by  ' 
hand.    Sanplea^of  the  content  and  format  of  t&st  questions  drawn*  from 
previous  admin  At  rat  Ions  of  each  examination  are  also  provided.  Statistical 
.analyses  and  validation  studies  of  National  Bpard  examinations  are  also  . 
described,  and  reprlnta  are  available  at  no  charge  on  request* 

.  ^     •  '  ■•    ■  : 

These' materials  provide  all  examinees  with  a  comprehensive  description  ; 
of  .each  examination 9  a  thorough  orientation  to  the  testing  materials  they 
will  encounter »  and  a  full  disclosure  of  their  rights  to  privacy  and 
due  process*    Such  materials  have  been  available  to  those  who  take 
National  Board  examinations  for  many  years*    T^i^^atlonal  Board  of 
"Medical  Examiners  Is    aware  that  similar  materials  are  available  In 
'  other  testing  programs  and  constitute  a  widely  followed    standard  of  . 
practice  within  the  measurement  profession* 

However,  the  reader  of  H.R.  35^4  and  H*R*  4949  would  conclude  from 

the  provisions,  oft,  these  two  bills  that  little  or  no  such  Information 

Is  provided  to  examinees r    Although  the  National  Board  supports  the 

dlsclo^re  of  (information  to  examinees.  It  Is  of  the  opinion  that 

little  can  be  achieved  by  passing  these  two  bills  when  they  mandate 

the  disclosure  of  inforpatlott  which,  by  and  large.  Is  already,  provldef.j/ 

routinely  b/  test  sponsors  and  testing  agencies*    The  National  Board 

does  not  belleye  that  the  sponsors  of  these  two  blll|9  have  demonstrated 

*      •  '  t 

tha%  the  provisions  In  them  will  achieve  added  enhancements  In  the  quality 

'        .'  .     ■  '  ^. 

of  occuj/atlonal  testing  which  have  not  already , been  achieved  through  the 

*     *  ■  ^ 

voluntas  efforts  of  the  professions  and  of  testing  agencies*  ,  ^ 

■        ■  ■  ■  ■  X  '  \ 


*  ■  • 

Infixed*  it  ip  the  provisions  of  thes^  bills  which  are  not  now  standards, 
of  practice  iiiithin  the  measurement  profession  that  seriously  concern  the 
National  Board  of  HedicaX  E3camln«rs,    Rather  than  advice  the  quality  of 
^ccupational  test ing>  these  provisions  would  ^erioiisly  endanger  its 
e)^ctiveness  • 

_ /He  first  of  these  provisions  is  contained  in  H.R,  35i54  (Section  6(c)) 
and  prohibits  the  establishment  of  passing  scores  "on  the  basis  of  the  ( 
relative  dist^bution  of  scores  of  other  test  subjects; "j  Setting  examination 
standards  is  an  ek^^mely  complex  activiti  requiring  the  integration  of  ' 
accepted  psychometricVorinciples  and  techniques  with  the  careful  JudgOent 
of  multiple  experts  in  a^profession.      In  ^wcamlnatibns  that  hre  used  to 
admit  individuals  to  a  profe^ion,  the  e:icamination  standard  mist  be  set 
at  a  level  which  maximizes  the  Xii;elihood  that  individual  examinees  have 
been  corvectly  classified  as  either  q^lif led  or  unqual^ified  for  professional 
pfactice*    At  the  present  time,  there  ate  two  basic  approaches  to  setting 
ex^nlnation  standards.    One  is  to  set  a  rel^tiSre  standard  based  on  the 
performance  of  a  reference  group  of  examine^ approach  would  be 
prohibited  by  H.R;  3564.    The  other  approach  Vis  tosset  sn  absolute  standard 
without''  considering  the  performance  of  any  Efifiup  of  ekamineea  and  consequent ly, 
without  co^sidcrring  any  objective  measure  of  the  difficult/  of  the  questions 
included  in  s  .given  examina^bn.    The  relative  standard  can^e  described 
as  one. in  which  s  fixed  percentage  of  examinees  in  some  group  must  fail; 
the,  absolute  standard  can  be  described  as  one  in  which  a  fixed  proportion 
of  questitms  miist  be  answered  correctly  in  dTder  to  pass  a  given  examine*-  i 
tion  regardless  of  the  actual  difficulty  of  thfTt  examination.  *  Both 


/  . 
7  . 


•■•\-  ••  •■■  ■         •  -.  , 

«ppl^di^8L  arie  subjective;  both  require  an  ^letoeAt  of  judgment;  and  nm.thferH 

has  Y>een  alTowix  in  the  scientific  literature  to  be  supericy  to  the  othej| 

OoW^very  both  approaches  can  be  Implemented  la' a  fair  and  logical  manner  ^ 

such  that  once  an  exainination  standard  has  been  established »  it  can  be 

applied  uniformly  from  one  test  administration  tp  the  next.    The  prpvlsll 

in  H^R.  .3564  (Section  6(c))  which  prohibits  the  use  of  one  standard  settiig 

approach  when ^ there  is  no  sound  evidence  in  the  scientific  literature  or  1 . 

even  consensus  within'  the  measurement  profession. regarding  the  superiorlt3| 

of  either  approach  is  an  arbitrary  and  unwarranted  restriction  which  in  no\ 

way  enhances  the  effectiveness  or  the.faixness  of  standard  setting.  Therefore, 

the  National  Board  of  Medical  Examiners  strongly  urges  the  elimination  of 

Scctlon-6(c)  from  H.R.  3564.  *  '    *  '  . 

Another  provision  that  is  particularly  troubling  to  the^.Natiohal  . 

Board  of  .Medlcal  Examiners  is  the  Requirement  in  H.R.  4949  (Section  5(a)(1)  (^A-B)) 

..." 
for  the  disclosure  of  test  questions  and  answers  following  each  administration 

■    ■  '  .  ■ 

of  an  examination.    Licensure  and  certification  examinations  in  the  health 

professions  are  designed  to  test  those  aspects  of  knowledge  .and  problem- 
solving  skills  .that  are  essential  requisites  to  Safe  and  effective*  health 
care  delivery.  •  The  three  examinations  which  comprise  the  itationaj,.  Board 
.  Examinations  are  developed  each  year  through  the  major  commitment  of  time  j 
and  effort  of  over  100  experts  in  the  basic  and  clinical  sciences.  Jt  is  | 
conservatively  estimated  that  these- experts  devote  mpte  t;han  4,000  man  hqursj 
to  the  development  of  new  test  questions  for  National  Board  ExoBdnatlons^ 
Of  the  total  number  of  items  reviewed  each  year,  only  fifty  per  cent  are 
Judged  to  meet  the  high  standards  of  scientific  correctness  and  psychometric. 


quality  required  of  examinations  that  wlll.^e  u^ed  to  assess  Individual 

i  ,  ■■ 

qualifications  for.  medical  licensure.    The  task  of  developing  hl^h  quality 

■    ■   ■  .        S*F  ■  ■ 

test  Items  Is  a  complex^  arduous ,  and  tlme-cbnsumlng- one.  ■  6nce  t'est  Items 

1  .     ■  . . 

hav  been  administered  in  actual  Natlcmal  Board  Examinations  and  are  found 
to  be  df  sufdclent  sclen  t  if  Ic  anS^psychoine  trie  Equality  ^.  they  are  classified 
^.atcbrding  to  a  iqultl-dimenslonal  categorization  system  and  stored  in  a 
computer-managed  test  item  library  for  use  on  future  National^oard 
Examinations.  'This  process  is  a  significant  factor  in  maintaining  the  ^  . 

high  quality  of  these  examination  programs  b^9au6e  it  provides  a  mechanism 
whereby  previously  test^sd  items  can  be  reused  on  subsequ^ent  examinations, 
thus  ensuring  not  only  the  quality  but  the  equivalence  of  examination^ 
.  from  year  to  year.    Multiple  administrations  of  high  quality  test  items 
jr^not  only  ensures  the  continued  validity  and  equivalence  of  examinations  ' 

■  ■'  ■.         '  '  ■  ■ «      .  %'  . i 

from  year  to  year,  bait  also  results  in  cosfii  savipgs  which  help  k^ep  the  feef^rim^^ 

.  •    ^  '  *t  . 

for  these  examination  programs  within  the  financial  means  of  tlie  students 

\iho  must  take  them.  ^  . 

The  requirement  to  disclose  all  test  questions  and  answers  following 

each  administration  of  an  exaioination  will  impair  the  effective  reuse  of  ^ 

s  .  .  .  .  * 

high  quality  test  items ^and  in  so  doing  i411  have  a  long-tetm  negative 
effect  on  the  quality  of  test  materials  fpund  in  .these  examination  programs. 
"  Mor^oi^er,  this  pr^pvlsion'will  increase  by  a  significant  proportion  the  cpsts^ 
of  test  development,  test -administration,  test  production,  and  scoring  and 
analysis.    Because  test    terns  that  are  used  in  calculating  an  examinee's 
r^w  score Vij^t  be  disclosed  following  the  adi^dnist ration  of  the  test*  these 
items  wlll.not  .be  reusable  on  subsequent  ^aroinatiob^.    This  will  have  two 


■■  /• 


■/•■ 


consequences*    First,*  it  wili  result  In  a  thirty  to  forty  per  cent  increase 

in  the  ntiinber  o£  new  test' questions  that  must  he  developed  each  fear, 

Horeover,  In  order  to  Include  a  sufficient  nitrober  of 'test  items  for  the  ^ 

•^tablishttent  of  teat  equivalence  from  year  to  year,  the  leqgth  of  ea<ih 

exandnatiotisvill  have  to  be  increased  by  approximately  twenty-five  per  cent. 

Students  vho.  would  normally  ait  for  a  twordaV^  examination  will  now  have  to  be 

tested  . for  tvomd  a  half  days..    Costs  for  developing  test  items',  i^enting 

e^mination  centers »  paying  fees  to  proctors,  printing,  scoring  and 

analyzing  auch  a.  test  will  increase  substantial^.    Because  most  occupational 

testing  program^  involve  a  much  smaller  number,  of *^xamlnees  than  is  found . 

In  admisalons  testing  .programs,  the  impact  pf  increased  costs  on* Individual  ^ 

examinees  is  mucji  greater  in  occupational  testing  programs. 

Another  ser  ous  conse^iuence  of  teat  item  disclosure  is  that  it  will 

destroy  the  security,  of  the  National  Board's  test  Item  pool  which  now 

forma  the  bssis  < f  constructing  three  other  examinations  used  to  assess 

■   n  .  ■   .  , 

qualificati(tf}8  f<r  ^adua te. medical  training* and  medical  licensure.  < 

Specifically,  thfe  licensure  examination  of  the  Federation  qf  State  Medical 
Boards^ibh  is /accepted  by  all  licensing  authorities  in  the  United  States 
and  its  terriCOriea 'could  no  longer.be  ^eloped  as  it  is  today  from 
previously  used  and  hence  statistically  calibrated  ^est  items.    The  Visa 
Qualifying  Examination  and  the  examination  of  the  Educatit)nal  ComraiBsidn 
on  Foreign  Medical  Graduates  would  be  similarly  affected..  These  examina- 
tions are  used  to  evaluate  the  professional  qualifications  of  foreign-trained 
physicians  who  are  beekii^  entry  into  the  U.S;  educational  and  health  caffe 
delivery  system.    Under  the  teat  item  disclosure  provision,  these-ea^aidna^ 
tions  cQulcl  no  .  longer  be  developed  by  drawing  upon  the  same  teat  items 
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that  have  been  used  tp  evaluate  the  professional  qualifications  of  U.'dr  ;  . 
medical  students.    During  {the -^ast  decade »  an  enormous  effort  has  been  made, 
fo^d  stipported  In  part  by  the  actlonj^  of  Congress,  to  ensure ^that  all  ^ 
physicians ^in  residency  training  ahd  all  candidates  for  jaedlcal  licensure 
In  thls^  country  meet  the  same  standards  for  knowledge  and  problem-solving 
skills.    The  disclosui;e  of  test  Items  will  severely  compromise  the  National 
Board  of  Medical  ExcUiln^rs'  capacity  to  meet  this  national  goal  and  ensure 
the  content  and  psychometric  equivalence  of  these' testing  programs. 
Potentially  the  single  most  serious  consequence'  of  the^^testMtem 

disclosure  requirement  will  be  it^  negative  Impact  on  learning.  Without 

■      '  .  ? 

^ doubt,  the  sudden  availability  of  thousands  of  test  questions  and  corresponding 
answers  will  divert  the  attention  of  medical  studi^nts  and  students  In  other 
health  professions  away  from  the  scholarly  study  of  the  bi^omedlcal  sciences. 
Instead,  students  will' be.  Strongly  tempted  to  engage  In  crash  craning,, 
relying  oti  disclosed  test  material  from  previous  administrations.  -  Wholesa^  " 
review  of  test  questions  and  ansi^ers  will  result  In  a  superficial  and  onl^ 
transitory  acquisition  of  knowledge.    A  deeper  understanding  of  scientific  . 
facte  and  principles  will  be  lost,  and  will  Instead  be  replaced  by  a  super^ 
flclal  and  glib  awarenes^s^f  the  correct  answers  to  test  questions.    The  only 
way  in  which  professional,  cdnipetence  la  acquired  is  through,  conscientious 
study  and  ongoing  experience  Ip  the  application  of' scientific  principles. 
Any  activity  which  distracts  a  professional  student  fVo'Jh  that  baslci. mission 
seriously  weakens  professional  growth  and  development  and  produces  poorly 

prepared  Individuals  who  lack  the  firm  understanding,  skill,  an(f  sound  . 

?  ■  '  .       ■       ■  '        ■      "       ■  ■  It- 

judgment' required  *fpr  safe  professional  practice.  .'  -  '  ^  ■ 
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The  descriptive  matetlals. routinely  available  tp  examinees  already. 
pr6vjt4e  adequate  and  effective  orlentatloa  and  guides  to  the  preparation 
for  ei^aiftlnatlons.    There  can  be  no  further  benefits  to '  be  derived  from 
^^discloslng  test  questions,  and  answers  following  aac^h  administration  of  an 
examination..   Indeed,  such  a  practice  will  Jeopardlte^  the  meoaurement  of 


accuracy  of  such  exAnatlona  and  will  interfere  with  the  thorough  and 
sound  acquisition  of  scientific  knowledge  and  understanding.    The  proponents 

of  test  item  disclosure  have:  failed  to  document  the  supposed  gains  to  be 

*  '  •  ■         .       ■  - 

derived  from  such  a  requlr^nent .    In  fact,  no  iftich  gains  exiist.    Instead » 
only  serious  threats  to  the  valid  assessment  of  professional  *^ompetence 
can  be  expected..    It  has  been  observed  that  "to  the  degree  that  we  are 
able  to  measure  competence,  to  just  that  same  degree  wilt  medical  competence 
be  available  to  tlte  people."    (Womack,  N.A.    "The  National  Board, of  Medical 
Bxaminers  -  A  Perspective."    The  National  Board  Examiner,  1963,  10(7):  1-4.) 
The  National  Board  of  Medical  Examiners  urges  that  H.R..  356A  and  H.R. 
not  be  approved.  .%  ■. 

■  .  ■  '■ '      ■  ■  •    I"  ■  .  ■ 
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pREPAREp  StaTi|^BNT  0|kTHE  AnfERICAN  SOOIETV  OP  CuNIOAL 
^  ^ATHOLOOISTS 


^ 


non-profit, I e 


The  Anjieirican  Society  of  Clinicai  Pathologists  (ASCP)  is  a 
jiucational  and  scientific  medical  specialty  society' 


representing  nearly  23,000  pathologists  atid  other^edical  laboratory 
professionajsi    put  tnerab^rs  practice  in  a. wide  variet^/  of  laboratory 
^'  .  .'       :  envirorvnents:    hospitals,  universities,  independent  labpratories,  .  | 

Itailitary  and  veterans*  hospitals,  and  federal,*  state  and  local  . 
government  facilities.    Our  organization  is  >iitally  concerned  with  . 
the  quality  of  health  care  ifl  this  nation,  ai^we  are  conmitted  to 
upholding ithe  very  highest  stiandards.  in  the  clinical  laboratory. 


The  two  major  activities  of  the  ASCP  are  the  development  of 
educational  programs  and  products  for  laboratory  pjfofessionals , 
and  the  C^tification  of  non-phVsiclan  medical  laboratory  personnel. 
It  is  because  of  this  latteir  activity  that  we  are  concerned  with 
legislation  presently  under  consideration  by  this  Sj^onimittee, 
and  ^e  appreciate  the  opportunity  to  submit  comments  on  H:R^  3564 
and  H.R.  4949..  ' 


:  ,  The  ASCP  and  its  Board  OJf  Registry,  have1)een  Involved  iii  the 
•  .  •   •      ■     \^ ■         ■      ■  ■ 

certification  df  me  die  aJJ^bot^tory  personnel  pince.  1928.    To  date-, 

the  .|oard  of  Registry  has  certified  just,  under,  200,000  individuals. 

At  present,  .certification  is  offered  in  three  getieiralist  categories 

(Medicil  Technologist;  Medical  Laboratory  Tec^^ician^atid  Clinical 

Laboratorjq  Assistant)  and  in  the  following  speciialty  ateas:  Mictj?- 

biology.  Hematology,  Chemistry,  Blood  Bartking,  Immunology,  Nuclear 

Medicine,  Histotechnology  and  CytotechnbXogy . .   The  Board  of  Registry 

♦  :         '  ■  ■  ... 

is  a  private,  voluntary  certification  agency.    Examinations  are 

administered  twice  a  year  throughout  the  country.    The  Board  of 

R^^try  itself  is  fnadfi  up  of  six  pathologists,  six  medical  o 

technologists,  two.  public  members,  and  one  representative  from  eacll 

of  the  following  org^^ions.:    Ainterican  Academy  of  Microbiology, 

American  Association  of  Bloo^-jp.anks, ^.American  Society  of  Cytology, 

National  Reg^|i:ry  in  (Slinical  Chemistry,  American  Society  of   s  . 

Hematology,  and  the?  National  Society  ^for  Histotechnology,-  Tha 

present  Chairperson  of  the  Board  is  an  ASCP-registered  medical 

technologist.    This  Board  and^ita  examination  committees  approximately 

100  professionals       are  responsible  for  the  development  and 

updatihg  of  the  various  examination *^orms  and  the  p.pol  of  test  items. 

They  have  staff  support  of  36  individuals  in  the  ASCP  Board  of  .  ^ 

Registry  offices-in  Chicago.    This  staff  includes  tiesting  and 

/education  professionals.  :  ,        .  .  . 


Our  concern  with  H.R.  3564  and  H.R.  4949  grows  out  Af  Ipur 
present  involvement  with  and  fifty-one  years  experience  in  testing 
and  certification.    Although  it  is  our  understandijng  *that ,  as  ^ 
they  are*  v/rltten,  neither  . of  thele  bills  would  apply ^to  private. 


voluntary  certifying  organizations  ^such  as  ours,  we  feel  that  any., 
agency  involved  in  or  interested  in  testing  should  be  closely 
monitoring  and  participating  In  the  consideration  of  legislation 
such  as  this.    We  must  state  our  strong  oppos'jLtion  to  these  two 
bills.  :  .  c 

As  members  of  th6  Subcommittee  may.  know,  In  thie  health  care 
field,  private  certifying  agencies  have,  with  Fed^ial  support, 
recently  established,  the  \ational  Co^nmission  for  jlealth  Certifying 
Agencies.    This  organisation  will  set  standards,  evaluate,  and 
accredit  the  various  agencies  which  certify  health  care  professionals. 
It  is,  we  believe,  a  fine  example  of  what. can.  be  achieved  in  the 
private  secto^r,  with  government  support  and  cooperation,^  raAer 
than  by  government  regulation.    It  is  a  model  which  tltis  Subcommittee  . 
"  might  study  as  ai9  alternative  to  the  proposed  ♦legislation .  * 

Though  the  goals  of  the  sponsors  of  H.R.  356A  and.H.R.  ^949 
are  laudable,  it  seems  apparent  that  these  bills  would  not  achieve 
thede  goals.     This  fact  has  been  pointed  out  by  both  witnesses' 
and  members  of  the  Subcommittee  diiring  recent  hearings,  on  this  •. 
legislation.     Based  on  our> experience  in  testing,  our  close  reading 
of,  the  bills,  and  our  observation  of  the  problems  already*  being      •  ■ 
encountered  in  the  state  of  New  York  where  similar  legislation  has 
been  passed,  we  certainly  Concur  with  that  position.    Indeed,  We  • 
believe  that  the  irapl^fmentation  of  this  legislation  mighj^  prove 
harmful  to  the  very  individuals  its  sponsors  wi*s.h  to  help.  * 

Further,  th^re ^appears  to  be  no  established  need  for  many  of 
thg^ provisions  in  this  legislation*  particularly  those  of  H.R.  3564. 
Applicants  for  examinations  are  presently  provided  with  a  considerable 
amount  of  information  prior  to  the  examination,  and  tUoae  who  ait 


for  ^lie  examination         given  explanatory  material  with  their  trgst  0 
results.    This  is  certainly  true  of  the  Board  of  Registry  examination, 
.  and  ^  havejincluded,  as  attachments  to  this  statement ,  .  samples  of  ▼ 
•  the  material- odr^Bxamlnees  receive,  prio^to  and  after  the 
examination/  This  material  includes  a  subject  outline  of  information 
upon  which  they  will  be  tested,  samples  of  the  kinds  of.  questions 
to  appear  on  the  examination,  tes't  scores  broken  down  by  subject 
.\cate|ory,  and  a  lis-t  of  individuals  within  the  Board  of  Registry 
st^ff  to  contact  should  they  have  need  of  further  information.    It  | 
is  our  understanding  tliat  many  testing  agen^es  have  made  availaVJ.^ 
to  this  Subcommittee  similar  samples  of  the  types  of  material./  .     .  • 
^  which  they  provide  to  examinees.    tt.R,  3564  and  pafts  of  IJ^.^.  4949 
would  simply  be  a  codification  of  practices  presently/tn  effect  i 
in.  testing  agencies.  ^  ^ 

In  testimony  before  this  Subcommittee  important  point^^av^ 
-'.been  made  which  refuse  the  claims  made  by  proponents  of  these  bills 
•    negarding  secrecy  of  examinations.    5^inc^  most  examinations  are 
in  fac!^.  developed,  screened  and  evaluated  by  professionals  in  the 
/subject  areas  being,  tested,,  it  can  hardly  be  held  that  professionals 
s  in  the  field  do  not  haye  access  to  the  examination.    The  Medical 
College  Admissions^est  is,  developed  and  evaluated  by  physicians 
and  physlcian^educators,  the  Law  School  Admission  Test  by  attorneys 
and  la^>chool  faculty  member^    The  ASCP  Board  of  .Rbgistty  examination 
LB  dfeMftloped  and  evaluated  by .  laboratory  p|pf.essional8  pathologists, 
■mescal  technologists  and  clinical  scientists. 
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I  Our  majbr  concei^n  with  this  legislation  Is  the  provision 

;       (Section  5  of  H.R.  4949)  which  would  req^re  disclosure  of  the* 
examination  Itself  and  correct  answers  to  thel^est  questions.  It 
.*  l6  our  belief  that  this,  provision,  If  enacted,  would  be  truly" 
destructive  to  many  examinations  "^presently  adraioistered.  Though 
H.R.  4949  in  its  present  form  applies  only  to  educational  a.dmissions 
examinations,  we  are  cor^cerned  about  possible  amendments  which 
would  combine  it  wlth/H.R.  3564,  Q;r  otherwise  extend  its  provisions 
to  occupaftibnal  examinations.    T^re  are  examples  of  tests  within 
both  categories  of  examination       educational  and  occupational        _ * 
Which  are  limited  because  they  are  designed  to  t6st  certain  types 
of  knowledge,  or  because  they  take  a  unique  approach  to  the  knowledge 
f or  which  they  test.    Disclosure  of  the  examinatioh  questions  and 
answers,  so* that  those  particular' questions  could  not  be  used  again, 


would  have  serious  consequences  for  these  achievement       as  opposed 

litis 


to  aptitude         exominatlStis .    .    •  ' 

In  our  Board  of  Registry  examination,  for ''example ,  t^be  approach 
taken  iti  designing  a  test  item  is  as  Impottant  as  the  substance  of  the 
material  being  tejsted.    The  examination  is  based  on.  a  defineq  content, 
, appropriate  methods  of  construction,  criterion  validity  and 


reliability.     Because  we  are 'testing  for  acquidrition'^of  very  / 

'  ■         ■       ■  •  •  /  ' 

specialized  knowledge,  because  we  6eek  to  assess  more  than  ^<ist  . 

cognition,  our  ytest  items  are  designed  accordingly.    Further,  bec€^i;se 

of  developments  in  health-care^echnolo^y,  and  the  evet- changing 

nature  of  the  practice  of  medicine,  you  cian  well  imagine  the 

dynamic  nature  of  the  base  of  knowledge  on  which  examinees  are 

being  tested.     It  differs  somewhat  from  the  material  used  in  an 


todmiAsioAs  examination  covering  general  knowledge  of,  for  example » 

\ .  • '  :    •  /  •  ■■  *  •  ;  *  ■ 

ma thematic 8,  grammar  or  history. 

We  certainly  agree  with  the  sponsors  of  this  legislation  that 
a  feedback  rtechanisra  is  needed,  so  that  an  exdmjtnee  can  learn  from, 
the  examitiatlon.  process.    It  is  for  this  reason  that  we  break  down 
our  test  results  into  subject  categfor.ies  which  correspond  to  the 
categories  iti  the  subject  outline  given  to  the  applicant  prior 
to  the  examination,     (see  attachments)^  The  examinee  is  told  how 
many  questions  he  missed  in  each  of  the  categories  of  the  subject 
outline.    TolLd  that  he  missed  8  out  of  29  ijuestions  in  hpcteriology , 
for  example,  he  will  go*  back  to  that  subject  . area  arid  review  it 
to  determine  where  his  mistakes  were.    If,  on  the, other  hand,  he 
had  questions  and  answers,  he  would  check  to  see  what  the  correct 
answer  was  and  go  no  further.    The  efforts  of  test  developers  would 
..be  better  spent  in  constructing  more  sophisticated  methods  of 
providing  meaningful  feedback  to  examinees  than  i-n  developing  moire 
and  more  test  it'eras  to  replace  thos^  disclosed  after  each  test 
1  .  administration .  '  ^ 

We  estimate  that  our  overall  cost  for  development  of  one 
test  item  is  $300-$400,  and  this  fi-gure  does  not  include"- a  factor 
for  the  marty  hours 'bi  tira^»  donated  b^y  volun|;eer  members  of  our 
.  Society.  .  The  mAobers  of  our  Board  of  Registfry  and  its  examination 
committees*'—  all  of  them  laboratory  professionals ,  scientists ,  i 
educators       meet  several  times  during  the  year  to  work  on  test 
.  development  and  updating  and  also  put  in  many  hours  of  time  working- 
individually  on  test  items.  ■  They  receive  no  payment  for  this^jiJU*{. 
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We  arp  able  to  maintain  the  Very  highest  standards  in  our  examination 
because  of  the  constant  efforts  of  these  professionals  and  of  . 
our  Board  of  Registry  staff  to  develop  arid  update  our  test  itetn 
pool.    If  each  of  our  examination  forms  were  made  public,  with 
correct  ansvfers,  that  item  pool  would  soon  be  "aepleted,  <?ur  costs 
for  development,  wou^ld  increase,  and  the  process  by  which  we 
certify  laboratory  profcsj?ionals  would  be  altered. significantly,^  '  • 
Kfe  beli^eye  that  many  testing  agencies^would  find  themselves  in  a  . 
similar  situation  were  this  legislation  to' be  enacted.  \ 

Based  on  our  .experience  In  the  testing'  field    and  our  knowledge 
of  test  development  and  administration,  we  urge  the  Subcommittee  • 
to  re-examine  these  bills,  to  compare. the  legislation  itself  to 
the  goal's  its  sj^onsors  seek  to  achieve,  and  to  give  careful 
consideration  to  the  testimony  of  testing  professionals  and  ' 
educators.    This  legislation 'does  not  serve  those  Who  are  now 
taking  examinations  or  those  who  will  sit  for  examinations  of 
all  types  in  the  future,  nor  is  it  in  the  best  intferests  of 
education  or  occupational  certification.    We  stror^ly  opppse 
H.R/  3564  and  H.R.  4949.'         .  '  ^  / 

Thank  you  for  this  opportunity  to  submit  our  confflients. 


I. . 
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MEMORANDUM 


plicants  tor  Board  of  Registry  Exemlnatioris 


(fice  of  the  Director 
Examination  Procedures 


The  enii/osed  documents  have  been  prepared  to  expialri  Important  Board  of  Regtairy  ex- 
amlnaUDn  procedures  and  to  provide  you  with  a  general  content  outllrie  for  the  specMjc  ex- 
amlnaiion  for  which  you  have  epplj0d.  With  regard  to  this  outMnd,  Itihould  be  noted  that 
specific  references  are  not  mentioned.  The  Board  of  Registry leels  thw^lnce  the  laboratory 
scleVces  llleralure  Is  so  voluminous,  It^ls  inappropriate  to  officially  review,  redommdrid,  or 
onijlorse  any  material  In  the  form  of  reading  lists. or  study  guides.  The  Board  can  suggest 
\hM  an  applicant  use  any  standard  texts  or  references  as^l^s  In  reviewing  for  an  examlna- 
•Wpk  To  further  . help  in  structuring  this  review,  the  enclosed  content  guideline  Includes  the 
/proximate  number  of  Items  that  can  be  expected  id  appear  within  each  major  area  with 
Me  exception  of  Managerhent  and  Supervision,  Education,  Research  and  Development 
Sections  which  will  riol  appear  et  this  time. 

lease  contact  the  specific  staff  units  within  Ihe  Board  listed  below  If  you  have  any  ques- 


tions regarding  the  fpllowing  topics: 


V 


For  Questions  Concerning: 

Application  Status 
Reporting  of  Scores 
Examination  Procedures 


Contact: 

Applicant  Services  (ext.  125, 133, 134) 
Applicant  Services  (ext.  130, 132) 
.    Administrative  Services  (ext.  141, 217) 


c/o  Board  of  Registry 
P.O.  Boi  4872 
Chicago,  Illinois  60680 
(312)738-1336 


r- 
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EXAMINATION  PROCEDURES 
EXAMINATION  QUESTJONS  .  ' 

All  Board  of  Registry  examlnatlorts- contain  written  objective  questions  which  jnay Include:  multiple 
choice,  matching,  multiple  response,  and  in  Nuclear  Medicine,  sevisrai  true-fal^etjuestions  (see  page  3  for 
examples  of  these  formats).  Some  of  the  ouesUons  may  refer  lo  charls/dlagrams,  color  plates,  or  other 
visual  material.  The  Board  of  Registry  incdftorates  (pretests)  several  objective  questions  at  random  within 
most  its  examinations  for  the  purpose  of  obtaining  statistical  information.  This  Is  done  to  evaluate  the  ap- 
proprlaleness  of  particular  qu^stionp  at  the  level  for  which  they  are  intended,  thus  enabling  the  examirta- 
tion  committees  to  mal<e  a  more  valid  decisiorLfor  incorporating  a  question  Into  a  future  examination. 
■These  pretest  questions  are  not  used  tp  calculate  mearts,  pass/fail  points  or  scores,  but  only  for  response 
feedback.    •*    ^  . 

• 

In  addition  to  the  administration  of  objective  questions,  the  specialist  examinations  In  Chemistry, 
Hematology,  and  Microbiology  Include  a  series  ol  essay  questions;  the  Blood  Banj^ing  and  Histologic 
Technic  ejtaminatlons  Include  a  practical  component  and  the  Cytotechnology  examination  IncludjBS  a 
visual  component.         '  •  . 

TIME  LIMITS 

A  maximum  of. four  (4)  hours  is  allotted  for  the  examination. 

SCORING  PROCEDURES  ,  ' 

A1  the  present  time,  the  Board  of  Registry  utilizes  a  norm^referenced  procedure  fordelerrrilnlng  minimum 
passing  scores  on  its  examinations.  A  minimum  passing  score  is  calculated  by  subtracting  one  standard 
deviation  from  the  mean.  For  example,  if  the  mean  score  pn  the  Medical  Technologist  examination  is  t35 
points,  and  the  standard  deviation  equals  2(J,  the  passing  score  would  be  equal  to  115  points.  In  this  exam- 
ple; any  examinee  attaining  a  sco;e  at  or  £^ove  115  passes  the  test  and  is  subsequently  cerrified. 


TEST  CENTER  PROCEDURES 

■  \    '  n 

I.  When  you  lake  your  examination,  you  should  bring  with- you  at  least  two  fvlo.  2  pencils  with  go.o6 
erasers.      \  '  •  ■ 

II.  Scratch  paper  Will  be  provided  for  you.  No  books,  dictionaries,  or  paper  may  betaken  into  the  examine- 
.  tion  room. .        .  ' 

Ill  Though  they  are  not*jiece3sary,lhe  Board  of  Registry  does  allow  the  use  of  slide  rules  and  calculators  . 
by  applicants.  They  must  be  brought  In  without  cases. 

IRREGULARITIES  -       .  *  ^ 

If  an  examinee  is  found  cheating  on  a  certifying  examination,  the  results  will  be  held  until  such  time  as  the 
applicant  appeals  lo  the  Board  of  Registry.  The  Board  will  review  each  Indivldjjal  case  and  determine  the 
appropriate  consequences.  ^  .  '  . 
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R^POHTINQ  OF  SCOltES. 

■  y 

The  oxaminatlon  results  are  generally  released  approxifnately  six  {6)  weeks  following  the  date  ot  the  ex- 
'kmination.  it  Is  Madvlsabl^  to  call  the  Board  of  Registry  for  yog.r  results,  since  test  results  cannot  be  re^ 
leasedxiver  IhQ  tetephdnl  to  anyone.  It  is  suggested  thdt  you  fnform  the  Boar'd  In  writing  If  you  do.  not 
receive  your  score, wUhIn  two  (^.nionths  after  taking  the  test.  If  you  are  thus  affected,  you  may  contact 
the  Scheduling  and  Reporting  Unit  (see  first  page  of  noofnoracidum  for  address).  ^ 


individuals  who  fail  an  oxamination  will  ^ejye.  In  addition  to  their  sco4$.  Information  regarding  reap- 
pllcatlon*       *  .    '  • 

EXAMPLES  OF  OBJECTIVE  QUESTION  FORMATS  r 

The  fpllowing  questions  illustrate  the  variety  df  objective'  iteni  toMmats  that  may. appear  on  a  ^oard  of 
Registry  examination;  ml  all  question  types  wlH- necessarily  be  administered  oh  any  particular  examina- 
tion. The  most  widely  used  'fomials  bn  all  examinations  are  the  multiple  choice  and  multiple  response. 

Please  note  that  the  material  presente^ln  these  questions  is  not  necessarUy  laborotory  relevant  nor  repre- 
seYitative  of  the  content  of  Board  of  Regislr^^  examinations.  These  questions  are  presented  solely  forihe 
purpose  of  illustrating  question /or/naf. 

MULTIPLE  CHOICE  QUESTIONS 

y  %  ■ 

Directions:  Each  o(  the  questions;or  Incomplete  statements  below  is  followed  by  5  sugqesled  answers  or 
completions.  Select  the  or?e  that  Is  BEST  \o  each  case  and  blacken  the  appropriate  space  on  the  answer 
list. 


p|e 

1.  Vi/hich  'ot  the  lollowing  U.S.  cities  is  known  for  itb  abundance  of  lakes? 


A.  Minneapolis  .  .      ■  /  " 

B.  Chicago  / 

.     '    C.  St.  Louis  '      ^  .  •  f      •  . 

D.  Dallas  '  .     ,  k       ^  ■>  . 

E.  .San  Francisco  • 

■  Answer*A  •  *  ■  ^  

MULTIPLE  RESPONSE  QUESTIOI^JS 

Directions:  For  each  of  (he  Incomplete  statements  below.  ONE  or  M6RE  of  the  completions  given  Is  cor- 
feet.  On  the  answer  sheet  blacken  the  space  beside:' 

^  A.  Jf  only  1,2,  and  3  are  correct . 

^/  If  only  1  arid  3  are  correct  '  .  *  .. 

♦  C.  if  oriJy  ?  and  4  are  correct 

•D.  If  orfly  4  Is  correct  ^ 
E.  if  all  are  correct  » 

2.  Wjjii'ch  of  the  following  illnesses  Is  associated  with  a  vltafriln  deficiency? ' 

1.  Scurvy  .     ,  ■     ■     •  . 

2.  <  Pneumonia  *  . 

3.  Ricket?  »  •  . 

y^'     .    •      4.  Hepatitis  \  ^  a  <. 


Answer  B 


V-:-. 
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MATCHING  QUESTIONS 


Directions:  For  Items  3-6  below,  Indicate  the  letter  of  the  most  closely  retated  Item.  The  same  letter  may  be 
used  once,  more  than  once,  or  not  at  all. 

A.  '4  players 
Bu   5  players 

C? '  6  players  .  *  ^  . 

D.  ^  9  players 

^  •      E.  '11  players  •  * 

 Baseball 

4:  BasketMil  • 

5.  _:__^Football  •  ,  . 

6.  LHOckey  '      \  ' 

Answers   ,3,  D   .  * 

.4.  B  '  . 

.5,  E  .  ■ 

6.  9  c 

TRUE  FALStE  QUESTIONS 

<•  ■  '  .  ■ 

Directions:  Please  Indicate  whether  the  following  statements  are  true  or  false^f  true,  blacken  £\n  your 
answer  sheet,  if  false,  blacken />.  « 

7.  The  dumber  of  feet  In  a  rnile  is  ,1,000.  True  False 
^.  The  most  common  blood  type  Is  0.        True  False 

Anrswers    7.   B  . 
.8,   A  . 

EXAMPLE  OF  QUESTION  BASED  ON  VISUAL  MATERIAL 

high 

^  Physical 
Comfort 

^  low 

low  high 
.  Temperature 

The'graph  presented  above  shows  the  relationship  between  temperature  and  an  Index  of  physical  comfort. 
On  therbasis  of  these  data,  the  BEST  conclusion  regarding  this  relationship  Is  that: 

A.  as  the  temperature  gets  warmer,  people  become  more  comfortable  ^ 

B.  as  the  temperature  gets  cooler,  people  become  more  comfortable 

C.  temperature  and  phy^cal  comfort  are  not  linearly  relate.d 

D.  temperature  and  phy^cal  comfort  are  both  related  to  a  third  variable' 

Answer  C  . 
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RULES  AND  REQUUTIONS  FOyOARD  OF  REGISTRY  CERTIFICATION 
^XAMtNATldN  DATES:  Examinations  ate  conducted  on  the  third  Friday  of  February  and  August  each  year. 


OEADIrlNE  DATES:  Your  application.  muM  be  ii»  our  office  by  the  first  work  nig  day  of  October  for  Iho  February  examination 
aifU  ti»**  fir^^l  v*orkino  day  of  April  for  the  Augus!  examination.  The  Board  oi  Registry  strictly  adheres  to  the  estab- 
lished deadline  dalns.  Applications  rocoivod  alter  Iho  deadline  will  pe  processed  Idr  the  following  examination. 

EXTENDED  DEADLINE  DATES:  Exlvnded  d'iadllne.dales  are  Indicated  in  the  scoring  Information  lor  applicants  who  fall 
•Hw  Bxarnnmlion  and  wish  to  be  re  examined  lor  the  next  iconseculive  examination. 

APPLICATION  FEE:  The  Initial  application  tee  is  550.00  No  application  will  bo  processed  unHoss  accompanied  by  lljis  lee. 

EXAMINATION  W-IQIBILITY:  Etigibillty  for  examinalinn  rs  esta^lshed  by  meeting  the  current  stated  minimum  require- 
menii  lor'a  panicuJar  calegoiyior  level  of  certification,  submission  o|  an  application  and  payment  of  lee.  The  data  • 
"  buttriHod  on  an  application' must  be  vorilled  before  an  applicant  Is  determined  eligible. 

CiFFlCIAL  OOpUMENTS:  .  ,  ,  u,, 

amf  MT  •   A  t/,ins  '■  ■  h^ '  r»'":.»-V'j  c;MniptMinn  of  'I'-  trquiMu'  oiMjiliility  ■ 

"    ■      ■,„.  .  .  .  ■■  ..  \.  i,  .,..ijM.'       w.-.h«*vva  ...  .  ;  ■•  yn.!.  Muliml  ;ilt^  1  Hil>  0' »"(;Ut^t  M  i  :j11IST.DF  IN  OUROF- 
^c  fUJ 'V  r'^UU  C'jViM^!  UCmIuULED  ^0M  tAAI*<lNAriON. 

2  s-m'  ipplicahl'.  znly  ~  An  offiual  Itanticiip;  fjum  a  regionally  .jccredlted  colU'flo/ui diversity  twarino  the 
'"<•  I .  •  ii'.  rnir  •f|«  'tu'vef'^ii/  thi*  s>t)naiirre  ol  i'ih  t'.'f)  and  !  itn  your  ifoyrutf  w.ivcpjifeired  or  y/ilj  bo 
■  ■  •  M- .]  ti     I'Wy.W.n  MUtJJ  Hi:  IN  OUR  Or  f  'OF  DEf  OPE  FXAMlNAltON  SCOREb  CAN  BE  RELEASED. 

3  A.,  other  ( .vlcgc-nu'S  vvhiuh  Require  a  coilogo  bacKgrpund  -  An  officiaMrxinsr.ripi  from  a  regionaiiy  accredited  co\- 
le-o/univrtt'-iry  byaVin » the  seal  of  ihe  coitege/univcrsily.  iho  clgnaluio  of  the  R«oi5trai  and  the  date  the  degroe  ■ 

Ci.nlmi.td  THIS  DOCUMENT  MUST  0E  IN  OUR  OFFICE  IN  ORDER  TO  DETERMINE  ELIGIBILITY. 
CMku'C''-.  OF  NAME  ANO/On  ADDRESS:  Notify  us  promptly  i'  you  have  a  change  of  name  and/or  address.  Changes  lo 
c.     J  -.tKi*'       utijht  (H.  •.•-raK.ponod  prior  to  th"  ex  vii'nalion  ddth  vviM  not  be  rtiioclod  on  your  examination 
• ,  •  .•'Juie  IHt»tt 

CH  A* 'OH  Or.CXAMINATlON  AftEA:  Ftoquwvts  for  chanqe  o'  crumlnatnn  area  must  be  In  our  office  two  weeks  before  Iho 
^tl  ■  ••.-.irationoriheex.niP  -.^iioti  arid  mu^l  be  accornpuiui>d"hynnad(litr,s  change.  A  let' of  $10.00  i^ctlatged  tor  this 
. .-  .  t-»  alter  '.clicdjin  Iflti'rs  hjvd  b<;"n  ouilwi  No  h.iiuti-ir.  v/ifl  he  mu'Je  within  ttio  sjitiio  lc8lfi»g>ea. 

rfL^'  * '^h'of  SCOftFS  E  ^ainiration  scvros  are  reieasioU  li»  it»n  applicanl'and  the  ollicial*.  ol  the  piogram  In  which  the  ex- 
tni^t- war,  ciiio'li*d 

f.:C'.  :.-'.T  FOR  HAMDSCORE  An  Ji)piir.,u.l  v.  nilowed  W-t.T,-i  lio  n  thed.itftoi  re-^oipt    ^-^  ores  kM;u«'StiOn examination 

.fv.,.M'.  ■      .  . 

^Pt*i\i  S  MHCHAHlSW:  Cornptjiitis  an-l  jippeais  must  b,i  MiLimttud  to  the  Hoatd  of  Hpy'i't'y  v/rrting  within 90  days  of 
-    ■    r,A*t;^nt  or  jiot'lication  The  deiiision  of  the  Bo.i*d  will  bo  reported  to  the-oppropnare  inilivltlu;ir(3). 

PET* KE  AND  H £*»CHEDULE  FEES:  tl  you  tuncel.  Uo  not  iippeaf,  fall  iHe  exaniinatiou  or  aro  dntennined  inqliglbl»  lor  ex- 
,vnioaVion.  you  must  submit  a  lull  sppii'iation  fee  prior  to  ihn  •esl.iblished  deadline  date  along  wilh  your  request  to  bo 
fv  icf'vdi/'f'  l  to:  e/r,n»ii^jtif\i  r/\ -Ww  dpplicatioti  lormrs  nql^reqijircti )' 
jUi'.;  .*'.«;d  li  .td.ii    tUlou  Fnit  v/gll^lny  day  of  Apni  uf  Ociutnr 
ntKUNOR  «I  -o  t  ;«-ni!(>''jrr;»Mi'-U  i-wligibf.*  loM'xAminatidii.  '^0'-  of  yo-ji  .ippliccttton  l«>«.vrili  usitomalicatly  beri'iundcd  (o 
■   \  ■\.  Ut.t>n  f ■'(.'.  <;'l     a  'ult  i.^'phc  iticn  Ice  and  notiftcanon  tti.it  Jtl  iIoliLiont  '-.-^  tiavebten  rtMnovj»d,  your  af>fAllcalion 
s.«:«  bo  pror*:sr.o  I  fof  |tm  n^xt  jK»5Sibi»  examination  Ginco'uppftcalion^  atu  r«itainpu  in  our  office  for  a  period  of  live 
ytoru  vou  do  f.ol  rmeJ  lo  i"subrrnt  an  appiicatton  lorm  *  .      * .i.  » 

■.J  ■  r.'  th»'  .■!  atiop  focNvii:  ^lA  rpfui-<«"l  if  you  canret  at  L  .ist  live  v/ccV.^  p'lor  to  Ih'?  ex«mlnalton  daitv  Afw  that 
•■   •  !■  1 1  .'*  I.:  ,  v.ih  l_j«>  !ss..t.rt  '  .  * 

n^FXAiVlNATION:  Y-.j  jio  porrr.ilU^d  lo  take  the  fcxnrninaliiin  u  loUtof  :»tx  tirTiL3  If  yoy  arc  unsucco'sslul  alto-  six  at- 
W'tii-'Ji'-.y**'.' rno!'.)»Mi»  *ni  furjtuir  ctarninaticn.  '  ■    .  •■  /  <^ 

■   APPI  ;CAtlC»;-.'a  Hf  i  O  FOH  five  years:  AjM''ii"*<'OHU  leitiatn  vand  tcii  a  pi^""  lol  I'V'J  ye.T  .  iroin  th.-jdaH'oi  ^^^^■^}'^^}°!\ 
M       ■ijl.  lol-  re-.- Ii  Uiil^d  io;  the  same  caienory  of  pxaminalinr.  .vimm  ihis  limol'ntt.  suhrmt  a  full  fee  ot  550  00 
.u'ot  ,|  iv.th  ir'o  lo'io«mg  nlotmation  Name  (Maiden  name  v/hAn  appiioaoto).'  addioss.  dale  apptiod  and  fast  examina- 
I.J-.  t=iS2n  (if  nppricati'O  AHor  live  (5)  yoars.  rt  will  be  nocensaty  lor  you  lo  suhinit  a  new  applicaimn.  with  ihe  luil  tce 
.  «Mi.1  rr.eet  current  rcqu<reniehts.  ■  , 
CAHc  A  ACCREDITED  PROGRAMS:  Tliofeduc  ♦lion  rrc^^ived  honi  3  CAHHA  u.-.:r..flHod  PrngMm  is  accoptable  lor  a  period 

oJ  !i*e  (b)  years  from  Ihetl.'te  of  Lnmpietton 
HUM  QPVlFRi^i  rOR«E':?ONDENCctO:TV»a'4.j*.R«»n.^*ry  PO  H  »«  i?;vn  '/Z  liii'ii;.sG0»W2.A'Urres!icorre'.pof.- 

O  l'  .^^  .-.^  .  I  •  ■  ,M/r-i{  n<     «t  W  ».t  M'f'j'><'v        Uo*.^i/'i"0    "  ■'».  iii.i:t  »*v'^e'*u  »^ddriv.s  -  o*respon 

lic-Ho-Jran:;'  oi  *s  to  t"^ai  HulD  GRAOcS  to:  Boa^d  of  He{jlstry.  P  O.  bo'  bOb  i.  Ci'icago.  litmois  60«H). 
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FACT  SHEET 


lMr^RTA,Vt;  PIC.W  rouin  thk  Fuel  Sh^\  conUInIng  Ihe      of  oxuminalidn  areas  ond  iUn  rules  and 
•  regulouoM  for  your  Informilion, 


PERMANENT  BOARD  OF  REGISTRY 
EXAMINATION  AREAS 


ALABAMA 

Dirminghani 

4LASKA 

Anchorage 

:  ARIZONA 
Phovnix 

ARKANSAS 
Little  Rock 

CALirORNiA  - 
Lo»  Angelea 
San  Francisco 

COLORADO 
.  Denver 

CONNFCTICUT 
Hartford 

DISTRICT  OF  COLUMBI  A 
*  Washington,  D.C. 

FLORipA 

■  JAoksonvilie 
Nfidtni 


GEORGIA  ' 
Atlanta 

HAWAII 
Honolulu 


IDAHO 

i^oise 

ILLINOJS 
Chicflgo 


INDIANA 
Indianapolis 

IOWA 

Davenport  . 

KENTUCKY 
Lexington 

LOUISIANA 
New  Orleans 

MAINE 
Augusta  ' 


MICHIGAN 

Detroit 

■  MINNESOTA 
Miiuieapolis 

MISSISSIPPI 
Jackson 

MISSOURI 
St  Louis 
Kansas  City 

MONTANA 
Great  Falls 

NEBRASKA 
Omaha 

NEW  JERSEY 
Edisbn 


NEW  MEXICO 

Aibuquei[que ' 

NEW  YORK 
New  York 
Albany 
Buffalo 


NORTH  CAROLINA 
Durpam 

NORTH  DAKOTA 

Bismarck 

OHIO 

Columbus 
Cbveland 

OKLAHOMA 

Oklahoma  City 

OREGON 
Portland 

PANAMA  CANAL  ZONE 

PENNSYLVANIA 
Pittsburgh  ^ 
Philadelphia 


PUEl 


RICO 


'  San  JUan 

RHODE  INLAND 

Providence 

SOUTH  CAROLINA 
Charleston* 

SOUTH  DAKOTA 
Rapid  City 


TENNF^EE 

Knoxvilie 

Memphis 

TEXAS 
DaUas 
Houston 
San  Antonid 
El  Paso 
^  ..' 
UTAJI 

Sal^'Lake  City 

VERMONT. 
Burlington 

VIROINIA 

Bichmond 

WASHINGTON 
Seattle 

WEST  VIRGINIA 
CnLrleston 


WES1 


WIBCONSIN 
Mil  ^aukee  ■. 


WY( 


Lar<  mie 


)MING 


Mm 


.1 
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BOARD  OF  REGISTRY 
J    EKAMINATIOW  CONTENT  OUlDEtlNES^      .  . 

'  MEDICAL  TECHNOLOGIST  EXAI^WNaTION 

.    MlCROBlOLpGY  KNOWLEDGE  AREA  .    *  * 

Content  Artasl  through  V  httvt  •stantlaNy  tha  same  gtmral  format  as  spproprlata  tor  each  Area.      ■     '  ■ 

■  '  Number  ol  Qiwtlont 

I.  Ccjiccl-tffem  positive  and  negative   3-6 

II.  i3fem  positive,  aerobic  artdonaeroWc  rod!.; —  3-6  % 

til.    tnterlc  and  other  gram  wJgative  rods  ^  ..^  

IV.  Mycobactef la  and  miscellaneous  oroenisms  (sptr ocbates,  mycoplesma,  etc.)     4  —  7 

V.  Mycology  {yeast,  motda  and  yeast^Iike  molds) . .  ■.  ,   4-6 

*A.  Morphology  IcellulBf)  '. 

1.  General.  .      ,       •  I  ' 

a.  ahape  '      .  ■  ^  . 

b.  arrangement  "  ■  ♦         '  ■ 

'  I        2.  Use  of  atalna  *4  staining  characteristics  ■  i  *  .  *    ^  • 

'.  ■  ■        .'3.  Stnjctures       •  \  • 

a.  ■  flagetla  \         .  ' 

b.  spores  \  .  ■  . 

c.  capsuia 

d.  .  granuiat .        *  '  '  '  '■  . 
B.  Cultural  characterittlcs    •                                         ■         ,        ■                            "  ■ 

'  1.  Media 

e.  growth  requirements 

I  b.  Inhibitory  cortipoonda  .  ' 

c.   role  of  nutrients  In  metaboiism 


2.  Redox  potential  »  , 

3.  Environmental  requirement|i*< 

4.  Colonial  appearance  •  ' 
B.   size,  shape,  conabtencv.  etc.  of  colony 

b.  chromogenasis  ' 

i.  effect  op  blood  .•  "  - 

.  d.  effect  on  other  media 
C.  Secondary  Identification  i 

1.  physiologlcat  charactamtics 

2.  Biochemi<:at  reactions 

.3.  Antigenic  stnJctures  and  serologlG  Identification 
0.  Specimens 

1.  Sources  f 
2*.  Processing 

•  a.  safety  procedures  '         ..  ^  . 

b.  contamlnanta  ' 

c.  primary  culture*  '  ''W 

i 


<^  t  B  7  B  by  ^  Ametiean  Sodaiy  of  CHnleal  Psthpioglitil 
Rev.  to/78'  .  ^ 
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VII. 


VIII. 


IX. 


XII. 


Xill. 


Parssltas  ; . . . ,  .■  

A.  MofpholOjiiv  ■•        •  *  - 

1.  Sha(U 

2.  Structurti  '  •      .  ■        "  . 

B.  Sp«c.imtni  "  i  *  .'^ 
'    1-  Sources 

2.  Contamtnahts  and  artifacts 
C-  UfacYctos                                          ^  vW 
Madia  praparatjon  and  f  aagants . .  i  : .  PP.   J   V. , 

A.  Pr'lnciplaa  .  j 

B.  Procaduras 

C.  intarpraUtkm  and/or  troubia  scooting 

Olsinfactlon^nd  starlUzatlon .....  *  ! , ,  ^  

A.  Prindplai  '  '  I 

B.  PfooadMfaa  ■  ,  ^ 

C.  tntarpratation  and/or  tr<Mjb(asi>oot{ng 

Quality  Control  •.  J  ,  :  , 

A.  ProcaffcKas  "  ! 

B.  PrJnciplas  ■     ^  .  ^ 

C.  Mathod  corriparison  and/or  devalcpmant 
0.  Intarpratatlon  and/or  troubtafhootkH} 
Antlbtotica  including  sar^Uvity  Xtktlng  

A.  Procaduras 

B.  Prkidplat 

C.  Intarpratation  and/or  troubfa  shooting 

Ganatlcs  -  prlnclplat  /.  :      ^  ^ 

A.  Chromosomaatructurai^  function 

B.  ^utatlon,  transduction,  transformation,  conjugation 

pA)ganiclty  vji.....  |  

A.  Fptsaasa  atataa 

B.  ^i^achantsms  I 
Host  Dsf  aifisa  ^  ^  \   ' 

A.  Noo-spacific  ' 

B.  Spaclfic  > 

C.  ContrttwtlfK^actOfs 

.  1.  CoftWostaroWi  '     ■  '  . 

■  2.  hadtailon        '  \ 

3.  AiStiblotica 

4.  Oisaasaatataa  • 

Epidanvology  ■.  ;  [■  

A.  >Pravanth)n 
B/  Spraad 

Nosocomial  . 
Standard  OpafatingProcadure  .'  ■  ;  ,  .■.'J...-,... 

A.  Recordlr)g  r- 

B.  Reporting 

C.  Safety  s  ' 

Viruses  ,  ,   . 

A.  filature     *     ■  .         .    *       ^  . 

B.  "  Replication  ^  , 

C.  types  of  infections 

D.  Collection  and  handling  of  specimerts 


4-e 


1-:2 


1-2 


2-*3 


1-2 


1-3. 


1-2 


0-2 


2-4 


1 032 
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:  HEMATOLOGY  KNOWLEDGE  AREA 


> 


Eiythrocytos'    

A.  Formation 

1.  Bone  nisf row - 

2.  Liv«r 

■  3.  .  SpiMn 

4.  Kidnfy 

5.  Endocrina  glands  . 
.  D.  function 

C.  Cotttction 
^^1.  AnllcoagulanUi 

^ •  Vanoua 

3. \Caplllafv 
4..  Bona  marrow 

6.  Sp^haridtl'ng 

D.  '  Enumaratlv^Procaduros 

■  1.  Manual  c^nt  ^ 

2.  Automated  6<Hint 

3.  Rricutocyto  . 
.  4.'  Indices  *  . 

6.  Correlation  of  resuitf 

6.  Quality  control 

E.  Basic  testa 

1.  8edimentatlon  rate  . 

a.  Wintroba 

b.  Wastafgren 

2.  Hematocrit 

3.  Fragility 
4  '  Sickle  ceU 

5.  'Hemogtobki 
e.Heinj  bodies 

7.  Sugar  water  test 

6,  .Ham  test 

■  9.  Hemoglobin  electrophoresis 

10.  Correlation  of  results 

1 1 .  Otjality  contror 

F.  Cytochamistry 

1.  Wright's  stain  and  variations 
2/  iron  stain 
3.  .Supravital  stain 
Q,  Enjymea  including  Genetica 

1.  Glycolytic 

a.  GlucosahB-phoBphate 
dahydrogenaia  (GORD) 

b.  Pyruvate  Icinasa 

c.  Glutathione  (GSH) 

2.  Non-glycotyttc 

a.   Lactic  acid  dehydro* 
genaselLbH) 
H.  Morphology 

1.  ^Normal 

a.  Peripheral  ■ 

b.  Bor>e  marrow 

2.  Abnormal 

■a.  Peripheral 
bf  Bone  marrow 


.  e- I  B  question* 


I 

3.  Inclusion  bodies 

4.  Correlation  of  results 
t.  Radlonudidei 

1 .  Blood  volgme 

2.  Schilling  teat.  B,..  Folate 

3.  i  Red  cell  survrval 
J.  Genetics  * 

1.  Hemoglobinopathlas 
K.  Pathtldgical  states 

1.  Macrocytic  ar>emiaa 

2.  Mormocyticanenniaa 

3.  Vjhicrocvtic  anemlaa 

4.  Hemolytic  anemiaa 
6.  Potycythemiaa 

0.  Panqytbpeni 
Leuitocytes. 
A.  Forrpation 

1.  Spleen 

2.  Thymus 

3.  Bone  marrow 

4.  Lymphatlc'aystem 
8.  Function  , 

C.  Collection  ^ 

1 .  Antlcoagularits 

2.  Venous       i    '  '  ' 

3.  Capillary  | 

4.  BoneniarroW' 

5.  Special  handling 

-  0.  Lymph  node  irW)rint 
.  D;  .  E'numeratlve  Procedures 

1.  Manualcountl 

2.  Automated  colint  . 

3.  Differential    1      ■  ■''^  ' 

4.  Eosinophil  count 

5.  Corrtiation  of  raaulta 

0.  Quality  control 

E.  Basic  TesU 

1 .  Lupus  erythematosus  (LE.) 

F.  Cytochemistry  . 

1,  Wright's  steinar^dvariationa  i 

2.  Giamsa  . 

3,  Peroxidase 

4.  Periodic  Acid-Schlff. 

6.  Sudan  blacit 

0.   Leukocyte  atkalin^  phosphatase 

G.  Morphotogy- 
^     1.  Normal 

a,  Peripheral  ^ 

b,  .  Bonemarrovy 

c,  Lymph  node 

*    d-  Electron  microscopy 
2.  Abnormal  . 
.a.  Peripheral    _  1 

b.  .  Bone  marrow 

c.  tymph  node 

d.  Electron  microscopy 


8—1)8  questiona 
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3.  IndkitHmbodlM 

'4.  Ccffrtl«tlon  of  rMolts 
.  H.  GtfMttct 

1.  PNI«<S«lpNachrornotom«.  . 
..  2.   AnomaHf^         *■  ' 

I.  PathotoglcalStatM 

'1 .  Gentttc  Inheritfd  Conditions 

2.  infectioni 

Vfrtl" 
c.  Ptrasltic 
.  d.  Mycologic 
'  3.-  Metabolic  and  ToxtcConditiont 

4.  LMJk«moMSte)tt 

a.  Leukamltp 

b.  Ly^pt>omM  • 

c.  Multiply  myalomas ' 

d.  Metastttet  ; 
6.   Miscaltaneeua  Conditions  of  Unknown  Eti6loov  ' 

a.  Lupup  EryjlMfnatosut 
b-  Pancytop^anias 

W«telaJt      ^. .  2«-4  qof itions 

A.  Formatloo 

1.  Splaan  *  .  ■ 

2.  Uvaf  ?  ' 

3.  Bona  marrow 

B.  FurKtion 

C.  CoUaction 

1 .  Anticoagulanti 

2.  Vanous 

3.  Ca^lafy 

4.  Bonahiarrow 

5.  Spacial  handlirig 

D.  CnufTwfativa  Procaduras 

1.  Manual  counts 

■  a.  Counting  chambar 

b.  Slida  mattiod 
c  Phata 

2.  Automated  counts 

3.  Corralatton  of  rasuUs .  .  - 
4..  QuaHty  control 

E.  Enzymes  and  Fact ora 

■  1 .  Adanoalna  triphoaphata  (ATP) 
2.   Platalat  factoraHhrouofi  7  '  , 

F.  SpacWtasta 

1.  ^  Clot  ratractlpn 

2.  Rumpal'^Leeda 

3.  Adhaatvants;  .  '      .     ■  . 

4.  Ptstalat  factoir  assay 

G.  o  Morphology 

1.  Nom»aI 

a.  Paripliaral 

b.  Bona  marrow  ' 

2.  Abnormal 

a.   Paripharal " 
b  /*fedna  marrow 

3. '  ■  Cof  reflation  of  results '  4 


I 


H.  Pathologkal  States 

-  1.  Tbrombocytbpanias 

2.  Thrombasthamlaa 

3.  Thrombbcythamlas 

IV.  '  Bona  Marrow  In  MiscaUanaous 

Pathologteal  States   /  2-4  quatttons 

A.  Morphology 
.  1.  Ganatio  Inherited  Conditions 

2.  rnffbtionr 

a.  Bactefial 

b.  Viral 

c.  Parasitic  ■  ^ 

d.  Mypol6gIc 

3.  ;  Metabolic  and  Toxic  Disorders 

4.  Leukemold  States 

5.  NeoplesticDisaeses 

a.  Laukemias 

b.  Lymphomas 
C.   Multii^  myelomas  and 

gammopt^thles  (psraprotainamias) 
■  d.  Matestasae 

6.  Miscellenaous  Conditions  ol 
Unt(nown  Etiology 

B.  Techniques  ^ 
■1 .  Specirnen  Hanpng 

a.  TIssueBlock 

b.  Perticle  SMa  Smeare 
.c.  Culture 

2.  Special  Stains  . 

3.  ChamlcatAnalysIs 

4.  SitdaEvakiations  "  ' 

V.  Coagulation  sifi  quastions 

.  A.  Thaofy 

1.  '.Intrinsic 

2.  Extririflc 

B.  .Factors 

1 .  Nomenclature 

-  2.  Function 

C.  Basic  Tests 

1 .  Bleeding  time 
'  2.  Xlotting  time 

3.  Plasma  recak:tfi€Mltion  tjma . 
..,    4.  Prothrombin time^lesU 

5.  Activated  Partial  Thrpmbo^lastin 
Time  (APTT) 

6.  Fibdnogan 

7.  thrombin  tima 

D.  Special  T^^ts  > 
1 . .'  Substitution  tests  ' 

2.  Factor atssys 

3.  ^uglobulin  lysis 

4 .  Fibril^  Split  Products 

E.  Quality  Control 

F.  Correlation  of  Rasulta    '        >  . 

G.  Patholooical  Slates 
1.   intrinsic  ^ 

a.   Hemophiliac  States 
.  h    Proihromhin  CompfeK  AbriormalMies 

c.  Fibrinogen,  fibrinolysis^  Complait 
.   Abnormalttias      '  . 


I 
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•2.  Extrinsic 
.    9.  Facto*  VH 
•*    b.  Other  TisiuvFaciors 
3.  CcmbirMdOoficlfncyStatM 
•..  von  WiR«bf*nd't  DiMtM 
b.  Ditt«mi.n«t*d  iniravHCutor 
Coagulatton  (DIC) 
VI.  kifUumsntation  

A.  Princip)«s    .  y  f 

B.  Components  .        ;  . 

C.  Stsndifdizstion        *  ' 

•  .  D^Prsvontivt  Mfllhtsn«n<^  f 

•  "  6.  i'rouW«4*»ooting 

Vtl.  Lsbofstory  Safety  

VIII.  Mi»ce«noeouf      

A.  Spina)  fluid  Cell  Count  and  DIf  fereniial 


2— 4  questions 


1-2  questions 

.>v      1  —  2  questions 
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IMMUNOLpQiV  (IMMUiNOHEMATOLOQY)  KNOWUOOE  AAEA- 


OffMrtl  ~  Tht  Inwnbn*  Pr9cw»  

A.  NtturallmrPMnltvandlrTWTHinologtcMbsUncM 

r  LVtoiymtt  "  ■  ■ 

•    2.  Btalc  po)vp«ptklM 

3.  Proptfdin  .  .  ■ 
8.  AnHgtn* 

C.  Humoral  and  6#llulk  immunity  |^ 
1.  SpMincity  •  •  / 

.  2.  MtchanitmoUmibodyformaficm 

a.  Lymphocyla  function 

b.  Thymui  gland  function  .  .  - 

3.  frnmunogloMina 

a.  ClaMiflcatlon 

b.  GanaiUbropartWt,  ttrtictura 

c.  Identifk^itlon  ttchnlquai 

U  In^unoeltctrophbresit 

2)  InrjmunodlKutJon  . 

3)  Immunofkjorafcance 

4)  RawoknmunoaMay  (RIA)  '  - 

4.  PHmar#Mtai#t9ndafy  ratpont e 
■  5.  Pataiva  InvT  unity 

D.  Antigen- antftxdy factions 

1.  Indloatort  of  anUgflii-antibgc(y  rgactiont ' 
%        a.   Aoofutir  atioo  ^■ 
I     ■  b.  Lytlt«  (n  ikidlng  hamolysli 
c.   Pracipfti  tion 
d:  Complaff  tiint  fixation  ■ . 
a.   Huofatc  Hit  Antibody  TecM<)ua 
\  NautraUzathxiof  antiganabyantibodiat 
^      3.  Opaonization  ■  ■  ♦ 

C.  Compltmant  ■  . 

F.  Autoimmunity  .  '     •  ^ 

1.  ^^tufalimmu>ologictotaranca  of  ona'aown'protein  (self  concept) 

2.  Autoimmuita  atponsaa  - 

a.  AutoimminahtnKilytlcanamfaa 

1)  Acqt  If  ad  hamotyttc.anamiatcautatJ  by  Incomptota  warm  antibodies 
.21  AcqiiradhamolyticantmiaacausedbycoklautoantitKxiies 

3)  Paf a  :yamal  coW  hamogloblnur^ 

4)  Atyp  cal  autolmmuna  hamMyttc  anamiat  ... 

b.  Autotmm  ma  coMagen  diuate  *  *^   

9.  iQducadtotarinca.  graft  r«}action  and  tumor  immunology 

qJ  AHargy  -  dalayad  riyptraanaiUvity  j  . 

sirologkTMU  for  Syi  hIKi  >   

A*  Qanafpiprinciplaf 

B.  .  Falaa  poaltivat  ^ 

C.  Flocculation'teat 

0:  Complamfnt  fixati  sn-tattt 

E.  FluOraacant  Trepoiwma  Antibody  (FTA) 

F.  Quality  control 

1 .  dapofting  rai4Jta 

2 .  nacord  Miintananca 
.  3.  ftaagant  contrA 

4.  Equlprnent  matvtansnce 


11-15  questions 


2  — 4  questions 


/ 
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'  S^rodlagnosticTMtt  ^  Non^syphiKttc  

3'.  Wldf!  reaction 
.  OpBonooytophaglcindtx 
t.  Ftbtii*  •ggKitintns 

1.  '  e«ucttk>tl»  - 

2.  WeilFefix(Prot6ti8  0X19,OX2«OXK) 
3  P#fatyphoWA 
4.  Tyi^H 

D.  .Cold  s^Kl^tinins  including  ttreptococcut  MQ  •ggKitinitii 
\  E.   Strept<>coccut  grouping 

F.  S^tologlotMisfof  rhMMnatoldafthritit 
'  1 .  Lattx  fixation  taati  (including  set eaning) 
2.  Bantonite  f (bcculayoo 

G.  An'liatraptolysin  0  titeft 

H.  Antihyaiufonidau  titera  • 

I.  .  C-raactiva  protain 

■  J.   Autoimmun«&Dbitanca»  .  . 
K.  infectious  Mo<l!onucleoslt Tasting 

1 .  '  HataropMa  *         '  ' 

a.   Pratumptlva  •  * 

•b.  Orffaranlial 

2.  Monotpol 
L.    i^ragnancy  Tas  t» 

M.  Other    .  ■ 
t..  Tulaffamla., 
!.  Laptoapifoaia 
ToHOplasmoaia 

Echinococous  '  ' 

Trichinoaia 
U,  duality  contfol 

1 .  Reporting  rasulla  ^ 
Record  maSrttananca 
Raa(H>nTc5nfr6l  '      — —         ■  ■ 
Equipment  rnaintananca 

tV.   lnnmu|iohafnatology  r  Bipod  Banking   

aatectlon;  Procaaalng  of  btoo^:  Blood  collection 
ll  Conor  identification  .  ^ 
21  Qar>erel  quaMf  icationa 

Medical  Indications  for  dohbr  rejection 

a.  Protection  of  dofMH 

b.  Prot^tion  of  racipifi^t 
Physical  exam  incHtdino  lab  data 
Therapeutic  bleeding 
Autologous  trartsfMskma 
Pfasmapherasla 
Routir>a  donatiOTtt 

I  a.   Blood  coHaction 
.     I  b.  Blood  processing  anfl  laMng 

Ic.   Blood  prwervatlw  and  stof  age  * 
9. 1  OoiWM  reattlons  '\ 
B.  '  B}opd  components  ~i  preparation,  fr>d 

1.  I  Whole  blood 

2.  Ipackadcella 

3.  iFreshfroianplaan^^ 

4.  'C^opreclpltata 
B.  iH^talat  rich  plasma 
D    iWkocyte  poor  blood 

■  \    ■     ■  ] 


0-11  queations 


7 

/  ■ 
/■ 


^2~14qu«stlons 


d  Indication  for  use 
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t.  PrtpwitiontndMirniflttritionofblopd 

}   2.  ■  Blood  groupktQ  end  typing'   '  1 

3.  CroMm«t^(fn«)iK  and  minor)  \        ^  ' 

a.  SaNof ,  r^k>m  Itmpff ^tur«  phaM 

b.  Hl0hprQltln.37n:pbaM 

c.  EnzynW       •    ■  ' 

d.  Antihuman6kSbuHn(Coofnbt)'   ;  - 

.  4.  Antflx)dydittGtibnandidantinc«tion 

.a.  'Scrain(nocan$.  can  panels  ,  - 

■    b.  Tltr^ion  >  . 

c.  Absforption.  aMion 

d/  Fa<torsaf(actlngttood  group  antigen-antibody  reactions 

6.  Prot>lam  solving  tn  crostmatchet 

0.  Emeroentoy  use  of  blood 

7.  Tranflffusfon  reaction 
Other  gai(aral  blood  banking  considerations 

1 .  G9mtit9  of  blood  group  Inheritance 

2.  ABO  groups 

4.  Ojnefbiood  group  Bystame 

5.  HerT>o^tl;diaeaseof  rMwborn  ^ 
a'.   Caus*- Rh.  ABO.  other 

.   b..  Datactiofi  -i, 

1)  Ekitipn  '  ^ 

2)  Antibody  identitlcetion 
'  c.   Exchange  tranafuskm 

d.  Therapeutic  MsesofRh  Immune  globulin 
QuaKty  control 

1 .  Rtponing  rasulte  (g/ouplng,  typing,  crossmatching) 

2 .  Relaaae  and  tranaf  er  of  blood  and  components 

3.  Record  maintenance 
J.   Pre-trana^sJort  j  ■ 
b.  Potl'transfuslon  / 

4.  Reagent  control  . 
5-  Equipment  maintenance 
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MISCI^NEOUS  TOPt^S 


TMt  out(in«  coven  tba  (oHowtng  knowledge  ereai:  Urine  &  Other  Body  f\mi*.  Cvlooen6tlc$.  Management  &  Supervition.  Education.  - 

Research  &Oevek>pment  a  mJFundamentelAMyttfal  Principled  emJ  Laboratory  Celc^^  ^  ' 

■  .  '  •"     .  ' 

URINE  4  OTHER  BODY  FLUlDin 6 -20 questions)  B.  Faeces 

I.  Renal  Ptiyiiotogy  2 -4  questions  ^  1.  Phyilotofly 

A.  Glomerular  Function  '  2.   Specimen  collection  &  hendling 

B.  Tubular  Function    '  '  *            3.  Physical  tests 

1.   Secretion       '*          **     -            i  4. .  Chemical  testa,  quslltativre  ■  . 

Reabiorptlon  e.   occult  Wodd 

*      3.   Threahotd  •       .  (at 

'  C.  Endocrin*  t,   pepsin  .  . 

.*  D.  Volume  5,- Correlation  of  test  refulls' 

E.  Urkw Composition  G.  GastricFluid 

Rate  of  Formation  1 .  Physlotogy  / 

G.  CoTreiatiOn  of  Results  with  Pa thophyiiology    ■  2.   Specimen  collection  ft  handling      ^.  / 

II.  Routine  Urinalysis  .9-13  questions  3.   Gastric  enalysit  / 

A.  Physical  T  as  IS  4.  Correlation  of  test  results  / 

(IrKkjdes  principles  &  sources  of  error)  D.  Seminal  Fluid 

1.  Appearance  1.  Physicel  testa   .  - 

2.  pH.  titratabie  acidity  2.   Specimen  collection  &  handling 


3.   Concentration           ■.  3.  Fertility  &  sterlNty  siudles 

e. .  ^  specific  gravity  '  (irKkidtng  routine  semen  analysis) 

-  b.  refractive  indev  '4.  Medical-legat  atudiea 

z.   osmolality  (typing,  chemistry,  etc.) 

B.  Chemical  Tests  6.  Correlation  of  test  results 
(includes  principles  &  sources  of  error)  ■  E.  Amniotic  Fkiid. 

*1.  Carbohydrates  1.  Physical  testa 

a.  glucose  -    2.   Specimen  coHectlon  &  handling 

b.  reducing  tugara  3.  Correlation  of  test  resulta 
'   c.   other  reducing  substances  F^  Atciltc  Fluid  APteural  Fluid 

2.  proteins            ^  '   1  Physiology 

3.  Ketones  2.  Specimen  coHectioniihsndnng 

4.  Pigments  .3.   Correlation  of  test  results 
a.   bilirubin.           '  G.  Duodenal  Fluid 

•  b.  .urobilinogen  1.  Phystology. 

c.  hemoglobin,  myoglobin  2.  Specimen collectiQn-&  handling 

d.  homogentisic  acidl  melanin  3.  Correlation  of  test  results 

e.  pof  phyrina  '  H.  Salivary  Fluid 

5.  Miscellaneous  '  1.  Physiology 

a.  phanylpyruvlcMd  >  2.  /Specimen  collection  ft  handling  ■ 

b.  urinary  celcuS  f  3.  Correletlon  of  test  results ' 

C.  Sedimerit  Exeminetlon  I.    Synovial  FkiW 

1.  Cells  •   .             \  •    ♦           ■  .      1.  Physiology 

2.  Cests  '      '  2.   Specimen  collection  and  harKiHng 

3.  Crystals  .3.  Correlation  of  test  results 
"  4.  Lipids 


i 


6.  fetasites.. fungi. bacteria  .  CYTOGENETICS (1  ~3 questions) 

D.  Specimen  Collection  &  Hendling  \   .         *  1^  Cytogenellca 

E.  Quality  Control  V  ^*  G*"**'<^P'''^'P'*» 

F.  Correlation  of  Test  Results  ^  B.  Specimen  collection  &  processing 

Other  Body  Fluids    3-7  questions .  1 .  Examlnatloij  of  smeers 

A.  Cerebrospii^  Fluid'  ^.  CeH  culture  techniques 


1.  Physiology  IP  ft  analysis 

2.  Specimen  collection  fthandljhg  C.  Correlation  of  results 


3.  Correlation  of  test  resvlti 


ERIC 
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MANACEMENT  ft  SUPERVISION  (3-5  questions) 

I.  Budget 

A.  OptfttlngEMpfntM 

B.  Cost  Accounting 

C.  S«tary  ExfMntM. 

0.  Justification  Qf  Chang*  in  Budget 

II.  •  Ptffonnel  .  , 

A.  Vyori(l<^ena}yt)s~4itl>tdu)ing 

1.  Number  of  tests 

2.  Number  of  houriT' 

B.  Hiring  Praclicee 

C.  Advancement  Practicee 
0.  Tefmlnation  Practicee 
E,  EvaHiation  of  Personnel 

III.  .Laboratory Spec*  . 

A.  Planning  New  Fediitiee 

B.  Utiflxationof  Existing  FadRtlea  , 

IV.  ' Laboretory  Supplies 

A.  Ordering 

B.  Storing 

•  C-  Inventory. 

V.  Labor e  tory  Equipment  -  Fixed  or  Heavy 

A.  Procurement  -  Purchase.  Leese 

B.  Maintenanc*.  Including  Record  Keeping 
&  Quelity  Control 

C.  Trouble  Shooting,  indudinf^  Record 
Keeping  &  Quality  Control 

VI.  General  Principles  of  Records,  Federal  &  State 
Regulations,  and  Laboratory  Safety 

A.  Records  ■ 

B.  Federelft  State  Reguletlons 

C.  Uaborstory Safety  '  . 
lincludes  radiation  safety) 

VIL  Ethics ftMedtcal/LegslMattera 

A.  Ethics 

B.  Medicei/LegelMattere 

EDUCATION  (3-4  questions) 
L  JobEntrylndoctrinatioQ. 
tl.     Continu)r)g  Education  for  Laboratory 

Employees 
Ill     Interdepertmental  Rotatiorf 
IV.   tnservic«  Education 


*^A.  Interdepartmental 
B.  Intredepsrtmental 
V.    Effective  Mechanisms  of  teecNng 
^     A.  Objectives 

B.  Curriculum  Development 
C  Evaluetion'  ' 

RESEARCH  &  DEVELOPMENT  (1  -  3  questions) 
I.     EvefUation  of  Test  Per! orme.nce 

A.  Quelity 

B.  Quenftty 
\C.  Coat 

II     Initistion  of  New  Proceduree 
A. 'Criteria for  Initiation 


\ 


'  B.  EveluatlonCriterle 

1 .  Accuracy' 

2.  Precision 

3.  Coei  ■   ,  , 
C.  (nformetionDleeeminatlon 

1 .  To  laboratory  peraonnel 

2.  To  physiclana  * 

3.  Channeof  normal  values 

4.  To  other  IneOtullional  penonrMl 
iMpertments  -f 

FUNDAMENTAL  ANALYTICAL  PRINCIPLES 

AND  LABORATORY  CALCULATIONS  (1 0-14  queetiwis) 

L     Solutlone  and  Standards  1—3  questions 

A.  MolaL  Moler.  Normal,  and  Percent  SoHitione 

B.  Specific  Gravity  .  ' 

C.  Hydretes  and  Water  of  Hydrattbr) ' 

D.  Dilution  of  Solution  and  Serial  Dilution 

E.  C^erefonProMeme 

F.  Balances  end  Weighing 

G.  Analytical  Standards 

H.  Glaaeware  precision  .j. 

n.    Preparation  of  Grephe..  0- 1  questione 

A.  Use  of  Greph  Paper  (Certesiin.  Log.  Semilog) 

B.  Coordinates  * 

C.  Stendard  Curves 
.   .   6.  Units 

in.    Spectrophotometrtc  Catculatlone  1  — 3  questions 

A,  Applicetloneof  Beer'eLaw 

B.  Molar  ExtinctiOftCoefflcient 

IV.   General  Principles  of  Quality  Control  <  3-5  queetione 

A./BelicStatistice       :         '    .  . 
/  1,  Meen,  ntedlen,  fttod.e 

2.  Standard  deviation,  veflapc* 

3.  Coefficient  of  varletion 
Quality  Control^  I 

1 .  Accuracy,  precistwi.  reOsbiiitj 
■IgnHicant  figures] 

2 .  C  onfidence  limits,  bercentilee 

3.  Distributior^cheradteristice 

4.  DevelbpmentofnolrmelvekiM 
6.  Control  charta  . 

Vl  -  Hydrogen  Ion  toncentretion  &  pH .........  2  —4'  questions 

A.  Standard  Acids  and  Besik 

B.  pH  Reference  Solutlone  1^ 

C.  Celculetionof  Hydroger^bH 
0.  Cetculationof  HydrogenionCortcentration  ' 

/       E.   Buffers,  Henderaon-HeeselbelchEquetiori 

f  VI.'  Principles  of  Miorogct>py  '   0- 1  questio/n 

A.  Ught  .        .       ♦  . 

B.  DsricFi|Ms 

C.  Fluorescence 
t^Phese  Contrast 
E.  Interference 

\Principiee  of  Nu^leer  Medicine  .0-1  questione 
A.  Radionuclide  Physica 
0.  Regulations  &  Salety 

■  .\  '     ■ .  ■ 

\   ■'  .     .  .  ■•   ■  .. 

■  \  ■ 
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)     *V  CHEMISTRY  KNOWLEDGE  AREA 


1.*.'  IfwtruiMntttlon  -  Vw  (oNowino  cUtu—  of  Initrumanu  mb  to  bf  toveied  

:  i.  CoukwMtric        ■  ^ 
,Z,  SptctfophofomttHcfcPhotometrte- 
emtoilondamt 

b.  ttomtetbtofptloo 

c.  co*ofVn«ttc 

'    3.  FluoiMCtncff  &  PhotphoTMcenco        '  . 

•  "4.  Autom»ttdAn»lv2irt 

m.  coothHWOiltow 
.  b.  di«cf«tatMnpllng.  • 
6.  Etoctrofjhovttic  &  ChrOfnatoor«phic 

0.  pottntk>nHtrk:  IbKkjding  blood  QM  enatVMffl)  ^> 

•  7.  lilcof dk>g  d«vteM 

•  8.  CantilhiOM" 

^.  Otmonwters    •  ■ 
.    10.  BtUncM  -  " 

11.  Ro<)109ocM«instnjm«nU  - 

A. -  Thtory  of  Opvfation 

1.  Physical  prindptotlnvolv*^  in  opwation  * 
2!  ClWn>kMlprinclplMlovoh4djnopefatlon  ...  ^ 

B.  E»MntUIConvofw>tooflnatnim»ntf -  4 

.  1. ,  powarMJpply 

2.  ^dtfflamp  ■  ' 

3.  Mooochcomator.  .  • 

4.  Samplaholdac  • 
B.  Phptodatactof 

I     6.  RaadQutfW^ 

0.  Appjicattoo/Utaollnatjumenti 

1.  Opwation 

2.  Maintananca  \ 

\    I  a,  caSbratiofl  racocda  ^  . 

"  b.  compooantchangaa&docgmtntatton 
.  '       "3.  CholcaoflnitrtiinaotTvpa 

C.  SpadalPracautKma.SpackntnC^llactlon&TcoobteShootJ^ 

11;  Thaofv&Appltoa|ooo(PHyalolo9teBlochaml«trv...  

'  Tha«oltowlngiubtopk;tfcoddaKriptlvacoinpon«ntowl!lti«BppIiadtotop^ 

1.  iiofrT»l*abowmalW»k)logy 

2.  Taftp»oca<hiia» 

a.  pfinclpla    *  .  ' 

b.  procadura 

•  -    c.  apacWpfacautlow/apacHnancoMactJooaL trouble  ahootlnjj 

3.  Intarprataltoo  ^ 

^  .   a-  ralatad.tophyaloloflv  j| 

b.  rwii>*lva.abi>ofmal  W 

^    c.  vaWi^y  &  accuracy  of  procadwa  .  • 

d.  lniaffalaUonthlp%^tholha#labofatofvtetU 

.4.  QuaUty  oootrol         '  .  . 

a.  ttatlallca&dataMcofdlno 

b.  Intarpratation&i^oldata      .        '  a 

•  Nfwtaatdavalopmant         ^  . 
«.  ivaluatlonofnawprooaduia 

b.  ■JbachaolcaolaettVioup'wpcocadurH 
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A.  C«rl)Ohydriiw;...........   -   .  3^5 

MccKafldas.  Id«ntificatk>n  tola rancas.  ate*  '  _  . 

•  TdlncKida  th^  ma}or  alactrolytaa  and  trace  etementa.  Substances  such  as  anilixi  aVwa  and  proteins  are  ' 
'   covered  separately  In  topic  E. 

C.  Ac^d  Base  Baleofle/Blood  Gekas: , .-.         .      3 _  g  u„tlons 

•  Distribution  of  lorta  in  fntreceltular  sr>d  extracatiuUr  compartmenU,  Qibbs-Donnen  EqulUbVlum  and  oa-        ^  ^* 
molality;  Henderton-Hssselbach  equation  (or  btearbbnata-carbonlc  acid  systems;  other  body  ttHi^    .  * 
systems;  transport  of  oxygen  and  carbon  dioxide.  .  ^ 

D.  Eniymes:  f>.       ^   ^    ^^^^  ^ 

.  To  include  aH  eniymas  of  dlnical  significance.  EniyrMkfnetlce.fact^^  F  °" 

re*:tlona.  enzyme  acdvatora  and  Inhibitors,  enzyme  denaturatlon  and  Inhibition,  role  of  coenxymes 
and  isoenzymes. 

E.  Protelna  &  AmIrvtvAcids;   ^     .  ^  3-5 

To  Include  all  slmplAanjtf  complex  proteina  except  lipoproteins  and  erizymet.  " 

F.  Nonprotein Nitrogenoup Substances:  ^  \ ,         .3^5  ^  y 

To  Include  all  major  component*  such  as  creatinine,  urea  nitrogenend  urid  add. 

G.  HemePeflvetivea:   "       «  .- 

,   ,  .  ^  •-  *       3— 5  questions 

:    To  include  h«me  precuraors  auch  as  pyrroles  end.  porphyrins,  heme  per  se.  end  the  hietaboUc  breaks 
down  pr oducU  rettted  to  heon  such  as  Wllnibin  and  urobHlnodan. 

To  Include  the  following:  Upoprptelns.  non-esterified  fatty  adds. 'in'olyce'ridci.  '^^^^^^  ,  -Bqueatlons 

.sphjngoliplds.sterafs  and  fatty  acids?  ,    .  ■ 

I.    Endoctlnology:       ^  3   5  uest 

To  Include  the  nature  and  action  of  hormones,  control  of  honnone  secretion.  S|»clflc  areas  io  be  qu««k)na 
covered  include  adrenocortical  hormones.  steroMs.  androgens,  estrogens,  prostaglandins,  pituitary 

hormones,  insulin,  catecholamines,  vanilmandelic  acid,  aerotonin  and  5-hydroxyIndoleecetIc  acid  •  " 

J.  Toxicology:    «   r       .  • 

▼  u        i '  »•       3-5  question*  . 

To  kKlufie  geses  auch  aa  carbon  monoxWe;  volatile  eubstancea  such  ea  ethanol.  methanol,  cyankle. 
.  keioeene;  corrosive  metata  such  aa  arsenlcats.  lead;  non-metals  such  as  bromldea,  fluorides:  organic 
substanc«e  auch  as  amphetamines,  barblfurates.  saticylatas. 
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.CONTR^  NUMtER 

999006969 
.  MT 

V 

CATfOOKV 

MAX.  SCOME 

YOUR  SCOAE 

•  ' 

BACTERIOLOGY 
BLOOD  BAMKIN^ 
CALCULATIONS 
CHEMISTRY  .  . 
JpEHATOLOGY  i  CuAG 
PARASIT  t  MYCO 
SEROLOGY  ' 
URINALYSIS 
MISCELLANEOUS 
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'  17 
19. 
40 

■  36 
Jp  . 

^21 

13 
14 
24 

30  ' 
.08 
17 
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PASS 

cCnTll^tCAT^^S  NUVBtA 

MT  222222 

AMERICAN  BOCtETY  OF  CUNtCAL  PATHOLOOiSTS  .  , 

DEAR  CERTIFICANTi/^ 

IT  IS  A  PLEASURE  TD  INFORM  YDU  THAT  YOU  PASSED  THE     BOARD  OF 
'registry  EXAMINATIPN  ^kDHlNISTERED  DN  AUGUST  17,  1979  'HE 
WELCDHf  YDU  TD  THE  RANKS  OF  OUR'  CERT  I F IQANTS .       YOU  ARE  NOW 
ENTITLED  TO  US^  MT(ASCP)  AFTER  YOUR  NA^E ,  INDICATING  TH/^T 

YDU  ARE  CERTIFIED  BY  THE  BOARO^^OF  REGISTRY-  OF  THE  AMERICAN' 
SOCIETY  DF  CLINICAL  PATHOLOOJ STS.,  YOGR  CERTIFICATE  ANO  .IDEN- 
TIFICATION CARD  ARE  ATTACHED.  ^ 

■    ■    ■  .   ■  ^ 

IT  IS  ESSENTIAL  THAT  YOO  KEEP  US  INFORMED  OF  YOUR  CORRECT 
ADDil^SS.  THE  ADDRESS  .SHOWN  ON  THE  IDENTIFICATION  CARD  IS  3E- 
CORDEO  ON  OUR  DATA  PROCESSING  RECORDS.  IF  THIS  .INFORMATION 
IS  INCORRECT,  OR  tF  YOU  CHANGE  YOUR  NAME  OR  ADDRESS  PLEASE 
NOTIFY  US  PROMPTLY,  STATING  YOUR  FULL  NAME,  CERTIFICATION 
■  NUMBER. *DLO  ^ND  NEW 'AODRESStS,  INCLUDING  ZIP  CDOCS.YOUR  CER- 
TIFICATIDN  NUMBER  IS  INCLUDED  IN  THE  ADDRESS  BLOCK  ON  vpuR 
IDENTIFICATION  CARD  AND  SHOULD  AtWAYS  BE  INCLUDED  I NiCQM^^UN- 

ICATIONS  With  the  bpaj^  of  registry.  r 

CONGRATULATIONS- 'AND  BtST  HTSHES  FDf^  YOUR  CONTINUED  SUCCESS. 
-SINCERELY  YOURS,  ^  '  i 

Barbara  M.  Casttfeberry.^H.S.V  HT(ASCP) 

CHAIRMAN'!  Bt)AR!a.,(;Lf  J|EGISTRY  -        '  * 

\^  :.j^mM  ^^^^ 


i    JACK  R^NBOLT 
HT(ASCR)  222222 

!  200  E.  Ontario  street 

j    CKICA^^.IL  60611 


V  t'Lv 


y  YOUR 
f  IDSNTlFlCATICN 
C/vnO.  CUT  ALQNt  1 
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PlAlFAmU)  ^TATBJmInt  OF  Dr*  0WD*1  BfKlERNAN/ExECtJTIVB  DiAcTOR, 
^ATIONAXi  AlsOClAtlON  OP.  Sb^ONDARY  ScHOOL  PRINCIPALS 

....  ■  ■  ,  .   <*    \  . 

Hr.  Chairman  and  ^distinguished  members  of  the  ConmUtee,  I  thank  you" 

for  the  opportunity  to  share  ^wlth  you  the  National  Association  of  Secondary 

School  ^iijclpals'  concerns  about  a  bill  currently  before  your  Committee, 

the  Educational  Testing  Act  of  1979  {H.R.4949).    First,  you  should  know 

»  that^e.NASSP  represents  more  than  35,000  secondary  school  administrators  • 

^'  nation-wide,  who  In  turn  are  responslbl? ^or  the  education  of  20  million 

American  youth.  . 

"  .  We  have  reviewed  this  proposal,  and  wish  to  explain  our  firm  opposition 
to  It  on  the  grounds  that  (1)  It  calTs  for  the  federal  government  tp* Interfere 
'   with,  and  tntrude  into,  ah  Important  area  of  education  in. a  mahner^ which  is 
totally  inappropriate;  (2)  it  represents  yet  another  example  of  federal 
paperwork  to  which  Americans  are  taking  iacreasing  exceptidn;  and  (3)  it 
■  enlists   Uncle  Sam. in  federalizing  admission  policies  in  our  higher  educattwi 
.  .   institutions.    Let  me  be  mot:e  specific  1n'T)ur  opposition  to  what  we  believe 
to  b^  a  bad  bill.  , 


1041 
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.-2-  . 
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First,,  it  "has"  long  been  our  belief  that  e^Iucation  is  a  local  function^ 
a  etate  reBponBihility;  and  a  federal  oonoem.    Only  two  weeks  ago.  Congress 

■gave  its  final  approval  to  legfslation  creating  a  separate  cabinet-level 

^      .  ■  , 

Department  of  Education.    We  applaud  this  action.    Iri  thaf'long  and  heated* 

•         ■         .  ■       •■       - , 

debf^e  the  Congress,  In  its  wisdom,  included  language  to  forbid  federal 

control  of  edii^Jtipn,  and  more  positively  to  ensure  state  and  .local  control 
of  America's  schools.    H.R.4949.  flies  in  the  face  of  this  clear  direction, 
containing  the  roots  of  federal  |ntrusion  into  the  highly  technical  ^standardized 
terst  industry.    And  which  federal  agency  will  be  charged  with  the  responsi- 
bility to  carry  out  such  a  law— the  Department  of  EducationI  . 

Regarding  tffi^  intrusion  by  the  federal  government,  let  me  cite  several  . 
glaring  example^  in  the  text  of  H.R..4949?   In  Section  2(b)4,  you  will  note 
one  of  the  purposes  of  the  Act  is  "to  encourage  use  of  multiple  criteria  in 
the  grant  or  denial  of  any  significant  educational  benefit."   What  fonn  will 
this  "encouragement"  take?    Does  this  imply  that  our  higher  education  institutions 
■will  be. "encouraged"  to  modify  or  revise  their  admissions  policies?   A^d  how 
would  they  be  so  "encouraged?"   .This  seems  to  us  to  be  a  crude  in vitati^^  |^o  ^ 
bureaucratic  interference  with  the  legitimate  authority  of  edCfffational 
d. we  vehemently  oppose  such  a  purpose. 


acfcninistrators.  ar 


ar  d  we 
.  let\ 


FUrthennoy^e.  let'me  call  your  attention  to  Section  7(2)E.F  and  G  where  you. 
wilj  note  that  the  Commj^ssioner  (Secretary  of  Education)  is  empowered  to  monitor 
the  fiscal  activity  of  nonprofit  testing  organizations.    This  is  a  clearly 
Inappropriate* role  for  the  Department  of  Education  to  assume.    It  assigns 
regulatory  functions  to  the  Qppartment  in  the  ar^a  of.priv4ite,e>iterprise  which 
have  never  been  contemplated  for  this  agency.    How  would  the  Department  use 
thi^  ..Information  regarding  revenues  and. expenses  of  test-making  agencies? 
■ ■    ♦  ■\      ■      •  '  ■ 
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^lould  "It  .coordinate  its  information  with  the  Internal  Revenue  Service? 

vThis  portion  .of  the  bill  more  thian  any  other  smacks  of  a  witch  hunt  that 
is  absolutely  unsupportable,  and  raises  questions  as  to  the  real  purpose 
underlying  the* entire  bill,-  These  purposes  are  presumabl)^stated  in 
Section  2,  and  have  been  presented  elsewhere  as  being  primarily  tp         .  \ 
protect  persons  taking  standardized  tests  against  error  and  improper 
application.    Some,  of  the  controls  and  limitations  on  the  use  of  standard 
testing  sought  to  be  imposed  by  this  bill.vsuggest  more  far-reaChing  ^ 
objectives,  however,  including  the. possible  elimination  of  standardized 
testing  entirely  on  the^asis  of  some  philosophical  objections  not  stated 
in  the  legislation.    Indeed,  Subsection  (a)  4  of  Section  2,  setting  forth 

^the  bij^1*s  findings  and  purpose  does  say  that  "there  Is  increasing  concern 
among  citizerts,  educators,  and  public  officials  regarding  the  a*ppropriate  ^ 
use  of  standardized  tests  in  tfie  admissions  decisions. of  postsecondary 
.education  institutions.".  We  would  respectfully  point  out  that  there  is ^at 

least  as  much  concern  among  ffiany  citizens,  educators,  and  public  officials 

*  ■  . 

that  reasonable  standards  be  maintained  by  those  institutions  to  assure  the 

public  that  the  diplomas  and  degrees  ^they  grant  are  worth  more  than  the 

paper  on  which  they  are  printed. 

Mr.  Chairman,  I  think  it  is  incumbent  upon. the  members  of  this  Committee 

to  recognize  the  serious  crisis  of  confidence  into  which  we  have  fallen  in 

recent  years /egaHing  the'. quality  of  etjucation  at  ali  levels.  Without 

attempting  to  debate  this  wider  issue  here  today,  it  would  hardly  seem 

prudent  at  this  time  to  weaken  public  confidence  further  by  seeking  to  destroy 

mechanisms  for  assuring  some  measure  of  evaluating  the  quality  of  student 

abilftieis  tfnd  studenLaciL^^^*^"*"^'      well -as-^diagnosing.  weaknesses  and  pro- 

•viding  remedial  instruction.    To  the  extent ~tfre^.^M^ii.the^^ 


/ 
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tfils  and  similar  legislation,  1t  must  be  seen  as  particularly  pernloious. 

•  Finally,  we  oppose  H.R.4949  as  a  further  contribution  to  the  paperwork' 
blizzard.   We  agree  that  a  greater  understanding  of  standardized  tests'  Is  a  . 
right  of  all  test  subjects,  since  their  academic  futures  will  be  atOedst 
partially  affected  by  their  performance  on  such  tests.    At  the  same  tlme^ 
tMs  bill  exemplifies  an  age-old  federaj  problem  of  Information  overkill, 
•Scfftlon  3,  for  example,  requires  provision  In  "understandat^le  language''  Of 
the  Intents,  purposes,  and  skills  measured  by  test^*  and  an  explanation  of 
Irvterpretatlon  of  scores.    In  addition, 'however.  It  requires  that  the  subjects 
of  the  tests  be  Informed  of  the"^  "standard  err^r  of  measurement"  and  "correlation 
between  scores  and  success  in  careers.".  We  contend  that  these  kinds  of 

technical  test  analyses,  although  very  useful  in  upgrading  testi,  will  be  of 

7  ' 

tittle^  use  to  test  subjects.    Instead,  such  f^quiremen^is  can'only  be  viewed^ 
as  a  continuation  of  the.'ill-advfsed  tendency^ of  Congress  and  federal  agencies 
to  collect  data  for  the  sake  of  collecting  data.    We  believe  Any  such  procedure 
to  be  Inappropriate. 

the  release  of  test  questions  arid  answer!  as  required  in  Section  5(1)  and 
(2);  would,  not  only  add  to  the  cost  of  developing  tests  but  will.be  Of  IHtle 
use  to  test  i?ubjects.    It  goes  without  saying  that  the  major  effect  of* 
releasing  questions  and  answers  to. tests  will  not  be  the  improvement  of  a 
subject's  subsequent  score,  bqj  meriely  ah  increase  in  the  number  of  sample 
questions  presently  supplied.    The  beneficiaries  of  released  questions  and 
answers  may  very,  well  be  those,  who' run  costTy  test  preparation  courses  rather 
thanj^he  subjects  themselves. 

In  1978  a  Resolution  was  unanimously  adopted  by  our  Association  which  J 
states,  "The  NASSP  supports  standaHized  testing  in  secon^iry  schools  as  an 
•appropriate  measure  of  student  perfoi^mance  when  such  tests  Tit  the  ataU  level 
are  properly'devised,  administered  and  Interpreted.    NASSP  encourages  continuing 
£ffQEts_tb„ijnp.rov$  standardized  testing  as  opposied  to  testing  abandonment." 
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This' continues  to  be  our  position  |;oday.  *iCt 

.  We  believe  that  the  approach  of  H. ft.  4949  to  the  legitimate,  goal  of 
providing  students  protection  against  error  arid  abuse  of  standardized  testing 
Is.  ill-advised.   We  urge  /he  Conm|ttee  to  defeat  this  misguided  attempt  to., 
bring  the  standardized  test  industry  .into  submission. 

Thank  jtru  for  the  opportunity  to  present  our  views  on  this  legislation. 
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Prepared  Statrmext  of  the  ^America  ?r  Educatioxal  Researgh 

;  *\  AiBSOCIATION' 

V    .    —Preamble— ^  *  * 

The  American  Educational  Rejearch  Awclation  (AERA)  is  a  professionlal  association 
of  nearly  IMdO  members  engaged  in^he  breadth  and  depth  of  educational  inquiry.  Our 
members  are  concerned  vwith  both  the  quality  (reliability,  vialidity,  dnd  accuracy)  and  the 
effective  and  fair  administration  and  use  of  educational*tests.  AERA  members  are  actively 
engaged  in  the  improvement  of  educational  tests  and  in  studies  on  the  educational, 
psychological,  and  societal  impact  of  testing. 

•We  submit  this  statement  iathe  spirit  of  assisting  XMt  Congress  in  its  deliberations  and 
decisions  concerning  testing  legislation  which  has  far  reaching  implications  for  the  future 
practice  of  educational  measurement.  We  belieVe  thai^the  C6ngress  should  legislate  in  this 
ar^a  w|th  great  care  and,  on  balance,  the  services  prdvI3ed  to  individuals  and  society  by 
admissions  tests  outweigh  disadvantages  inherent  in  any  effort  to  assess  hum-an  potential.  It 
is  not,  however,  our  irttent  to  take  a  polemic  position  m  either  of  these  bills  or  specific 
aspects  of  the  legislation  before  the  Committee,  In  fact,  there  is  no  clear  consensus  among 
researchers  and  scholars  regarcftn^  the  need  for  this  legislation.  There  is,  however, 
agreement  .that  the  .consequences  of  the  proposed  legislation  are  not  well  known  at  this 
time. 

We  share  with  Congressmen  Weiss,  Gibbons,  and  their  co-sponsors  the  interest  in  increasing 
the  understanding  of  the  purposes,  development  procedures,  contributions,- and  limitations  of 
admissions  tests.  We  also  share  their  interest  in  constructing  and  applying  such  tests  in  a 
manner  which  does  not  arbitrarily  discriminate  against  test  subjects  because  of  their  race, » 
sex,  ethnic,  income,  or  family  background.  We  recognize  that  individuals  from  varying 
backgrounds  score  differently  on  admissions  tests;  however,  these  differences  have  also 
provided  needed  information  to  the  public  ^d  Congress  which  has.  beert  useful  in  creating  an 
irtcreased  awareness  of  dlscriminatioo  and  prejudice  4n  ;the  society.  This  increased 
awareness  has  b^en  a  significant  component  behind  the  enactment  of  programs  and  has  often 
•used  the  results  of  educational  measurement  and  ability  assessment  to  argute  for  enactment 
of  educational  legislation. 

•  Educational  measurement^  including  admissions  tests,  is  far  from  perfect  and  is 
limited  in  the  ability  to  predict  future  education  or  occupational  performance.  As 
educational  researcher's  apd  concerned  citizens,  we  hope  that  any  congressional  action  in  the 
testing  arena  will  improve  the  development  and  administration  of  admissions  tests  and 
enhance  the  equitable  and  fair  treatment  of  test  subjects.  We  believe  that  the  proposed 
legislation  (has  already  stimulated  health  discussion  and  debate.  We  are,  however,  not  sure 
that  the  s(>ccific  provision^  of  these  bills  will  accomplish  the  laudable  legislative  purposes 
which  they  set  forth.  Legislative  action  should  promote  increased  understanding  of 
educational  measurement  by  stimi^ating^  more  and  better  research  and 'analysis  of  tests; 
however,  no  such  action  should  undermine  the  validity  and  reliability  of  the  tests.  • 

The  most  serious  concern  with  the  proposes!  legislation  is  the  required  test  item 
^disclosure.  Any  such  measure  should  improve  test  development,  administration,  use,  and. 
•understanding  without,  providing  an.unfair  advantage  to  those  who  can  most  afford  to  use  the 
at  information. 
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1/  ACTING  FROM  A  BAJE  OF  KNOWLEDGE 

The  Committee  has  hejird  from  numerous  witnesses  explicating  the  advantages, 
potential  Harm,  and  unknown  consequences  of  the  proposed  legislatwn.  We  believe  that  the 
most  salient  feature  of  such  testimony  has  been  in  the^area  of  "unknown  consequences/*  We, 
therefore,  believe *that  the  Committee's  deliberations  and  decisions  would  be  greatly 
enhanced  with  increased  knowledge  and  understanding  from  the  following  phenomena: 

.  >  .1.  Ability.  Testing  .Report.  The  Committ^  oh  Ability  Testing  of  the.  National 
Academy  of  Sciences  (see  ATTACHMENT  -A-,£or  members  &  staff)  has 
undertaken  a  "major  examination  of  the  role  of  standardized  testing  in  American 
society*' .  (including  iconsiderations  of  aptitude,  intelligence,  achievement,  or 
ability  tests)..."!t  is  expected  that  the  (NAS)  Committee's  work  will  result  in  a 
, report  that  illuminates  tjhe  probltfrns  posed  by  . the  use  of  standardized  tests^and 
recommends  appropriate  policy  alternatives."  (NAS,  March,  1979)  Tl?e  report  is 
expected  to  be  distributed  by  August  1980. 

2.  Standards  for  Testing.   AERA,  the  American  Psychologiqal  Association,  and 
•  the  Nati%nal  Council  on  Measurement  in  Education  have  agreed  to  undertake  a 

».  •   revision,  of  their  Standards  fof  Edudationai  arid  Psycholfecal  Tests.  -  These . 

Standards  are  widely  qsed.  .  They  are-  recognized  in  thV  federal  Uniform 
Guidelines  in  Employee  Selection  Procedures  and  have  been  used  in  at  least  two 
Instances  .by  the  U.S.  Supreme  Court  as  the  standard  guide  to  sound  professional 
practice  in  testing  and  by  major  test  publishers  throughout  the  country.  The 
current  and  revised  Standards  will   provide  the  Committee  with  useful 

• background  ^nd  information  op  salient  issues  and  topics  being  considered  by 
researchers,, test  producers,  tc^t  administration  agencies,  and  test  score  users.* 

3.  New  York.  .  The  recently  enacted  New  York  State  admissions  testing 
legislation  provides  a  mandate  similar  to  the.  test  disclosure  provisions  in  H.R. 
W9.  Observation  an<j.  analysis  of  the  imjxict  of  the  New  York  liw  will  provide 
the  .  Committee  with  useful  information  and  understanding  qt  the  potential 

.  consequences  of  test  item  disclosure  and  other  specific,  provisions .  of  the. 
"  '     proposed  bills.  »  •  <w  '  -  •  • 

/  Study  Commission  or  Mandated  Study.  Alternative  //K  Several  witnesses  have 

suggested  that  a  congressionaily  eslablished  study  commission  would  signficantly 
^assist  the  Committed.  Alternative   tf2.  TH^  Congress  could .  mandate  an 
admissions  testing  ^udy  to  be  conducted  by  National  Institute  of  Education 
*'(NIE).  The  comiYii^sion/study  on  educational  an(j  occupational  admissions  testing 
could  use  available  information  from  the  above  phenomien a.  Additional  research 
and  data  on  testing,  wlAch  could  be  provided  by  th^  testing  agencies.  Individual 
re;^arch  efforts,  and  fedejrpj.  ageilcies  could  also  be  examined.   In  addition  to 
.  providing  the  Committee  with  useful,  policy  relevant  information,  the 
'  -  '         '  commission/study  could  point  out  areias  where  existing  knowledge  is  unavailable 
or  uncertain.  .  ,         *. . 

The  commission  ^  advisory  ^oup  for  the^andated  stMy  could  inclbde  representatives  of 
various  interested  parties,  such  ast  test  takers,  parents,  teachers,  public  interest  groups, 
test  producers,  test  administrators,  test  users,  teit  developiYient  and  education  irieasurem'eht 
experts,  researches  (testing  and  social  ^  Individual  impact  of  tests),  legal .  scholars, , 
minorities,  women,  school  and  higher  education  adminlstr^ors  (including  professional 
Schools).  Ex  pf f icio  members  6f  Congress  and  federal  agengies  concerned  with  education 
and  occupational  testing  would  provide  an  ongoing  Interchange  of  information  while  the 
study  and  analysis  is  being  conducted.  .  ^     "  -        '  * 
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ISSUES  AND  A  CH/WGEJO  THE  "e0MMI5SlW 

^  •  •  The  proposed  legislation  and  testimony,  presented  to  tke  Committee  provide  a  useful 
set  of  Issues  and  questions  for  a  congressionally  charged  study  or  commission.!  Through  a 
process  of  interim  and  final  reports,  the*  Committee  c^uld  benefit  ,  from  ia  thorough 
examination  of  the  f oUowi^g^ssuest  '  . 

""■A.  Is  federal  legislation  needed  to  assure  that  test  takers  have  adequate     ^  ~ 
inlormation  both  prior  to  and  following  their  participation  in  admissions 
tests?  \ 


Proponents  argue  that  test  agencies  either  go  not  provide  adequate  information  or  that  they 
only  do  so  when  under  pressure  from  outsid|kconsumer  and  public  interest  goups.  They  also 
argue  that  such  information  could  reduce  nay  ths  and  over  reliance  on.  test  scores  ih  the 
admissions  process.  \A-  '       ^  '      .  »  ^ 

r  .  ■    ■   •         ■  $ 

Opponents  argue  that  nearly  all  of  the  inforrnation  required  by  the  proposed  legislation',  is  ^ 
already  provided  and  that  students,  schools,  and  institutions  of  higher  education  already 
have  information   related  to  standard  errors  of   measurement,  scoring  procedures, 
limitations,  and  purposes  of  the  tests.  v 

CHARGE:  The  commission/study  could  provide  an  external  validation  of  the  claims  made  by 
"test  agencies  and  outline  for  the  Committee.any  discrepencies  between  information  required 
by  the  proposed  legislation  and  that  already  provided  to  test  takers  and  u^er  institutions  and 
organizations.  There  could  also  be  an  analysis  of  the  degree  to  which  such  information  Is 
used  by  test  takers  and  test  score  users  to  improve  the  individual  and  public  understanding  ' 
.  of  the  value  and  limitations  of  admissions. tests.  ■  ^ 

B.  Should  legislation  rfiandate  thg  disclosure  of  specific  test  itqms  used  for 
scoring  purposes  (including  correct  answers)  to.  test  takers  arid  the  federal 
*  government^  user  Institutions,  and  public? 

Proponents  argue  that  a  form  of  just  due  process  for  test  takers  |o  see  the  instruments 
upon  which  their  academic  future  will  be  judged.  Such  disclosure  i^ould  also  allow  a  more 
thorough  examinatipn  of  test  yalidityi  bias,  and  characteristics  of  admissions  tests.  They 
also  argue  that  disclosure  would  improve  test  performance  given  a  better  understanding  of 
testing  domains  and  areas  where  participants  do  poorly.  Disclosure  would  also,  according  to 
the  proponents,  lead  to  Improved  test  development,  expose  scoring  errors,  and 'Improve' 
research  on  testing.  y  ' 


Opponents  argue  that  test  agencies  already  provide  sample  tests  and  that  item  disclosure 
wiiy  increase  costs  (to  participants),  reduce  test  administrations  (particularly  for  special 
groups  like  the  handicapped),  reduce  tesV  rieliabUity  and  fairness,  cause  "equating"  problems, 
reduce  the  value  of  copyrighted  material  (without  compensation),  cause  some  test  producers  . 
t6  cease  such  activity  (causing  increased  monopoly  of  test  development),  increase  teaching 
to  the  test  (thereby  Increasing  the  influence  of  tests  on  education  curricula),  and  have 
adverse  effects  on  those  test  takers  least  able  to  afford  test  coaching  or  us^  test  items  to 
improve  performance.  The  test  agencies  argue  that  they  already  have  elaborate  safeguards 
to,  prevent  scoring  errors.  •  ...  4 


CHARGE:    The  commission/study  could  examine  several  of  these  issues,  including  the 
potential  impact  on  different  populations.  For  example,  it  would  be  useful  to  know  11  high 
schools  ill  large  cities  and  remote  rural  areas  would  have  the  caMcity  to  use  test  items  in  a 
manner  similar  to  those  In  affluent  communities  with^large  counseling  and  guidance  staffs. 
Cooperation  with  testing  agencies,  who  could .  provic^e' seAre:.  tests  and  analysis  ol 
development  procedures  4nd  costs,  would  allow  a  better,  understanding  of  the  potential  ■ 
benefits  and  costs  (including  validity,  reliability,  and  equating  problems)  under  conditions  of  I 
disclosure.  The  New  York  case  wilj  provide  valuable  insights  into  many  of  the  unknown^ 
cohstequertces. 

C.  Will  the  proposed  legislation  provide  an  opportunity  to  clarify  the  issues 
surrounding  cultural  or  age,  sex,  race,  or  regional  bias  in  admissions  tests? 

Proponents  argue  that  the  tests  are  inherently  biased  and  have  j>rovided  the  Committee  with- 
research  studies  demonstrating  that  different  vulnerable  groups  score  lower  than^  the 
national  average  on  some  of  the  most  commonly  used  tests.  They  claim  that  these  tests 
play  a  significant  role  in  limiting  the  educational  and  occupational  life  chances  of  certain 
populations.  They  also  claim  that  the  test  agencies  refuse  to  ^reveal  informati9n  on 
>wifferenti£^  scofing  by  racial  and  economic  groups. 

.Opponents  do  not  dispute  the  dif^eiences  in  test  scores  among  certain  groups;  hdwever,  they 
argue  that  such" differences  are  a  reflection  of  the  broader  society  and  have  provided  policy 
makers  with  needed  information  to  develop  and  enact  policies  which  are  designed  to^ reduce 
scoring  gaps.  Test  agencies  argue  that  they  engage  in  research  and  development  efforts  to 
eliminate  "arbitrary"  bias  in  the  tests.  They  also  state  that  some  data  on  income  and  ethnic 
background  is  not  collected  or,  if  revealed,  would  be  a  breach  of  privacy  or  agency  policy. 

CHARGE;  The  commission/study  could  examine  the  available  research  on  test  bias.  Under.  ^ 
agreement  to  retain  test  security,  they  could  examine  or  commission  qualified  researchers 
(under,  the  same  security  agreement)  to  examine  test  items  used  in  different  tests. 
Procedures  used  by  test  agencies  to  eliminate  or  reduce  arbitrary  bias  could  be  examined* 
and  assessed..  The  commission/study  could  establish  guidelines  for  determining  who  should 
have  access  to  test  items  for  legitimate  research  purposes.  .      '  ..     "*  . 


D.  WilJi 
with 


the  proposed  legislation  place  the  use  of  test  in  proper  perspective 
;ard  to  academic  and  occupational  admissions? 


Pro^nents  argue  that  there  is  an  overreliapce  on  test  scores  in  admissions  procedures,  such 
procedures  are  too  rigid,  the  tests  do  not  measure  important  criteria  for  academic  and 
occupational  performance  and  success  (e.g.,  motivation,  interest,  perserverance,  etc.),  and 
that  the  economic  benefits  or  producing  cheap  paper  and  pencil  tests  places  an  undue 
emph^is  on  rote  learning  to  the  neglect  of  conceptual  skills. 

Opponents  argue  that  the  test  agencies  advise  academic  institutions  that  the  tests  should 
.not  be  the  sole  criteria  for  entry  and  postsecondary  education  associations  have  stated  that 
their  members  use  a  variety  of  criteria  beyond  test  scores  to  determine  "Academic  erttry. 
They  also  argue  that  the  test  producers  have  eliminated  a  great  deal,  of  bias  found  in  early 
versions  of  the  tests  and  that  these  tests  have  helped  r^Suce  arbitrary  seie.ction  procedures 
in  academic  admissions.  Institutions  of  higher  education  claim  that  the  proposed  legislation 
could  reduce  the  use  of  standardized  tests  and  increase  the  use  of  "institution  made  testi" 
which  would  likely  be  of  poorei*  quality.  Some  fear  that  the  disclosure  provisions  of  the 
legislation  may  increase  the  relative  importance  of  testing  beyond  stated  limitations. 
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X:HAUGE:  The  commission/study  could  famine  the  available,  research  on  admissions 
practices  andi.in  c<*perat/on  wUh  funding  aiehciJfes,  exajiine  a  sample  of  such  institutional 
practices.  They  couW  also  examine  the  setf^  of'^e  tesTs  and  ability  of  test  producers  to 
aSssess  some  of  the  criteria  mentioned  aboV 

*    E.  Would  the  proposed  legislation  increase  the  understanding  of  thelimpact 
f .  •        .    .  of  test.  cQaefting  schools?  „  .      V  * 

Proponents  argue  that  coaching  does  have  a  posltiy^^  effect  on  test  performance  for  some 
test  takers  and  that  test  coaching  is  a  growing  buslnesJ^.  They  argue  thit  coaching  schools  ^ 
gain  access  to  tests,  and  for  those  able  to  aflqrd  them,  Create  an  unf&ir.  ^dvanta^e  fpr^ 
higher*  income  grou^.  ^  ■  v. 

Opponents  argue  that  the  evijlence  on  test  cpaqhing:  is  far  from  conclusive  and.  that  the  • 
'  proposed  legislation  will  create  an  undue  Iwnanra  for  cbaching  school^  '    "        '  ' 

CHARGE:    The  comn)ission/study  could  examine  the  test  coaching  ar'enay  including  an 

•  examination  of       numbers,  types,  and  effects  of  coaching  schools.  Such  an  examination  „ 

•  should  also  include  an  assessment  of  the  degree  to  which  test  security  qan  be  or  is  being 
violated  by  such  schools  and  the  ability  to  coach  for  the  testy..    ,  ,      .  ^ 

i  F.  le  f^^rai-Ugidjitinn  ni»^riti>d'to  rfeveal  the  financial  arranRements  betwe^  ^. 

test.producing  and  test  administration  aRcneieTahd  the. costs  and  Jncpme^  test 
agencies?  '  •  ■  '  .'  '  .        •  /  •  •     '  ' ,  ".^^ 

'  Proponents  argue .th^t  testing  is  a  large  industry  dominated  by  a  irganiz^^  ^ 
corSor'ations.  As  such,  they  ^rgue  that  test  agencies  should  be  treaW^.  like  ^^<^.^ti|»<»«^ 

.  '^A^hich  are  subject  to^certair^  financial  disclosure  .requirements.  They  alsj)  ar^  that  sUch  • 
"  disclosure -Will  reveal  the  mdfein  of  income  ^ver  cost  among  the  non-profit  tesV agencies.  It  . 
is  argued  that  such  information  would  be  useful  in  determining  the  need  ior  increased  costs 

•  \to  test  takers  and  users  should  the  re()orting-- and  it^m  ^sclosure  requirement  of  ..the. 

legislation  be  enacted.  . 

Opponents  ar«ue  that  test  agencies  provivle  a  valuable  public  service-  Nonprofit  test 
agencies  state  that  they  use  income,  for  a  variety  of  purposes  designed  to  improve  testing, 
"  •  Including  rfse^rch  ^nd  development  project^  on  tests;  Both  commercial  and  nonprofit  test 
agencies  say  that  the  proposed  finaacial  ^disclosure  requirements,  are  not  bas^d  qn 
substantiated  claims  of  misuse  of  the  funds  they  recfci^^e.  They  alsp  say  that  thisj^sdosufey 
,  would  place  them  at  a  disadvantage  in  Competition  for  contracts^  and  that  certain,  rights  of 
privacy  wiji^ be  violated  by  sbme  oi  the.  disclo^Q'r<?, provisions. 

^CHAR<5V  The  commission/  study  could  ekamlne  tWe  Wal  and  c^Mt^tion^^^^ 
'  surrouhdipg  the  wious^  financiftt  disdosi^e  provisions  of  th^  pfoposed  legislation.,  ^mce 
"sucb'fe^ulrem^t&  are  not  incltSed  in;^the  New  York  law,  .such  an.- examination ^pd^^ 
>>alOa^)e  lor  the  t:ommittee  tl' dfetermifte  tbe:%a>ibm     of .  dnforcement  anJI  the^le^^al  - 
'  probleg»s-assoCiaiea*Mh^f*«i^nc^^  •  . 


G.  Is  te^deral  Ifegisiatlpn-^neede^  :to^^stimulate  im'p^yed  adher:ence  toi  ptof gssi; 
standards  of  test  deyetopment  a'hdiiie'^ 


Proponents  argul^  t^t  nhe  cul tMral^  hi9»f  secrecy,  ^nS  limltttipns  of^iii^f/^^^^^ 
indicate  that  protcs^ioi^  >ta*iWards  art'^riOl  fpllpWed,  not  enforced,  or  that  It  is  imptfisibte., 
to^eter mine  U  they  ac6  followed:  ■   .  '     r'.'  -  .  ^       .  «   *  ,  ■       .  "  ^ 
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Opportents  argu«  that  fe$t  agencies  follow  the  requice ment$  pf 
'  Standar^and  that  ho  charges  of  violation  have  beef  substanti 
theyals^  adhere  to  their  own  guidelines  and  prowdures  d 
proper  dcvelopmciit, 

*  . 
CHARGEr  The  cominission/study  could  conduct  an  examination 
Standards  an'^thcr  code$  of  testing  condu<it  are  followed. 


/AERA,  APA,  NOME  . 
Test  agencies  state  that 
to  assure  fairnesi  and 


^he  degree  to  which  such 


H.\Is  legislation  necessary  to  increase  the  ^federal  study  of  admissions  testing 
and^to  ^oyid^increased  information  to  the  public  and  researchers  who  other- 
.      ^      wiSfc^onotnave  access  to  such  data  and  inf  ormfwwTc  ^      '  ^ 

\    •  *     '    '  '  ■  '      '  ' 

.  «    Proponents  ^rgue  that  there  is  an  inadequate  base  of  knowledge  and  information  to  conduct 

^needed  xeifearch  on  testing,  test  deyelopirnent        Vie  effects  of  tests  on  different 

.  populjSitldns.  Thcy.^gi^  that  atterrtpts  to  gain  study  d^ta  on  cultural  bias  and.  test  validity 

-    r-  ant^  rflikbait y  is  edtW  <lif f icult  t<^btaln  or  not  availably,  (either  due  to  its  lack  of 

\  *  existfoce  ^;JSaL3g!^^^y  ppJ^Cy  preyf^ntlng.  dlsclO!sure),  They  also  argue  that  test  producers 

have  Ip^^rrtV^galhsFfrcJiLpel  MiMing'ic>l<t(;«st  research 'studies  and  that  they  only  release  data 

'i^t..iVpesorreseirchtf?^" . 

.Opponent^  ar^oe/tbat  'te$t  ag^rt<ii*  alfpady  provide  a  great  de^  of  <Jafta  to  researchers; and 
thaOhey  continuous! y>^^  present*papers,.and  publish  results  of  research 

;^tudifes  .6n  t^sts  ai^d  trstihg.  -Tji^r  ar^Me  th^t  the  current  form  of  the  legislation  would  place 
.    an  andue  'bur<<?a.  05  t^t  agen^es  bK  the  government  with  any 

.  study  based  on  data  tN^V  pgovi^e.  TWvWpMld  result  in  the  te$:t- agency  either 
r,  reducing  the}r  data  acCess^or  placing  certain  restriaions  on  independent  researchers.  They 
also  daim  that  the  legislation  is- vajgue  with  regard  to  wh^if  constitutes  "a  study,  eviluation, 
or.  stati$tic|l  report.":  It  is  cbmtnoh  that  preliminaVy  draft  reports  are  ftot-  disclosed  because 
rfevisio)i5  jtTj^y  be  nec<*^/iry  following  a  review  periods   Premature  release  of  statistical 
-    x^^xXs^i^x  xj^i^cy^  stu<fi«  ^*y>e  ase^d  to  mislead  the  public  2^nd  policy  m^ikers.  ^ 

CH^RGEr.  The  conihrii3«ionistudy  roUld  prbvTde.the  Committee  with  an  assessment  ot  the^ 
*'5tate  of  tfie^.art^'  wjt^reg^^rij  to  testing  research,  >  Such  an  assessment  could,  include,  an 
.  0  analysis  of 'Available  d^ta  lor -«uch"-studie$,  the*  current  "  knowledge  and  information 
limitations  regairdirt^  testing^research,'  ahd  ;  the  ■availability' ^^'0^  non-fedcril 
support  for'sMcti  rcsea/ch..  The  analysis  could  also  Include  ari  assessment  of  the  research  and 
f*Tyailua^On  componern^  of  the  legislation  to  determlge  Its  ^enforceability  ar\ji  reasonablenesss  ■ 
of  the  study  requirenients.  -  '     t  •  "  ■ 
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SUMMARY 


The  giost  salient-opposing  Xhkmes  of  the  proponents  and  opponents  of  the  proposed 
legislatlpn  can  be  summarized  as  follows! 


The  legislation  Is  a  reasonable 
federal  effort  to  assure  due  process 
lor  indiVlduais,  further  the  publi^: 
interest,  and  Increase  the  under- 
standing of  admissions  tests  ^d 
their  use.  Admissions  testing  Is 
dominated  by  a  few  large  organlzatloijp  . 
which  have  significant  influence  owfrj-^''-'^ 
individuals,  academic  institutions, 
and  occupational  organizations;  there- 
fore,- testing  agencies  should  be  Sub- 
ject, to  close  public  SntTpJ^essional 
scrutiny  (in  a  manner  similar  to  that 
require<J  of  -public  utilities). 


CON  ■  ^' 

The  legislation  is  a  first  step  toward 
improper  federal  regulation  of  testing 
and  admissionsiprocesses.  Many  of  , 
the  charges  leveled  against  testing- 
are;  in  effect,  attempb  to  "shoot  the 
m^ssen^er."  This  legislation  could 
damage  a  valuable  public  service  which 
^voluntarily  does  much  of  what  the^ 
legislation  would  mandate.  The  f^^a 
of  the  proposed  legislation  is  of  ten 
vague,  occassional/ unreasonable 
and,  in  sQme  instances,  violates  existing 
legal  protections  of  pf!vacy,  copyright, 
and  academic  freedom. . 

The  debate  and  discussion  stimulated  by  these  two  bills  has  done  much  to  clarify 
the  issues  and  problems  associated  with  federal  legislation  in  the  admissions  testing  arena. 
The  testimony  has  made  a  significant  point  that  we  share;  Tha^  4s,  the  consequences  of 
the  central  features  of  the  legislation  are  not  well  understood.  Test  item  security,  has 
been  a  tenant  of  the  testing  process.  Any  definitive  statement  on  the  effects  of  test  item 
disclosure  would  be  both  misleading  and  premature.  The  Committee  faces  four  fundamental 
questions  as  they  act  on  these  bills;  . 

1.  Is  the  legislation  valid?  That  is,  will  the  provisions  of  the.  proposed 
legislation- accomplish  the  purposes  which  they  set  forth?  c. 

■    ■    V       2.  Can  the  legislation  be  improved  With  further  understanding  and  knowledge 
gained  from  existing  or  recommended  studies? 

3.  Js  such  legislation  necessary? 

k.  If  so,  is  the  federal  government  thfe  apprdpriate  body  to  enact,  administeK,  . 
and  enforce  such  legislation?  .  ^ 

all  of  theSe  questions  can  be  answered  by  the  four  phenomena  noted  in  our  statement: 

-The  report  of  the  Committee  on  Ability  testing  of  the  NAS 
•  -The  analysis  ol'tlje  recent  New  York  law  and  its  consequences 
-A  review  of  the  iturrent  and  revised^Standgrds  for  Educational  and 

jgsvchological  Tests     ,  ^       4|W    ~'    \  ^  .  .      )  » 

-A  congresslonkily  established  study  commissTUiror  mandated  NIE  study  on  / 
a((nissions  testing.       ■     ■      •  ' 
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It  Is  our  belief;  however,  that  these  events,  studies,  ancj  reports  will  significantly 
assist  the  members  of  the  Committee  in  making  their  decisions  on  the  proposed  leRislation. 
We  have  already  (wrovided  the  Committee  with  the  names  of  a  number  of  individuals  who, 
from  a  basis  of  research  and  scholarship,  are  able  to  provi^expcrt  testimpny-on  the 
proposed  legislation.  We  wUfbe  pleased  to  further  assist  ^Te  members  and  staff  of 
the  Committee  as  they  continue  their  <ll?cuss^on  on  these  ^Uls. 


THE  AMERICy^N  EDUCATIONAL  RESEARCH  ASSOCIATION 
contact: 

David  H,  Florio,  Director 

Governmental  and  Professional. Liaison  ,  ^ 


/  > 


r 


i 
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Prepared  Statement  of  Donated /O.  Z 

Psychologist  and  Professor  of 
'  srrr,  on  Behalf  of  yi^  America 

AsSOCIATIpN^  /  ^ 


I  have  bQjein  asked, by  the 


,  Ed.  D,,  Counseliko 
DQY,  Iowa  State  Univer- 

ERSONNEL  AND  GmDANOB 


cers  of  the  sAmerican  Person- 


nel and  Guidance  Asso^pi'ation       prepare  a  statement  on  the  two 
bills,  ^  3564r  i^r^^iiuced/ty  and 
HR  49^9i  *introdi*ced  by  Representative  W^iss  and  others.  ' 

haVe  been'a'memb^r  of  this  organization  since  I  was  in 
graduate/ 90 ho ol  preparing  to  become  a^  professional  counselor. and 
am  greatly  honored  to  be  asked  to  represent  its- more  than  4o,000 

■  .  ...        ■      .V  :■ 

members.  . 
\       I, have  b^en  for  the  last  l4  years  a  coupseling  psychologist 
on ^the.  staff  pf-  the  Student  Counseling  Service  at  Iowa.  State 
J/niversity.    In  thJLs  capacity»  I  see  numerous  s-fudents  each  week, 
.and  endeavor  to  use  my  professional  skills  $0  help  them  with 
their  educational r  careej,  feind  personal  concerns.    I.  am  also 
Profejssor  of  Psychology,  teaching  counselors-'in- training  the 
skills  and  competenc.ies  of  the  profession.    As  well,  thi^  year* I 
am  serving  as  the  president  of  the  Association  for  Measurement 
and  Evaluation, in  duidance,  a  division  of 'the  Association,  and 
have  just  retired  as  editor,  of  the  division's  joiirnal.  Measure- 
ment, and  Evaluation  in  Guidance.    I  am  also  a  Fellow  of  the 
American  Psychological  Asfiociatiori,  a  licensed  psychologist  'in 
the  State  of  Jowat  and  ^  diplomats  oS  the  Americ'an  Board  of 
Professional  Psychology.    I  would  emph^ize  .my  very  first  stated 
qualification  for  this  taski     that  I  see  college  students,' on  a 


.   \   ■  ■    .  '  •  .    .  . 

day-*y-day  basis,  abbut  their  very  serious  and  real  concerns,  in 
attaining  their  educational  and  life  goals., 

;  '  Vo  one  can  disagree  with  the  stated  purposes  of  HR  356^  and 
4p49i     to  ensxiye  equal  rights  and  fair  treatment; of  test  takers, 
to  promote  more  knoWledge  of  tests  and  admissions  practices,  and 
to  improve  the  quality  of  standardize'd  tests.    Professipnal  , 
coun^ors  are  well , aware  of  the  anguish  of  some  students  as 
they  take  admisstl 6ns.  tests  and  many  have  seen  instances  of  the  , 
"misuse  of  test  scores  in  the  admissions  and  placement  proCeSs^. 
endorse  these  purposes  witl^out  reservation* 

•    A  g^ner^Ll  reading  of  the-biUs  givds^rise  to  "the  i^mplica-  • 
tion  that  tljere  are  a /luipber  of  specif  ic  grievances  on^the  part  , 
of  appli'bants  to  colleges  and  post-^aduate  programs^which  must 
be  rignted^.  exclusive  relt^ce  on  a  test  score,  profiteering.^ 
by  the  test  developers,  secret  reporting  codes,  serious  errors 
, in  computing  scdreS,  applications  with  noticeably  low  validity. 
While  testimony  accompanying  early  hearings  on  these  bills  re- 
counted  such  charges,  fropi  myCpeprspective  as  a  day-to-day. 
Cpunselor;  and  as  ofe^  who  keeps  abreas*  of  the  publications  re- 
lating  to' my  profession,  I  know  of  no  credible  Reports  of  such 
abuse  as  widespread.^    After  reading  the  provisions  of  these 
bills,  I  conalude  that  they  will  work  far  more  damage  and  hard- 
.  ship  than. that  which  th^^  are  intended  to  correct, 
V        Mr.   Gibbons'     Bill,  HR  356^.  appSars  to  call  for  two 
things  I    more  information  about  the  nature  and  purposes  of  the* 
tests,  and. for  certain  requirements  in  the  u^o?  occupsttional 

admissions  tests.    Many  tests  in  current  use,  such  i^s  the 

■»  ■■         *■  ■ 


|066 

Graduate  Record  Examination  or  |;he  ACT  A^sessme/t,  appear  ,  to  me 

.  to  exceed  the  information  r^ciuiremehts  of  thW  bill  already. 

f  *// 
The  ACT  test  does  an  excellent  job  of  .presjmting  results  fof^  the 

understanding  of  the.  test  taker,:  and  the  'GJ^  goes  .to  the  trouble 
6f  including  in  its  inf ormation  biioklet  aln  entire  te^t,  with  a 
correct #nswer  key,  and  norraing  informatipn.    I  belie that 
Other  test  producers  could  be  induced^o  come  up  to  this  stand- 
ard wi'thout  talcing  the  time  axvd  attention'of  the  Congress  of 
the  United  States.    Concerning  the  occupational  features  iti  Mr. 
Gibbons'    *  bill,  it  seems  to  me  that  its  requirements  are  amply 
provided  for  by  the  EEQC  regulations  on  employment  testing.  Is 
it  necessary  to  dupUcsite  this  already  functional  law?* 

Mr.  Weiss'  Bill,^HR^i^9^9.  is  much  more  specific^in  its 
•requirements  and  merits  more-'extensive  comments    I  will 'limit 
mine  to  several  major  features  of  the  bill,  since  I  have  read  ' 
testimony 'from  test  publishers  which  address  many  of  the  tech- 
nical, and  l^gal  specifics  which  Concern  them  most  directly. 
^     Much  ij*  the  bill  concerns  itself  with  the  misuses  of  tests." 
Yet,  the  proposed  regulations  are  applied  to  the  producers  of 
tests  instead;  of  the  users.    Of  course,  a  test  publisher  shoulc^^ 
reasQnat)ly  be  expected  to  offer  evidence  of  the  quality  of  any 
tes.t.    But  th^  responsibility  for  showing  the  validity  of  a  tes\ 

specific  application  should  rest  with  the  user.  is 
this  principle  which  is  embodied  ih  the  EEOC  regula-Ciohs  ori^N 
empXoyjne|J:  testing.    If  a  iow  predictive  utility  is  revealed  in 
a  giyen  application,       behooves  the'  user  to  select  a  better 
test  or  other  indicator,  or  to  examine  the  nature  of  their 


V 


■  ^ 
S 


!X/1  > 
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criterion  (usually  first  year  grades)  to  deterpiine  whether  it  is- 
contributing.;to  the  problem.    Many  test  producers  provide  services 
toVompute  the^e  coefficients  on  a  custom  basis)  perhaps  the 
Natiortal  Institute  of  Education  could,  be  asked  to  provide 
■assistance  for  institutipns  which  cannot  avail  themselves  of  • 
*such  service^. 

*     The  bill -does  not  acknowledge  another  use  of  test^i  which  I 
believe  might  be  interfered  with  if«  enacted.    In  many  state 
colleges  and  universities i '  admission  is  mandated  by  state- legis- 
latures, often  on  the  basis  of  rank  in  one's  high  school* graduat- 
ing  class.    Tesfs  whicfTSvB  used,  for  admissions  purposes  in  other 
institutions  are  used  to  assist .in  placing  the,  new  student  in 
courses  where  he  or  she  may  have  a  reasonable  expectation  of 
success.    Validity  information  in  this  application  is  mtich  more 
difficult  to  obtain  owing  to  the  smaller  numbers  and  lack  of 
'C'orrespondenc 6  between  thf  many  courses 'which  are  affected. 
*  .    It  is  haird  not  to 'conclude  that  the  bill  seeks  to  discourage 
the  use  of  test.st    While  it  is  stated  that  the  purpose  is  -to     .  S 
encourage  the  use  of  multiple  pre'dic tors,  the  bill  only  asks  for  . 
disclosure  about  one  such  j^edictor— tests--.and  fails  to  address 
other  extensively  used  predictors,  suoh  as  previous  grades  or 
rank  in  <?las*s,  or  lette^  of  recommendation.    Should,  it  not  ask 
for  the  reliabilities  and  validities  of  these  predictors  to  be 

made  public  as  well?  "^^V_^ 

i.'      ■  ♦  ■  ■       ■  .  .  • 

Trfe  New  York'  "Truth  in  Testing"  law  recently  enacted  may 

be  instructive  to  'the  framers  of  HR  i^9^9.    It  has  be^n  Yepdrted 

that  the  sponsors  of  the  jnedical  and  dental  college  admissio^ 


tests  will  not  administer  these  te'sts  in  New  York.    On  the 
.basis  of  what  informiation  will  New  York's  s-tudents  be*admitted 
to  medical  .and  dental  schools?    Grade  average?    There  are  qiiEiny.  ' 
reports  of  "grade  inflation,"  which.  would»reduce  the  value  of  • 
grades  in  selecting  students  for^  post-bacQalaur.e^te  education.. 
Recommendations?    Personnel  ^Tsychology  has  published  many 
r.eports  of  research  which  show  that  I'etters  of  recommendation, 
are  the  least  effective  predictors  of  performance.    I  am, 
ii^ressed  by  the  irony  of  the  situationi    Te^ts  were  first 
introduced  to  correct  UnTai^ness  in  access  to  opportunity i  the-. 
*lJ^ruth  in  Testing"  laws  could  very  well  retiurn  us  to  that  old 
wrong. 

Although  MrM  Weiss' ^Bill  names  governmental  agencies  in  his' 
definition       test  score  rec ipientsi  I  note  that  the  government 
is  absent  in  the  definition  of  test  agency.    Governmental  units 
of  all  kinds  are  among  the  highest  volume  test  producers i 
State,  county,  a/id . munic ipal  civil  service^tests i ■  the  PACE  Exam 
of  the  Federal  Civil  Service  (which  in  my  experience  produces  . 
as  much  anxiety  among  college  seniors  as  the  SAT  d.oes  among 
high^school  seniors) ,  and  the  Armed  Services  Vocational  Aptitude 
Battery  (whose  *inf ormational  materials  appear  to  me  to  not  meet 
'the  standards  of  the  li.ill) .     All  of  these  organizations  provide 
poBt-secpndary  education.     In*fact,  the  appeal  of  the  Armed 
Services,  is  to  continue  one*s  education,    if  the  bill  ie  to 
achieviB  its.  stated  purposes,  thSse  tests  should  .surely  be, 
covered  by  its  provisions.  • 

Further,  do  the  bill's  sponsprs* realize  that  some  states  • 


are.both.producers  and  users  of  college  admissions  test.  Can 

« 

a  federal  law  apply  to  these  circumstances?    Should  a  high  school 

student  be  protected  ..when  she  or  he  takes  the  SAT,  but  not  when 

*  /  ^  t         •    •        '  '  ' 

he  or  she  takes  the  state- developed  test? 

Ti^  provision  of  Mr.  Weiss*  Bill  which  is  most  controvers- 
ial, cl^ly,  is  the  disclosure  of  test  items  with  their  correct* 
answers.    Such  a  prac'tice '  ^eems  quite  consistent  with  the  grow- 
ing openness  seen  in-i^he  Freedom  of  Information  Apt,  open  m^et- 
iBg  lawsi  the^u^h  in  Lending  Act,  and  the  like.  Presumably 
for  tests,  this- provision  would  allow 'the.  test  taker  to  ascertain 
whether  any  error  has  been. made" in  computing  or  reporting  4iis 
or  her  score.    In  contrast  with  the  \nformation  rivealed  in  the 
foregoing  laws,  any  test  item  with  its  correct  answer  which  is 
made  public  becomeffe  useless  and  must  be  replaced  in  the  n"fext 
administration.     As.  I  am  sure  the  test  producers  have  testif  ied, 
and  as  even  the  rawest  elementary  school  teacher  can  verify,  it 
is  a  difficult  process  to  produce  a  good,  fair,  and  valid  test. 
What  is  more,  the  revelation  of  test  items  will  without  doubt  lead 
to  practices  which  will  reduce  the  range  of  scores  earned,  which 
in  turn  will  reduce  the  Validity  of  the  test. 

As  an  alternative ,* if  a  test  taker  suspects  a  serious  error- 
*  in  her  or  his  scor^,  coul^  not  a  person  be  designated  in  a 
school  who  would  receive  the  test  taker's  answer  sheet  and  scor- 
ing key  in  order  to  do  the  manual,  check  of  the  machine  score? 
That  person  could  even  counsel  with^the  test  tak^r  about  the 
nature  of  their  wrong  responses,  if  the  test  were  scored 
correctly^    What  better  person  could  be  designated  than  the 


school '^^/cQunselor,  who  very  likely  had  the .  responsibility  for  • 
Administering |the  test  in  the  first  place,  and  who  saw  the  test. 
'  Itetas  but  whose  regard  for  profess ionadism  does  no  damage  to  the 
■  f utur.9  of  the  test  by  revealing  tjiem,    Thia  same  counselor  probably 
also  has  the  expertise  to  insure  that  the  augmented  information 
about  the.  test-cpuld  be  used  to  reduce  the  test  taker's,  anxiety, 
or  could  apply  anxi^ty-sp.ecif ic  covuiseling  as  well.  ' 

If  the  purpose  of  this  provision  isr  educational  as  well, 
publication  of  a  copy  of  the  test,  as  several,  publishers  now  do 
and  as  the  recent  California  law  specifies,  should  suffice'  with- 
out the  potential  for  damage  that  revelation  has. 

;  Several  badi^a  are  attempting  to  prepare  more  extensive 
responses  to'tljfepM  legislation..    National  Science  Founda- 

tion,  tl>e  National  Consortium  on  Testing  of  the  Huron  Institute,  * 
'and  the  Association  of  Measurement  and\Evaluation  in  Guidance 
are  three  that  I  know  of  at.  this  writing.    Would  it  not  be^ more 
reasoned  to  postpone  action  until  thes^  groups,  representing  . 
producers  an^  users  as  well  as  personally  disinterested  parties 
have  had  an- opportunity  to  prodtoce  their  analyses?  * 

In  summary^  while  I  know  of  misuses  of  admisdiohs  testing, 
I  do  not  believe  that  they  are  so  .widespread  nor  so  damaging  ^  '\ 
to  require  legislation  as  comprehensive  as  HR  and  rlR  ^9^9. 

.  I  woui^  rather  that  such,  legislation  be  based  on  the  findings 

■       \  * 
of  widely  published  and  verifiable  information,  such  as  may  be 

f orthc oming 'in  the  near  futyre.    If  the  Congress  is  intent  Upon  ^ 

ena,cting  such  ^  law,  I  would  resp.^ctr'ully  requ^jst  that  it  consider 

. incorporating  the  following  modiftcrattonsi 


jqUBSi 

following  modiftcrattons I 


1.  Require  that  the  reliabilities  and  validities  of  all^ 
variables  used  in  admissions  decisions  be  calculated i  and  avail- 
able' upon  request  from  the  usfi£»  such  as  the  EEOC  guidelines  on 
testing  in  employment  rSquire.  ^  * 

Zi  Be  certain  that-  all  tests  which  are,  used  in  admission  .-^o 
educational  opportunities,  particularly  thqse  promulgated  by 
governmental  units »  are  included  in  the  p overage  of  the  law, 

3 ♦^  Encourage  the^publication  pf  a  sample  tetst,  with  scor- 
ing key  and  norms,  in  the  inform|iti6n  abput  the  test  which  is  . 
given -to  teist  takers  before  tho^  actuauLly  tgike  the  test, 

..      Permit  a  disinterested  and  professional  third  party — 
a  Counselor— to  exsunine  the  list  taker's  answer  sheet,  at  their 
request,  for  scoring  errors.  (  ^     ,  . 
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Preparep  Statement  op. Dr.  David  Gt.  Stratman,  Director, 
^  Campaign  Fmi  the  Future  / 

Mf»  ^halrmon  and  Members  of  fhe  SvbcommlHM: 

My  nam*  U  Doctor  ^ a rold  £•  Jefve/,  Jr.    I  am.  Execu five  .  Dlrecfm' -Secretary  of 
the  Federation  of  State  Medical  Boards  of  the  United  States,  Incorporated,  whlch^^s 
founded  In  1^12.   The  membership  consists  of  the  medical  licei^g  boojtls  of  the  fifty 
stotM  and  th^  District  of  ColumLlo^  together  with  Puerto  Rico,  Guom,  Cdnal  Zone  ond 
'^the  Viryin  |slar>(is.     In  oddltlon,  eight  Independent  itate  osteopathic  examining  boordf - 
ore  members  and  the  ten  Conadlon  Provlnclol^  Licensing  boards  are^lftUote  members. 

Mr.  Chalnnan,  although  Henry  Ford,  on  acknowledged  genius  observed  that  '*H(^tory 
Is  bunk",;  I  would  jespectlvely  submit  that  for  brdlnary  mortols  he  who  does  not  knCw 
history  Is  condemed  to  repeat  the  mistakes  of  the  past.  TKe  history  of  medical  licensure 
'  Is.o  cose  Irt  polnt»»^  Until  1968  each  state  boord  developed  ond  scored  Its'mecHcol  llfeenslr>g 
-  examination,  ^e  system  was  chaotic  and  state  board  examinations  lacked  uniformity.  In 
the  mojorlf^  of  states  exams  were  largely  iub|eCtlve,   The  test  methodology  wos  relatively  . 
.unsophisticated.   If  would  be  difficult-,  If  not  Impossible,  for  two  or  more  examiners,  grading 
the  same  exam,  to  orrlve  at  the  some  scores.    Reliability  ond  validity  were  terms  foreign 
lo  the  vest  majority  of  board  members. 

.    Over  the  post  fIfty-sIx  years,  thousands  of  dollars  and  countless /nan  hours  hoYo  been  . 
spent  by  dedicated.  In  lei  I  (gent  Individuals  to  create  o  high  qualify  examination'  whU:h  oil 
states  would  accept.    Through  the  effort^  of  many,  this  goal  wos  finally  ;ochleveH  In  1968 
''  ond  "FLEX^  wos'bom.    The  (^onym  stonds  for  Federation  Licensing  Examlnatly.    The  "ii^ 
wos  odded  to  moke  It  more  euphonlstlc;  otherwise.  It  would  be  the   "FLE"  exo(n[nat16n. 
Not  very  dignlftedl  .     "  . 


i  could  asqilain  hwi  "FLEX^Ii  com»ructicl.  flow  the  qunHoni  ar»  •valuated.for  r«llablU»y 
and  hew  Ih*  wiring  ti'dont,   IhM  iMUt/Koye  been  ihoU  with  In  great  detail  by  others  and 
thm^U  no  need  for  me  tot  repeot.    /        ,      #  ' 
'  Ono  oT  the  problems  that  this  ^npotad  Legltlbtton  Intends  to  correct  and;  I  quote,  ^  •. 

•  ■fostlng  of  s^lls  for  entry  Into  an  occwpoHon  whether  of  of  profeislon.  Craft  or  trode  ^noture, 
\;ls;d  criHcoJ  factor  gdvemtng  the  evdrt.  fUw  of  rndlvldool  dtllls  In  Interftpte  commerde  and 

.  ^riomly  offects^fhe.norton'i  capability  for -economic  grp^^^       I  would'agroe.'  What  has  \  I*,  i 

.  .*TLEX'*  actompllihed  In  resolving  this  probfem?  .  y 

Eight  slates- porHclp^  In  the  FLEX  program  In  'l96ff.    In  the  relatively  jhort  spon  oIf  ten 
yeon,  with  Florldo  ehteHng  the  progtom  this  yeor,  all  50.  states,  the  District  of  |Go.lufAla,  Carjal 
Zone,* the  Virgin  Islands,  Puerto  Rica,  Guam,  and^the  Province  af  Sailcatchewan,  use  "FLEX", 
Thls  meons  there  Is  a  single  exomlnatl^  ^ed  across  th?  U.Sfi  and  Its  territories. ,   The  Federatl<>n 

'..  Is  justly  proud  of  thjs  achievement.  This  not  only  gives  /seme  of  confidence  In  the  competence  o 
ph'yslislans  entering  the  jxactlce.of^midlclne,  but  removes  barrfen^whlch  existed  prior  to  1968.  In 
the  years  befof«r  .»tat«»  would  recognize  the  exqmlnotlon  of  isertaln  slates  as^  being  equivalent  to 
their  own,,  but  would  Ywtaftctpt  oHws.  Recl^oclty  conjfacts  were  entered  fnto  by  itat^.  These, 
tn  effect,  said,  "You  ,lolce  my  llconsee  and  1*11  take  yourVl^  There  woj  na^comlslahf  rationale  as 

*  to  how  these  decisions  were  made*^  As  a  result,  physicians  could  iiot  move  from  one  slate  to 
onother  without  being  subjected  to  another*  ewmlnotlon.   This  wa^o  "critlcar factor  -goverplng  the 

'  even  flow  ^  Individual  skills  In  1ntefslate  cJinmerce\  This  problem  does  not  exist  In  197?,  With 

\  ,  * .     •       .  *  . 

.    thtf  unlvendl  acceptance  of  "FlEX"  theJe  Is  Increosed  physlclar\  mobtllty. 
•     ■    \  *         ■  ^-     "     .    ■.  ■  ■  . 

.  ifi^  will  the  proposed  Lqglslattbn  affecf  the  remarkable  progress  that  has  been  made  In 

,  medical  licensure  with  the  advent. of  "FLEX"?^  ; 

As  othen  have,  testified,  the  pool  of  questions  Is  limited;-  the  requlremont  thbf^the  candidate 
*can  request  ond  must  b»  given  a  copy  Af  the  exom  with  all  the  correct  arisWerf  and.  those  ml  wed 
wiuld,  within  o  short  period  of  Mm*  itwRe  .lj  a  force.     By  reviewing  leyerol  exams,  any 
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raotondbly  tntellfgcnl^  highly  moHvated  Individual  would  be  able  fa  make  a  passlnjg  s£ore. 
'   •     .       *  . 

.  The  validity  gnd  reliability  of  que»Hons  apd  security  of  the  entire  exaiVi  would  be 'non-e)(lttent;. 
.The  proposed  r«rqulrementi  far,  fee  disclosure  and  justin  cation  are  also  Inappropriate 
•  ~^  t.n  the  context  o^  tlie  state  medico P  boarcif*    Obvlqysly,  the  examination  fees  levied  by 

such' boards,  are  direody  a  matter  ^of  ^public  record.  The  |ustlf]^t(on  for  those  fees  Is 
\yreadljy  apparent.*  As  orm^of  the  various  state  governments,  these  boards  ore  charged  with 

maintaining  the  qualification  of  new  physicians  -  a  role  tradltlonaly  accepted  by  the  states. 
...'*By  virtue  of  itwt.tfatus  It  would  be  Inappropriate  for  the  Congress  to -attempt  ta  regulo^, 
'*  'or  dversee 'their  activities.  -  fhls  Is  particularly  the  cose-  since  there  ore  no  alleged  abuse* 
by^the  staVe  boards  that  would  call  for  refbrm*  *  .  © 

•^^  From -the  standpoint  of  the  FederaticAfv  of  State  M^l col  Boards,  the  overriding  cancel^' 
»  ■     is,  '*Does  thl|  committee^  through  this  proposed  Legislation,  wish  ta  thr#w  out  the  bdby  with 


the  both  woter?^  For  the  reasons  stated,  as'  well  ds  others,  I  am  Reasonably  confident.  If 
..  «  '  these  'bills  were  passed,  some  of  the  st^t«  mfedlcaj  boards  would  withdfaw  from  the  "FUEX" 
.    ~-  -pro^m.    Sudi  boards  wouH  opce  again  develop  tbeir  awn  exoHlndflbns,  with  oil  the 

{tiequltles  and  Ir^tlonajity  that  ypo^wlsh  to  corr^t.  Alj  oT  the  efforts  expended  and  progress 
'     ■  mad^  might  well  ceose«    Medlc(jJ||ieh(Lir«  ^ot/td  well  revert^  back  to  the  pre  1968  days.* 

^'^  t^:'    '  ^^^^  ^         cbnoef^ippp  be  voiced  by  such' groups  as- Dentistry,  Lew,  Nurifrrg, 

.  '^  Osteopathy  and  Pharmacy.  /       ■  .  .'  "  ^       j,  ■ 

%:rjy  *The  ^deration  opposes-  HR  3564  and- 49^jS  they  not  i>i6 'passed  theFr 

,^  pras^nt  form*   There  has-been  no  groonds^lf^f^PP^I^ress  to  become  Ipvat^  In  medical 

Itcensurtf*'  In  my  |udgmeni^-the' stated  mi^rltfous  . objectives  will  not  belichtey^*  Progrpi% 
wilt  no^ull.  f  ^  *.>.*.. 

j  thantc  you,  Mr.  Chotrrnen,  for  the  opportunity  x>f  testifying,    I  will  be  happy  ta 
^answer  any  .Questions  you  or  yrfie  committee  'members  may  have^    "  \  . 

^>  -  ■■■■■ 


r 


".  ^        .  ^  ■ 

^Prepared  Statement  of  Dr.  Harold  E.  Jbrvey,  Jr.,  ExECtrnvE  Pirec- 
tor-Secretary,  Federa'pon  of  State  Medical  Boards  op  the  , 
United  States,  Inc. 

Uir,  Chair mani     .  ;.  ' 

/l  am  David  Stratman,  Director  of  the  Campairn  for  the  l-'uture,  an  ^ 
•  oreanization  committed .  to  the  revitalization  of  public  creation. 
■•   I  wish  ^  thank  you  for    the  opportunity  to  offer  testimony  on 
•    H.R.  ^949,  the  Educational  Testing  Act  of  1979.  > 
Ik    _  ■    ■  ,  . 

.  We  welcome  aiid  endorse  the  Educational  Testing  Act  as  an  important 
•.-■•step  in  providing  to  students  and  psir^nts  information  about  a  pro- 
cess which  has  ^mmense  impact  on* students'  education  and  on  the 
opportunities  which  ^ill  tl^  open  to  them  up^on  graduation.    We  see 
the  importance  of  this  le^^islation  to  b.e  not  only  *what  its  enact- 
ment will.  accomplis|J|  we  view  it  as  the  opening  round  in  what  must 
become  a  national  (debate. on  standardized  testing  1    on  its  uses,  its 
limitatiof\s,  and  on  its  effect  on  the  educational  process.  F6w 
^sues  strike  so  deeply  to  the  heart  of  educational  policy  and 
•practice j^s  the  issues  Vailed  by  standardized  testing. 

The  concern  of  Campaign  for  the  Future  is  with  standardized  testing  ;| 
at  all' levels' of  education.    H.k.  i*9^9  speaks  only  to  standardized 
testif\g  at  the  college  ieyel  and  beyond.    I  would  like  to  comment 
on  the  specif ijc  issues  raised  by  the  Educational  Tentinr  Act,  and 
also  to'  extend  the  discussion  to  questions  related  to  standardized 

■    ■  .  .  %  ■  r 

>      testing  which  pertain  as  well  to  elementary  and  secondary  education,  . 
The  most  critical  question  about  any  form-  of  testing  is,  "V/hat  do 

'     '  '  ■  . 
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thesQ  tests  measure?"    The  quection  ic  inpprtant  because  it. 
brings  to  attention  not  ordy  the  educational  usc;&ilnfiSf;  of -the 
teot,  but  also  raises  questions  involved  vdth  test  design  and  con- 
strUction,     Mr,  Robert  Solomon,  Executive  Vice  President  of  •Lduca- 
.  tionai  Testing  Service,  raised  this  question,  in  his  testimony 
■  before  this  Subcommittee  on. July  Jl,     Th6  question  involved  is^ 
j'one  of. cultural  biasi 

.the  argument  is  made  that  tests  of  academic 
aMlity  are  biased  becfiuse  they  repre'sent  --iddle 
class  culture.  .  These  tests  do  reflect  ski^lls  and.  : 
knowledge  considered  important  in  the  mainstream  ^ 
culture,  in  many  jobs  and  in  higher  education,  but 
■  /*lhe  fact  that  a  test  mirrors  the  common  culture  ig  a  ■ 
^  poor  basis  for  calling  the  tes.t  biased. 

The  c^se  for  removing  the  shroud  of  sicrecy  from  educational 

t^stinc  does  not  hinge  upon  the  charge  of  cultural  bias  in  testing. 

Students  and  parents  have  a  right  to  know  on  what  basis  their 

lives  are  being  directed  tcward  one  option  or  another  apart 

from  the  general  vali^Jity  Qf  the  bases  of  these  judgments- 

Nevertheless,  the  claim  that  standardized  tests  simply  "mirror 
*    the  common  culture"  is  /lot  irue  in  thfe  sense  in  which  it  ia  interyj^ 
in  t^e  statement.     The  "cultural  bias"  inherent  In  standardized 
testii^.is  not^a  perip'horal  problem,  to  be  resolved  by  a  simple 
mp(|ification  of  particular  test,  questions.    ,It  is  inherent  in  the 
design  and  the  purposes  of  the  tasts.  .    .'  t  . 


t 


The  design  of  a  test  is  9,.  function  of  theuse  for  which 
it  is  intended.  .  If.  a  teacher  wants*  to  know  how  well  ^her  students 
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*    ■  •    •  ■  ,    '  ■  ■  ■  . 

■   '         ■   .■  *       "  ■         .  ■     ■      *  ■ 

4»ave  learned  their  multiplication  tabloo,  aYfC  v.ill  ask.  her  Students 
some  of  the  problems  they  have    studied.  ^That  is  called  a, criterion^ 
referenced  test,  and  is  used  every,  day  by  c;:*6Broom  teachers.    It  ^ 
is  a  useful  kind  of^testing,  because  it  help's  the  teacher  desien 
the  nrtct  step. in  the  students'  instructional  procrara.    This  ki^d  - 

ft  "    "  . 

of  test  riB  n$)t.. inherently  biased,  .. 

If  a. teacher  has  beep  told  to  grade  her  students  on  a  "curve" 
with  some  A'8,  some  F»s,  and  some  students  falling       between,  she  • 
will  need  to  design  a  test  which  will  procude  that  distribution  of 
scores.    A  tbst  designed  to  produce  a  "normal"  or  "bell-shaped 
curve*  -Ts  caU^d  a  ^norm-referenced  test/    Its  purpose  is  not  to 
measure  what  students  know,  but  to  sort  them  out  al6ng  a  bell- 
shaped  curve'/   If  all  of  a  teacher's  students  have  learned  their 
multiplication  tables  well,  so  that  they  would  get  all  A*s  or  B's 
,i^  tested  on  their  tables,  the  teacher  would  have  to  design  ft  tes^i 
that  would  BQFt  the  sturientfi  out  on  Rome  other  basjs '  thftn  %\^^ir 
knovfledge  of  their  times  tables. 

*       ■  '  ■  ■  ^ 

This  could  be  done  in  any  number  of  i^/^yB-»-by  presenting  the 
questions  i^ confusing  language  that  only  some  of  the  children  would 
understand  I  by  making  the  test  a  speed  test  that  spme  of  the 
students  would  not  "respond,  to  as  weU>-or^by  testirig  these  students 
on  some  differlfit  materi^  and  then  claiming  that  the  children  were^, 
,ng  tested  on  their  "mathematical  ability"  or  '"mathematics 


er|c:     .  '  %  ,^ 
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•aptitude 


Stfifhdardized  |norm-*ref  erericed .  teste  use  all  of  these  techniques  to 
produce  test iscores  that  the  test-makers  claim  reflect  atudentc* 
••mathematice^  ability"^or  "verbal  a^tiility,"    The  standard  achieve- 
ment tests  frequently,  administered  to  grad^-  school  younj^ster.s  are 
.deists  of  this  type.'  , 

Tests  of  this  type  are  inherently  biased,  because,  th^.  arc  designed 
to  produce  a  predetermined  distribution'  of,  scores  irrespective  of 
the  stiidents*  knoy/ledge  of  what  they  have  been  . taught.     TO  desicn 
a  norm-referenced  test,  the  test-maker^  must  first  decide  Which 
students  exhibit  what  he  considers  to  ba  intelligence  or  achieve-  ^ 
nent»     He  then  designs  a*  set  of  questions      at  fulfill  his  expecta- 
tions of  who  is  sm^r^,    ^  students  whom  he.  ha^s  selected  perform  * 
poorly  on  a  certain  questioh,  It/b  rejects  that  question  and  selects 
a  new  one.    And  vice-versa t    if  children  whom  he  has  judged  to  be 
poor  students  perform  well  on  a*question>  that  question  is  rejected. 


Questions  like  "V/hat  is  •intelligence?"  or  "Who  is^  snfart?"  or  "What 
is  student  achievement?"  are  questions  tha^t  the  test- maker  answers 
^n  the  basis  of  his  assumptfkops  about  students  before. he  constructs 
the  test  desigjned  to  answer  the^e  questions,  '  * 


Scholastic  Apt  itude  T^ests  apd  other  major  standar'dized  college 


enVanqe  examinationa  iEgre  referred  \o  by  their  publishorc  an 
••perforinance  testo.**.  V/hile  thoy  differ  in  some  respects  from  - 
standardised  achievement  testo i  they  are  similar  in  that  they  are 


designed  to  sd^t  students  out  rather  than  to  test  what  they  kn9w. 

In  the  case  of|SAT's,  the  tests  are  designed  to  sort  students  in  such 
a  way  as^  to  predict  thfeir  success  in  college.    This  is  their  valjje  . 
to  the>6Llegec  which  subscribe  to  the  Educ4jional  Testing  ServiceEi 


services/   Questions  are  selected  for  the  tests  r)ot  because  they 
y  reflect  somiB  curriculum  which  all  the  test  takers  have  shared  and 
thus  caif  be  .expected  to  know.    They  are  selected  because  those 
students  who  tend  to  do  well  in  college  tend  to  suiswer  them 
correctly.    If  students  who  have  not  historically  done  well  in 
college  answer  certain  qi^estions  correctli^,  but.  students  who  have-/ 
done  Wbll  do  not,  those  quBtions  arc  rejected  in  favor  of  be tte^* 
'predictors;     .  .  '  •  /  *// 


Thus  standardiz 


Thus  standarAzed  entrance  examinations  are  not^ ••mirrors  of  ^c^piet)/'* 

in  the  sense'that  they^flect  the  skills  and  Knowledge  of  students 

from,  different  backgrouiids.    They  are  mirrors.,  only  in  the  s^rtse /ihat 

they  reflect  and  eraii^M  historical    p^itterns  of  social  hierarchy,. 

They  are  not  njirrors  of  a^^^lBttw^at  and  ability  but  •gateHe0pcrs  • 

on  .the  paths  to  socia^^'S^tus.    Class  and  race  bias  are  inevitably  ^ 

part  of  their  design,  because    these  factors  cannot  be  ditfassoQiated 

'     ,  ■  ' '    ■  •  »    ■  ■ '  * 

from  the  pre|d^ic^tive  purpose  of  the  tests,     ^  .  • 
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A  critical  question  related  to  standardfzed  testing  i^,  "What  ie  the' 
educational  effect  of  these  kinds  of  testine?"    This  question 
emerges  most  forcefully  in  .considering  norm-referenced  testin^j,  ^ 
especially  at  the)  elementary  and  secondary  level*  f  " 

Standardized  tests  wre  used  to.  make  decisions  about  students  at^ 
many  critical  junctures  in  their. education,    They  may  lead  a  child* 
to  be  labled  or  "tracked"  as  having  only  a  certain  level!  of 
•abildty.    They  may  influence  guidance  counselors  and  teachers  to 
advise  or  treat  a  child  in  a  .certain  way.    They  can  affect  a  . 
students    chances  for  college  or  scholarship  rr.oney,    Their  impact 
and    potential  for  harm  on  students'  lives  are  immense, 

3ut  the-  sorting  process  and  the  bell-shaped  turve  of  the  'itest 
■can  have  another  effect  that  is  of  di  more  day-to-day  and  fijcially 

more- important  nature.  Standardized  tests  are  an  ojitside  "authority*' 
.that  seems  to  be  confing  from  on  high ,    Parents  and  teachers  may 

feeX  unegjsy  about  these  tests  and  the  judgements  which  they  ' 

impose,  but  still  find  it  difficult  to  challenge  them, 

'Because  the  tests  compel  and  lecitimatiiie  the  sorting  s^nd  labelling 
of  the  students,  they  necessarily  have  an  enormous  effect  on  how 
teachers  fiind  parents  view  the  students-,  and  how  the .  students 'view 
themselves. 
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Cftc  half  of  Btudente  tested  overall  •  no  matter  how  well  tiiev  havv- 
mastered  the  material,    are  told  that  they  are  "below  averace* " 
Each  student  ifi  tolci  by  the  test  .Jthat  his  performance  is  important 
only  to  the  extent  that  he  compares  rgainot  other  students  takinfi 
)    the  test — since  that  is  all  these  tests  can  do,     (Remember  that 
*^the  performance  is  based  on  •"aptitude/*'  not  knowledge  of  the 
curriculum,) 

Standardized  Intelligence  and  achievement  tests^/i^n    other  wordsi 
bring  into  the  classroom,  and  into  the  lives  o^the  students  a  view 
of  themselves,  of  education #  and  of  each  oth/r  that  can  onl:^  damage 
their  educational  development, 

A  third  area  of  our  concerh  is  with  the  barrier  of  secrecy  which 
has  been  erected  ar(/und  testing,    H,R.  49^9  speaks  ,pointedly  to 
this  isaue,  *^      .  ^ 

From  early  childhood,  through  entry  into  professional  schools  or 
Jobs,  standardized  tests  make  significant  judgments  about  our 
children.    Yet  no' portion  of  the, public  school  system  is  less 
understood  than  the  facts*  ahcitrt  standardized  tests  i  their  assets 
and  their  limitations.      Campaign  for  the  Future  is  deeply  concerned 
that  testinfi^  programs  are  being  authorized,  paid  for,  instituted 
or  withdrav/n  and  evaluated  without  jlny  -broad  ^)ublic  discussion  on 
many  of  the  momentous  issues  raised  by  these  programs.    As  parents 


0'  .....  .  ■•  yvv 
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and  teachers,  we  feel  it  is  important,  to  achieve  a  creator  der;rec 
of  accourttability  i^  the  testijig  process,  yet  such  a  review  or 
Ryblic  discussioij^  isidifficiil^  or  impossible^becaupe  of  the 
irftense  secrecy  tha-y  surrounds  these  tests. 


Due  to  the  mask  of  **security , **  the  public  has  been  unable  to 
evaluate  dispassionately  the  claims  of  ten^makersi  the  uses  4 
by  public  school  systems  &nd  institutes  of  higher  learning  or 
the  many^  reported  abuses.    Information  about  the  tests  and  the  ^ 
testing  process  is  minimal  and  is  rareiy  shared  "after  the  fact" 
with  those  most  intimately  concerned  students  and  their  families, 
*  Yet  these  tests  serve  as    gatekeepers  to  the  future  for  our 
children^  they  develop  patterns  of  expectation  by  teachers  and 
school  systems  that  often  are  totally  unrelated  to  a  child's  true 
capabilitie?!  and  because  the  power  to  test  is  the  power  to 
influence  curriculum,  they  teiyJ  l;o  reinforce  curriculum  patterns 
that  respond  only  to  the  ultimate  goal  of  "looking  good"  On  the 
national  tes't;s«  -  '  _  - 

•  .  ■  • 

Whil.e  would  by  nO  means  address  these  critical,  questions 

directly,  by  lifting  the  shroud  of  secrecy  from  these  tests,  it  would 
for  the  first  time  allow- a  broad  and  informed  debate  over  iheir 
construction  and  uses.    The  debate  would  alloy/  both  the  public  Eind 
the  individual  student  to  put  the  tests  -in  a  more  reasonable  perspec- 
tive. .      '  / 


4 
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Campaign  for  "the  Future  has  a  further  concern  with  8tajidardize<J 
testing  which  relates  to  its  effect  on  the  future  of  Uudation  in 
the  United  States,'   ^^any  experts,  on  educational  testing  have  pointed 
to  the  history  of  standardizied  testing  as  a  device  for  social 
control,  .  -4,' 


Itp  first  Use&,  both  abroad  and  in  the  United  States,  have  been  as 
a  means  of  sorting  out  those  individuals  with  backgrounds  and 
values  most  like  the  roost  powerful  groups  in  society, 
"gatekeeper**  function  of  testing  is  to  ^rt  out  those  whAwill  ^ 
.••succeed"  in  these  terms,  and  'to  justify  the  rejection  of  Those 
who  do  not.    As  it  was  with  immigrants  in  the  1910's  and  1920's, 
so  it  i^  now:  with  the  children  of  the  working  class  1  standardized 
testing    is  constructed  to  justify  the  advancement  of  the 
children  of  the  middle  class,  and^to  assigi/'to^brkinc  class 
children  a  low  statusand  a  diminished  future.  The  tests  justify 
yin  terms       •♦aptitude,**  "ability i"     or  even  "intellipnce, ";what 

is  in  fact  a  clash  of  values  and  family  background.    The  tests  are 

ji-  ■    *  ■      .  »  * 

thus  used  to  justify  an  unequal  society  which^'^promises  in  the_  future 

\  ^  ■.•*-.      ^  . 

to  becoiBSJOOre  unequal. 


It  is  this  historical  pattern  which  concerns  us  most.    The  use ^of 
standardised  testing  has  been  greatly  increased  in  the  pajpt  several 
years,  at  the  elementary  and  secondary  level  1  and  promises  to  be  y. 
even  more  influential  in  children's  lives  in  the  future.    As  ^ 
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economit  opportunities  diminish  in  what  will  likely  be  a 
contractinc  social  hierarchy  in  the  nefxt  decade,  there  will  be 
powerful  pressures  on  the  educational  system  at  all  levels  not  to 
educate  students  but  to  sort  them  out,  and  to  justify  their  s^lecti 
with. supposedly  "objective"  measures.    This  eventuality  would  be 
disastrous  for  America's  children  emd  for  the  schoolsj  indeed, 
it  would  'mean  a  historic  revws^  in  the  direction  of  Amorioaw 
society.    We  see  the  pressures  for  increased  testing  to  be  akin  • 
to  the  pressures  for  tuition  tax  credits  and  other  attempts  to 
inake  "feducation  the  privilege  of  a  few.  Their  aim*  is  to  lower  the 
society's  expectations  of  what  its  children  can  achieve, 

I  would  like  to  make  one  further  comment  in  support  of  this 
legislation.^  Critics  of  the  bill  have  alleged  that 
id  a  measure "for  further  federal  control  of  education.     In  fact, 
it  is  nothing  of  th^^ind.    What  exists  now  in  education    is  a    '  • 
J\u^c  teetinc  establish  roent,  .^ith  immense  effect^  on  millions  of 
students' lives,  which  is  veilAd  in^  secrecy  and  accountable  to  no  ' 
'one.    This** legislation  does  no^  propose  government  i^ogulation  of 
the  industry  |    it  nerely  would  enforce  the^dero;  ulation*'  by  the 
industry  of  its  own  processes^w  by  making  them  open  to  test 
subjects.    The  bill  does  no*  interrupt  the  rights  of  private 
individuals:    it  restores  th^m.  * 

We  urge  this  suljcommittee  to  act  favorably  oh  this  legislation, 
Thank  you,  *Mr.  Chair^oan. 
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Pkepared  Statement  of  the  Natiokal  Jjeaoue  fg^  Nurbino,  New 

York,  r 


ATIOKAL  Le- 

K,  N  Y.  1^ 


STATEMENT  FOR  THE  RECORD  OF  HEARINGS 
.ONH,R.  4949  AND  H.R.  3569 


The  National  Lei^g^fi^tor  Nursing »  a  coalition  of  nurset»  other  health 
profeiiionaisi  co^HHk  and  health  agencies      17,000  individual 
membert  and  1 » d^mPTcies      all  of  whom  work  together  to  help  meet 
community  nursing  needs  and^to  assure  high  quality  nursing  education^ 
respectfully  submits  this  statement  for  the  Record  of  Hearings  on  ^ 
H.R.  4949  and  H.R.  3569.  '  '      '     '  '  ' 

i  k 

NLN  provides  preadmission  and  achievement  test  services  to  state -dBproved 
schools  preparing  registered  and  practical  nurses.    The  League  als^sei'ves 
as  the  test  service  agency  for  the  State  Board  Test  Pool  Examination  for 
both  registered  and  practical  nurse  licensure.    Each  of  the  licensing 
'  examinations  is  a  nationally  standardised  test»  administered  twice  a  year 
on  uniform  testing  dates.  j 

The  National  Leagi^e  for  Nursing  has  had  many  years  of  experience  in  ad<- 
4«dsfion  testing  in  the  areas  of  guidance  and  placement  of  students  in 
yc^ools  of  nursing.    T^ft  first  edition  of  the  Pre-N|irsing^and  Guidance 
Abomination  (PNG)  for  use  by  registered  nursing  programs  was  published 
In  1946  and  an  edition  of  this  battery  has  been  continuously  available  for  y 
the  last  33  years.    NLN  has  provided  a  preadmission  test  battery  for 
practical  or  Vocational  nursing  prog  rains  since  th(  1950s.   Although  we 
understand  the  serious  concerns  of  many  cohs^omer  groups  and  students 
.over  a  procedure  that  plays  such  an  important  role  in.  the  education  and  . 
careers  of  nnany»  the  League  believes  that  there  are  serious  flaws  in  some 
of  the  provisions  ^jf  the  proposed  Ugi^Uition.    Therefore,  we  wish  to  focus 
our  coniments  on  the  is sue  of  disclosure  of  test  content.  '  ^ 

■»  .  *      .  ■  »      .  •  . 

LegislatiQn  advocating  dlaclOsure  of  test  questions  and  fnswers  seems  hasty» 
especially  considering  that  the  result  might  be  the  drastic  reduction  in 
standardised  testing  available  for  guidance  and  placement  of  applicants 
to  post- secondary  programs  and  ihe.  subsequent ^use  of  the  subjective  criteria 
'  in  nnany  pases  for  this  pur pQse^    '   .  '  ^ 

i 

It  should  be  remembered  that  fairness  to  the  examinee  is  the  prinfiary  objective 
of  test  security.    The  practice  of  treating. test  content  as  secure  material 
evolved  so  that  no  test  taker  would  enjoy  an  advantage  over  another  through 
prior*  familUr^ty  with.thi  specific  questions  included  in  the  test.    While  grantin||^ 
all  exaxninees  access  to  test  ccmtent  before  testing  may  seem  to  be  providing' 
fair  and  equiUble  treatment  to  test  takers  as  well»  realistically  this  is  not  sc^. 
Given  the  wide  diversity  in  circun[|stances  for  examinees,  factors  -  not  the  | 
least  of  which  is  econoi^c  »  will  decrease  the  opportunity  of  getting  the 
questions  for  many. 


/ 
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Keeping  test  forms  secure  ensures  that  each  test  taker  it  being  presented 
with,  the  same  test  prol^lems.    Standardizing  testing  conditions  are  necessary 
for  sound  test  development  and  Statistical  studies  for  equating  scores  from  > 
different  editions  of  a  particular  test.    The  customary  equating  procedures 
require  the  comparison  of  student  performance  on  a  new  set  of  questions 
with  performai\ce  on  a  set  of  questions  previously  administered  within. the. 
testing  program.   One  widely  used  method  of  carrying  out  this  comparison 
is  to  adnninister,  as.  part  of  a  new  test,  a  sample  of  questions  that  had  been  ^ 
previously  administered  as  part  of  the  same  program.  ^  * 

Only  when  all  test  takers  encounter  testing  nriaterial6  for  the  first  time 
under,  similar  e^f^mination  conditions  is  it  reasonable  to  use  performance  oh 
the  larger  body  of  nnaterial  from  which  tlie  test  is  drawn.    Ifa1|»  such  pre-, 
viously  administered  question's  had  already  been  released  and  widely 
circulated  among  examinees,  alterations  would  be  required  in  the  equating 
process  since  it  would  no  longeV  be  possible  to  treat  both  sets  of  questions 
as  identical  for.  purposes  of  establishing  the  relationship  between,  new 
questions  and  the  previodsly  administered  questions. 

A  standardized  test  is  valuable  particularly  in  two  kinds  of  situations: 
situations  in  which  comparisons  have  to  be  made;  in  which  there  are  large 
nonffbers  of  people  about  whom  decisions  need' to  be  made,  but  for  whom  the 
decisibn.- maker  has  no  dommon  or  comparable  data.    There  are  a  great  , 
number  of  situations  in  education  where  comparisons  need^to  b^  nriade.  One 
important  example  is  guidance  and  placement  of  applicants  to  educational 
programs  whethel:  the  concern  is  |d  select  the  best  qualified  for  a  liniited 
number  of  available  openings  or  to  allpcate' teachers  and  facilities  to  meet 
the  learning  needs  of  prospective  students  in  the  country.  « 

Standardized  tte St s  are  also  ver)»  valuable  as  predictors  of  future  behaviors. 
As  part  of  NLN's  service  to  test  users,  the  League  has  conducted  studies 
on  our  adnriissions  tests  to  determine  their  usefulness  as  predictors  of 
performance  in  schools  of  nursing.    The  most  recent  validation  study  of ^  . 
the  current  edition  of  Pre -Nursing  and  Guidance  Examination  affirmed  the 
^usefulness  of  th^^t  instrument  as  an  aid  in  making  admissions' arid  placement 
decisions  for  schoole  preparing  registered  nurses.    The  results  indicate  that 
the  Pre Nursing  and  Guidance  Examination  battery  functions  well  as  an. 
indicator  of  future  performance  in  schools  of  nursing,  and  on  the  licensure 
examination.   Although  each  test  in  the  battery  contributes  to  prcJ^iction 
of  uiccesB  within  thV  nuraing  program,  conduct  of  the  study  enabled  NLN  to 
ideJtify  those  tests  which  contribute  the  most. 

The  construction  of  sound  standarjjized  tests  is  a  long  arduous  process 
and  the  investment  of  money  and  effort  is  a  formidSf^l^  one.  .  The  first 
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^tep  ill  conitiructing  a  ■tandarcjiised  teit  it  development  of  the  plan 
imd  epecifiqationt  for  the  test*    Th|^'itemt  have'  to  hh  written  to  fit 


the  •pecificationi,  reviewed,  edit^,  and  tried  out  on  grpipt  similar 
to  those  fojr  whom  the  teet  it  intended,   ^xt,  item  analytit  mutt  be 
done.o  On  the  batit  of  the  retulti  of  iten|toalyeit.  the  itemt  for  the  ^ 
final  form  of  the  teat  are  telected,  or  iteint  may  be  ifevited  and  new\ 
•itemt  written  and  tried  out  again.  :  When  all  the  itemt  for  the  final  form 
of  the  tett  are  readyi,  tlie  j^ettt  have  to  be  printed^,  a  repretentative 
national  taitkple  mutt  be  ^^cruited,  and  thejtettt  adminittered  to  the  ' 
•ample  of  ttudentt.    tettt  mutt  then  be  tcored,  raw  tcoiyCt  tabulated, 
and  normt  de>reloped«   At  thit  point  additional  data  need  to  be  gathered 
and  analytet  carried  out  to  periooit  determination  of  reliability  and      r  . 
.correlationt  with  other  meaturot.   ManUalt  for  adminittering  the  ffctt  . 
ind  interpreting  th^  retultt  mutt  be  prepared. 

Thit  prbcett  it  obviously  a  very  painit4king^  time  contucr^g  add  cottty 
one.    Tett  dieclosure  would  require  that-portiont  of  thit  procett  be 
eliminated  or  modified  drattically  becaupe  of  time  conttlraintt  and  that 
other  portiont  be  repeated  each  time  a  tett^it  adminittered.    The  oiott 
obviout  increate  in  time  and  expente  wilier e^ult  from  the  additional* 
tett  itemt  that  will  need  tp.  be  wri^en  and  readied  for  ute.  Witness 
the  recent  example  of  New  York  State  where  at  a  retult  of  the.  |4tta^e 
of  the  Admittiont^  Tetting  Act  of  1979»  tome  testing  programt  a\ 
charging  at  nuich  at  $5  more  than  ttudentt  eltewhere  to  ti^ke.exakit. 
The  National  League  for  Nurting  would,  accrue  large  cott  increaait 
with  the  conttructioh  of  nev  tettt  wnd  a^tociated  printing  cottt.^There, , 
a}to  exittt  the  very  real  danger  that  there  will  be  a  depleti^^pf  the 
pool  of  high  quality  itemt.    Etpecially  whye^tnuch  of  the  imormation  ^ 
to  be  tetted  it  of  a  ditcrete^  technical  t)at|^e»  Vt  in  the  health,  profettiont.  . 
.  there  it    limit  to  the  number  of  quettidnt'  thAt  can  be  |}eveloped.  ^ 

iknother  very  critical  point  that  needi  to  be  more  clbtely  examined  it 
^hether  the  ditcloture  provition  of  the  legielatioa  will  be  able  to>ccomplith 
that  it  it  intended  to  acconiplith.    That  it.  r  J||lkting  the  tett  quettiont 
^  alone  would  not  be  of  much  benefit  to  the  .ttiident  without  any  knowledge  ^ 
of  other  factort  involved  in  developing  the  ^emt  tuch  at  the  relationthip  . 
.of  individual  quettiont.  to  the  tett  at  a  whole  or  the  level  of  difficulty 
ofthe  iteiOt.    Undertti^ding  thit  requiret  tpecialised  training  .   If  the     ,  , 
Intent  of  ^e  legitjktion  it  to  reveal  U>e  quettiont  to  ttudentt. will  be  able 
to  identify  the  areas  where  they  are  academically  weak,  then  review 
bookt  are  availablfs  Vor  all  the  majdr  admit sionP  tests.ahd  could  surely 
be  used  for  that  purpose.   If  test  items  are  required  to  be  disclosed^  they 
will  simply  provide  an  additional  san^>ling  of  test  questions,  some  of 
livhich  are  always  found  in  review  books  now*   In  addition^  most  test 
AdiAipistrators  already  inform  applicants  of  the  general:  areas  to  be  covered 
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and  after  testing,  tell  him  hpw  they  did  in  each  specific  subject  ar«a.  ^  • 
The  State  Board  teift  for.  registered  nurse  licensure  most  assuredly 
dpes.this.  u  . 

Proponents  of  the  legislation  also  believe  that  the \niblic  release  of  tests 
and  answers  could  help  to  detect  cultural  bias  in  the  test  itima. 
The  exa^  opposite  si^^uation  may  well  occur  considering  that  standardised  • 
testing  provides  the  data  foi:  research  on  cultural  comparisons  in  test 
performance*    There  is  the  danger,  conside<^g  a  greater  availability  . 
'  of  transpor^tioni  time  and  financial  resources  to  white  ntiddle  class 
students,  that  they  wo'ufd  be  more  likely  to  acquire  test  items  and  gain 
more  understanding  of  the  entire  testing  procedure  because  of  having 
^ore  support  systems  availably  to  them.    Test  users  Would  be  required 
to  obtain  persotial  data  from  examiz^ees  b^in%  tested  in.  order  to  comply, 
with  tile  terms  of  the  proposed  law.    Conceivably,  some  test  subjects 
might  object  to  providing  personal  information  -  Such  as  family,  income  -  in 
the^testti^g  situation, 
*  • 

At  the  present  time  there  are  nnaiiy  serious  repercussions  occurring  in 
New  York  State  as  a  result  of  the  SEate's  new  Admission  Testing  Law, 
requiring  that  publishers  of  standardized  admissions  tests  file  test 
questions  and  correct  answers  with  th^  New  York  Commissioner  of 
.  £ducati&n»    The  State  Education  Department  Has  estiniated  that  20  of  the* 
26  college  and  graduate  school  admission  tests  covered  by  t^e  law  would 
be  withdrawn  fi^m  the  State  after  January  because  of  .the  cost  of  developing 
additional  questions.    In  addition,  the  frequency  of  test  sessions  will  be 
reduced,'  nnaking  illuinore  difficult  for  examinees  to  select  a  convenient 
time  for  testing.    Proposed  legislation  would  make  it  more  difficult  for 
NLN  to  accomodate  the  need*  of  handicapped  students.    Before  enacting 
legislation  on  testing  of  this  scope,  legislators  would  be  well  iadvised  to 
take  ^he  tiaae  to  esCamine  the  impUcatipns  and  repercussions  of  "truth  in 
testing"  in  New  York  SUte. 
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Pr£pared  Statejmcent  of  the  American  Nurses'  Association. 

'  As  tiie« national  professional  membership  organization  .for  registered  nurses,  the 

American  KursesV  Association  is  dedicated  to  improving  the  quality  and  availability 

of  health  car^  se^ices  for  all  Americans..  A  key  factor  in  meeting  these  goals  is. 

an  adequate  supply  of  competent  nursing  manpower.    There  is  opportuni^ty  and  need 

for  developing  and  utilizing  talent  from  all  sectors  of  our  society,  most  certain]^y. 

including  minocitdes  and  educationally  disadvantaged  groups. 

.  * 

Standardized  testing  perfjorms  a  critical  role  in  cultivating  this  manpower 
resource.    Testa  are  used  to  identify  siiudents  of  ^promise  to  provide  feedback  for 
continuing  development  in' both  educational  and  professional  prac&d'0  settings,  in, 
licensure  to  determine  ability  for  safe  and  effective  nursing  practice,  and  \w 
Certification  to  asse^^  quaj^f ications  in  specialized  fields  of  nursing.  Through 
.nationSl  .Btan^atc^-zationy  tSstS  promote  educational  opportunity  and  mobility  of 
fprofessional  workers i>   While  such'  te#ts  should  always  be  used  in  conjunction  with 
other  indicators  of  abilities  and  qyalif ications ,  we  know  of  no  fully  adequate 
substitute  .assessment  method. 

The  American  Nurses'  Association  therefore  wishes  to  insure  that  aspirants  to 
and  neobers  of  the  profession  have  timely  access  to  highly  valid  and  fair  testing 
.programs  without  art  if  }citil«  barriers  to  candidate  success.    We  do  not  believe  that' 
the. proposed  legislation  will  contribute  to  this -  purpose .    In  previous  ^testimony , 
others  have  raised  serious  questions  about  the  effects'  of  such  law,  including 
concerns  about  the'  prospective  negative  impact  on  minorities,  quality  of  tests, 
accessibility  and  costs  of  tiests  to  candidates,  and  misdirection  of  student  ^ 
*  learning.^  We  believe  any  case  for  regulating  testing  should  be  based  upon  ^a  . 
documented  need  and  a  thorough  analysis  of  costs  and  benefits  to  be  achieved. 

We  ask  that  this  statement  be  made  s  part  of  the  permanent  hearing  record. 


■  -  ■  ■■■■ 

.  ■  ■ 


ERIC       .  .  ' 
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Prepared  Statement  op  Robert  Glasei^j  President,  Diyision  of 
Evaluation  and  Measurement,  American  Psyoiioixxjical 
associatiok 

The  Division  pf  Evaluation  and  Measurement  of  the  American  Psycho- 
logical  Association  supports  the  intent  ofabo.th  H*^*  33'^^>  the  Truth  ^ 
in  TcjS^ing  Act  of  .1979,  andH.R.  494.9^  the  Bducational  Te8ti?i|5.  Act  . 
of  1979,  to  improve  the  quality  and  avaidability  of  infc^atioh 
about  tests  and  testing.    However,  we  do  oppose  certi^in  aspects  of 
both  bills  because  technical  considerations  would  work  to  vitiate  the 
fulfillment  of  this  intent . 

We  support  the  following:    First,  that  students  and  other  persons' 
who  take  tests  should  have  a  sample  of  test  items  available  to,  them 
be^re.the  test  is  given  so  that  they,  can  s^e  the  kind  of  items  they 
will  be  confronted  with  in  the  actual  test.     Second,  that  students  also 
need  some  assurance  that  their  ansi#^r  sheets  hav^  been  -correctly  scored 
and'  recorded.    Third,  that  they  need  to  know  in  general  about  the  re- 
lationship of  test  scores  to  the  achievement  or  performance  beii(^  ^ 
predicted,  «  Finally,  that  the  co||^umer  needs  to  knbw  that  the  items  are 


fair  and  of  good  quality. 


^     We  beticveV  hoover  I  that  none  of  these  purpoiee  i a  served  by 

Section  5  of  U.R.  4949  requiring  public  difcloeure? of  ell  teef  items. 

la  feet    diicloeure  of  items  used  on  stendar<liEed  tests  hes  many 

dieadvantages  (most  af  vhich  militate  against  the  students  them* 

selves)  which  far  outweigh  any  posaible  advantages.    In  some  cases, 

a  complete  sample  test  wi>h  instructions  and  explanations  of  coVr«ct 

anewets  is  provided  to  students  who  sign. up  to  take  the  test  and  study 

giiides  frequently  are  available  for  many  other  tests. 

Accurate  scoring  of  test  results  has  not  been  a  serious  problem 

*with  modern,  standardi«ed  tests*    The  number  of  checks  and.  balances 

in  cobputer-scored  tests  makes  errors  extrtoely  unlikely.  Furthermore, 

it  is  and  always  has  been  standard  practice  to  recheck  the  scoring  on 

a  test  when  doubts  or  disputes  arise.  . 
■  i  *  . 

Extensive  statistical  data  are  available  on  the  f elationsh^iD 

between  test  scores  and  the  achievement  that  they  are  in  tend  e<l||P  pre- 
dict.   This  infcwrroation  has  b^en  available  to  anyone  interested  from 
numerous  and  varied  Cources  Including  prublications  by  teat  developers, 
college  publications,  and  the  technical  journal  literature. 

Regarding "^the  consumers  need  to  know  that  test  items  are  fair  and 
of  good  xiuality,  we  btelieve  that  item  disclosure  will  work  against  the  I 
construction  and  use  of  such  items.    Quality  items  on  standardized  testaf 
take  months  and  even  years  to  develop  in  order  to  insure  that,  they  are. 
fair^  that  they  val idly  predict  future  performance,  and  that>;they  are 
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unajibif^uous.    To  diflcloee  eucli  f tenfi    f ter  every  administratidri  of  a 

teat:  eventually  could  rpault  in,  the  hasty  coriet^uctipn  of  new  i  tem^ 

'  •  •  /      '  •  •      •      -  • 

which,  in  all  probabilTty,  Would  be  Iobs  fair,  less  v«lid\ nfore  ainbi- 

};uou8,  and  generally  of  poorer  overall  quality*    Moreover,  the  effect  of 

disclosing  itejns  inevitably 'would  'result  in-  [ewer  services  provided  to- 

tne  student,    Kor  example,  the  Ci'aduate  Uecord  Examinat'ion.  now  is  given 

six  tiroes  a  year,  in  addition  to  speciat  adr.)ini  strations  for  handicapped 

^  .  •  ■     .  " 

iwrsons  and  tor  persons  wljose  religious  convictions  prevenf  their  taking 

teats  on  Saturdays,    buch  special  services  to  students  Could  be'  seriously 
■    ■  * 
curtailed, 

i\dditioiially,  we  wish. to  point  out  that  decisions  currently  require- 
inn  lest  scores  as  one  source  of  information  will .  continue  to  be  made, 
anci  if  tests  becjonie  less  reliable  and  less  valid,  then  (gore  subjective 
judgments  of  student  achievement  and  quali f ications  wi II  be  relied  upon. 
It  i  s  al-so  important  to.  realize  tffat  release  of  test  items  will  not. 
es8uaf>e  the  inequities  engendered  by  the  unequal  quali  ty  of  education. 

(lost  of  the  provisions  of  these  bills  appear  to  be  in  the  public 
interest,  and  the  Division  fully  supports  the  movement  toward  more  ac- 
countability in  testing  and  more  public  knowledp.e  refjardinR  how  test 
information  '^8  used.    At  the  same  time,  we  ask  the  ConjKe^perSons  in- 
volved to  consider  the  deleterious  effects  that  hastily  constructed, 
nonreusable  teats  will  have  on  all  students,  majority  and  minority  stu- 
dents alike,    we  believe  that  Btul^cnt8,  themselves  would  be  the  principal 
losers  . if  th(»  provisions  of  Section  5  of  .H.V.  A 949  were  to  become  law,^ 
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we' would,  of  course,  we-lcome  the  opportui|ty  'to  aid  you  in  any  way 
pbssible  toward.  iHprovements- in  these  bills      Please  lee  I  tree  to  contact 


eijther  of  the  undersisnea  to'  arran^  "  p,>eeti|R:  with  representatives  of 


the  Division  it  this  would  be  nelpful,. 


kobert  Claser,  |r«sider|t  | 
Division  of  liva:i^aMt>r»  MeaBure.nGnt 
American  Paythol^U  Association 


l,orrain«  Eyde,  SUV-retary-Tf e-nsurer 
Division  of  Uvaluation  and  Measurement 
Ameriiaft.  Psycholojt^^ical  Association 


Prepared  Statement  of  Wiluam  F,  Jk^j^soN,  D.V.M.,  President, 
<  ,  ^MERicAN  VeteriJ^arv  Medical  Association 

Die  American  Veterinary  Hedical  Association  has  reviewed  H.Ft^  3564-  and 
presents  the  following  conrosnts  for  the  record  of  hearings. 

♦     /  ■       ■     •  .  •     ..  ■ 

We  are  persuaded  most  strongly  that  testing  lea^ng  to  the  licensing 
and  cflrtifidation  of  professionals  should  remain^  a  p61^ce  poirer  of  the 
respective  states,  or  where  aMToprl^te  it  should  be  retained  by  the  organ- 
ized body  attenpting  to  raise  nie  cohfietency  leyel  of  the  practitioner  of  a 
discipline.    We  are  further  persua^d- that  occupational  groups  p0>viding 
testing  services  to.  the  various  state. ageh'cies  roust  relnaln  in  tJie  capacity 
of  service  and  advice,  with  final  a^t^ority  reserved  to  the  apjaopriate  state 
.agency  or  agencies 'charged  by  the  laws  of  that  state  with  the  ^spohsibility 
of  assessing  the  .competency  .of  candidates  for  llcensiyre,  certification,  or 
registration. 

Testing  for  cboj^tency  certification  within  the  various  professions 
(i.e.,  specialty  boards  and  colleges)  should  remain  a  function  of  the  diici* 
pline  .or  profession  involved  until  such  time  as  states  see  fit  to  require 
such  disciplines  or  professions  to  be  licensed  or  certified  \Lthin  the  police 
powers  of  the  states.    ^.        .  ■  . 

we  are  opposed  to  any  .legislation  which  yould  in  any  way  require  the  * 
public  di^c:^sure  of  the  eicamin^tion  items.    Mgny  valid  reasons  may  be     .  « 
presented  in  support  of  an  item  bank  that  prepares,  validates,  stores,  uses 
an^  analyses  test  it4ms  that  determine  the  knowledge  and  ability  necessary 
for  certification  of  an  individual  i^a  practice  a  profession.    We  believe 
that  the  eliaiinatioi)i  of  the  opportunity  to  continue  this  practice  would  have  . 
the  follot^ing  effects. 

1,  l€  would  markedly  increase  the  cost  of  creating  the  examination', 
and  this  cost  would  have  to  be  passed  on  to  the  examinee..  In 
small  professions  such  as  veterinary  medicine  and  the  smaller 

■  disciplines  within  it  (e.g.  veterinary  radiology,  etcw),  these— — 
costs  to  the  individual  would  be  extremely  high.  1 

2.  With  increased  costs,  the  nunft>er  of  times  an  examination  could  be 
administered  would  be  reduced.    Tills  would  ^rkedly  reduce  the 
opportunity  now  available  for  multiple  state  licensing  within  a 
reasonable  time  period  (e.g.  the  first  year  after  graduation)  . 
Tills  ability  to  be  licensed  in  several  states  presently  provides  \ 
for  much  greater  professional  mobility.    If  the  national  board 

.  examination  were  given  less  frequently,  this  pppprtunity  would  be. 
eliminated  or  greatX:^  reduced. 
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3.  Public  dlg<aoiuro  of  t«st  itmvm  would  tend  toward  the  ^evelopoent 
of  new '  teit  itene  which  would  have  a  tendency  to  move  toward  the 
trivldlf  end  thie  would  reduce  the  validity  of. the  examination. 
The  opportunity  to  teet  repeatedly  for  the  more  critical  knowledge 
and  skills  permits  a  mdre  reasonable  and  practical  test  which  will 
more  nearly  measure  the  knowledge  aAd  skiU  of  greatest  iin|>ortahce 
to  the  public  welfare.  ^ 

I  •  . 

4.  Publif^  disclosure  vhioh  would  weaken  and/or  eliminau  the  test 
Item  banks  would  have  a  significant  impact  on  small  but  .critical 
e|#as  ,of  knowledge  where  only  a  few  itei^ might  be  appropriate. 
PubUe  disclosure  of  such  items  would  pero^t  memorization  of  pat 
ansi^rs  father  than  demonstration  of  valid  understanding  and  know- 
ledge of  such  material. 

5.  Public  disc^sure  of  test  materials  Vould  have  an  inhibiting  effect . 
oh  the  development  of  new  testing  metlK>ds.    this  irt  of  great  concern, 
to  the  veterinary  medical  profession  im^jph  has  made,  significant 
progress  in  test  design  and  examination  ^roipedures  that  promise  to    '  ^' 
be  of  much  greater  accuracy,  in.  measuring  candidate  ability  and  skill. 

6.  Public  dieclosure  of  test  materials  would  eliminate  the  .opportunity  . 
to  use  such  teterials  for  the  certification  of  candidates  on  an 
individual  or  small  group  basis  since  new  tests  could  not  be  ^ 
developed  for  such  limiteB  Use.    Many  state  veterinary  medical 

t  practice  acts  now  provide  for  administering  individual  examinations  .  ' 

;    under  appropriate  conditions.    He  do  not  wish  to  deny  such  individuals 
this  opportunity  or  be  unable  to  meed  such  a  heed. 

In  sunmary^  we  believe  that  there  is  no  persuasive  need  for  federal 
legislation  in  the  area  of  occiqpational  certification  and  that«  in  fact «  this 
is  an  abrogation  of  state  ei^ihts.    Rather/  we  believe  that  legislation  written 
in  the  perceived  spirit  and  ^intent  of  H..R.  3654  would  have  a  markedly  disrt^tive. 
and  destructive  impact  on  stik^h  testing  within  and  f or  .  veterinaify  . medicine w 
Further,  we  are  of  the  opinion  that  the  candidates  for  such  examinations  are 
'  benefited  to  a  greater  degree  by  present  praotioes  than  would  be  the  case  if 
H.Ir.  3564  were  to  be  enacted.    We  request  that  all  those  having  aJDthprity  or 
pojwer.  to  influence  such  legislation  use  their  position  to  prevenjt^  the 
enjactmunt  of  H.R.  3564.       .  . 

  /  ■ 


Respectfully  submitted,  < 
American  Veterinary  Medical  Association 

William  F..  Jackson,  D.V.H.,  President 


IT 


ERLC    .  V 


1086 


B^w 


t^RKPARED  Statement  of  Alfred  B,  \Virxc()x,  Executive  Director, 

THE  MaTHEMATIC^  ASSOCIATION  OF  AMERICA  ^ 

^  Mr*  Chairman »  X  m  Allfred  B*  Wlllcox,  Executive  Director  of  the  Mathe- 
matical AaaoclatlDn  of  America  (MAA).  The  MAA  Is  an  organization  of.  18,500 
members,  the  largest  organisation  In  the  world. devoted  to  the  Improvement 
of  the  teaching^ and  content  of  collegiate  mathtoatlcs*  Oar  members  Include 
persons  at 'all  levels  and  In  all  branches  of  the  mathen^tlcal  sciences^  but 
the  ^ackbone  of  our  membershp  consists  of  fsculty  in  our  nation's  ^,500  college 
iste  anfl  university  departments  in  the  mathematical .self nces. 

The  officers  of  the  Mathematical  Assoclii^lon  of  America  have  recently 
approved  on  behalf  of  all  of  our  members  the  following  ststenent,  which  has 
been  sent  with  minor  editorial  changes  to  the  members  of  your  A:ommltteer 

H.R>.4949 

H.R.  4949,  the  Weiss  Bill,  cslls  for  full  disclosure  oT  all 
standardised  tests  -  all  questiona  on  each  teat,  together  with 
-  the  correct  answera* 

The  bill  is  introduced  Iti  the  name  of  consumerism,  but  It 
.  is  certain  to  lead  to  Increased  costs  to  the  consumer  and.  to      .  ^ 
deterioration  In  the  quality, of  the  tests. 

Costs  will  rise  becauo  coaproialsed  tests  will  hav^  to  be  ^ 
replaced  after  each  teat  administration* 

■   » ■ 

Quality  will  deteriorate  because  it  will  no  longer  be  pos- 
sible to  Standardize  tests.  Standai^lzstlon  Is  sccomplished  by 
repeating  selected  test  questions  to  compsre  different  forms  of     .  ^  . 

a  test  ahd  different  test  populations,  a  practice  that  will  clear- 
ly not  be  possible  unde1^  the  disclosure  i^equlrement. 
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•  Thu»  the  Wtlas  Bill  will"  leid' to  more  expensive  "staitdatd- 
'*  ..  tied*'  teiti^hat  hive  no  itendardt;  .  '  '  ' 

For  theie  and  other  raaaona,  the  offlcera  of  the  Mathematical  . 
Aaaoclatlon  of  America  atrohgly  oppose  H.R.  4949  and  respect- 
fully urge  Its  defeat*  ^  ,  • 

Thl«  Statement  stands  alone,  and  It  auanarlzea  the  position  of  the  Maihe- 
ftaticsl  Association  of  Anerlce  on  HiR.  4949.   -However,  such  s  brief  position 
•Utaaant  nacessarlly.  onlts  aost  of  the  subtle  Issuaa  In  the  proposed  leglala-  • 
tion.    To  undaratand  our  poaltioo  fully  and  ,to  recognize  the  moat  serlouv  flaws 
in- H.R.  4949  one  nuat  undaratand  theee  laauea. 

In  thla  t'eatinony  I  will  amplify  the  above  etatenenf  In  order  to  explain 
■ore  fully  why  ve.  feel  that  the  Vela a  bill  would,  In  the  long  run,  decrease 
accesa  to  education  by  deaervlng  American  youth  and  be  detrimental  In.  many  ways 
tb  education  in  the  United  Statiea.  .  *  . 

Standardized  teatlng,  In  tlif  form  we  know  It  In  the  United  Statea  through 
aiich  testing  progr«»a  aa  thoae  of.  CEEB  and  ACT*;  came  of  age  after  World  War  II 
•In  reaponae  to  the  drive  to  open  post  seTpondary  school  education  to  all  qual- 
ified atudeflta.   Colleges  and  unlveraltlea  auddenly  faced  aerloua  problems  In 
•valuatlng  the  apptltudaa  and  training  of  vaat  meabera  of  high  achdol  graduates 
^ing  for  a  limited  number  of  college  openings.    Difficult  choices  had  to  be 
■adt  awjng  appllcanta  on  the  baala  of  akatchyand  unreliable  Information.  High 
achool  gradea  from  thousands  6f  high  scrfola  spread  over  the  entire  geographical 
and  aoclo-economlc  apeotra  were  almost  Le.less  credentlala  for  deciding  which 
applicartta  were,  more  qualified  and  at  wiiat  level  a^aucceasful  candidate  could 
■oat  efficiently  begin  atudying  in  a  local  curriculum.    Colleges  and  MnlverBltlefl . 
faced  difficult  problema  in  deiigrting  their  curricula  to  fit  the  needs  of  the 
*  American  atudent  and  in.advifllng  aehoola  how  to  train  their  students  better 
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for  entering' Int^  the  college  curriculum.  ' 

The  opening  of  post  secondary  education  at  all  universities  to. all  stu- 
dentSy  without  geographic  or  soclo-econooilc  restrictions*  ^ade  It  absolutely  - 
..necessary  that  sone  norms  be  established  to  measure  both  secondary  and  post 
secondary  education.  * 

^undardlzed  .testing  programa  Vere  developed  to  provide  the  ojily  dala  ^ 
for  evaluating  aptitude  and  training  that  could  span  both  populations  and  tine. 
The  Infornatlon  provided  by  such  tests  as  the  SAT  and  ACT  tests  provided  one 
data  codponenty  to  be  added  to  the  other  conponents  provided  by  school  trans- 
cripts^  recoonendatiohs.  Interviews*  and  anecdotal  evidence  of. special  talents, 
that  helped  colleges  select,  helped  students  know  where* to  begin,  and  helped 
educational  Institutions  coordinate  their  curricula. 

Without  standardized  tests,  our  educational  system  would  ^Ickly  drift 
back  toward  the  elitist  European  atyle  In  which  pedigree  ai\d  position  pren 
determine  educstlonal  opportunity,  f  * 

We  recognize  the  dangers  inherent  In  any  large  scAle  testing  program 
which  is  conducted  In  great  secrecy  and  which  can  ddterolne  or  strdngly  In- 
fluence future  educational  and  economic  opportunities!  for  Individuals.  Howt- 
ever,  this  description  doea  'not  fit  the  standardized  testing  programs  In  the 
United  Stlite^st  sil.    Both  CBBB  and  ACT  have  isade  ^ver^  effort  to  disclose 


as  much  aboOt  their  tests  and  about  the  grading  and  ^scoring  procedures  as  Is  ^ 
poaslbU  within  the  miivln^  constraints  of  standardisation.    Colleges  and  uni^ 
varsltisa  have  learned  to  use  reaults  of  thesa  testa  as  one 'data-point  among 
many  in  taking  admissions  and  placement  decisions.    No  institution  we  know 
illovs  a  high  SAT  acore  to  guarantee  admisslpn  or  a  Ipw  one  to  deny  admi salon 
when  contrary  information  la  available.    And  colleges  and  universities  have  not 
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dl«lnlih«<J  th«if  •ffort«  f<9  tind  n«w  tourcM  of  Information  about  appllptarits 
becauM  of  iht  availability  of  atandardlied  teat  data*    In  abort,  we  believe 
•  tbat  tbt  avlla  attributed  to  atand^rdlaied  teata  by  opponenta  of  theae  programa 
'  ara  lUuaory..  ^    ^         .  ^ 

Standardised  taata  ar%  ndt  only  benl^,  thay  are  vital  national  educa- 
tlooal  reaourcaa.    I  have  argued  Ala  In  the  hlatorlcal  coiwen^a  above.    Ut  - 
.  '-m  now  give  an  ckaapla  of  curra^  intaraat.    I  haa  been  evident  to  college 
and  unlveralty  teachera  (a«)n/othera)  ever  elnce  the  turbuletit  eo'e  that 
aoMthlng  profound  and  dlaturblng  via  happening  to  the  a^rademlc  q^uallf Ica- 
tXona  of  Incoming  freahmen.,    ClaBaroom  teachera  have  been  relating  anecdo- 
tal evidence  of  a  decline  In  the  apparent  ability  of  entering  etudenta  for 
.over  a  decade.    But  the  evidence  vaa  local,  or  at  leaet  locally  observed. 
The  first  reaction  of  an  Individual  teacher  or  an  Individual  department  to 
the  perceived  decline  in  aftudent  ability  waa'to  suapect  that  unlvetslty. 
•tahdards  ^st  be  creeping  up.    Teachera  wondered  yhether  they  were  grad- 
ually eVectln$  too.^ch  of  their  "etudenta;  deana,  alarmed  at  ^eprasslng  grade 
'    atatlatlca  and  incraaaed  fsllure  ratee,  preaaured  academic  deparOoenta  to  mind 

their  grading  atandarda;  aUo|ancea  were  made  to  reatore  the  familiar  bell  . 
'     curva  to  Ita  normal  poaitlon.    There  waa  no  natlbnal  conaehaus  to  ease  grading 
.  et^l^rda.    There  were  only  thouaanda  of  Individual  adjuatmenta  made  con- 
'  cloOaly  or  sub^concloualy  to  meet  trenda  which  were  felt  but  only  dimly  per-\ 
celvad.    The  net  effect  waa  aa  amooth  e  national  program  of  grade  Inflation 
atf  could  have.been  orcheatrated  by  the  pipat  efficient  and  Influential  Educa- 
tional Coomlas.lon.  .   ^  ^  1 

Then  It  waa  noticed  that  SAT  aco'rea  had  been  declining  for  quite,  a  num- 
ba/of  yeara.    This  observation  flrat  announced  the  possibility  that  j  i or. what 
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ever  cotDplcx  reaflions,  the  level  of  training  and  ability  of  entering  college 
•fcudenta  was  in  a  real  decline.    A  flurry  of  statiatlcal  research  on  trends  . 
.over- time  and  acfote  populations  (male/female •  black/white,  urban/rural.  .  .  ). 
and  a  cacaphony  of  discuaaion  and  debate  e)cploded  on  our  nation^    Some  In- 
aig^hta  on  'trenda  in  our  educational  ayatea  and  in  our  society  have  emerged. 
Aaong  other  thiagai-we  apddenly  recognized  rampant  grade  inflation  for  what  it 
vas.    Standards  have  begun  to  be  tightened.    Sotoe  basic  changea  iti  both  aecon- 
^dary' and  poa(  secondary  education  are  being  nade  to  reverse  a  trend  that,  once 
recognised,  vaa  frightening. 

The  point  of  this  anecdote  is  that  it  was  precisely  the  testing  prograraa 
that  had  beeA  in  place  for  more  than  twenty  years /involving  tests  that  were 
carefully  equated  over  tiae  and  population,  that ^enabled  us  to  see  cleatly  a 
trend  th^t  was  invisible  in  our  day-.to-^day  academic  experience.    The  tests 
did  not  Inmediately  reveal  the  nature  of  the  trend,  nor  did  they  provide  ^ 
solutions  to  the  problen.    But  they  were  a  vital  data  aource  -  an  important 
national  resource  -  that  served  pur  nation  we]ll  in  a  criais. 

What  does  this  have  to  say  about  the  Weiss  Bill?    The  answer  is  clear 

when  one  realizes  that  one  re$urt  of  Q.R.  4949,  poasibly   not  foreseen  by  its 

■   1  ■ 

authors  and  supporters,  would  ouike  it  virtually  impossible  to  standardize 
tests.    S.uch  standardization,  called  "equating,"  involves  comparing  different 
populationa  of  teat-takera  by  atudying  how  they  perform  on  aelected  test  items 
which  must  be  repeated  in  the  administ ration  of  the  tests  to  these  populations. 
If  the  test  populations  being  compared  exist  at  different  times  then  this  in- 
volver  repeating  test  questions  at  diffe/*ent  times,  often  many  tines  ov^r  a.. 

period  of  years.  ^This  would  clearly  be  impoasible  if  all  (eat  questions 

■  ^  ■ 

were  made  public  a^ter  each  test  admin is t rat Ion.  ■ 


^thout  atahdftedUatlon  of  testa  ttudeo'tfl  would  again  be  prisoners  of. 
Class  I  location,  and  time.    Colleges  and  universities  would  once  again  be 
forced  to  rely  on  established  "old-boy"  networks  glvlti^S>"^^erence  to  prepa- 
ratory achoola  whose  prograns  are  well  ktiown  to  the  Individual  admissions 
offlca.ra  and  ualng  oth^  tried  and  true  but  reatrlctlve  screening  devices. 
Aaerlcan  education  cbuld^be  aet  4>ack  thirty  years  by  the  removal  of  stan-; 
dards  from  at^dardlzsd  teata« 

'    As  we  all  know,  the  State  of  New  York  has  passed  a  "Truth  In  Testing". law 
which  requires  disclosure  of  standardized  tcata,    It  Is  legit las te.  to  ask  why, 
In  the  light  of  the  arguisenta  presented  above,  the  8AT*s,  the  Graduate  Record 
Examai  and.  other  atandardlzed  tmats  will  be  continued  in  New  York.    The  answer 
Ilea  In  the  fact  thst  the  Neiw  York  law  apeclflcally  exem|(ts  certain  types  of  * 
tea(s  <e.'g«  the  CEEB  achievement  tests)  siid  certain  parts  of  othier  tests  (the 
equating  sections  of  SAT's)  fro»  the  disclosure  reqnlrement.    Without  these  ex- 
eaptlonsi  sU  of  tbsse  testa  would  bis  frozen  out  of.  New  York  Stste  entirely 
and  Nf w  York  students  would  be  placed* at  a'dlstlnct  disadvantage,  via  a  vis 
their  counterparty  In  the  rest  of  the  nation;  tn  admission  to  colleges,  univer- 
sities, and  professional  schools.  ^ 
^      In  factr  aeversl  testing  organisational  specifically  those  offering  tests 
used  for  admission  to  law  snd  medical  schools, have  announced  thSt  their  tests 
will  henceforth  not  be  given  In  New  York,    These^  tests,'  like  many  others,  are  ol 
the  type  for  which  equating  is  not  poaalble  by  means  of  special  "non^-operafclon^ 
aectlona  apeclf Icall/ exeapted  by  the  New  York  law. 

Thla  aervea  to  Illustrate  the  havoc  that  can  be  csused  by  a  haatlly  con- 
^atructed  disclosure  law,  no  matter  how  good' the  .Intentions  of  the  framers. 

In  lyimSllApt  font  the  Weiss  bill  contains  a  disclosure  requirement  pat- 
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tetned  after*  but'nore  Incluslvei  Chan  the  requirement  in  the  New  York  law. 

It  would  thtr^tfore  be  a  fav  aore  sqrioudf  blow  to  standardized  testing.    But  Che* 

■■■ '     ■■  .  ■     -u  ■ 

fact  that  SAT's  and  GRE'a  could  be  saved  in  New  Yorkjnly  by  the  specific  ex- 
clusidn  of  t^hese  pfirticular 'tests  is  ^dequate.^testitnony  that  the  operative  dis- 
closure provisiotis  ate  poorly  conceived.    Already  we  are  learning  of  other  tests 
that  sHouXd  have  bean  excluded.  -  .Hoif  are  the"  citizens  of  New  York'  to  know  what 
other^  tasting  prograaa,  jtreseot  or  future,  idtll  be  crippled  or  aadfe. Impossible  ' 
by  the  indi^crlmlxiate  .requifrenent«  of  disclosure.    Eiipanded.to  a  national  level  .. 
such,  a  blow  to  a  major  educational  res6urce  would  be  c.atastrophic.  «  ' 

In  testimony  to  your  coraaitteej  others  , have  described  additional  ways  in 
which  the  Weiss  Bill  would  harn  education  in  the  United  States.    Others  have  des^ 
crlbed  the  strong  efforts  of  testing  organizations  to '^sc lose  as  much  infor-^  c 
nation  about^tests  and  testing  procedures  as  possible  within -.the  constraints  of  * 

A.' 

Standardization.    Still  others  have  delcribed  Jthe  strong  efforts  of  the  educa- 
tional coonunity*  through  such  organizations  as  the  American  Council  on  Educa- 
tion, to  review  apd  evaluate  all  standardized  testing  programs  ii^he  light 
of  present-day  concerns  (which  wo^  all  agi^ee  are  quite  valid  In^ our  free  demo- 
cratic  society).    We  wish  only  to  add  oUr  strong  plea  that  the  disclosure 

\  ■        ■     *  ■     ■  .  . 

clause  in  the  Weiss  Bill  not  be  allowed  to  beco^l%  laW.    This  is  why  we  oppose 
the  Weiss  Bill,    tf  It  is  defeated  then  weTcan  perhaps  consider  other  legis- 
lation incorporating  somef  of  the  beneficial  aspects  of  H.R.  A9.49  and  H.R.  3564. 

Thank  you  fqr  your  careful  consideration  of  our  concerns  and  for  all  of  your 
efforflftito  inprove  adu'cational  opportunities  for  the  youth  of  o^tr  nation. 
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PiffipARED  Statement  OF  Jack  J,  Stocktox^IXV^ 
.  AsspOJ^i^oir  OF  American  Veteri^^ary  MFj)rcAL  Colleges  .  i 

.  '*StiandardlMd'*  fxaminatlofui  arf  glvtn  for  a  nunb«r  of  r^ajions.    A  few 
ot  ihm  vety  liB|»ribai>t  oniss  arat    U)  to  establish  "norms*'  and  Identify 
'th6se  who,  for  irhatayer  reason,        at  the  extremes}  (2)  to  provide  some 
•  long-^terin  an<|l  continuing  basls^or  coiqparlsoni  which  may  be  useful  In  .  < 

evaluating  the  total  systemy  /s)  £o  Identify  "areas'*  of  strength  and  weak- 
*     ness  In  the  eicanlnees  both  Individually  and- collectlvelyi  and  (4).  to  pro- 
vide another*  element  in  thia/prooesn  used  for  selection.    Admissions  groups 
need'  all  the  help  they  easy  get  in  making  sound  judgmsnts  on  selections  to  ' 
highly  coeipetsitlva  progr^i  and  licensing  boards  must  determine  competency 
to  perform  ahd  render  rpdlable  services  to  the .  consuming  public.    In  a  • 
purely  academic  settlfig,  the  educational  value  of  prpviding  feedback  on  . 
examinations  has  prp^nents  iihd  opponents,  but  in  that  setting  there  la  . 
.  general -recognition  that  such  proeeduj^es  do  have  educational  value*  How-' 
.  ever  "Standardii^d  Testing**  as  currently  conducted^  whether  It  be  for  entry  y. 
td  the  university  or  f6r  professional,  lioensure  divisions/  has  different  ' 
objectives.    The  state,  and  national  diw^flsioni  of  these  examinations  also 
imiply  an  entirely  different  set  of  ciroumsta^s  than  that  for  an  examina- 
tion in  a  given  course  in  a  given  educational  institutioA,  and  detailed  .  ' 
feedba(d(  is  not  essential*  ^  • 

Specifically, 'the  Association  of  American  veterinary  Hedical  Colleges  - 
'  speaks  against  th$  proposed  legislation  because  i  ^    «    '  ^ 

(1)  We  are  not  convinced  that  such  proposals  would  solve  any  ills  , 
that  are  perceived  as  currently  existing.    In  fact,  such  legis-      '    *  . 
lation  woul'd  be  complicating  and  counterproductive  to  the  overall  ^ 
obtlectivas  of  standar'dized  testing  as  currently  practiced.  .      '  ^ 

(2)  The  body  of  knowledge  is  extensive  and  sampiina  is  essential. 
.  As  major  and  in^rtant  concepts  are  tested  forlln  examinations, 

^  *  new  test  items  would  tend  toward  the  trivial  ii  questions  and  '  , 
answers  iiere  routinely  pubXlishedi  ^- 

ii)    Flexibility  ^uld  be  greatly  reduced.    Students  now  have  an 

opportunity  to  take  a  nunber  of  examinations  in  varied  locations 
\%  various  times.    For  example,  the  Veterinary  Aptitude.  Test 
(VAT)  is  currently  pf fared  5  times  per  year.    There  vould  be  a 
move^to  many  fewer  offerings  per  year  and  in  the  instance  of  VAT 
•  a.       probably  to  once  per  year» 

-^""-^  ii*wt  the  AW^I ^thi      ^  ^r-,r-^.-x->^.v 

groi5).  affected.    For  exasple,  most  high  school  students  in  the 
Onited  States  take  the  SAT  and/or  ACT  Test,  afl  there  is  a 
« relatively  low  deHlopment  cost,  per  student  as  coft^ar^d  with 
those  tests  for  many,  many  fewer  examinees,  e.gi,  human  medicine 
and  MCAT  and  veterinary  mediolQe  and  VAT'-where  the  development  . 
cbst^would  increafie  significantly.,/ 
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($)    Thtrt  vould  btt  a  grfat  wasta  of  professional  tima  In  tha 
v'.     radundanoy  of  naw  ajcamination  ponstruotion,  detracting  from. 

the  ability  to  evaluate,  analyse,  and  inqpijove.  f  .. 

,     (6)    The  tendency  to  produce  a  ^levelling  effect"  in  test  performance 
i*  a  grave  concern,  since  the  advantages  of  innate  ability  and 
• .  concerted  study  effort  oh  a  broad  front  would  tend  to  be  negated. 

Fairness,  objectivity,  an<i  oapric^iousness  are  not  in  contention  as 
these  are  fundamental  and  obvious  concerns  of  society*    Examinees  need  to 
know  the  nature  and  use  of  examinations  and  to  be  assured  that  test  scores 
accurately  reflect  performance*    Feedback  on  areas  of  strength  and  weakness 
should  be  available*    We  b«Ueve  testing  services  are  sensitive  to  these 
batters  and  are  not  just  the  money-mongers  some  try  to  make  them  out  to  be. 
However,  the  profit  motive  is  as  real  in  providing  services  as  it  is  in 
selling  hard  merchandiipe,  and  the  free  enterprise  system,  if  it  is  to  obtain, 
cannot  be  battered  and  beat  by  the  very  hand  that  it  feeds* 

Evaluation  is  as  fundamental  to  the  educational  system  as  the  jury  is 
to  the  judicial  eystem*    An  examinatioh,  which  is  an  evaluaUon  device,  is 
•       an  exercise  to  determine  a  person's  knowledge,  ability,  and  qualifications 
in  a  prescribed  area  idiiph  may  be  rather  broad  or  rather-  limited  in  scope. 
If  a  person  has  bdth  the  questions  or  probleme  and  the  answe^,  there  is  in 
effect  no  examination,  and  the  fundamental  objective  of  the  Whole  process- 
evaluation— is  negated.    That  the  system  is  imperfect  is  recognised  and 
admitted,  but'  so  is  the  political  system,  the  judicial  system,  or  any  other 
system  devi^d  by  imperfect  people.    9efore  the  system  is  radically  manipu- 
lated it  should  be  understood  as  it  is  being  used  and  with  the  full  recogni- 
tion of  what  radical  changes  will  acconplish*  * 

t  .   ■  : 

°  ^  *•  participants  tod  educiaitors  in  a  health  profession  fields  we  si?>port 

the  concept  of  standardised  testing.    Concurrently  it  should  be  enc^hasised 
;  that  such  tests  are  not  the  only  criterion^  used  in  arriving  at  judgment 

decieions  which  must  be  made*    Rather,  test  results  are  conbined  with  other 
.  academic  and  sociological  data  to  provide  a  bMadth  of  input  in  helping  to 
evaluate  ability  and  motivatloft.    Discriminating  elements  need  to  be  honed 
and  refined  and  not  blunted  or  made  moire  diffuse* 

The  Association  Of  American  Veterinary  Medical  Colleges  can  see  no 
^  :benefit  to  students,  the  general  pjUJlic,  educational  insUtutlons,  or  the 

educational  testing'* industry"  from  these  bills,  and  we  Action  whether 
the  bills  would  have  t|ie  effects  claiUwd  by  their  t^qe^nents*    We  believe 
it  ie  neoessairy  to  reject  ^ese  bil^ia  order  to  pifeJerve  the  systems  of 
-NN^V^V-v?^!!,!^^^  a^i*,i^«;^^^  ^i^^!l^^•^^*yv  now  *^i«t • 


Respectfully  submitted. 

Association  of  American  Veterinary      '    #  | 
Medical  Colleges 


Jack  J*  Stockton f  D*V*M*,  ^residen^ 


\ 


.•  ■     ;  ;    .       :•    ■  ■  ■.   .      .  .» 
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Prepared  Statement  of  the  National  Council  oj*  Ai^ciiiTEOTtmAii 
i  :  Registration  O^oards 

1,    Th«  National  Council  of  Architectural  Registration  Boardf  - 
.;.Th»  National  Council  of  Architectural  Registration  Boards  (NCARB)  Is  a 
non-profit  corporation  whos^^^lfly  members  are  the  architectural  regis- 
tration boards  of  the  fifty  states,  the  District  of  Columbia,  Puerto 
!lioo#  Guam  and  the  Virgin  Islands,   'NCARBVs  principal  functions  are  to 
foater  uniformity  of  laws  relating  to  the  regulation  of  architectural    .  .• 
ragd^stration  and  praotioe  ir^  order  tcT^facilltate  the  free  flow  of  pro- 
fttasional  practice  in  interstate  commerce •    Its ^activiti^s  are  more 
tully  described  in  .  the  Appendix  at4:aot)ed  and  entltledT^^Hpw  Architectural 
Registration  Boards  Work  Together,"     '         .        1  /^^.^  ^  . 

2. ,  The  Architectural  yicensinq  Examination^  -    The  States  art^ 
.  Territories  \thpuB  architectural  regis tratlon  boards  comprise  NCARB  have, 

beginning  in  1897|  all  enacted,  statuteis  regulati<ng,  the  practice  of  \ 

architecture  and  creating  the  state  registration  boards  to  enforce  tife  .» 

respective  #tate  -laws.    Common  to  the  registration  procedures  of  all  "of  • 
.  the  States  and  Territories,  is  the  raquirement  that  all  candidates  for' 

architectural  registration  pass  faertain  licensing,  examinations  which  ar^  now 
'  prepared  by  NCARB  with  state  board  participatioh  and  are  adopted  for  \Ii8e 

by  all  state  boards #  a  process  which  has  been  judicially  recognized  and  ^ 
«    approved*    Henkes  v.  Fisher;  314  F,  Supp.  101  (1970)  ,  aff 'd. ,  400  US^^* 

985  ~       .    "  m 

The  Professional-  Exadd nation  consists  of  two  parts,    tart  A  is  . 
a  design  examination  requiring  candidates  to  demonstrate  their  competence 
to  produce  a  graphic  solution  to  ah  architectural  design  problem.    Part  B 
.  is  a  two-day,  X6'*hour  multiple  choice 'examination  which  poses  to  the  can- 
didate actual  architectural  practice  situations  in  which  his  or  her 
abilities  to  exercise  value  judgments  ate  «tested  and  evaluated.    This  . 
examination  is  given  in  four  sessions  ^vering  the  following  filelds  in 
the  context  of  a  specific  building  project:  ^       ^;  , 

•  , ^  (a)    environmental  analysis  -  covering  the  natural  and  manmade 

surroundings,  relevant  laws,  and  the  commu>iity  setting;  , 

(b)    architectural  programming  -:  covering  overall  planning  of' 
the  project; 

^  (c)    d^esiyi  and  technology  -  covering  detailed  design  of  the 

project;  ana 

(d)    construction  -  covering  contract  administration,  construe- 
^  tlon  manfl^gement,  construction  methods,  and  materials.' 

Ci^fidi^ates  must  achieve  a  minimum*  score  on*  each  of  the  four  parts  in  order  i 


to.  pass. 

• 


i 
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Candidates  without  an  accredited  degree  are  also  required  to 
take  the  Qualifying  Test,  a  two-part  22-hour  examination  divided  into  ^ 
the  following  sections:  architectural  History;  structural  techhQ):ogy; 
ipaterials  and  methods  of  TJonstruction;  environmental  control  systems; 
and  principles  of  site  planning  and  architectural  design.  All  sections 
^are  multip3.e  choice.  As  with  the  Professional  Examination,  a  minimum 
score  for^aqh  separate  ^?irt  must  be  attained.  > 

Through- NCARB,  the  content  of  these  exams  is  reviewed  con- 
tinuously by  representatives  of  boards  around. the  country.  Educational 
Testing  Services  of  Princeton, .  New  Jersey,  serves  as  testing  consultants. 
i;i  1977  an  independent  panel  of  internationally,  recognized  architects 
in  practice  and  in  education  reviewed  the  objectives  of  the  Professional 
Examination  in  order  to  verify  that  the  examination  was  reasonably  related  . 
to  the  areas  of  knowledge,  skill  and  aljility  being  tested..  This  process 
will  be  repeated  periodically  to  ensure  that  the  examinations  do  their 
job.       .  V  . 

Part  B  of  the  Professional  Exam  is  written  by  the  members  of 
NCARB*s  Professional  Examination  Committee.    For  the  most  part,  the 
exam  writers  are  practicing  architects;  a  few  of  them  are  pducators. 
Nearlv  all  are  drawn  from  the  NCARB's  member  registration  boards,  with 
geographic  representation  through  the  country. 

«       About  30  architects  serve  as  e)^am  writers  each  year.    They  work 
without  compensation  under  the  'supervision  of  a  Chairman  and  four  • 
Coordinators.     A  coordinator  directs  the  wdr4t.of  seven  or  isight  exam 
writers  on  each  of  the  four  parts  which  comprise  the  Professional  Exam. 
The  NCARB  fixaminiticms. are  more  fully  described  in  the  attached  Appendix 
entitled,  "^The  NCATIB  Examinations — A^ Summary  Report  of.  Their  Preparation 
and  Si^tting  ot  Passing  Scores." 

3,     H.R.3564  -  NCARB  urg^s  that  H.R.3564  be  given  unfavorable  action 
by  the  .Congress.     H.R.3564,  a^jdll  introduced  by  Congressman.  Gibbons  of 
Florida,. "To  Require  All  Educational  Admissions  Testing  Conducted  Through 
Interstate  Commerce,  and  Al^  Occupational  Admissions  Testing  (Wh%h 
Affects  Commerce)  to  be  Conducted  With  Sufficient  Notice  of  Test  Subject 
Matter  and  Test  Results,  and  for  Other  Purposes,"  is  flawed  in  three 
basic  respects:     first,  it  establishes  federal' jurisdiction  over  the  ' 
entire  range  of  all  occupational  licensing  which  heretofore  has  been  a 
local  matter  left  to  the  individual  states;  second ^  it  establishes  federal 
ocCUD{\tional  licensing  policies  (and  the  precedent  for  such  policies) .and 
oust*:  the  states  from  enforcing  inconsistent  or  contradictory  occupational' 
licensing  jpolicie?;  and  third,  as  with  nearly  all  sweeping  declarations 
of  broad  jprinciples,  this  particular'  bill  establishes  requirements  which 
are  ambiguous  and  di'fficult  to  properly  administer  and  which  invite  need- 
less and  disruptive,  litigation  on  "the  .part  of  disappointed  Candidates  for 
architectural  licenses  —  of  whom  there  will  always  be  some.- 
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Cregtlhq  M^ederal  jurisdiction  oviar  occupational  lloenislng 
is'  tonwiset 


.  .  .- .      SincA  th«-MF^]ky-day8 -of- ^e-Reptibllbf  It  haft  kfeen^  a  recognized 
.and  accepted  function  pf  state  governments ■ to  regulate  activities  which ^ 
even  though  formally  private  In  nature,  nonetheless  affect  the  public 
health,  safety -or  welfare.    One.  aspect  of  thle  ro]|k  has  been  the  regula-  \ 
tlon  of  the  prof  essl(dn8,  who86.  members' are^iK>perlp  considered  to  have  . 
J  special  responsibilities  to  th<^  public  as  well  as  to  the  Individuals 
m  receiving  services*    The  essential  ratlon.a]^  and  standard  for  such 
rsgulatioA- was  aet  forth  by  the  U.S.  Supreme  Court  in  Dent  v«  West 
Vlrciinia,  129  US  114,  122  (1889)  ,  when  the  Cour^t  saids 

.  *    The  power  of  the  state  to  provide  for  the  gsl^al  welfare 
of  its  people  authorizes  it  to  prescribe  all  suoh  regulations 
aS,  in  its  judgment,  will  Secure  Or  tend  to  secure  them,  against 
the  consequences  of  ignorance  and  Incapacity  as  well  as  of 
deception  and  fraud.    As  one  means  to  this  end  it  has  been  the 
practice  of  different  States,  from  tliroe  immemorial,  to  exact  in 
many  pursuits  a  certain  .degree  of  skill  and  learning  upon  which - 
the  community  may  confidently  rely,  their  possession  being 
-  generally  ascertained  UDon'  an  examination  of  parties  .by  competent 

*    persons,  or  inferred  frSkn  a  certifidi^te  to  them  in  th6  form  of  a 
diploma,  or  license  from  .an  institution,  e stab 11 ebed  for  instruc- 
'  tlon  on  the  subjects,  scientific  and  €therwiae,  with  which  such 

pursuits  hAVe  to  deal.    The  nature  and  exftent  of  the  qualifications 
'  required  must  depend  primarily  upon  the  judgment  of.  the  State  as 
^  ,  -    to  their  necessity.  * 

.  NCARB  does  not  know  all  of  the  ocoupations  for  which  all  of  the  states 
Tidw  administsr  somt  form  of  ^aptitude  or  achievement  examination,  whether > 
Vritten  or  oral,  and  [including]         objective  multiple  choice,  macfhine. 
scolded,* essay,  practical,  performance,  or  demonstration  examinations^ —  '/ 
the  definition  of  an  bbcupational  admissions  "^test"  to  which  H«R.  3564 
•  applie^.    He  suspect,  however,  that  the  list  As  nearly  endless,  and 

•  growing  each  year.    The  precedent  established  by  enactment  of  this  bill 
would  therefor  extend  federal  jurisdiction  in  a  massive  reach  over  a 
multitude  of  professions »  occupations  and  trades.  .  I 

We  do  not  hold  any  particular  brief  for  this  qrowing  list  of  recjfU- 
late d  occupations,  and  believe  in  each  itistance: ^(before  subjecting  an 
occupation  to  requlation)  that  th^  states  should  answer  the- twin  questions 
of  how  such  regulation,  will  protect  the  consumers  of  services  rendered 
by  the  practitioners,  and  how  such  regulation  will  protect  the  public  at 
large,    we  believe  that  in  the  case  of  architectural  practice,  appro-  . 
priate  regulation  both  protects  consumers  who  might^  otherwise  be  vie-  ( 
timized  and  the  public  whq  might  otherwise  be  injured.  '  . 

}        But  the  particular  standards,  including  testing  standards,  which  can 
most  effectively  protect  the  public  interest  is  a  matter  far  better  left  - 

•  with  the  states.    'Establishina  stan4ard8  for  entry  into  professions  and 
occupations  is  a  subject  particularly  appropriate  for  exercise  of  the 
states'  traditional  police  (>owers.    The  diversity  of  different  regions* 
needs  and  the  differing  perceptions  of  the  public  interest,  can  better  be 
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accommodated  at  the  stated  level.    On  the  other  hand,  establishing 
Uniform  federal-  standards  regulating  occupational  entr^*  seems  almost 
pertain  to  require  that /there  be  a  single  vj,ew  of  the  public  interest 
'^hat  submerges  the  different  regional  need^^nd  the  perceptions  of 
^  people  in  a  given  loca^'ity*  ■ 

■'  •'B.     The  new  fedei^al  jurisdiction  VQuld. supplant  state  jurisdiction 
over  subject/matter  now  regulated.  [     \  '  '.  ^ 

H.R. 3564  addresses  two  subject. matter  areas «  one       education  testing 
not  now  generally  su|:}ject  to  any  gov^rniw^l.  rd^ulation,  and  the  other  — . 
occupational  testing       presently  subjeq|Hp -extensive  governmental  regu- 
lations.   For  all  of  the  reasons  mentioneu^lsewhere,  we  question  the  wis- 
dom of.  this  bill,  but  Jlf  the  Congress  feel  that  there  is  sufficient  need 
uAa 


to  broaden  federal 
that  it  jgive  prima 
regulation. 


Lsdiction  'testing  generally,  we  suggest 
attention  to  such  testing  as  is  now  subject  to  no 


Architectural  liqensin'g  tests  are  clearly  covered  by  this  bill;,  and 
they  are  now  the  subject  of  state  law  in  all  the  states.    This  bill  is 
not  merely  bad  precedent.^  at  least  in  two  respects  it  could  supplant 
inconsistent  state  law  policies.     In  Sec,  6  ^a)  (3) ,  the  bill  requires  that 
each  applicant  be]  provided  with  a  written 'notice  containing  "the  margin 
>o.f  error  or  the  crxtent  of  reliability  of-  the  test,  determined  on  the 
basis  of  experimental  uses.**    Passing  the  ambiguity  of  this  mandatory 
•    requirement,  it  appears  at  the  least  to  require  ,that  all  occupational 
/  i    tests  be  verified  in  %ome  manner  in  terms  of  their  ability  to  predict 

or  measure  knowledge  or  aptitude.     And  being  mandatory,  If  an  architectural 
registration  bpard  had  not  Verified  this  by  ^experimental  usage  —  and  it 
is  unclear  hoW  experimental  usagie  of  different  yearly  tests— could  -so 
verify  —  then  ijt  could  not  give  notice  of  this  required  informatibn^ 
and  could  thereflor  not  give  the  examination.    This  requirement  presents 
a  particularly  acute  probleTn  regarding  the  design  portion  (Part  A),  of 
the  Professional^  Examination  for  architects.     We  believe  architecjbs  must 


be  minimally  corr 
for  such  design 


demonstration  examinjation"  covered  by  the  bill's  definition  of  "test** 
(Sec.  2(3) )  Yc 


experimeh^al  use 


architectural  lijcensing 


gradi^ng  teats 
all  state  polici 


petent  to  express  themselves  graphically,  and  testing 
competence  is  quite  clearly  "practical,  performance «  or 


^t  we. are  at    a  loss  to  see  how  st^e  registration  .boards 
can  de^fc^rmine  "njargin  of  error  or  extent  of  relialllity  on  the  basis  of 

and. give  the  required  notice  to  applicants  for  ^-^ 


In  a  more  dirept  manner  ,  H.R. 3564  prohibits  a  particular  method  of  • 


(Sec:  6(c))  I  if  this  respect  also,  the  bill  would  supolant 
ea  ^hich  are  Inconsistent^  « 


C.    The  bill's  zunbiguities  invite,  needless  and  disruptive  litigation 


^n  the  j^ederal  courtT 


H.R. 3 


The  most  critical  ambiguity  of  }I.R.3564  is  found 'In  Sec.  6(,a)(3) 
noted  above.    Noi^e  of  the^e  terms  refledt  a  common  body\of  meaning  and 
general  understar^ding  in  the  testing  -  field  generally;  they  have  even 
less  meaning  when  they  are  sought  to  be  applied  to  particular  occupa- 
tional tests  such' as  architectural  tests.    Moreover,  there  'is  no  federal 
authority  given  rUle-making  responsibilities  to  Enlighten  tf^e  state 
occupational  licehsing  boards  through  regulations  as  to  the  proper 
meaning  of  the  "reliability "  requireme'fiib.    Instead,  individual  Federal 
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District' Court  jud^^  will  .be  left  to  decide  the  Congressional  intent 
.on  a^ase  by  case  Asia .    And  in  almost  all  instances,  thcv  decision 
Will  have  to  be  maOe  by  the  judge  (and  responded  to  by  the  state  r 

. licensing  board)  under  the  severe  time  pressures  of  |an  application  for 

'  permanent -or  temporary  injunction.  (Sec.  7(a)) 

'   Ife  cannot*  state  that  no  grading  errors-  have  ever  occurred  in  grading 
.  the  architectural,  examination,  or  .that  the  test  format  or  questions  can- 
not b4  improved.  ,  Each  year  literally  hundreds  bf  hours  are  given  witm-  - 
out  corapensation  by  practitioners,  educators  and  others  wht7  are  tjne 
•  state  officials  serving *on  NCARB/s  member  state  boards  to  assure  that 
examinations  accurately  and  adequately  test  candidates'  Knowledge,  skill 
and  ability  in  applying  professional  level  judgment  to  architectural  ^ 
problems*  ■•[    •  ■      ' .    .  %  f 

There  is  a  s^ibstantial'  body  of  case  law  which  over  the. years  has 
developed  to  protect  candidate!  for  occupational  licensing  against 
arbitrary  and  capificipus  actions  or  other.  viol2(tions  of  their  due  procctss 
rights.    The  majority  view  has  been  that  in  the  absence  of  arbitrary 
or  capricious  ac^dj,  failing  candidates'  rights  ar^ , sufficiently  pro- 
tected-if  they  may  retake  the  failed  examination.    Tyler  y-  Vickery , 
517  F,  2d.  load,  1101  (5th  Cir.  1975)  cert.  den.  426  US  940  (1976) ? 
Singleton  v.  La.  Statje  Bar  Ass'n*#  413  F.  Supp.  1092  (E.D.  ta.  1976)? 
In  Re  Mead,  197y  N^ss.  Adv.Sh.  599  (Ma.  1977) .    See,  Detroit  Edison  Co. , 
L.R.B.,  47  U.S.LJW.  4233  41979);  HenHes  v.  Fisher,  supra. ?    Whitf ield~v. 
linois  Bd.  of  Lavt  Examiners,  504  F.  2d  1-74  (Tth  Cir.^  1974) ;  Chaney  v. 
tate  Bar  of  Califcirnia,.  386  "F.  2d  962  (9tih  Cir,  1967).    NCARB  submits  /' 
that  thi^  eyolvihg  ^dy  of  law  offers  more  appropriate  protection  for  ^ 
disappointed  csndidktes  then  does  H..R.3564.  .  i 
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HOW  ARCHITECTURAL  REGISTRATION 
BOARDS  V^oRk  TOGETHER 


INTRODUCTION 

.  Thii  document  hat  been  prepared  by  the  arch j- 
tectural  registritlon  boards  of  ihe  United  States  In  , 
an  effort  to  acquaint  state  legitli^prs  and  members 
of  state  executive  departments  with  the  process  by 
which  architectural  registration  boards  work  to-- 
gather.  It  explains  the  inter-relation  of  the  state 
boards  an<^  the  National  Council  of  Archltec(Or»l 
Reglstretion  Boards  ("NCARB")  which  sen/es.as  a 
national  forum  for  its  member  boards. 


THE  NATURE  OF  ARCHITECTURAL  PRACTICE 
AND  ITS  EFFECT  ON  REGISTRATION 
#■ 

It  is  important  to  appreciate,  at  the  outset,  the  way 
in  which  architectural  practice  in  the  United  States 
differs  from  that  of  moat  of  Ihe  other  learned 
professions  and  how  that  difference  has  affected 
registration.  ' 

While  the  regulation  of  the  practice  of  archi- 
tecture, like  other  learned  professions,  Is  remitted  to 
the  states. by  tradition  going  back  to  the  nineteenth 
century,  the  architect  is  typically  Involved  in 
Interstate  commerce  In  a  way  unparalleled  by  other 
professional  groups^  It  Is  true  that  lawyers,  doctors, 
and  accountants  require  some  measure  of  reciprocal- 
licensing  in  order  to  permit  the  lawyer,  doctor  or 
accountant  to  move  his  practk^e  fiiom  one  state  to 
another  (without  the  necessity  of  submitting  himself 
again  to  the  full,  Vitial  licensing  proceis).  These 
profeisk>ns  rarely,  however,  r^uire  the  capacity  to 
rnovi  routinely  across  state  lines.  Architects,  on  the 
other  hand,  customarify  do  their  work  ir)  their  base 
state  and  surrounding  itates;  and  Amerk:a's  larger  - 
ardiitectural  f  inns  have  a  practice  which  is  national, 
if  not  international.  In  scope. 

Of  course,  each  particular  state  Is  concerneawith  \ 
the  quality  and  safety  of  buildings  constructed 
within  its  borders.  Each  state  as  kaen  an  interest  ' 
in  examining  the  Rualifkatlons  of  an  architect  from 
another  state  qoming  in  to  do  a  project  as  it  has  with 
regard  to  the  qualifications  of  an  architect-resident 
within  the  state.  ' 

The  process  by  which  an  applk^nt  is  admitted  to  - 
registration  in  his^  base  state  Is  appropriately 
substantial  and  exectino.  To  require  that  avery 
architect  seeking  to  design  a  project  to  be  built  in  a 
state  other  than  his  base  sta}ie  comply  with  that 
substantial  procedure  -vAoukJ  seriously  obstruct  th6 . 
capacity  of  architects  to  move  from  state  to  state. 
Both  architectural  regtstration  boards  and .  the 
profession  at  large  early  recbgnized  that  there  was 
no  place  in  tho  system  for  the  local  protective 


instinct  which  sought  to  obstruct  the  free  flow  of 
practice  from  state  to  state.  In  general,  there  has 
been  r^early  unanimous  recognition  pf  the  notion 
that  it  is  In  the  interest  of  the  publk  as  well  as  the 
profession  to  facilitate  interstate  practice. 

Thus,  each  state  was  charged  by  its  legislature  to 
protect  ttw  public  health,  safety,  and  welfare  by 
examining  the  qualifkatlons-of  persons  who  were  to 
.hft  pewwilied  lu  Uwlyu  R'fUctures  witHln  that 
jurisdiction.  At  the  sarne  time,  there  was  a  cleer 
.  understanding  that  the  public  interest  required  that 
the  practicing  architect-  be  free  to  move  from  state 
to  state  ^n  order  to  practice  his  profession.  The  first 
solution  to  this  diiert^na  was  to  provide  In  state 
statutes  that  an  architect  registered  in  his  base  ftate 
could  come  into  enother  state  if  the  base  Itate 
permitted  the  second  state's  architecU  simllarb  to 
^ave  access  to  practice  in  the  base  state  and  Irthe 
standards  for  registration  of  the  base.state  were  no 
less  than  the  requirements  of  the  second  state.  Such 
a  solution  broke  down  in  two  respecti  First,  it  was 
exceedingly  .difficult  for  an  Individual  State  to 
scrutinize  and  evaluate  the  requirements  of  every 
other  stafe.  Second,  it  was  difficult  to  assess 
whether  another  state  was  opening  Its  doors  to 

•  architects  from  the  host  state.  A  state  board  heard 
of  aggravated  cases  only,  and  often  those  cases 
overshadowed  the  good- faith  reciprocity  which  may 
have  existed. 

^  miich  more  effective  solution  was  to  provide  a 
national  clearing  house,  controlled  by  the  boards  of 
the  several  states,  which  would  evaluate  and 
recbmmend  candidates  seeking' regiftrat ion  In  a 
second  state:  •  This  solution,  however,,  posed  still 
another  problem.  If  there  Was  an  Infinite  variety  of' 
startdards  among^he  fifty-five  jurisdictions,  could. 
.  '  any  state  board,  charged  with  protecting  its  citizen^ 
allow  a  national  clearing  house  tamake  judgments 
cor>cerning  the  equivalency  of  stancftlds? 

The  registration  boards  ultimately  succeeded  in 
resolving  this  problem  to  a  large  extent  by  creating 
the  NCARb  as  a  forum  for  ibe  joint  developmeht  of 
normative  standards  for  the  natioru  Thui,  the 
member  boards  a%  a  {yroup,  acting  through  the 
NCARB,  study  end  "recommend  standards  for 
training  and  education  which,  when  adopted  by  the 
member  boards  individually,  become  the  NCARB 
standards  for  granting  its  Certlficate-a  document, 
evidencing  the  NCARB's  alfflrmative  recommen> 
datlOn  to  a  member  board  that  the  Certificate-  . 
holder  is  qualified.  In  fact,  the  process  has  worked. 

^11  states  use  the.  national  examinations  developed 
by  NCARB^All  states  recognize  the  NCARB 
Certificate  as  evidence  of  an  applicant's  qualification 
to  practice.  Many  states  have  edopted  the  NCAR9 
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training  and  •ducattonal  itandards  as  their  o^n 
ttahclarda  for  ragiftratlon*  . 

WHATISI||CARB?  ... 

In  1919,  tht  archftactunil  boards  of  i  hamlful  of 
states*  recf^izing  the  problem  posed  by  Inter  state 
praotice,  nttt  to  diacusa  the  formation  of  a  national 
organization.  Thaat  dlaaisslons  resulted  {n  the 
•ttablishpent  pf  the  National  Council  of  Archi- 
taetunlflegistration  Boards  In  IjMO. 

NCApB,  located  in  Vyashington,  D.C.,  is  a 
nofWprcIlt,  membership  organization  established 
under  lie  laws  of  the  State  of  lovw.  comprising  the 
ragHtrlloii  boenls  of  the  fifty  states,  the  District  of 
Columbia,  the  Canal  Zone^  Guam,  Puerto  Rico,  and 
th^Vif^gin  Islands; 

It  M  Important  to  emphasize  that  NCARB's  only 
rnambtn  are  the  legally  constituted  architectural 
registr«Hon  boardi  Only  the  boardi  formulate  the 
mlea  and  policies  of  the  NCARB,  and  elect  its 
directors  and  off  lean  To  be  elected  a  director  or 
officer,  a  candidate  must  be  currently  serving  on  a 
member  board,  although  he  may  subsequently  be 
reelected  or  elevated  to  a  higher  office  at  a  time 
when  he  may  no  longer  be  serving  on  his  State 
board. 

The  chief  activitiea  of  the  NCARB  can.  for 
convenience,  be  divided  Into  two  general  ereat.  The 
first  area  comprises  thoee  services  rendered  by  the 
NCARB  to  its  inember  boards.  Including  the 
development  of  ■  the .  registration  exams  to-  be 
administered  by  member  boards,  the  development 
of  recommefyled  education  and  experience,  stan- 
dards which  niay  be  edopted  by  member  boards  as 
the  standards  to  be  required  ^f  candidates  for 
registration,  and  the  developmem  of  recommended 
Itandards  of  prt>fessk>nal  conduct  which  may  be 
adopted  by  member  boards  pursuant  to  the 
Arute-making  power  generally  found  in  registration 
\tBiutaL 

>  The  second  category  comprises  services  to 
registered  architects^  the  khief  of  which  is  the 
maintenance  of  a  nationwide  system,  baaed  upon 
the  Certlffcata  issued  by  the  NCARB,  by  which  an 
architect  registered  in  one  state  Is  edmittaf^  to 
practice  In  another  state.  This  system,  perhaps 
unique  to  the  profession  of  architecture,  has  evolved 
V  over  the  years  and  represei^ts  the  principal  path  by 
vvhich  architects  are  able  to  conduct  their  practice 
beyond  the  bonders  of  their  base  state. 

In  its  most  recem  fiscal  yeer,  the  dues  collected 
from  its  member  boards  comprised  lets  than  two 
percent  of  NCARB't  gross  rweni^s.  NCARB's 
charge  for  the  national  «xaminations  and  associated 
charges  comprised  approximately  thirty-eight  per- 
cent of  the  Coundi's  gross  rwenues.  Nearly  sixty 
percent  of  the  gross  revenues  of  the-NCABB  came 
from  registered  trchKecU  uSing'^the  Coundi's 


lervicas  in  connection  with  intersUTe  practice.  These 
figures  underline  the  rather  unique  position  of  the 
.  Council  when  compared  vvith  similar  /lational 
councils  of  governmental  organisations:  while  the 
entire  control  of  the  NCARB  Is  in  the  hands  of  its 
member  state  boards,  over  half  of  its  revenue  is 
generated  from  the  services  it  affords  private 
practitioners. 

•  H0WNATI0NAtSTANDARt>8AREDEVEL0PED 

NCARB  engages  in  extensive  work  by  committeesloT 
/develop  the  recommended  standards  which  wer4 
discussed  above.  The  committees  comprise  members, 
of  NCARB's  member  boardi  The  Committee  on 
Procedures  end  Documents  reexamine  each  year  the 
standards  for  training  and  education;  the  Committee 
on  the  Intern  Architect  Development  Program  Is  a 
major  effort  to  re>exanUne  the  process  by  which 
'  young  applicants  for  re^^ration  develop  ade<)uate 
training  experience;  ttie  various  examination- com- 
mittees dear  with  the.  Qualifying  Test  and  the 
Professional  Exam;  and' ther  Committee  on  Profes- 
siortai  Conduct  is  presently  making  recommen- 
dations to  all  member  boerds  concerning  a  Code  of 
Prof  esskHial  Conduct  which  the  member  boards  may 
,  adopt  by  regulation.  In  this  fiscal  year,  thirty-seven 
ftates  hive  memben  x>f  their  boerds  partidpating  in 
this  committee  work.  The  States  without  parti- 
cipating oorhmittee. members  this  yeer  will  doubtleis 
have  parttelpants  in  the  next  few  years,  for  it  has 
been  the  consckMis  practk:e  of  the  NCARB  Board  of 
Directors,  who  Represent  the  member  boards  and 
who  come  from  eech  geographic  area  of  the  United 
States,  to  constitute  Important  committees  In  such  a 
way  as  to  be  sure  they  reflect  a  bniad  geograpliic 
crosf'sectlon  of  member  boards. 

During  the  year,  the  committees  deliberate  on 
their  areas  of  refponsibility.  In  cases  where  outside 
consulunts  are  necessary.  {9.g.,  testing  experts,  legal 
counsel,  educational  experts,  and  the  like)  these 
consuttantk  Jre  retained  by  NCARQ  to  assist  the 
committeesTThe  work  of  the  committees  is  reported 
periodical:/  to  the  NCARB  Board  of  Directors. 
Every  important  polkiy  oonskieration.  including  any 
Important  change  in  the  standards  to  be  recom- 
mended to  the  member  boards,  passes  under  the 
scmtlny  of  the  Board  of  Directors.  / 

In  addition,  policy  .matters  are  rt^viewed  in  the 
separate  meetings  of  the  RegioriN|l  ConferencaS  of 
the  NCA^B.  Each  member  bo^rdls  also  a  member 
of  a  RegloHal  Conferience,  which  is  Vgeographkral 
(^uping  of  boards;  there  are  six  niegtonal  Con- 
ferences. The  Regional  Qpnferehces  hold  at  ieest 
two  meetings  yearly.  ^k:h  are  cnicial  to  the 
process.  These  regional  meetings  are  frequently  a 
source  of  new  policy  proposals  as  well  as  an 
oocaskHi  for  study  of  outstanding  matters^  Typl^ 
cally.  national  offkers  and  staff  personnel  attend 

2  \ 


V 


110 


5 


1102 


Mdb  regional  meeting.  Their  titk  \%  to  provide  a 
dittHed  picture  of  propouii  which  Vf  >  expected  to 
i|*  Kibmlttod  for  vote  at  the  Annual  Meeting.  Thete 
^opoiali  are  diicuNad  and  frequently  modified  at 
'  thf  regional  meetlngi. 

At  letit  thirty  days  prior  to  t^  Annual  Meetjng 
in  .eech  year  all  matwrs  to  be  voted  on  muit  be  sent 
to  the  memfiel  boar^  Thit  requirement  enables  the 
member  boards  to  deliberete  themselves  on  the 
.  quettioni  to  be  raised  at  the  Annual  Meeting 
\  At  the  Annual  Meeting  new  policies  to  be  voted 
on  af^  presented  In  detail.  The  chairman  of  the 
committee  responsible  for  such  policfes  is  given 
ample  tin>e  to  present  the.proposil  to  the  entire 
Annual  Meetinj^.  They  era  Informally  discussed  in 
regional  meetings  held  at  the  time  of  the  Annual 
Meeting.  Frequently  the  committee  chairman  or  one 
of  the  national  officer!  is  invited  to  }oin  the  regional 
meeting  to  answer  questions  raised  by  region 
memben  Thereafter,  the  policies  are  debated  in.  . 
plenary  sessioa 

When  the  Issue  comes  to  a  vote,  each  member 
board  has  a  single  vote.  It  has  been  the  tradition  of 
NCARB  that  no  major  policy  change^s^put  into 
effect  when  supported  only  by  a  n»rroW-ma}ority. 
All  such  changes  have  been  held  In  ebeyance  until 
there  Is  substamial  consenius  In  favor  of  the  change. 
The  membership  is  always  sensitive  to  the  fact  that  a  - 
change  in  the  standards  for  the  NCABB  Certificate 
effectively  changn  the  rules  by  which  a  regis^red 
^architect  is  frM  to  practice  In  another  state;  If  a 
^single  state  refuses,  as  a  result  of  the  change,  to 
accept  the  NCABB  Certlficete,  the  entire  structure 
of  interstate  re^lttretion  may  be  bndiBrmlned. 

SUMMARY  ^ 

The  foregoing  underlines  the  Important  role?-  bf  ■ 


NCARB  as  the  forum  through  which  Its  member 
boards  affect  national  registration  policy.  At  a. time  . 
when  responsible  state  budgetary  authorities  artf  /' 
seeking  ways  to  redu^  the  cost  of  govarnment,  it  Is  '  ^ 
useful  to  emphasize  the  unique  utility  of  the 
NCARB  for  Its  member  boards.  As  an  example,  it  Jb 
commonplace  for  Items  of  "out-of-state-travel  ^io 
be  the  first  victim  of  budget  reviewen  While  rn^y 
such  lmer*governmental  agency  meetings  are'Mwf ul 
only  as  an  educational  experience  (exchange  of 
ideas,  staying  •bfipiit  of  current  developments),  the 
NCARB  meetings  ineviubly  affect  the  policy  of 
registration  In  eech  member  boards'  sovereign  stata 
No  ftlte  cen  afford  to  be  absent  when  changes  in 
standards  are  discussed  and  adopted.  While  it  is  true 
thai  a  particular  state  may  refuse  to  adopt  the  new 
standard  when  considering  an  appHcatiorr  fr6m 
another  state.  If  it  does  so  persistently,  it  runs  the 
strong  risk  that  its  own  registrants  will  be  barred  . 
from  practice  in  other  statet.  In  flnort,  the  delicate 
national  system  of  'mutual  rntpect  and  comity 
among  the  reglttratk>n  boards  of  the  sovereign  states  - 
sunrives  only  twcause^  to  date;  substantially  all  of 
the  states  have  recognized  tfie  importance  of  the 
decisions  taken  by  memt>^r  boards  at  NCARB 
meetings  / 

*As  another  example,  many  state  government 
officials  question  their,  board  as  to  why  it  should 
defer.  In  eny  way,  to  the  judgments  of  a  substantial 
number  of  the  boards  of  sitter  states.  Each  state  ll ' 
sovereign  arid  can  make  Its  own  judgment  as  to  how 
best  to  protect  the  heelth,  safety,  and  welfare  of  its 
habitants.  No  one  denies  the  validity  of  that 
proposition;  but  no  one  can  deny  either  that  the 
free  ifiow  of  professional  practke  throughout  the 
country  requires  a  sense  of  mutel  respect  and 
comity  among  ragistratkxi  boards.  It  is  through  the 
forum  of  NCARB  that  the  delicate  be  lance  Is 
maintained.  »  . 
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APPENDIX  D-THE  NCARB  EXAMINATIONS 


A  SUMMARY  REPORT  QN  THEIR  PREPARATION  AND 
SETTING  OF  PASSING  ISCORES 


1.  BACKGROUND  I 


Before  tht  uniform  mqltiple-choict  testing  format 
wts  developed.  Registration  Boards  wrote  their  own 
individual  examinations.  These  were  gen^lly  of  the 
eesay  iype.  Each  board  graded  its  own  papers  end 
established  Its  own  criteria  and  staridards  to  deter- 

'  mine  passing  i^apers.  The'  tubiecU 'covered  in  the  . 
examination  fo.Howe<l  a  lyjlabos  recomnr»ended  by 
the  NCARB,  J)ut  the  content  of  each  examination 
was  determllied  l^y  each  Board.  The  passing  scores 
fbr  each  section  off  the  examination  varied  from  60 
to  76;  however,  paesing  determined  on  the  basis 
of  the  tot^l  examinatton  and  of  achieving  a  percent- 

.  age  (e.g.  ep.  65>  70  or  76)  of  a  possible  1,000 
points.  / 

In  the  late  'SOs,  NCARB  began  Investigating  the 
use  of  the  multiple-choice  format  for  the  seven-part« ; 
four-day,  36-hour  examination.  The  first  multiple- 
choice  tests  were  used  in  t962,  and  t>y  1965  all 
portions  of  the  seven-part  test  except  for  the  two 
graphics  tests  were  cast .  In  the  multiple-choice 
fornr)at. 

.  The  required  passing  scores  fbr  these  tests  were 
determined  by  the  members  of  the  Member  Bbards 
meeting  at  the  1065  NCARB  Annual  Meeting  in 
Weshi'ngton.  O.C.  The  procedure  celled  for  the  dele- 
gates present  to  evaluate  the  questions  in  each  of  the 
tests  and  to  rate  the  difficulty  of  each  question  for 
the  minimally  qMlified  candidate.  In  addition,  each 
delegate  was  asked  to  ^Indicate  his  professional 
opinion  as  to  the  percent  of  the  total  number  of 
questions  the  candidate  ihould  answer  correctly  in 
each  test  iO)  order  to  pase.  All  data  were  collected  ' 
and  evaluiftd,  and  tpe  exam  passing  standards  were  * 

.  established. 

In  1968,  further  research  by  NCARB  led  to  the 
development  and  implementation  of  what  are  now 

•  known  as  the  Qualifying  Test  pnd  the  Professional 
Examination.  These  two  examinations  became  effec- 
ttva  in  1973.  (Note:  The  QualifYing  Test  was  ini- 
'ttatly  entitled  the  Equivalency  Examination.) 

2.  EXAMINATIONS 

The  Qualifying  Test  is  designed  to  test  the  candi-  « 
date's  knowledge,  skill  and  ability  In  the  fundamen 
•   tale  of  the.  art  and  science  of  the  practice  of 
architectural 

^The  Professional  Examlriatton  Is  designed  to  test 
th«»candidate's  knowledge,  skill  and  ability  in  apply- 
ing professional  level  judgment  to  architectural 
problems  and  their  ability  to  synthesize  all  techni- 
cal, programmatic  and  aesthetic  aspects  In  .the  reso- 
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lution  of  an  architectural  design  problem  es  related 
to  the  practice* of  architecture  and  the  protection  of 
the  public.    .  [- 
A.  Test  Development  Background 

Before  afflfsubject  areas  were  defined  or  any 
'  test  questions  written,  an  exhaustive  study  was 
made  to  determine  which  subfects  form  the 
.    core  of  knowledge,  skill  and  ability  necessary 
for  the  practice  of  architecture.  The  Commit- 
. .   tee  assigned  to  this  tesk  concluded  that  the  test  ' 
should  be  designed  to  elicit  a  level  of  knowl- 
edge, skill  /and  abilities  equivalent  to  that  of  a 
stu(|ent  aflbut  to  be  graduated  from  an  accred- 
ited program  in  architecture. 

Preliminary  content  specifications  for  the 
■four  subject  ereas  of  the  pualifylog  Test  (His- 
tory.  Structures,  MateriaR  and  Methods,  and  ' 
MtoMnical)  were  prepared  by  the  Committee. 
Tliese  test  specifications  were  then  distributed 
to  all  schools  of  ac£b|jecture  with  accredited 
programs  for  their,  x^lm  and  comnMnt  es 
related  to  the  content  ai^depth  of  coverage  of 
each  subject  as  taught  in  the  Khools. 

Additionally,  faculty  members  frorn  the 
Schools  were  requested  to  submit  copies  of . 
thqir  final  examinations  as  well  as  a  number  of 
muitiplf-cholce  test  questions  for  the  Commit- 
tee's review  end  (^sslble  use.  The  information 
collected  from  the  schools  were  analyzed  and 
the  final  test  specifkjations  were  prepared.  The 
writing  of  test  questions  was  then  undertaken 
complying  v^th  these  specifications. 
-    The  NCARB  Committee  writing  the  Qualify- 
ing Test  consists  of  architects,  educators  end 
Board  members.  Two-thirds  of  this  Committee 
is  made  up  of  aithitetit-educators  recognized  In 
'        academia  for  their  abilities  and  knowledge  of 
their  specialties.  The  architect-Board  mftnbers 
are  noted  for  their  expertise  In  par^(^ar  sub- 
ject veas  and  bring  to  the  Committee  the  con- 
cerns of  registration  Boards  as  a  policy-setting 
^  factor.  The  Committee  has  sUteen  active  mem- 
bers who  meet.twlpe  a  year  in  formal  sessions 
and  also  contribute  considerable  personal  time 
Ms  writing  test  questions  at  home. 
2.  The  Profetsfongf  Bx»mtn»tion 
The  Professional  EKaminetion,  multiple-choice 
sections.  (Idenilfle«fas  Section  B)  progressed  to 
Its  present  format  after  several  years  of  inten- 
sive study  and  development.  The  subject  areas 
of  the  Examination  were  derived  after  a  study 
was  made  of.  the  practic#s,  procedures  and  ser- 
vices offar^  byNfrchltects,  and  an  analysis  and 
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pn>i»ctA>n  of  what  architectural  practice  and 
public  needt  might  be  in  the  future.  The 
ichooll  of  architecture  were.conkfjited  for  their 
«f|iprattal  of  the  future  of  architecture  in  order 
;to  develop  realistic  arid  appropriate*  lubject 
are^t  artd  test  specifications. 

A  mocl(  Professional  Examination  was  devel- 
.  oped  ar)d  the  Member  Boarcfs  reviewed  the  con- 
cepts, subjfct  areas  and  sarnple  test  questions. 
The  procedures,  format,  subject  areas  and 
fhedults  for  the  new  exarhlnation  were  adop- 
.    tedJn  1972  and  the  first  official  tes)  was  given 
in  Dkember  1973! 

The  Initial  NCARB  Committee  of  forty  per- 
sons changed  with  the  development  of  the 
Examination  was  comprised  of  architects, 
•  educators,  gen^elists  and  interns.  Over  the 
•  years,  this  Corr\mhtee  has  been  effective  with 
fewer  members  ananow  numbers  twenty -eight 
persons  comprised  of^chitect- Board  members 
and  architect -educators/'^is  Committee  meets 
three  times  during  the  yMc  end  each  member 
spends  a  great  deal  of  persoi^l  ttme  in  writing- 
questions,  .r^lewlng  TIP  matV^al  and  .taking 
the  examination. 

3.  EDUCATIONAL  TESTING  SERVIC^  (ETS) 
INVOLVEMENT  IN  NCARB  EXAMINATjMDNS 

>  Educational  Testing  Service  of  Princeton,  New  . 
sey,  and  Berkeley.  California,  has  assisted  NCARB  IrK 
the  preparation  of  examination  materials  for  more 
than  twenty-five  years.  Their  testing  specialists  in- 
struct the  NCARB  Committee  rpembers  on  how  to 
write  multiple-choice  questions;  edit  the  question's 
for  clarity,  punctuation,  grammar,  etc.;  score  the 
exan^;  prepare  rosters  of  the  candidates'  perfor- 
mance; and  accomplish  the  statrstical  and  analytical 
work  related  to  the  whole  aHamlnatlon'^vMll  as  to 
indivlduai  questions.  ' 

ETS  neither  attempts  to  write  examination  ques- 
tions nor  to  establish  the  required  minimum  scores 
for  paning;.  however,  they  do  provide  bacliground 
data  and  ijuidance  ori  accepted  testing  procedures 
and  provide  the  technical  expertise  and  administra- 
tive worl( force  for  the  NCARB  prepared  testing 
instruments.  \ 

\ 

4.  EXAMINATION  WRITING  { 

Questions  in  every  NCARB  examination.ere  written 
by  architects  or  educators  who  teach  architectural 
subjects^  Questions  iri  reviewed,  criticised,  rewrit- 
ten and  either  accepted  for  use  or  refected.  The 
questions  are  written  to  cover  the  subject  ereas  as 
specified.  Each  que|tion  in  all  NCARB  tests  except 
Structural  Technology  are  valued  at  one  point  each. 
In  the  Structural  Technology  test,  fifteen  questions 
are  valued  at  five  points  each  because  they  are  calcu- 
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l^tion  questions,  taldng  more  time  to  answer;  there- 
fore, these  questions  have  a  higher  point  value; 

Within  every  test  a  series  of  ^questions  appear  that 
have  been  used  in  previous  tests.  These  questions  are 
used  without  modification  for  the  purpose  of  conv 
paring  the  difficulty  of  the  current  test  with  previ- 
ous tests  and  to  compere  the  Ability  of  this  total 
'  candidate  group  with  the  group  tatting  previous 
tests.  These  questions  are  called  ''equaters'*  in  th^t 
they  provide  statistical  data  that  aid'ln  establishing 
,the  required  minimum  raW  scores  for  passing  the 
test  thereby  enabling  the  maintenance  of  uniform 
passing  standards  for  each  test. 

SETTING  OF  MINIMUM  REQUI()EO  SCORES 

Of  critical  importance  is  the  establishment  of  the 
Initial  requirements  fdr  the  demonstration  of  mlni- 
murn  competence  . in  a  given  subject  arisa.  This  is  the 
most  difficult  and  agonizing  aspeOt  of  the  entire 
examination  process.  After  the  test  has  been  given 
end  a  significant  number  of  answer  sheets  have  been 
scored,  those  few  questions  (items)  in  the  test  that 
have  poor  performarice  statistics  are  analyzed  by  the 
CHairmen  of  that  portion  of  the  test.  Then  a  deci- 
sion Is  made  on  whether  to  retain  the  item,  to  r^ect 
it  or.  In  rare  cases,  to  change  the  answer  (key).  ' 

The  next  step  is  to  analyze  the  test  with  regard  to 
its  difficulty  as  compared  to  previous  versions  of  the 
test.  A  test's  difficulty  is  determined  by  tabulating 
the  difficulty  values  of  the  test  questions  and  divid- 
ing that  total  by  the  number  of  questions  in  the  test. 
sX    Difficulty  is  .ctetermined  by  observing  the  perfor- 
^^Npence  *  of  candidates  and  translating  that  perfor- 
\nhknce  into  numbers  V))irough  usA  of  formulas 
»^dard  to  the  testing  iiKlustry.  A  value  of  11.7  on 
a  suie'  of  0-20^  represents  middle  difficulty. 
NCARB  tests  strive  to  be  In  the  r«>ge  of  10.0-13.0 
jo  diff'^lty  rating.  Also,  the  candidates,  as  a  group, 
■  are  evaluatea  for  their  overall  Ability  aodthni  com- 
pared to  thVprevious  candidate  group  abiltly:  Candi- 
date groupXability  Is  assessed  by  measuring 
p^rf^mance  oV  the  brightest  candidates  of  one 
group  to  the  abilltyof  the  brightest  candidates  from 
previous  groups.  These  enelyses  tfre  accomplished 
through  the  incorporation  of  the  "equater"  ques- 
tions (see  Item  4  above). 

Regardless  of  the  number  of  questions  In  a  test  or 
the  length  of  time  allowed  to  answer  the  questions, 
the  passing  score  of  a  test  can  be  set  that  is  equiva- 
lent to  that  of  previous  tests  throu^  application  of 
the  test  difficulty  and  group  ability  data.  Through 
this  process,  once  the  initial  levels  of  performance 
have  been  set,  each  new  test  applies  uniform  stan- 
dards In  relation  to  Its  predecessors  with  regard  to 
the  candidate  ability  required  to  attain  the  mini- 
mum passing  score.  Thus,  It  becomes  possi|)le  to 
require  that  candidates  perform  at  the  same  stan- 
dards as  previous  candidates. 

2924" 
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.  No  wr  it  comidtrtd  jnor*  important  ttian  any 
otiwr;  mhm  oqrtifdtrtd  tqual  in  viiue.  Ont  oortlon 
of  tiM  Owtltfyn^  TMt-4totipn  B->hM  i  ndlkbtr  of 
quMttom  which  c«rry  i  hightr  point  viiiM.  This  ii 
tomttinm  c«li«d  "wtflghting".  Tht  quettioni  in  the 
Stfuctural  portion  of  tht  twt  that  art  "wtighted" 
art  tht  caicula'tion-lypt  qutstiont.  Tha  purpoM  for 
"wtighting"  tych  qgtitiont  H  to  aniurt  that  tht  ' 
candldata  wiii  attainpt  to  antwtr  tham  and/ also,  to 
rtflact  tht  Impqrtanct  of  antwtring  such  quattlons 
in  ordtr'to  paw.    *  «  ^  - 

Mambart  of  tha  Examination  Committat  mutt 
analyza  tht  data  gantratad  from  tha^  adminittra-' 
tion  M  notad  abova^  tf  tha  tatt  undtr  contkJtration 
it  a  contlnultlon  of  ifraviout  vartlont<  ''aquating" ' 
data  art  utillzad  In  the  latting  of  tha  raquirtd  mini' 
mufT) .  raw  Miot^  (numbtr  of  quttttom  antwarad 
corrtctiy).  if  tht  ttit  it  tht  firtt  of  a  naw  form,  hit- 
torical  dau  from  pravioui  tattt  on  timiiar  tubjactt, 
or  "pra-tait"  data,  wiii  ba  tioniidtrtd  and  Incor- 
poratad  Into  the  procadurt. 

Aftar  caraful  study  of  tht  data,  tha  Committat 
nfMicaa  a  datarmination  on  bahaif  of  public  health, 
ufaty  and  waifara  at  to  tha  laviiL  of  ptrformanct 
raqulrad  to  damonttrata  minimum  compattnoa  In 
tht  lUbjact  araa  of  tha  tatt  Tht  minimum  raquirtd  • 
raw  tcort  tttabiishad  in  this  manntr  rtfltctt  tht 
Committtt't  profattlonal  judgment  of  the  expecta- 
■tloni  of  the  public  and  the. profession  with  regard  to 
mInlnrHim  competence.  Qnoa  the  minjmum  required 
raw  score  It  established,  a  conversion  tiilife  it* devel- 
oped through  which  raw  tcoret  canr  be  cofWerted  to 
e  scale  ranging  from  1  through  99.  In  the  conversion 
table,  the  required  minimum  tcore  It  set  toequei,  or 
convert  to,  76.  Tht  nun)btr  "75"  It  timpiV  myrjbh 
trary  numbtr  ahdi  does  not  represent  a  perbeptage  of 
the  totel  number  of  questions  In  the  tes^  The.  rium- 
ber  '76"  It  the  converted  score  required  to  past  the 
test.    ^  ■  . 

(On  e  fett  where  raw  tcoret  can  range  f^m  0  to 
160,  and  e  raw  tcore  of  67  It. determined ^to  be  the 


minimuni  required  score  tb  pats,  87  is  set  to  convert 
to  76.  a4iw  tcore  of  94  might  convert  to  83;  and  a 
•  raw  tcore  of  45  might  convert  to  60.) 

The  difficulty  of  any  ietthes  e  direct  relationship 
to  the  required  minimum  pasting  scotb,  Tha  test!  are 
not  intended  to-^nk  candidates  (thetit,  to  find  out 
who  tsbest  jrverege  or  v^ortt).  The  tests  are  designed 
to  determlfM  If  e  candidate  hat^demonttrated  mini- 
mum levels  of  icnowledge;  understanding,  slclii  and 
ability  In  the  lubject  aree.  Since  each  test  covert  e 
number  of  salient  points  about  .the  subject  of  the 
test  that  are  releted  to  principles,  theorlet  and  their 
application,  there  nury  be  teverel  tett  questions  on 
single  aspects  of  the  subject  Consaquently,  several 
opportunities  ere  given  to  the  candidate  to  respond 
to  the  principles  and  theories  of  the  test  subject* 
The  tett  It  not  dttlgned  to  require  expert  ststus  on^ 
any  subject;  Its  purpose  is  to  allow  the  candidate  to 
dernonstrete  minimum  competence. 

Samuel  T..8eten 

Director  of  Professional  Development 
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National  Association  of  Boards  of  Pharmacy 

1  East  Wacker  Drive  •  Suite  2210  •  Chicago,  IL  60601  •  3(^2^467-6220  j 
*  July  20-,  197? 


*  Chairman  Carl  Perkins 
Subcommittee  on  Elementary,  Secondary,  * 

and  Vocational  Education    '  '  (^  ' 

Coniplttee  on  Education  and  Labor 

B-3^6-C  Rayburn  House  Office  building  .  . 

U.S.  House  of  Representatives  •  i 

.  Washington,  D.C.  20515  ' 

pear  Mr.  Chairman; 

In  response  to  the  needs  of  our  member  boards,  the  57  state Hwardsi of  pharmacy  < 
In  the  United  States  and  Canada,  the  National  Assoclatio/)  of  Boards  of  Pharmacy 
(NABP)  Is  now  the  producer  of     standardized  and  uniform  entry-level  licensure 
.    examination  used  In  ^19  American  Jurisdictions^  Our  examination^  Entitled  NABPLEX 
(for  the  "National  Association  of  Boards  of  PhVipacy  Licensure  Examination")! 
would  fall  under  the  scope  of  "The  Truth. In  testing  Act. of  1979,"  H.R.  "556^1,  as 
Introduced  by  the  Honorable  Sam  M.  Gibbons,  and  referred  to  your  subcommittee. 

V  . 

*   Jn  the  sponsor's.  "Dear  Colleague"  lettei>^  Hay  3,j,Hr, *  Gibbohs  sald^  'M  would 
appreciate  your  suggestion. on  how  this  blU  can  b^  Imprpved  with  Its  overall 
purpose  In  rtiind  wlthbut^unduly.  burdening  testing  .firms,  professional  and  occupa- 
tional llpenslng  f>o^rds  or  educational  Institutions.','    The  proposed  Act  Is  basic 
ally  a  good  and  useful  TnstrUment;  yet  some  provisions  would  be  Injurious  to. the 
methods  used  In  constructing  and  administering  a  secure  and  non-dlscrlmlnatory  ^ 
examfna^Ion.    Specifically,  Section  6(b) (^)  Is  too  broad  and  would  permit  examina- 
tion candidates  to  re<iuesc  scores  of  other  candidates,  copies  of  test  It«ms  or 
other  test  Information  which  would,  contradict  good  testing  procedures  and  good 
public  policy.  '       .  - 


In  addition,  Section  6(c)  appeajrs.  to  be  aimed  at  eliminating  ftbrm-referenced 
score  Interpretations.    How^ver^  the^fa^gua^e  eliminates,  the  use  of  ctatls.tlcal 
treatmeht  and  reporting  of  scores  based  on. the  relative  dIstrtbutH)n  of  scores* 
It  would  als6  eliminate  the  use  of  average  scores  whjch  are  base4  on  score^of  ■» 
other  test  subjjscts  which  have  been  statistically  treated  or^^  the  basis  of  score 
'dIstrl))utIons.    This  language  Is  avyl^ward  and  would  ml  1 1 tate^agalnst  the  use  of 


7  ■■■ 


CarlW  ChiM 
y^hburn.Tlorih  Dtkota 


JoMphQ  Bh«|tn«ky 
Kanui  City.  Xtnui 


JH  Vbigt 


,'.  Tri^iurtr 

mUritynn  M  Jurovich 
C«9per.  Wyoming 


Chicioo.  Iilinoil  . 


Carl  StMfchtk 
Eugvnt.  Oregon 


Don«id  B*n. 

Pittsburgh.  Ptnnsylvinis 


John  P.  Piurfitntr . 
Psirmont.  Wnl  Virginia 


Dover,  Oetawart 
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acceptable  scientific  testing  practlces.to  both>eport  and  Interpret  scores. 
•  Perhaps  the  Intention  I to  emphas I ze  cri terloff^referenced  approaches  to  score 


Interpretation.  If  ^so,  care  should  be  taken  to' spec!  fy  how  criteria-are  e«a 
bll shed  both  from. the  public  . policy  standpoint  and  f rom  ,the  standpoint  of  the 
curreot  state-of-the-art  of  the  tests; and  measurements  field. 

Thank  you  for  the  opportunity  to  cofnment  on  H.R.  356^^    The  language  we  have 
criticized  would  make  the  bill  enti rely  unworkable  and  would' negate,  the  bill's 
purpose  and  overall  effect', 


MahaffrfV,  PharWtD. 
Executive  Director- 


FTH/m  .  . 

cct    NABP  E^fccutlve  Comnlttee' 


An  Identical  letter  Was  also 
^  received  from  Dr.  Mahaffey 

representing  the  Fcfderation 
of  Associations  of  Health 
.  J  Regulatory  Boards. 

•  ^/^  •  ^  ■ 


J 


■  T 


} 
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Carnegie  Council  on.  RDicy  Sti^jdies 


■  in  Higher  Education  .I- 

2160  SHAnUCK  AVENUE 7bERKELEY,  CALIFORNIA  94704  (415)0^9-4474 


\ 

August  li*,  1979 


The  H'onorfla)le  Carl  D.  Perkine 
.  U,Sr  House  of  Representatlvea 
.    '  .  2352  Rayburn  Building  ' 

Washington »  D.C.  • 

""x-  pear  Carl:  •  "  . ."  . 

.  >  This  Is  to  tell  you  of  n^y  concern  with  bills  to  regulate 

'  ,     *  standardized  testing,  H.R.  1*91*9  and  H.R,  356I*  now  before  your 

Subcommittee  on  Elementary,  Secondary  and  Vocational  Education- 

Both  bills  reflect  an  awareness,  that  atandax'dlzed  testis  have 
'     '<  come  to  have  an  iiqportant  place  in  the  Amet^ican  educational  system.- 

Those  who  have  'developed  the  tests „are  also  acutely  aware  of  tljis. 
.  j  .  fact  and,  to      knowledge,  haye  been  extraordinarily  consoientl.qus 

*    in  c&rrying  out  the  responsibilities  ^heir  role 'implies.    But  the. 
very  objectivity  they  have  sought  to  guarantee  for  the  test 
^  *  development  euid  administration  process  has  made  Standardized 

testing      almost  uniquely  impersonal  part  of  the  educational 
■  ^. '.)^  system. 


This  Impersoneaity  is  now  being  widely  interpretel^^s  a^jlenlal 
of  the  worth  of  the  many  "valuabie  human  qualities  the  tests  do  not. 
purport  to  measure.    These  qualities  should  be  taken  Into  account, 
in  an  educational,  admissions  program.    They  are  so  taken  into 
account  wherever  the  admissions  process  1^  conducted  in  a  knowledgeable 
and  far-sighted  manner.        .    *     .  .  ^* 

The  need,  however,  is  f6r  each  Institution  to  have  such  a 
balanced  adrntsaions  process,  not  to  discard  tbB«iobJectivlty  of  tests 
or  to  make  objectivity  more  difficult  to  achlete.    It  is  worth 
emphasizing«-and  considering  in  the  delibe ratlins  qf  your  committee — 
the  great  contribution  of  objective  stoildardlzid  tests  in  opening 
up  opportunities  for  many,  many  students  from/lis advantaged  backgrounds. 
It  is  through  such  tests  thai  such  students  who  have  come  from  Unknown 
schools,,  have  lacked  teachers  who  could  give  them  useful  recommendations 
and  who  have  sought  cax*eers  contrary  to  race  and  sex  stereotypes  have 
been  enabled  to  demonstrate  their  promlsio  and  tp  enter  outstanding  * 
institutions.     /        ■   ■  ' 

^  .  ■       .   .       ♦  c :  .. 


/ 


— ■  ■  ■  ♦ 

I 


AN  AC3TIVITY  OF  1^H§CARNEQIE  FOUNDATION  FOR  THE  ADVANCEMENT  OF  TEACHING 


\ 


♦ 


f 


I 


.  •  ■    r  ■■  ■    ^  : 

•I    •  .       .      ■  i  .  ' 

©lere  will  be  tuaxxy  student b  in  th^  future,  alBo,  who  wllL 
need  such  ppportunl ties.    They  will,  be  lll-aerved  If  It  becomes 
harder  to  take  euGhi  testa  i  or  more,  expensive  or  If  .ao  many  test 
.  questions  are  placed  in  thtf  public  ^oiatiA  that  It  will  be 
»  increasingly  difficult  to  frame  questioiyl  that  genuinely  ond^ 
fairly  test  knowledge  and  ability,    St^jjldardized  testB  are 
valuable  servants  of  the  educational  system  ahd  of  the  students 
who  have  no  other  way  to  Show  that  they  will  mt^e  good  use  of 
•  educational  o^rtunitiea,    .  ' 

.  Slncerelyi' 

■  Clark  Kerr  -  . 


L    v.--^         .^u,.v.   (  ^.4^        Y~^  •^~-. 
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I  •  orrict  or  -hti  | 
.VKa^rRuiDENT  AND  rROvoirr. 

THI  ROTJUNDA 


! 


UNIVERSITY  OF  VIRGINIA 

CHARLOTTESVUXE 
.  '  22903 


August  14, . 1979 


TEL.  IOMI4-9ns 


Mjc,  Carl  D,  Pferkina  * 
Chairman,  Education,  and  jLabor  Committee     .  I  ■  . 

Rayburn  House  Of flee  .Qulldlng 
Washington,  D,  C,  20515 

Dear  Mr.  Petklns:  «   .  ■ 

I  write  to  express  my  concern  aboyt  thsWeiss  Bill 
(HR4949).  now  under  consideration  by  your  subfflpmmlttee . 
As  I  am  sure  you  are  awarel  all  public  collets  and  univer- 
sities are  being  Continually  confronted  with  3  demand  for 
aocountAbllity,  and  as  a  mijor  public  Institution  we  it 
the  University  of  Virginia,  feel  that  It  Is  Imperative  to 
make  the  most  effective  use  ^.of  the  facilities  and  resources 
entrusted. to  us  by  the  Commonwe41th.    One  of  our  most 
difficult  problems  is  that  of  making  decisions  ab<iut 
admi^Bsiona  of  students  to  the  various  programs  ahdr  schools 
of  this  institution.    We  have\  found  that  a  wide  spectrum 
of  information  is  necessary  Ih  making  these  difficult 
.decisions  about  what  students' \bo  admit,  and  the  results 
of  the  various  standardized  tests  furnish- us  some  of  the 
most  useful. information  we  receive. 


,foi 


.     our  problem  is  a  huge  on0.    We  receive  about  25,?00 
applications  for  admission  to  the  various  par is  of  the 
University,  and  we  cah  admit  only  about  5,000  new  students 
each  year.    St  is  highly  important  for  us  to  have  the  bdst 
information  we  can  have  about  the  people  who  apply  for 
admission  so  that  we  can  best  gerve  Virginia  anf  be 
accountable  to  the  General  Assembly.. 

,        Our  objections  to  the  .W6iss  Bill  have  to  do  Especially 
with  Section  5,  which  we  are  certain  would  have  the  effect 
of  destroyipq  the'  quality  of  the  various  standardized  tests 
or  pricing  them  so  high  that  the  cost  wOuld.be  damaging  to 
the  pebple  who  take  them  or  both.    Wo  think  that  Setttion  5 
if  en^^cted  would  in  large  measure  destroy  the  utility  of 
staiySardized  tests  as  part  of  the  admissions  process. 


kmc 


lUl 


■  ...J- 


Mr.  Carl  D.  Perkins* 
August  14,  1979 
Page^Two  " 


have  two  arguments  to  make  against  Section -Sti^  The 
Weiss  Bill  Is  designed,  sa^  Its  propoMntii,  to  serve  the  ^ 
purposes  df  students  aff  consumers.    We  think  It  Is  atUeast 
equally  Important  that*  the.  Congress,  consider  the  Interest 
of  another  group  of  user^,  the  acaden\ic  Institutions. 
«Purtherr  the  history  of  standardized  national  tests  In  this 
coi^try  is  enlightening.    Before  good  tests  for  admlsspons 
were  developed  many  colleges  and  universities,  particularly 
the  prestigious  private  ones,  had  In  large  part  an  admissions 
process  which  could  legitimately  be  called  '^the  old  boy^ 
system.**    That  system  was  cleirly  elitist.    This  hlstorfcal  ^ 
fact  seems  to  escape  proponents  of  the  Bill,  who  f!ill  to 
realize  that  the  wide  Spread  U9e  of  v^andardlzed  admissions 
tests  has  had  a  democratizing  effect /N^ndeed,'  some  pro- 
'  ponents  of  the  Weiss  Bill  argue  ilhat  standardized  test6  • 
are  elitist.    They  are  not  elltllt;  -they  are  meritocratic. 
There  Is  a  vast  difference  between  an  elitist  society,  one 
based^^qn  Inherited  privilege,  and  a  meritoyetlc  society, 
suoh  as  THbffl^  Jefferson  envisioned,  based  ttpon  the  demonstrated 
•  merit  of  peopi^  '  " 

Sincerely  yours',  ' 


-eft 


David  A.  Shannon 

Vice  President  and  Pfovost 


DASi^r 


■OPPiceaF 


EASTERN  VIRGINIA  MEDICAL  sdndPL  ' 


700CX.N6Y  Rqao  ■ 


August  13, 1979  • 


\ 


Honorable  Carl  D.  Perkins 
.  Chairman 

Hov»e  ot  Representatives  \  . 

House  Olffce  DMllding  •    '     •  \ 

Washin^on,  DC  205^  \  . 

Dear  Mr.  Perkins: 

We  strongly  urge  your  non-support  of  H.R.  *9<»9.  ^  '      '   '  ^ 

i  In  our  Judgment)  the  Impact  of  this  blUf  as  currently  structural  would 
'seriously  aftect  our  ability  to  maintain  the  integrity,  high  iquallty,  and 
usefuln^s  of  the  New  MCAT  as  one  criterion  in  the  highly  complex  process 
lor  evaioatlon  of  medical  school  applicants.         .   '  ■■  * 

The  destructive  provision  of  H.R.  W9  is  the  requirement  that  a  copy  of  the  \ 
•  New  MCAT  examination  and  correct  answers  must  be  publicly  disclosed 
after  each  test  administration.    The  highly  specified  nature  of  the  New  ' 
MCAT  precludes  the  (fevelopment  of  an  unlimited  supply  of  new  questions. 

This  legislation  cauld  adversely  affect  our  ability  to  select  candidates 
■  capable  of  attaining  high  level  scientific  understanding  and  clinical-  \ 
performance  as  future  physicians  and  therefore  affecting  the.  quality  of 
health  care  for  the  citizens  of  this  country.  ^ 

Sincereiyp 

*  ■ 

Robert  M*  McCombs,  Ph.D. 
.  Interim  Dean   '  .    .  •  . 


RMM/cdb 


'  iii3 


TWi  MEPICAL  SCHOOL 

Wim  MIMCM4A4.  BwlMMJ 

Ml  E.  Cmcaoo  Atimi 


NORTHWESTERN  UNIVERSITY 

CHICACO.  ILLINOIS      I  ' 


August  16,  1979 


Menl)er8  of  thq  Education  and  Labor  OonmLttee, 
U.  S.  House  of  Rqpresait^itives  - 
\/ter.*  Carl  D.  Perktafl,  Chatnnan 

ttST  Paul  Slnwi  aUinoi^-24) 

Mr.  Jotn  N.  Erlcribom  (XlUnois-lA) 

Ft.  Miiel  B.  Crane*  (Illinois-^) 

Mr.  Robert  H.  Michel.  Minority  Whip.  (UlJnois-18)      .   _ 

W^hlngtcn.  D.C,     20d2;<        /  / 

Gentlenen:  '         ' .  ^'  '  . 

The  fbllowing  lett^  is  writtai  to  express  wy  concern  about  provislx3n^of  HR  4949 
recently  introducefcylfr,  Theodore  S.  Vtelss,  of  New  York.   Ity  specific  caacems 
are  the  innact  of  Qfe  bill  on  qualifying  ocanlnationa  offered  tteqdigfi  the  medlun  f 
of  tiK  Association  of  Ancrican*  Medical  (Alleges  and  the  NatioMT  Board  of  Medical 
EjcanlnerB.  • 

These  exandriations  are  of  the  highest  quality  and  are  bss0o%  the  most  carefully  in:e- 
pared  and  thorourfvLy  reaeard^ed  exaoodnaticns  of ferecTany^tere  in  the  wrld.   The  pre- 
Station  of  the  exanjnations  is  painstaking  and  acdjoplished  through  the  services 
Voluntarily  offered  \ff  hmdreds  of  pti^idans  and  scientists  throug^t  the  oountty 
and  in  C&nada.   All  exanlnationa  used  are  pre-6Bflted  and  the  results  of  eadi  exanina- 
tion  subjected  to  cocputerized  scrutiny  tO/^tlmlAate  naterial  that  is  misleading  or 
non-discriminating.   The  results  of  the  ^^xaralnatjjons  are  Indlspensible  to  medical 
schools  both  In  l5e  adnlssions  process',  to  medical  schools  and  in  evaluation  o^v  the 
students  as  they  progress  throi^  mfidical  education.    While  the  JCAT's  are  highly 
^  predictive  in  th6  tibSity  of  candidates  for  adnlssion  to  satisfactorily  pursue  and 
conclude  their  studies,  the  ^ffitC  ejcanlnations  provide  Invaluable  assistance  in  ineasur-. 
InK  students'  ability  tb  beconae  a  registered  practitioner  of  medicine.       fact,  as 
you  probably  know,  sucqissfullvvpassSg  the  three  parts  of  National  Bo^d  exandnaticns 
is  accepted  by-maiy  stipes  in  lieu  of  another  licensing  fexamlnatlOT.   Finally ,  upon  ^ 

/application  by  the  Dean  of  a  medic^  school,  a  profile  of  the  performance  of  his/her 
students  in  any'glven  s^ject  can  be  obtained,  thus  allowing  the  Dean  and  dialrmfln  • 

'  of  a  dejAc^t  to  ascertain  the  reliabiUty  of  the.  currictlim  in  coverln^I  sub- 
ject naS^  as  measured ^ against  national  standards.  ^  ^ 

Eadi  stident  learns  how  he/she  perfonns  in  each  8ti#ct.  To  require  tie  testing  agency 
xo  proSGe  the  perfomance  In*  each  question  and  thelrlght  answer  for  each  questlm  as 

"  well  as  to  nake  a  copy  of  the  total  exacoination  pii)liQ,  wuld  lead  to  destructiai  ot 
both  testing  agencies.   T!«  cxaminaticns  are  e)ctr«nely  conplex  to  prepare,  pre-test, 

•  research  and  evaluate.   Providing  questions  and  answers  wooW  be  laborious  dn^  costly. 
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Of  greater  significance  i$  the  fact  that  the  pool  of  questions  available  would  in  a 
few  years  beoome  totally  ekhausted,  thas  destroying  the  validity  of  the  use  of  the 
©camliiatixxis.    Occasional  copies  of  past  .exanijiations  havR  been  stolen  and  are  avail- 
able in  Mexico  for  largp  suns  pf  nroey.    I  mention  this  only  to  inderllne  the  value 
of  tte  availablUty  of  the.  written  ej^m^ 

The  proposed  regulations  can  serve  only  one  purpose;  to  destroy  an  extremely  high 
gj»de  evaluative  process,  to  fiirther  cocplicate  the  pr6ce&  of  adnitting  students 
to  medical  school  and  evalu^t±ig/ their  progress  througji  the  school,  and  to  reduce  to 
raedioprity  the  methods  pf  ditier^^nlng  viw  is  cocnpetent'  to  practice  nediclhe. 

If  I  can  bp  of  any  help  In  ejupplTlng  additional  information,  pleSase  let  iib  know. 


\ 


i|  Vsincerely  yours, 

NOKMteSTEPN  INIVE^riY  hEDICAL  SCHOOL 

Barnes  E.  Bckenhoff,  M.D.  '  ^■ 

'Dean  .     .  \ 


JEE-.pc 


/ 


^  '  Uftlwtnity  •!  ltUf*lt  at  IK«  M«A<«1  Ctolai.  CM(«f 

115)  W*«»  Nik  SliMl.  CM<*t*' )i»n«i«i«0«l3/' 

111)1  ♦♦*.ajoo  N 
August.  1979 

■  \  ■  .  -'/^   .      •  .  • 

The  HoBOri^ble  Carl  0.  Perkins  l  ' 

U.S.  House  of  Representatives 

Washington.- O.C.   20515  \    '  ^ 

Dear  Mr.  Perkins: 

Dn  July  31,  1979, .Or.  John  A,0.  Cooper,  President  of  tlie  Association  of 
Mierlcan  Medlcf^l  Colleger,  testified  before  the  House  Subconnlttee  on 
flawntary.  Secondary,  and  Vocational  Education,  Coliwittee  on  Education  and 
Labor,  dr.  Cooper's  coranents  were  addressed  to  two  bills,  H.R.  3564  and  H.R. 
4949,  currently  pertdlng.   The  former  Is  entitled,  "The  Truth  In  Testing  Act- of 
•  1979,"  and  the  latter  Is  entitled,  "The  Educational  Testing  Act  of  1979." 

It  Is  our  belief  at  the  University  of  lUlriols  College  of  Medicine  that 
neither  of  the  bills  would  assist  our  AAnlsslons  Coiwilttee  In  Its  efforts  to 
use  fair  and  linpartlal  procedures  for  selecting  candidates  for  admission  to 
the  College^  We  believe  that  the  new  Medical  College  Admission  Test  (HCAT), 
when  used  In  the  spirit  for  which  It  was  created,  provides  us  with. I  valid  and 
reliable  flieasu re.  of  our  applicants'  potential  for  success  In  medical  school. 

*We  further  believe  that  this  examination  covers  only  a  finite  amount  of 
material  for  which  only  a  flnltie  number  of  . reliable  questions  may  be  developed 
and  used.   Publication  of  such  examination  Items  would  ultimately  serve; to 

,  invalidate  the  reliability  of  the  new  MCAT  and  cause  our  /^thilsslons  Committee 
to  rely  5o\ely  on  grades  (given  by  faculty  and  schools  of  variable  quality), 
letters  of  recownendati on  (provided  essentially  on  student  request),  and  a 
relatively  short  Interview  that  may  asstit  In  Identifying  non-cognitive 
variables,  but  certainly  not  those  of  a  cognitive  nature.   Despite  the  fact 
that  the  results  of  the  r*w  MCAT  do  not  constitute  the  largest  portion  of  our 
data  base,  a  potential  loss  of  reliability  of  that  examination  will  make  our 
very  difficult  Job  all  the  more  difficult.   We  would  further  run  the  risk  of 
denying  admission  to  otherwise  well-qualified  students  who,  by  virtue  of 
attendlpg  an  undergraduate  program  that-dpes  not  give  grades,  can  present  no  , 
cognitive  credentials.  , 

We,  therefore,  strongly  support  Dr.  Cooper's  presentation  and  roost 
respectfully  urge  that  the  b.ills  in  question  be  tafcled  until  more  information 
on  their  own  validity  and  ultimate  effects  can  be  obtained  and  certified. 

Thank  you  in  advance, for  your  attention  and  support. 
.  '  .  .  Sincerely, 


1119 


1116 


THE  UNIVERSITY  OF  ROCHESTER 

MEDICAL  CENTER 


601  ELMWOodi^AVENUE 
ROCHESTER.  NEW  YORK  14042 
AREA- CODE  716  275  4022 


SCHOOL  OF  MEDICINE  AND  DENTISTRY  •  SCHOOL  OF  NURSING 
STRONG  MEMORIAL  HOSPITAL. 


CENTER  FOR  BRAIH  RESEARCH 
BOX 


August  17,  1979  ^ 


Congreesiaan  Carl  Perklnd 

2328  Raybum  House  Office  Building 

Washington,  D.C,  205lo 


Dear  Sir: 


Re:    HR  4949 


I'am  appalled  by  the  provisions  of  this  bill/  The  results  of  the  hllj. ' 
will  be  the  elimination  of  one  of  the  fmt  relatively,  objectitve  criteria  we 
have  for  evalu^lng  potential  medical  students.    These  tests  were  developed 
to  avoid  the  subjective  criteria,  or  at  least  to  serve  as  a  counterbalance  to 
the  subjective  crltecla,  obtained  in  interviews  and  letters  of  recommendation. 
Thfe  effect  of  the  blU  vijXl  be  to  increase  the.  importance  of  subjective, 
potentially  prejudiced  individual  Judgements  relative  to  the  much  more  objecfilve 
and  ''color  blind"  data  derived  from  testing. 

With  rampant  gradfe  Inflation  and  tremendous  variability  In  grading 
criteria  from  one  University  to  anotj^ier,  the  HICAT  test  has  been  the  only 
objective  criterion  for  comparison  with  the  subjective  jSdgement;.    A  mixture 
of  objective  and  subjective  criteria  are  desirable  In  selecting  medical 
students  for  avarlety  of  reasons  in  that  some  of  the  personal  qualities 
that  are  necessary  In  the  physician  are  not 'easily  detected  on  testing  of  - 
this  sort.*    Publishing  the  questi6ne 'Would  greatly  Increase  the  expense  and 
difficulty  of  administering  chls  test  and  de<^rease  Its  dffectiveness.  The 
expenses  involved  In  developing  a  new  test,  with  new  questions  every  year, 
would  add  greatly  to  the  cost  to  the  student  without  siknif icantly  helplHg 
hiipv    In  addition,  a  different  test  every  year  would  mufke  It  ^impossible  to 
detect  trends  in  performance  from  year  to^c^i^* 

In  summary,  I  find  theblll  very  mischievous,  ind  for  the  second-  time 
in  my  life,  have  been  jiUf flclqi^tly  bdthered^by  a  pending  bill  to  write  a 
Congressman  about  It.    t  hope  you  will  oppose  this  legislation. 

^  \  Sincerely, 


Rqibert  M.  Hemdoil,  M.D. 
Director,  Center  for 
Brain  Research 


RMH/nj 


OfTfOl  or  THI 


I 


UNIVERSITY  OF  VIRGINIA, 

rACULtV  6r  AUTi  AMD  KlINCtS  " 
4I»  CAIUX  HAIX 
'CHARLOTTESVILU  tXM 

.  August  17,.  1975 


/  OGomlttee  on  Edi| 
/     Office  No.  B3M6 
^.  Ra^txim  House 


itioh  and  I/ibor 


Building 


Gentle^teii: 


feUl,  H.R 

80  idifflci 
were  the 
ference 


very  nuch  that  you  will  take  a  stand  agalns^  the  .{^poeed  Weiss- 
i49.  Its  effect  would  seem  to  be  theft  of  making  standardized  testing 
to  otalrilster  that  the  future  of  such  t^estlng  would  be  in  gpeat  doubt, 
passed.   In  addition,  If  It  were  passed  It  would  be  unwarranted  inter- 
federal  goveirment  In  higher  education.    ^  . 

Slncerelir  yours. 


•  r 


Eiiwln  |.  Floyd-,. 
Dean 


11:^1 
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AMERICAN  DCNTAL  HYOIENISTS'  ASSOCIATION 


.  WASHINGTON.  D;C.  OFFICE 
!IOI  I7TH  BTnElt  N.W 
SUITE  1000  * 
WASMINCTON.  O.C.  ^0036 
1303)  833  3034 


August  20,  1979 


Honorable  CarL  D.  Perkins, 
Chairman 

Subcommittee  on  Elementary ,  •  • 

Secondary  and  Vocational  Education 
2?365  FtaybUrn  Building  ,  / 
Washington,  D.C.   '^OiP  ^  '. 

Dear  Mr,  Perkins;  ^ 

♦  ■     ■   .       ■  .      .  " 

The  American jDental  Hygienists'  Association  is  grateful 
for  the  opportunity  to.  submit  a  statement  on  H.R.  4949,.  "Edu- 
cational Testing  Act  of  1979%  and  H.R.  3564  "Truth  in  Testing  ' 
Act  of  1979"  currently  being  considered  by  the  Suljcommittee 
on  Elementary,  Secondnxj^, . and  Vocational  Education. 

■4  ■  ■  • 

:   The  Association  is  i^pt  in  favor  of  federal  legislation 

time  to  regulate  the  teating  industry.    Ther«  is  no  ■ 
evid^e  today  that  such  legislation  is  needed.    The  Associ- 
ation ^els  that  a  study  of  the  results  of  the  National 

AcademyNof  'Spiehces  and  American  Council  on  Education  studies  j  ♦ 

on  standdrdifeed  testing  which  will  soon  !^  released  ehcxuld  ' 

be  undertaken  prior  to  the  enactment  of  federjil  legislation. 

With  New  Yo^  state  passing  a  similaF  bill,  there  also  exists 

an  excellentftppportunity  to  learn  from  their  experiences. 

Much  more  evidence  ghould  be  uncovered  from  currently  rfivall-  • 

able  sources  betfore  action  of  this  scope  is  undertaken. 

If  the  proposed. bill  is  enacted,  the  effect  on  bollege 
testing  and  admissions  ma^be  undesifaMe.    Programs  that 
test  ^mall  numbers  of  appfica^ts  would  ie  severely  burdened 
economically  because,  of  the  substantial  added  costs  of  preparing 
and  shipping  hew  test  forms  several  times  a  year.    In  effect, 
these  smaller  testing  programs  would  ce^e,  and  colleges  wfiiild 
have  to  rely  solely  on  the.  larger  testing  agencies  which  test 
enough  people  to  offset  the  added  costs.    In  most  cases,  then, 
colleges  vould  have  little  choice  in  selecting  appropriate.  » 
tests .  A 

National  MBAOouAnjEMs  •  3n  cast  chicaoo  AvtfW:  chi^aoo.  Illinois  60oj  i  •  tiLi  «44  io9j 

r  .  ^  ■      •  ■  .  C 

f  ■       .  ■  :  '  •  ■  * 


1119 


Honorable  Carl  D«  Perkinff 
Page. 2 

August  '2Q,  197$ 


:    Trte  Dental  Hygiene  Aptitude  Test  itr  the  only  currently 
available  instrument  that  is  specifically  design^  for  dental 
hygiene  applicantii.  '  This  test  provides  informati^h  to  thie 
applicant: on  his  or  her  standing  in  comparison  to  all  appli- . 
cants r  and  on  his  or  her  standing  compared  to  others  with 
comparable  education.    Evidence  shows  thi^t  this  type  of  infor- 
mation is  useful  to  admissions  officers. 

If  this  proposed  leg^islaHon  is  enacted,  the  Dental  Hygiene 
Aptitude  Test  would  have  to  be  abandoned  since  the  cost  would 
become  so  prohibitive  ate  to  diminish  its  desirability  to  insti- 
tutions and  to  prospectus  dental  hygiene  students.    To  preserve 
the  integrity  of  the  test,  at  least  three  test  formd  would  be 
required  annually*    Costs  would  triple  in 'order  to:  maintain 
a  suitable  size  item-'pool;  cover  costs  for  extr^i  printing;  ship 
additional  tests;  and  construct  new- versions. .  These  costs;  of 
'■•   course, would  have  to  be  passed  along  to  the  consumer, 

|.        The  J5HAT  scores  are  not  th^  only  criteria  used  by  insti- 
^tutioni^  in  iadmissions  screening*    Personal  interviews,  grjsde  . 

point 'average,  other  tes^  scores,^ and  life  experiences  are  . 

also  part  of  the  selection  process.    The  DHAT  can  offer  an 

applicant  who  nas  long  been  out  of  sqhpol  information  on  the 
'likelihood  of  success;  it  can  also  identify  individuals  who 

may  require  remediation^  j|pt  is  obvious  that  the  DHAT  can  be- 

a  useful  admissions  tool. 

The  Association  firmly  believes  that  any  legislation 
t-his  point  would  be  detrimental  to  the  DHAT  and  to  the  colleges 
that  use  this  instrument  as  an  initial  screening  device*  The 
gain  in  predicting  academic  success,  as  compeared  to  selection 
of  students  at  randomn  is  large  enough  to  warrant  its  use*  .  At  ' 
this  point  the  Association  urges  the  adoptipn  of  a  "wait  and  - 
learn^  attitude  to  avoid  the  consequences  of  a  hasty  decision 
that  ma^  not  be  in  ^he  coi\sumer*s  best  interest. 

•A,k'  Sincerely,       •  r 

1  Kathleen  A*  Mapt,  RDH 

\  President,  ADHA 

jbct    Subcommittee  on  Elementary, 

Secondary  and  Vocational  Education 
ADHA  Board  of  Trustees 


) 
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COUNCIL  FOR  BASIC  EDUCATION 

725  FIFTEENTH  STHEET.  N.W..  WASHINGTON.  DC. 20005  «02)i47-4l7l 


August  29,  1979 


VIM  PMMMC 
Ota  (mtmm— 


MU  lAlCUTXtAIM  ' 
ft*m*t  ClWwMt 

MH»  MKIV  PINOHAM 

HtNlY  N  DBIiWIY 
r\»fmt*<  PrMutM  UMTWtiOr 
<:IIFTDH  FAMUAN  ' 

Umwm.  ttiriBM  riatn^  AI^b 

yiiltAMK  HAItMlUN 

MM  lOWABU  ■  HfMtNAMtN  ' 


TllOMA»«  fAVfANT 

MMITIMM  MI1K 

I  m4  to  i«M  liiiPn 

MKKAn  i  tfccrua 


H  MKNISCHAV 
AllWlll  DowvM 

lAMU  tioWAltD 
AMttMl  DMtf«at 

ANNC  ifHWH 


Honorable  Carl  D,  Petklna 
CoBpittee  on  B4jiication  and  Labor 
Rayburn  "Rouse  Office  Building 

Washington,  DC    20512  ' ' 

■    '  .       ■     ■    ■  .  .  *• 

Dear  Congresssvan  Perkins: 

The.  Council  for  Baffic  Education  has  a  long-standing  interest 
In  standardized  testing  in  the  nation's  public  schoblf.  *Your 
SubcooDlttee  on  Blenentary,  Secondary  and  Vocational  Sducation  ^ 
is  currently  considering  two  proposed  bills,  H.  R.  3564  and  . 
H,  R.  4949,  on  which  the  Council  wishes  to  comnent  briefly. 
For  a  ^Dxe  detailed  analysis  of  college  adaission  tests,  I 
refer  you  to  the  enclosed  1974  publication  df  the  Council,  • 
Uses  and /buses  of  Standardized  Testing  in  the  Schools  by  George . 
Weber  (pages  22-33).    I  have  also  enclosed  some  information 
about  CBE. 

As  far  as  college  admission  tests  are  concerned,  there  Is.  • 
no  need  for  either  of  the  ^roffOsecl  bills.    Both  imply  causes  for 
legislation  that  simply  do  not  exist,    tontrary  to  these  Implica- 
tions, college  adpiission  testing  provides  a  ^del  for  all  test 
makers  fn  ygn  in* explaining  their  tests  to'  teSt  subjects  and 
test  users.  Bke  .people  ptost.  concerned.'.  (See  Weber,  pp.  25-2B.0 
Unfortunately,  JournaUsts,  legislators*,  and  the  public  sometimes 
blur  the  significant  distinctions  that  properly  should  be  drawn 
between  college  admission  tests -and  other  kinds  of  standardised 
tests  that  are  indeed  flawed,    Thfe  Congress  probably  cannot 
leal  slat ^  successfully  against  auch  ignorance.  *  . 

■  It  may  be  that  college  admission  testing  has  been  damned 
by  Its  mistaken  ifssociation  with  bad  or  abused  tests.  Group 
."intelligence"  t«st8,  for  example,  probably  should  be  abolished, 
4jecause  thej^  stigmatize  children  unfairly  and  because  they,  do 
not  actually  measure  w^t  they  purport  to  nJea8ure*-native  mental 
bapacity.    (See. Weber,  pp.  3-6.)    Misuses  of  good  tests  can 
be. cited  as  well.    The  results  of  standardizi^d  achievement  tests 
are  widely  misinterpreted  by  teachers,  school  boards,,  legislators. 
Journalists,  and  the  public.    (See  Weber,  pp.  13-16).    In  all 
"forms  of  testin^^ abuses  are  possible;  in  moat  they  occur  frequently. 


\ 
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Avguat  29,  1979  V 
;  Page  Two . 
Honorable  Carl  D.  Ferkins  \ 


But  college  adal SB ion  tests  rata  high  marks  by  any  standard  . 
•  of  judgoMnt.    Fethaps  this  ia  because  the  existence  and  use 
of- college  a'daisslon  teats  are  detemlned  outside  the  schools 
whose  students' ate  heing  tested,-  a  fhct  that.neanB  reduced 
likelihood  of  abusa.  - 

With  no  help  fron  goverment,  college  admlsaion  tests 
already  effeCtividly  accomplish  their  intended  purposes  for 
'  colleges  and  students  without  ham  to  either.   These  teats 
are  not  afflicted  with  ills  that  require  new  legislative 
cures/ nor  do  the  two.  proposed  bills  offer  any  inproveaent  in 
the  admission  teats  or  the  testing  process  we  now  have.  In 
short)  the  bills  appear  to  be'unneeded  efforts  to  deal  with 
non-existent  problems --hardly  solid  ground  for  federal  action. 

Should  you- wish  me  to  develop  these  idea^  in  greater 
detail  as  testimony  for  the'Subcoonittee,  X  would  be  pleased 
to  do  so.      ...  ♦  .  '  ■ 


Sincerely, ' 


A .  Graham  Down 
Executive  Direct 


AGD/srb 
ends. 


Members  o(  Coonittee  on* 
Education  and  Labor' 
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Iffr  MILLS  APS  COLLEGE  Jackson^  Mississippi.  39210 

)\J^  OFFICEOFTHEP«€SI0ENt 


September  7,  1979 


.George  M.  Hormon 


The  Honorable  John  Hinson 
1512  Longworth  '  ^ 
House  Office -Building 
; Washington,  D.  C;  20515 

Dear  Mr;  Hinson; 


Hi  has  come  to  my  attention  that  yoU  will  be  sitting  on  a 
committee  considering  two  Bills:    The  Educational  Testing 
Act  of  197"9  (HR  4947)  sponsored  by  Conjgressman  Wise;  and 
The  Truth  and  Testing  Act  . of  1979  (HR- 3564)  sponsored  by 
Congressman  Gibbons.     In  m^  judgment  these  Bills  would  have 
a  severe  debilitating  effect  on  standardized  testing  as  it 
is  used  constructively  by  educational  institutions,  to  assist 
and  provide  guidance  to  atudents. 

Stan^rdized  tfests,  while  not  the  only  criteria/  are  invaluable 
as  toola  for  educators  in  assisting  students  tO:  understand 
themselves  and  tc  make  wise  educational  and  career  choices.  ^ 
Laws  violating  the  security  of  thes^  instruments  will  fig-  .  . 
•  nificantly  increase  the  cost  of  thflr. development,  thus 
limiting  their  availability  to  thf  disadvantaged.    Because  of  ; 
limited  items  available  tjKspme  testing  areas  the  possibility 
of  impartial  testing  may®  removed  entirely.    'Further,  the  door 
will  be  opened  for  "test  taking"  courses  based  on  the  item^ 
made  public,  again  creating  an  unfair  advantage  for  the  aflluent 
and  possibly  leading  to  incorrect  decisions  relative  to  the. uses 

of  the  test.  '     ;  '  - 

.         ■       ■  ■    ■  ■ 

It  is. my  hope  that  you  will  oppose  and  work  for  the  defeat  of 
both  Bills.    ^If  you  have  questions  I  will  be  more  than  glad  to 
provide  further  Information  at  Ifeast  as  regards  this  institutiion 
and  its  concern. 

Sincerely, 

George  M,  Harmon 
President  .  • 


GMH/mn 


.  .  ...       .  ■  .     •  ♦ 

.  . '  ■  '     .  .  .  ■     ■  ■   ■     *  ■ 


/ 


1123 


OrM<«  M.  BudfCV  L«M*r»,ClMtfp«K>n  , 
Mrt  J.  P«O0«.  Council  Bhilfl.  Vlv^CltefpMOn 
Juilte  (X  C*iB^t.  Moomfltld 
MUdr«d  C  EHMt.  Mouoi  Ayr 


STATE  Of  K)WA 


C.R.QALV1N 
.  (MREQTOfl 
TClCPHONet»19)MI-3lt9  . 

NATKMAV  ASSOClATtOH  OT 
HBAL  est  ATE  uCCNSE  LAW  Of  PICUIS 


•  I 


Real  Estate  Commission 

1223  E.  Court  Ave  ,  068  Moines,  lA  50310 
September  10,  1979 


Chairman  Carl  Per)cln8  ■ .  ^ 

Subcomnlttee  on  Eleraeatary,  Secondary, 

and  Vocational  Edu'catlon  '  ' 

Committee  on  Education  and  Labof  \' 

B-346-C  Rayburn  House  Office  Building  ,  ^  ■ 

U.S.  House  of  Represttntatives  \ 

Washington,  D.C»      20515  '  '  " 

RE J    tt.R.  3564 

'WeiB0  and  oibbone  Bills 

llie  lowft  Real  Est^e  Comniission  can  well  appreciate  the 
Legislators  thinking  that  there  is  a  possibility  of  a  ne«d  toiet^.  :  ^ 
Bond  federal  regulation  gpVerning  licensing  and  certification,  ■ 
but.  the  loWa  Real  Estate  Commission  is  of  the  strbng  belief 
that  this  type  of  regulation  can  be  regulated  more  efficiently 
on  a  state  level  without  federal  legislation.  . 

In  Iowa  each  appliceuit  for  a  real  estate  license  must  pass  ' 
a  written  examii|ation  authorized  by  the  Commission  and  administered 
■by  the  CbmmissiAi  or  persons  designated  by  the  Commission.  The 
examination  shall  be  of  scope  euid  wotding  sufficient  in  the 
judgment  of  the  Commis'sion  to 'establish  the  competency  of  the 
applicant  to  act  ^s  a  real  estate  broker,  salesperson,  or  apprentice 
salesperson  in  such  manner  as  to  protect  the  interest  of  the  public. 


The  Iowa  Real  Estate  Qonmiyaon  urges  the  Committflte  on  Education 
and  Labqr  in  its  investigatiJ!|t 'f  the  regulations  governing 
ocdupatj|onal  admiss-l4||^  tests  to  recognize  that  the  regulations  of 
Bygfh  business  has  bean  actively  delegated  to  the  icwa  Real  Estate 
Commission  Jby  the  state  legislature  since  1930.    License  laws  have 
been  aiid  are  regularly  being  r^yi^ed  to  meet  the  needs  brought 
about  ^y  changes^ 


Si 
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(chairman  Carl  .Perkins 
September  10,  1979 
Page 


There  has  bpen  close  cooperation  ;with  thejcivil  Rlghtd 
Cotnn'isslon  or  cotonlttee  tQ  tffi  that  the  contents  and  the 
structure  of  the! examination  does  not  aiscrlmlnate, 

.  fhe  Iowa  Re^ii  Estate  Coimnlsslon  does  not  believe  that  there 
Is  a  convincing  Case  for  federal  legislation  at  this  juncture/ 
and  that  the  occupatli^^al  admission  test  should  remain  the 
obligation  of  ea<;h.  state  and  not  a  federal  regulated  program. 


C.  R.  Galvln 
Director 


CRG/cw 
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THE  UNIVERSITY  C=  MISSISSIPPI  MEDICAL  CENTER 

?!'.:  Itft-th  Statt  Si'ttI 
JACr.i^M.  V.lSStSStm  39214 

September  12,  1979  " 


j^EP  18 1979 


>  tj  Ms  (V. 


The  Honorable  Jon  C.  Hinson  I  ^  J 

ISliv^ngworthL^  ■. 
^ouseN^fice  Building  .  <  ■ 

KashingWi,  D.C.    20215  . 

'    \  ■ "         .  ■  '  ^  .  '  ■  ■  ■  ■  r-   1  .  .'"  •  ■ 

Dear  Representative  Hinson; ■      ■  -    .  - 

.  I       very  conccr^ned  about  HR  4949,  the  Educational  Testing,  Act  of  1979 
introduced  by  the  Honorable  T.  V^^lss.    Having  reviewed  the'bill  and  the 
rcinarks  about  It  In  the  Cbngresftional  Record  dated  July  25*  1979  I  am 
disturbed  6ver  the  possible  Implications  for  dental  education.. 


I  hsve  discussed  the  proposed  bill  with  my  chief  administrators  and  - 
ceftain  members  of  theVfaculty  of  the  School  of  Dentistry;.  ,  It  is  my 
understanding  that  Blll\4949  may  be  reported  out  by  the  suUcommittee  in 
late  September  and  may  b«  discussed  by  the  House  Committor  pn  Education 
and  Labor  soon  ^fter.    Since  you  are  a  member  of  this  important  committee, 
I  w|hit  to  express  my  concern  over  the  'possible  effects  such! legislation 
.vouio  have  on  our  new  and  ^pldly  developing  School  of  Dentistry  in 
JaoHson.    Listed*  below  are  tihe  salient  points  from  our  joint  discussions 
which  I  would  like  to  bring  \o  your  attention.  1 

••Generally  the  bill  intends  to  alleviate  bias  in  testingi,  improve 
public  accountability  and\nanaate  financial  disclosure.]   These  are 
notable  but  we  fail  to  see\  how. this  bill  will  alleviate;  bias  in' 
testing  and  improve  public\ac:couht ability.     It'^can,  we  believe,  ' 
mandate  financial  disclosure 


> 


ERIC 


-In  relationship  to  test  bias 
income,  to  test- scores.  One 
that  there  is  a  moderate  co: 
income.    Perhaps  such-.a  correl^ 
scqre^  reflects  iittellectgal 
of  test  bias  Is  much  more  compl^ 
the  bill. 


the  bill  cites  studies  relating 
luld  just  as  well  cite  studies  showing 
ati^on  between  intelligence  level  and 

between  income  level  and  tost 
[ctors?    In  other  words,  the  problem 
tha^  that  which  Is  addiiessed  in. 


-Test  ma)iers  for  years  have  attempted  to  develop  tests  thai  would 
have  predictive  validity  (i^e.  pJfedict  criteria  with  a  high  correlation 
between  test  scores  and  the  criteria) «    Research  would  suiiport  the 

^  fact  that  many  of  the  aptitude  testing  programs  In  fact  do  a 
fairly  good  job  of  this  thuS'iravinlg  the  student  and  taxpay^c  much 

■  frustration  and  concern.    The  background  data,  presiftited  inithis 
bill  is  biased  froTn  this  standpoint^  when  they  say  correlati^ons  are 
very  low. 
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The ' Honor efale. Jon  C-  Hinson 
September  12,  1979 
Page  2 


^      -We  bslio.ve  the  bill  is  too  restrictive  and- places  unfair  ^^uidelines 
on  Vr.9  teat  coppanies,  especially  the  roquiro.-nent  for  companioo  to 
send  a  copy  of  th^  question  and  answer  sheets  to  the  sub;)ect.  .This 
.  is  urr^^listic  and  in  some  testing  areas  iten  pools  would  be  depleted 
ver^'  ^UicHly.    since  all  possible  items  would  be  available  to 
anycr.a,  it  would  defeat  the  purpose  of  testing. 

■    -Some  points  of  the. bill'  such  as  j^royiding  more  infoirmation  to  the 

subject  conporning  the  purpose  of  the  test,  skills  demanded,  Reporting 
of  srores  and  privacy  of  students  are  necessary.    If  testing  companies 
are  la- fact  t^Xing  advantage  of  the  public  related  to  costs,  then 
the  iccountability  section  of . th4  bill  would  seem  to 'be  appropriate. 
However,  very  little  background  data  is  provided  on  financial  ' 
acco.:ntability.  j| 

!  ■ 

In^sujimarv,  this  bill  does  not  seehr  to  be  realistic  in  what  it  hopes  to 

accomplish  and  the  methbds  of  doing  so  are  impractical.    We  believe  a 
more  adec-^ate  bill  with  much  less  restriction  should  be.  written.  I 

would  vor^•  much  appreciate  ypur  reaction'  to  -the  concerns  of  the  administrati 

and  faculty  of  our  School  of  Dentistry  and  please  accept  my  appreciation 
for  yoiir  considcratipn.                         ^  ':  . 

Sincerely,  ^ 

Wallace  V.  Mann,  Jr.,  D*j 
Dean,  School,  of  Dentist 

WVM/ajt  .  .  ■ 

cc:    Dr,  Harry  Bruce,  Executive  Director  -  Am^ic'an  Asrfbciation  of  Derttal  seh6ois 
Dr.  rnbmas  Ginley,  Secretary-  Council  on  Dental  Education 
Dr.  Tames  Graham  -  Assistant  Secretary  -  Council,  on  Dental  Education 

■  ■ 


\ 


I 


Honorable' Jon  Hinson. 

/.'S  House  pf  Representatives  '     .  t     ■  - 

V^shingtoh,  DC  20^1^ 

!>ear'  Jons  ^  /  .    .  i 

I  wanted-to  write'  you  with  regard  to^  t^o  related  bill's  (H.R. 3564  and 
-9A9)  which  are  currently  under  study  by  the-  House  Committee  on  Education 
and  Labor,  of  which  you  are  a  member,  I' believe* 

!  ttimply  wanted  to  express  my  very  , strong  opppsition  to  this  type  of 
legislation;  ooice  agaln^  it*s  like  taking  a  cfinnon  to. kill  a  fly* 
Thlif  is  legislation  somewhat  similar  to  that'which  has  passed  in  New 
Vonc  state  and  is  being  considered  in  a  number  of  other  states.  Such 
legislation  strikes  perilously  close  to  the  heart  of  the  academic  enter- 
prise*   Such  legislation  would  have  the  general  effect  of  requiring  that 
:est  questions  and  answers  be  disclosed  to  students  after  their  test 
results  are  returned  as  well  as  requiring  that  certain  information  be 
.    distributed  to  students  at  the  time  they  register  to  take  the  tests 
{ACT,  SAT,, MOAT,  LS AT,  etc.).     Also,  they  rfeqiiire  that  all  studies 
'involving  test  result^  b6  filed' as  a  matter  of  public  record.  Further, 
:ne  of  the  proposed  pieces  of  legislation  would  limit  the  use  of  test 
results  in  selection  decisions*  '       '  . 

lislcally,  I  an  opposed  to  such  legislation  because  it  is  quite  apparerU; 
:hat  Represent Aive-Weiss  from  New  York  is  tryJng  to  place  this  on  the^ 
federal  level  since  MOAT  opted  out  of  New  York  state  after  the  ^Jew  York", 
legislature  approved  a' similar  bill.     If  that's  what  New  York  wants,  thfi^jt 
is  their  privilege  but  I  do  nbt  believe  that  is  necessarily  good  for  the^ 
r.ation  just  because  New  York  may  desire  ft.  ^ 

Althought  the  proponents  cite  admirable  goals  and  disdain  any  intention  ' 
to  Interfer  with  the  adtnlssions  processor  wfth  the  nature  of  the  tests,  - 
"  the  legislation  would  accomplish  just  these  goals* in  a  most  ineffective 
vay.     Further,  the  potential  impact  on  institutions  as  well  a&  students 
And  their  families  has  not  been  clearly  established  not  have  the  relative 
costs  and  benefits  to  students  and  society  been  docuii^ehted.    Finally,  t^e 
limited  evidence  tliy^  far  presented  does  not  seem  to  document  sufficient  ' 
pervasive  harmful^  results  of  test  misuse  to  justify  legislation  Inter- 
vention nor  to  assure  ;that  the  cure  would  not  be  worse  tlian  the  disease. 
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I  shall  appreciate  your  thoughtful  consldetatlon  of  these  matttrs  and 
look  forward  Jtp  being  in  Uashington  in  the  not  too  distant  future-Co- 
jiscuss  these.  p9  well  as  otherTssuj^wlth  you.  ...  .. 

With  very  be^t  wlshfeSi*  .  '  J 

Lewl^  Kobles,  President 


\ 


LH:ps- 


\ 


I 
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SrUDENTo 
RJTEMS& 
PIACEMEMT 

Cari«(onCoN««a 

wAttMiMiiiw  507/663-4294 
Septeaber  14,  1979 

.  •  •  ■ . ! 

Congretfliun  Arlen  Erdahl 
House  of  Representatives 
Wsshljtyjton,  DC    20515       ,  ' 

Deer  Congressaan  Erdahl :  '  .    \  '  ' 

I  am  avar&  of  tha  "Truth  in  Tasting'*  legislatrio^  which  is  currently  being 
Congress,  referred  to  the' Education  and  Labor  CooDitte'e. 


i 


As  a  Bid-level  administrator  at.Carleton  College  for  .17  yearly  I  have  counseled  atudents 
and  slisiai  regarding  tests  required  for  admission  to  graduate  end  professional  schools, 
and  I  have  also  administered  many  testa  which  would  be  affected  by  the  pending  legislstion. 


In  my  op  in 


ijlon, 


truth  in  Testing'*  provisions  would  be  harmful  for  these  reaaons: 


(1)  The  kests  would  become  more  expensive,  since  new  questions  would  have  to  be  written 
for  (tach  new  administration,    A  valid  test  is  s  very  valuable  document,  and  you 

'  cannit  Imagine  the  great  care  ^hat. is  given  to  writing,  validating,  'Me-culturing" 
a  teit.    After  that,  extreme  security  is  practiced  in  the  distribution  pnd  collection 
of  t«sts.    When  on^  considers  the  labor  which  is  given  to  that,  effort,  the.  costs  of 
testing  borne  by  the  test  takers  is  very  low.    Th^  testing  business  is  an\ extremely  . 
efficlient  one,  I  feel,  and  I*ve  uorked  with  them  a  lon^  time.    By  the  way,    I  do  not 
conailler  myself  an  advocate  of  testing  companies — my  allegience  is  to  my  jbb  as 
a  placement  professional — my  firs&  loyalties  are  to  students  who  take  the  ^ests. 
I  teejL  they  are  served  very  well. 

(2)  Pressiire  .would  build  for  t^st  preparation^    Expensive  workshops  to  ^'cram'*'  for  l^w, 
medicil  and  other  boards  would  proliferate.    More  expense  for  the  serious  applicant! 
But  mi'.-  concern  is  also  that  tests  are  Just  one  of  many  considerations  that  a  college/ 
uniyersityi  should  consider  in  admitting  a  student.    X  think  this  is  practiced  now  dn 

*    most  (sses.     Federal  legislation  which  would  enable  t>ie  wealthy  or  the  \:onnlving 
type  cf  individual  to  Enhance  his  chances  of  college  admission  is  contrary  to 
.enlightened  practice.    Present  policy  serves  very  well — ptacfeice  questionif*^8nd 
gener^  informatioji  about  test  questions  are  Available  to  all.  - 

(3)  The  quklity  of  testing  would  have  to  sink. if  security  was  broken  each  time  tests  are 
administered.    Teffts  fin  all  reputable  companies  are  prepared  with  the  help  of  consul^ 
tants  Vnd  committees  from  Vheir  users.    Members  of  Carleton*s  staff  help  in  the  work 

ly.    Coming. from\  wide  variety  of  backgrounds^  they  insure  that  tests  are 
lich  insure,  as  muvi  as  possible,  the  brosd  representsilOiu-.  of  questions 
for  the  jbest^s  purpcAe.    These  people,' the. test  companies    could  not  ^eep  up 
ed  quality  of  work  in  the  fact  of  constant  need  for  new  tests,  unlessythere 
e  amounts  of  money  expended.    More  expense!    Greater  margin  for  error!    It  - 
is  possjLble  that  testing 'quality  would  drop 'so  that  testing  would  lose  credibility 
to  the  ^xjtent  that  it  would  be  unusable*    That  would  put  Us  back  in  the  Dark  Ages 


occasii 
writtei 
desirei 
.  the  riei 
were  hi 
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dongreasman  ArXen  Brdahl 
'  SeptOBber  14,  1^79 


P#8e  2 


«g*in  as  £ar  a.  tht  selection  of  candldatea^or  educatl^onol  opportunity; is  concernedi 


IM&y  I  say,  Ip  eloilngi  a  few  ^ilngs  about  the  perfornance  of  test  conpanlee  which  I'm  moBtj 
.  fa^illlar  With.    They  are  the  Educational  Testing  Service  of  Princeton,  NJ,  the  American 
Obilly^k  Testing  (^onpany,  Lowe  City,  4nd  the  Psychological  Corporation,  New  York.    Their  | 
4eilvery  of  serylces  Is  exenplary.    They  have  earned  and  enjoy  a  high  level  of.  trust  In 
' ' the\ acadeaic  coODunity,  including  the  overwhelming,  number  of  sttidents,  for  validity, 
■  efficiency,  andf,  beyofid  that,  an  enviable  performance  In  promoting  equal  opportunity  to 
the\generai  puUllc. 

I  wolild  hope  chat  you  will  coqaider  carefully  the  **Truth  In  Testing*'  legislation.  I  feelj 
'  It  le  unneeded  end  countjBfptoductlve  to  good  educational  practice. 


'Sliicerely, 


HarlVa  J-  Hill 
Associate  Director 
Placenient  Coordinator 
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kbWARD  R*  MADIGAN  ^ 
-  Illinois 


I- 


September  19 ,  1979 


The  Honorable  Carl  Perkins 
Chairman  .  , 

Subcommittee  on  Elementary,  Seconpiary 

4nd  Vocational  Education  *, . 

B  346C  .  .'^ 

Pear  Carl: 

The  encloeed  correspondence  from  the  president  of 
Illinois  State  University,  Dr.  Lloyd  Watkins,  addresses 
the  issues  involved  in  two  truth  in  testing  bills  currently 
under  consideration  by  your  Subcommittee  fn  Elementary, 
Secondary  and  Vocational  Education.    I  hope  President 
wJj^ins'  comments  Will  be  useful  in  your  deliberations  on 
this  legislation^ 


4" 

EM/jad 


ERLC 


Sincej:^ly , 


Edward  Madigan 
Representative  in  Congress 


\ 


0; 


THiSVTATIONEftYPItlMytO  ON  PAfCIt  WIADE  WITH  ltEGYCUU3  ^liMM 


\ 


V  . 


^  9 


Hllrrois  State  University  | 

President 

.  '  ■  "  ■  "    ■  .     ■  .  ' 

I      •  '   0^    '    ■  Sqgtember  6,  1979 


The  Honorable  Ed^rd  R.  Madlgan 
U*  S.  HouBe  of  Representatives 
1514  Longworth  House  Office  Building 
Washington,  D.  C.  20515 


Dear  Representative  Madlgan:  ^ 

My  purpose  In  writing.  1b  to  oppose  the  proposed  legislation  of  The  Weisa  bill 
(H.R.4949)  and  Ihe  Gibbons  blU  (H.R.3564),  the  so-called  "Truth  1h  Testing*'  le- 
gislation and  Bimllar  to  The  New  Yoik  State  bill  (S.5200,  LaValle  etal.)  which  was 
recently  enacted. 

In  opposing  this  proposed  legislation  I  am  not  unaware  that  some  misuse  of  stan- 
dardized testing  does  occur«  The  solution  to  the  probleni  of  improper  use  of  stan-^ 
dardlzed  testa,  however.  Is  not  to  enact  legislation  as  proposed  in  the  WelsB  and 
Gibbons  bills.  The  disadvantages  of  these  two  bills  far  outweigh  the  advantages. 
The  disadvantages  are  several,  and  each  Is  substantive  as  a  potoitial  dlsse^ice 
to  graduate  education  In  the  United  States.  Flrsy,  and  primary,  is  the  ^^vNjK^ 
test  quality.  It  may  hot  be  possible  to  maintain  ihe  present  qualify  and  nm^f 
the  test  as  an  aid  for  declslon-tfbking  for  student  admissions.  This  iB^^IPRloulaiiy 
true  for  the  Immediate  future  when  ^e  requlrc«nent  for  disclosure  of  test  questions 
^and  answers  will  result  In  compromised  tests y 

^  I  /  ■  *  ■ 

Sec9nd,  the  proposed  legislation,  (if  enacted,  /would  increase  student  costs.  The 

constant  development  of  new  testS|^  which  Is  j^xtremely  difficult,  le^  expensive. 

Third,  the  proposed  legislation  would  probably  result  In  fewer  tee^i^ administrations, 

thereby  decreasing  access  Uy  taking  the  test/for  t&e  student.  Thls^could  have  an^a^- 

verse  effect  on  admissions  processes. 

Your  consideration  bf  these  disadvantages  In  the  hearii^gs  on  October  10  and  24 
will  be  appreciated.  In  my  opinion,  the  legislation  should  not  be  enacted. 

\  -  .     -  ^ 

*  Sii^cerely,    ^  * 

"  ■      ■      v.  7/ 

^  ;Lloyd\,  Wfltklns 

,    President  ^ 


LlW/gc 


.  V(ormal*Btbominglon. 
Phone;  J09/43»-5672^ 


Illinois  I      >  ^  ^ 

'  .    .     /  tJofmal,  nilnols  61761 

Iquai  OppottunHy/AUirmiUve  Action  UnivenU^ 


I  1136 


,.  1138 

AMERICAN  BOARD  OF  MEDICAL  SPECIALTIES 


.Ol|M  R.  LEYMASTfli.  M  O. 


'JAMES  L.  NANSfH.  MO. 
JiuoclMa  OirMior 


1103  OalABtonAvwMM,  8ull«  (160 
EvinilQO.  tlllnoii  90301 
(ai2)  4t1409t 


October  9,  1979 


The  Honorable  Carl  D.  Perkins 
Chalnaan,  S^jbcoamlttee  on  Elementary, 
Secondary  ^nd  Vocational  Education  .   '  / 
Room  B3^6C  ■         .  '         ■    Z^-'.  ' 

Rayburn  House  Office  Building 
Washington,  DC  20515 

•  •      ATTENTION:    Clancy  Cober  ^, 
Dear  Sirs  •  '  ' 

This  letter  transmlte  to  you  testiffiony.  which  the  Amerlc^  Board  of  Medical  Specialties 
had  hoped  to  be  able  to  present  in  person  to  the  Subconmittee  on  Elementary, .  / 
Secondary  and  Vocational  Educatiim  since  it  is  directed  to  two  bi'^lSi  HR- 3564 /and 
'HR*4949|  which  ai:e  .currently  being  examined  by  your  Committee*  ' 

Since  we  , shall  not  hav^the  opportunity  to  testify  in  person  before  your  Committee, 
I  dm  submitting  urittten  matcurial  with  the  request  that  it  be  considered  by  your. 
-  ComDittee  as. part  of  the  deliberations  on  the  "truth  in  testing"^ legislation,  in 
accord  with  the  suggestion  of  your  staff.  ^ 

It  tfeeas  appropriate  to  me  to 'submit  the  statement  as  we  have  prepared  it  for  otal 
preaen^tion;  I  trust  that  Vpur  Coimittee  will  also  consider  this  form  satisfatl^ 
tory.    If  there  are  any  questions  regarding  the  testimony,  the  position  of  the 

.American  Board  of  Medlcal<:iS  pec  laities  anclany  of  its  member  boards  in  regard  to 
this  legislation,  I  shall  be  pleased  to  respond  on  behalf  of  ABMS  or  to  secure 

.  authoritative  responses  from  our  member  boards,  whichever  procedure  might  best 
secure  the  information  which  you  desire* 

If  additional  hearings  are  scheduled  at  a  future  date,  and  if  you  deem  it  appro- 
priate for  a  representative  of  the  American  Board  of  Medlcalc Specialties  to  pre- 

,.  sent  testimony,  please  let  me  know  and  we  sliall  be  pleased  to  send  an  informed 

.representative.  ^ 

^  Yours  sincerely, 

^ r,^  tf\  ^  ^  j  U     » A-- 

•     .       /Glen       Ueyroflster,  M.D. 
^  Executive  D^ector 


GRL/Jem 
At.tach^nt: 


American  Bdard  of  Medical  Specialities. 
Testimony  Regarding  Proposed 
"Truth  in  Testing'*  Leglslaeiotj^  '^i;. 
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"  '    •  ♦  .- 

Testimony  Jlegarding  Proposed  "Truth 

.in  Testing"  Legislation  before  the  .  * 

House  Subcpminittee  on  EleiAehtaryf 
Secondary,  and  Vocational  Education  - 

of  the  Committee  on  Education  and  ■ 
•    .       .  •  Labor;  Hon,  Carl  D,  Perkins,  Chairman.  %.        ^  , 

.     Good  day,  Mr.  Chairman/  and  members  of  the  Committee. 
The  American  Board  of .Hedical  Specialties  appreciates  this 

opportunity  to  present  its  views  on,;HR'3;$64  aricj  HR  4949.. 

9  .•     ■   .    •         "   •    !  . 

[Description  o^f  ASMS]  . 

I  am  Dr.  Gordon  W.  Douglas,  President  of  the  .American 
Board  of  Medical  Specialties.    Accompanying  me  today/is 
Dr.  G.len  R.  Leymaster,  Executive  Director  and  Secretary  of  the 
American  Board  of  Medical  Specialties.    The  American  Board  of  . 
Medical  Specialties,  which  we.  refer  to  as  "ABMS, "  is  an  organ^ 
Ration  v^iose  purpose  is  to  assist  the' 23  medical,  specialty 
boards  which, are  members  in  their  individual  efforts  to  eval|r 
uate  and  certify  physicians  specializing;  in  the  various  fields 
of  medicine.    The  23  niiember  specialty  boards  each  conduct 
voluntary  certification  programs  in  the  field  of  medical  prac- 
tice  they  represent.    These  specialties  range vfrom  anesthesi- 

ology  to  urology^    I  would  emphasize  that  the|e  certification 

'*  •   .  '  . 

programs  are  voluntary.    They  do-  not  affect  a\physician's 

'  *      •  ■  '  .       .   ■.  *  ■* 

license  to  pfactic^;  rather  certification  by  a  medical  spe-  ^ 

cialty  board  constitutes  formal  recpgnitiofe'.of 'a  physician's 
competence  in  a  chosen  specialty  by  his  pr  her  professional 
peer6.  ^  '  « 

*As  an  "umbrella  organization,  ABMS  also  serves  as  a 


spokesman  for  and  representative  of  it^  member 'specialty  boards 


spokesman  for  i 


■   //_.«;  11-85  ■ . 

•  '      ■  '       ■     ■  *        .  *         ^.  ■ 
^  within  the  medical  professioxi.    For  example,  ABMS  was  one  of 

the  organizers  of  sudh  bodies  as  the  CQordinating  Council  on 
Medical  Education,  the  niaipon  Committed  on  Graduate  Medical 
Education,  and  the  Liaison  Comroittee  on  Continuing  Medical 
Education-,    Thus,  ASMS  is  closely  concerned  with  medical  edu- 
cation and  18  involved  in  a  variety  of  efforts  to  assure  that  a 
high  level  of  physician  competency  is  maintained  in  the  medical 
profession.    As  a  result,  I  ^^^^^(j^M^J'^y  teBtimony  will 
IL:  reflect  many  of  the  same  conoern|Kxtrw»d  by  representatives 
\of •  the  National^oard  of  Medical  CT^riB^gyy  the  American  Asso- 
/i^ation  of  Medircal  Colleges,  the  Fed^^Sbn  of  State  Licensing  ^ 
Bdiirds,  and  others.    I  believe  *?t  is  -fair  to  say  that  virtually 
alltof  these  professional  .groups  liave  =  grave  concerns  about  the 
effe^  the  proposed  legisla1;ion  might  ultimately  have  on  the 
standard  of  medical,  practice  in  the  United  States. 

fProblemg  in  the  Proposed  Legislation] 

Whilf  it  does  not  appear  that  the  bills  presently 
before  this  comroittee  would  directly  affect  the  voluntary 
tes£ing  and  certification  programs  of  the  v?irious  medical 
specialty  boardsi  "MMS  is  concerned  that  the?e  bills  ml^y  mark 
the  beginning  of  a  development  that  would  ultimately  be^  detri-^ 
mental  to  the  goal  of  assuring  the  highest  possible  lev^  of 
pro{es6ional  competency  among  physicians.  . 

Of  course,  ABMS  has  no  quarrel  with  the  stalted  goals 
of  the  proposed  legislation.    Everyone  can  «^gree  that  tests 

*  used  in  evaluating  educational  admissions  or  entrai%e  to  various 
occupations  should  be  fairly  and  equally  administered.    That  i6 
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n<|t  the  only  wbrlhwhije  goal  toHbe^rsued,.  however.  Particf- 
laAy       the^casl  of  highly  sophisticated  professions  like 
medicine,  the  public  has  an  overriding  concern  th^t  a  high 
level  of  individual  competence  and  excellence  be  maintained. 
Indeed,  the  medical  prqf^ssion  has.  always  approached  the  evalu- 
ation  o^t^ysiciah  competency  as  a  public  trust*    Because  of 
the  oDI^ious  adverse  effects  of  allowing  any  but  the  most  skilled 
individuals  to  practice  medicine,  the  medical  profession  has 
always  sought  the  best  possible  testing  programs  to  insure  the 
excellence  of  all  who  are  admitted  to  practice. 

'.In  a  very  real  sense,  medical  testing  programs  and 
testing  programs  developed  by  the  other  learned  professions 
like,  dentistry  and  law  —  have  a  fundamentally  different  purpose 
than  tests  used  in  o'ther  vocational  settings.    In  many  occupa- 
tional  areas,  tests  merely  serve  to  verify  that  an  applican^ 
has  some  minimal  level  of  skills.  '  In  these  ""settings,  piib].ic 
accountability  for  the  fair  and  ^ven-handed  administration  of 
the  test  may  be  of  tantamount  concern.    By  contrast,  profes- 
signal  testing  programs  strive  to  assxire  that  professional 
practitioners  demonstrate  thd'^high  levels  of  competence,  skill, 
and  knowledge  commensurate  with  the  profession's  public  trust. 
In.  this  context,  thie  foremost  test  criteria  must  be  the  Assur- 
ance that  the  test  used  will  Successfully  screen  out  all  but 
the  genuinely  competent  applicants.    Thus^  appropriate  teiting 
standards  fnust  be  geared  to  the  testing  context.    We  submit 
that  inflexible  standards  of  test  administration,  such' as  those 
found  in  the  present  bills,  should  not  be  allowed  to  undercut 
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the  assurance  of  professional  inedical  competency  which  the 
American  public  expects  and  deserves. 

tPisclosure  of  Questions  and' Answers] . 

I  an  sure  that  the  committee  has  already  received 
testfimony  from  a  vai^ety  of  individuals  and  groups,  including 
other  spokesmen  from  the  medical  profession,  regarding  some  of 
th^  specific  problems  and  hazards  posed  by  the  proposed  bills. 
I  will  brief ly  touch  upon  ^ne  item  which  appears  to  b^  crucial 
to  a  wide  variety  of  testing  programs  now  used  by  the  medical 
profession. 

The  most  troublesome  provision  in  the  proposed  legis- 
lation is  the  requirement  that  test' questions  and  correct 

wswers  hb  disclosed*    This  poses  two  problems.    First,  once 

■•      .  .  .  ■  •  .  * 

published,  we  believe  it  would  be  the  height  of  irresponsibility 

to  reuse  a  test  question;    We  do  not  want  physicians  to  be   '  ^ 

licensed  or  certified  because  they  can  learn  correct  answers  ^ 

from  past  examijnations;  we  only  want  physicians  tV  be  licensed 

if  they  have  a  brclfessionally  sound  knowledge  of  medicine,  in 

some  highly  .'specialLized  areas  of  medicine,  the  need  to  constantly 

devise  new  test  questions  may  pose  practical  difficulties. 

Second,  and  more  fundamentallyr  the  need  to  con* 

Bti^tly^use  new  test  questions  may  reduce  the  validity  and 

reliability  of  the  testl^  themselves*    t  think  everyone  would 

agr^  that .  questions  which  .are  vague  pr  which  contain  some 

hidden  flaw  that  misleads  the  J^est*^ taker  are  bad  questions* 

Similarly,  and  particularly  in  professional  testing^  we  do  not 

want  questions  that  lend  themselves  to  Imoge  numbers  of  correct 

:  .4-  •  \ 

* .  •  ■  ■ 

\  .  .         ■  '■  ■  ■  . 
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gue9ses;  rather,  we  want  questions  that  accurately  §nd  reliably 
inei^Sure  the  test-taker's  knowledge.    Modem  test-construction 
procedures  cdh  eliminate  many  of  these  types  of  bad  questions. 
For  example,  by  statistical  analysis,  it  is  poissible  to  weed, 
out  questions  for  which  test-vtakers'  answers  do  not  correlate    ' . 
w|ith  their  overall  score*    A  lack  of  correlation  between  how 
well  test-takers  do  on  a  particular  question  and  how  they  do  on 
the  overall  examination  suggests  that  question  really  isn't 
measuring  the  level  of  , the « test-takers'  knowledge.  Similarly, 
question^  that  are  geiierally  too  hard  or  too  easy  can  be;  identi- 
fied statistically  and  eliminated. 

But  these  modem  test-consftruction  techniques  require 
good  information  on *the  past  performance  of .  the  question  in 
previous  examination  sessions.    By  preventing  reuse  of  questions 
disclosure  of  test  questions  will  severly  limit  the  use 
sound  test-constmction  methods.    In  short,  the  ^closure 
/proposal  appears  to  be  (R^ouriterproductive  to  the  g^al  of  the 
'.proposed* legislation.    It  will  not  make  tests  fairer  —  it  will 
dhly  make  them  less  reliable. 

.  ^      The  damage  that  ifould  b^  done  to  medical  testing  by 
disclosui:%  of  questions  and  answers  would  not  be  offset  by  any 
positive  benefits,    I  understand  that  some  previous  witnesses 
before  this  committee  have  suggested  that  diBclosure  would 
equalize  the  advantages  now  supposedly  enjoyed  by  test- takers 
who*  talie  t^st  preparation  courses  or  that  revealing  correct 
answers  would  be  a  "learning  experience"  forL.tiie_teBt-taker . 


-5- 
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Neitjier  of  those:  supposed  benefits  has  any  relevancy  to  prof es- 
.sional  testing.    The  nedical  profession  wants  physicians  to 
learii  medicine  in  medical  school;  not  by  repeated  efforts  to 
simply  pass  examinations, 

[Interference  with  Professional  Stahdards] 

What  disclosure  may  do^Jiowever,  is  to  expose  e^uca- 
tioriai  and  professional  standards  to  interference  by  a  wide 

variety  of  interest  groups  who  seek  not  to  assure  the  highest 

■»    •  •  . 

levels  of  professional  qualifications,  but  rather  to  assure 

■-*'■■       * '  ■     •  . 

their  own  success  in  ge^nihg  entr;  1:0  a  jchosen  school  or  field. 

One  can  reasonably  predict  that  professions  or  institutions 

which  attempt  tp  maintain  standards  of  jxcellence  willy  find 

themselves  embroiled  in  controversy  and  litigation,  a6  a  result, 

/      More^  broadly,  ASMS  is  concerned  about  whejp^/the  whole 

concept  of  a  federal  standard  of  "tiruth  in  testing"  is  leading, 

iRegulatipn  of  tjie  professions  is  a  rble^  traditionally  occupied 

by  the  states.    The  states,  in  ttm,  have  rejded  heavily  on  the 

various  pro.fes^sions  to  define,  improve,  and  maintain  prbfes- 

-Sionai  standards  and  qualifications  for  practice.    We  are 

confident  that  Congres[|  does  not  intend  that  this  traditional 

structure  of  professional  regulation  should  be  altered  simply 

to  facilitate  thfe  prescription  of  uniform  testing  standar4|p. 

yet,  the^roposed  bills  pose  that  tAeat.^  The  proposed  bills 

define ^their  scope  of ^coverage  in  terms  of  "interstate  commerce 

I  am  not  a  lawyer  and  I  cannot  speak  to  the*.quegt^n  of  whether 

medicine  is  an  aspect  of  interstate  commerce  as  a  legal  matter. 
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I  i|m  told  that  some  courts  have  given  that  concept  rather  broad 
meaning  in  the  past.    But  llcan  say  that  the  medical  profesBion 
does  not  view  itself  that  way.    And  traditionally  the  states 
have  nqt  viewed  medicine  tl|»t  way,  either. 

[Exemption  for  Professionai  Testing  Programs]  .  . 

In  sum,  ABMS  is  opposed  to  the  present  bills..    If  the 
committee  believes  that  some  legislation  ie  required  in  this 
area,  ABMS  urges  that  the  legislation  sfxould  be  carefully 
tailored  to  exempt  the  sot>histiCated  testing  programs  employed 
in  professions  such  as  medicine.    To  the  best  of  our  knowledge^ 
no  one  X8  claiming  that  there  are  any  significant  abuses  in 
medical  ^professional  testing  programs.    None  have  been  brought 
to  our  attention.    I  believe  that  any  review  of  the  presef^ 
structure  of  medical  testing  would  show  that  medicine  and  a 
variety  of  other  learned  professions  are  lignt  years  ahisad  of 
the  run-of-the-mill  testing  methods  used,  in  mahy  Occupational 
settings.    Jn  view  of  the  serious  problems  posed  by  the.  proposed 
legislation,  its  scope  should  be  no  broader  than  absolutely 
neceiBsary  to  meet  the  specific  abuses  the  committee  identifies. 
Medical  testing  programs  should  be  explicitly  exempted. 

Thank  you.  '  . 

■  'V 


-7- 
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•     -   ^     AM£BICA>i  .DEMTAL  ASSOCIATION 

WASMWOTON  OFFICE  •  SUITE  1004  M  lOl-l  7TH  STREET.  N  W   •  WASMlWTON.  0  C  20036  •  PHONE  202  533  3036 


October  11,  1979" 


.The  Honorable  Carl  D.  Perkins 

ChairmAn  j|| 
Subcommittee  on  Elementary,  Secondary 

and  Vocational  Education  '  ' 

232B  Rayburn  Houpe' Office  Building       '  . 
Washington,  D.C.     20515  '      ;  | 

,  y 

Dear  Chairman  Perkins:  i  . 

. .        '  ^  <    •  •  ■ 

I  am  writing  on  behalf  of  the  American  Dental  Association  to  express 
our  concerns  regarding  the  disclosure  provisions  of  the  Educational 
.Testing  Act  (H.R.  4949),  and  related  measures,  now  pending  *  before  - 
the  Subcommittee, 

 ^-  '  } 

As  you  undoubtedly  appreciate*,  the.  ability  to  perform  highly  precise  • 
manual  procedures  is  a  fundamental  skill  necessary  for  the  practice  . 
of  dentistry.    Unfortunately,  not  everyone  Who  seeks  admission  to 
dental  school  possesses  this  man^lal  dexterity  .    iJntil  1950 ,  the.  na- 
tional attrition  rate  in  dental  'schools  averaged  between  20  and  30 
percent.    This"  resulted,  irt  large  measure,  from  the  belated  discovery 
that  many  SftudWTts  entering  their  clinical  years  of  training  were 
simply ■  unable  to  master  the  fine  manual  techniques  require^i  for  grad-v 
uation.     In  response  to  this  problem  the  American.  Dental  Association  >^ 

■  developed  what  is  known  as  the  Dental  Admission  Testing  Program  (DAT) . 

t  Following  the  introduction  of  the  DAT  and  its  acceptance  as  a  condition 
•for  entrance  to  all  accredits  dental  schools  the  attrition  rate  was 
reduced  to  a^jproximately  7  percent.    A'  critical  element  in  this  dem- 
onstrated success  of. the  DAT  is  a  Series  of  perceptual  and  space 
relation  t^sts  which,  are  designed  .to  measure  an  applicant* s  manual 

•  dexterity-- The  current  formatv  6f 'tliis  aspect  pf  the  examination  is  . 
nonverbaif  consisting  of  two  and  three  dimensional  objects  which  tKe 
te^  subject  must  relate  to,       .  . 

The\ilemma  which  is  posed  by  the  disclosure  provisions  of  the  legis- 
lation cenljers  on  the  fact  that  there  is  a  finite  number  of  giltmfetric 
form3Lwhicli  can  be  represented  in. a  test  of  this  nature.     If  the  Dental 
Adroisfcon  Testing  Program  were  required. to  reveal  the  actual  tests  / 
after  each  examination,  as  is  proposed  in  H,R,  4949,  the  dimensional/ 


A 
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*     /  .... 

possibilities  for  measuring  perceptual  motor . skills  will  have  been 

exhausted  within  A  very  short  period.    When  that  occurs,  ^hese  impor- 
tant inAinual  dexterity  tests  will  haver  .to  be  discontinued  because 
their.  VAjifue  will  have  been  compromised.  "        .  •  *- 


nary,  the  DAT  is  unique  because  it  is  the  only  entrance  exeun- 
program  which  contains  tests  that  measure  abilities  as  well  / 
as  academic  knowledge."  A  disclosure  .of  the  verbal  aspects  of  the  DAT, 
such  as  its  science  or  reading,  comprehension  tests,  could  be  compen- 
sated for  in  part  by  other  criteria/    However,  there  is  no  compar^abl^ 
instrument  to  replace  the  manual  dexterity  component  of  the  DAT.  Its 
loss,  through  disclosure,  would  severely  restrict  the  ability  of  the 
dental  schools  to  .discriminate_  manual  techni,que  skills  among  their 
applicants.  ^  ► 

^  For  tha<-  reason,  we  strongly  urge  the  Subcommittee  to  ensure  that  any 
legislation,  which  may  contain  test  disclosure  requirements,  provide 
an  exemption  for  the  Dental  Admission  Testing  Program.     Such  an  exemp- 
tion could,  for  purposes  of  the  DAT,  be  accomplished  by  the  inclusion 
or  language  stipulating  that  the  disclosure  provisions  shall  not  apply 
^     to  "any  perceptual  ability  test  or  perceptual  ability . portioii  of  a 

larger  test"  or,   "to  any  standardized  test  which  will  be  administered 
to  fewer  tham  10,000  te^t  subjects  nationally  per  administ^ration . "  I 
am  enclosing  a.  copy  of  the  Association's  testimony  on  this  issue  which 
will  provide  additional  background  on  the  DAT.     Your  consideration  of 
this  request  is  greatly  appreciated.  ^  ^ 

.  Sincerely, 


WEA:v5 
Enclosure 

bcc:^  Mr.  John  F.  Jennings 


William  E.  Allen,  D'.D.S. 
Chairman 

Council  on  Legislation  , 
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Congress  of  the  United  States 
House  of  Representatives 
Connittee  on  Educatlo^  and  Labor 
Subcommittee  on  EleroeAtary,  Secondary  J 

and  Vocational  Education 
.t-'^kiC  Aayburn  House  Office  Buiiding 
^Washingtpn,  D.C.    .  205 V5 


Statement  on  MR  356^  and  NR.  ^9^9  Concerning  Standardized  Testing 


/ 

<  / 


Thank  you  for  the  opportunity  to  comment  on  two  bills  on  startdardlzed 
testing,  HR  ^S^k  and  MR  49^9     The  two  bills  have  the  I  audible  intent  of . 
protecting  consumers,  mainly  students  ^nd  Job  seelcers ,  from  testing  abuses. 
However,  some  of  the  mechanisms  proposed  to  provide  this  protection  will  do 
more  harm  than  good.  \ 

The  major  difficulty  with  HR  49^9  is  Section  5,  which  requi^s  Chat 
jthe  actual  content  of  each  test  be  disclosed.    The  apparent  intent  of  this 
provision  is  to  help  the  student  determine  whether  his  answer  sheet  was 
correctly  scored.    Merely  providing  ar^  answer  key  and  a  copy  of  the  student's 
answer  sheet  will  permit  checking  for  clerical  errors.    Publishing  the' 
'questions  will  verify  the  answer  key,  but  has  many  adverse  effects. 

I  Students  seeking  tb  improve  thair  scores  will  argue  that /)o  single  cor** 
^  rect  answer  exists  for  most  test  items.    Scoring  the  Itefns  w^  I  be  challenged 
'^/jl n  4dvopacy  proceedings.    The  bill  thUs  invites  the  substitution  of  JudJ^^laJ- 
^'^^  ^ud^^nt  foi;  educational  Judgment^ 

%  Publication  of  test  items  will  put  a  tremep^ews  additional  burden  on'  / 
^^^ffittJf^$P''^P3re  test  items,  since  many  more  will  be  needed.    Since  every 
Itetti'fl^St  ^; carefully  reviewed,  pretested,  and  analyzed  statistically 
/before  be  infused  operationally,  the  procedure  wHl  be  hard-pressed  and 

reducatlon  Invf^ual  I ty  of  items  seems  inevitable.    There  Is  also  more  chahce 
/  for  biassed  ;f^em5  to  slip  throuigh  the  screening  prtftess. 

ii^     ■       ■  , 
Therd  is  a  limit  on  the  number  of  new  quest  Ions  that  can  be  produced. 
It  will  not  be  possible  to  provide  a  new  form  for  every  occasion  on  which 
tests  are-VVy«n  and  So  services  will  suffer.    Special  admini st rat  ions  wl 1 1 
np  longer  be>R^ssible  for  the  handicapped,  »for  those  who  cannot,  for  rell- 
glou*  reasdrts,  take  tests  on  .Saturday and  for  those  needing  to  be  tested 
^^^befdre^  the  liext  available  regular  date. 


^^'•^'SV     *  testing  works  agalnst'neW'klnds  of  dblllty  measures.  Proponents 

of  the- blrh^rgue  that  the  legislation  will  encourage  alternative  measures, 
|)ut  \hey  surely  do  not  mean  alternative  tests.    For  example,  the  new 
*'anailytic  aptitude"  test  In  the  Graduate  Record  EXamln'ltlon  Is  still  under 
review  and  modification  two  years  after  Introducing  It.    New  types  of  items 


ni7 


ERIC 


\  .  1144 


Statement  oh  HR  3564  and  HR  kSkS  Concerning  Standardized  Testing'. 


are  being  trfed,    I?  all  Items  must  be  published,  a  huge'  reservol r  of 
avalleble  Items  Is. required  before  a  new  test  can  be  Introduced,;  and  the 
teijtlency  wMI  b^to  evold  enythl/ig  new.    The  GRE  •'analytit''  measure,  for  ^. 
example,  may  well'^ave  to  be  scrapped,  o 

Tmo  aspects -of  HR  3564  need  repair,  because  they  advocate  questionable 
test  practices.    Section  6b3  requires  publication  of  the  score  required 
for  admission  to  an  occupation  or  a  university.    Usually  therels  no  such 
score,  and  proper  test  use  avoids  specifying  a  particular  score  cut-off. 
Test  scores  should  be  used  In  conjunction  with  records  of  past  accomplish- 
ments., letters  of  references,  lnterV.Iews  ,and  other  pertinent  Infprmatlon  In 
making  a  final,  judgment. 

.  iSectl.on  6c  of  HR  3564  requires  thet  any  test  of  knowledge  or  achfevement 
as  (Wstlnct  from  aptitude,  be  graded  absolutely,  rather  than,  relative  to 
other  students.    Experts. dl ffer  on  how  to  do  this,  on  whether  It  can  be  done, 
and  on  how  to  distinguish  aptitude  from  achievement.    The  requirement  In- 
volves technical  matters  that  are  stIU  unresolved.     It  would  be  premature 
to  "solve"  the  problem  legislatively.   .  ■  ^  .. 

The  bills,  stripped  of  the  sections  mentioned,  endorse  the  test 
standards  already  put  In  place  by  the  Arcrlcan  Psychological  Association  - 
and  the  American  Educational  Research  Association.    They  require  publica- 
tion of  Information  already  In  the  publ I c  domain.    They  also  anticipate 
as  yet  undisclosed  recommendations  of  the  distinguished  National  Research 
Council  committee  on  testing.    At  the  least,  the  bills  are  pi-emature;  I 
believe  that  they  are  unnecessary. 

Some  of  the  language^  In  the  bills  suggests  that  the  tests  may  be      .  ' 
biassed  |n  favor  of  students  from  fami I les  with  high-  Income,  and,  by  Impli- 
cation, In  favor  of  whites.    Because  apt! tude  tests  measure  general  abili- 
ties developed  over  many  years  In  educational  environments,  they  reflect 
.the  quality  of  education  experienced  by  the  student>    Average  differences 
In  test  scores,  between  rich  and  poor,  white  and  black,  reflect  average  dif- 
ferences In  educational  opportunity.    Thft^jnly  way  to  avoid  these  differences 
Is  to  lmp|»Vf"«qtial  I  ty  of  educational  oB^t)|ftunl  ty .    Destroying  the  tests 
wn't  help.    Also\t  Is  shortsighted  t^^Wpus  on  the  average  values,  The 
tests  provide  an  op^rtunlty  for  each  rndiyldual  to  demonstrate,  their  talent. 
Many  fine  students  cJ>«p.^from  unknown  scfoois;  without  tests  to  demonstrate 
|he|r  Skills,  .they  wbo^'d  be  considered  bad  risks. 

I        no  Impgttant  benefit  from  the  legislation,  and  great  potential- 
Ivarm.'   hctiqmcnh  that  the  conml t tee  decide  against  the  bills*  -  '' 

•  Respectftil  ly  submlttQdj  * 


BFq/|)| 


Green 

r  of  Pj 

/John 

7 
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Ber^f  F.  Green 
Professor  of  Psychology 
The/Jqhns  Hopkjns  University 
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;  7  '  c  The  CoundLof  ^rjiduate  Schkols,in  the  United  States 

On«  Duponl  Qrcle.  W.W,.  .  I 

'  October  19.  1979  ^  •;■  .  '--^'y.'-  *^  .•; 

HonoVable  Carl  D.  Perkins,  Chairman  -     ■  i^.  .  V  - 

Subcommittee  on  Elementary,  Secondary^  and  „     :  .  .  .  ^  ' 

VocatlonaV  Education  .   .      .  "  >> 

Baybum  House  Office  Buildlrtg,  B-346C       .   >  . 
Washington^  0.  C.  20515  '    ^  ^      •   V  '  •  >  ' 

Dear  Mr.  Perkins:  ^         *  •  * 

f  Ws  Is  In  response  ttf  Vou**' October  9,  T979i  5t«tl"g^t^  ^^^^^ 

I-  .    .   Kept  a  wrIttS  s  from  The  Counc^J,?^  ^r^^^JjK^^ 

In  the  hearing  record  concerning  the  two  blllr  deal Ing^wl th  standardized  v  ^  ^ 
^testing,  H.R*3564  ind  H.R^4949;    \  c  .      "  "  ^ 

Let  the  record  note  that  The  Council  of  Graduate  ^SchooTs  In 
States,  representing  the  wishes  of  Its  graduate  deans,  is  against^ 
.passag^  of 'H.R.3564  and  H;Rf4949.   Attached  Iri^support      Jhjy^*!!^??;  !^. 
TsanvTIng  of  letters  from  ^ur  constituents;  Some  have  writteh  directly  to 
vdu    There  are  approximately  365  menter  Institutions  In/The  Council  of 
;eraduaKhS5ls,  ^^^^  and  H.R,4949  for^e^foTTovilng 

^reasons*;     ■         %  '    T         „   ,  .  :.       \     ■  ^  .  "      ^  \ 


0)  Hp,  believe  that  the  MlTs  are  overly  prec1p1tpu$.  ^^9^^ 
■chanqe  Is  Sknaat<a;  Q9feftt1  study  s  .  -  „ 

probablerraiiiJflcattons  of  ^such  leglslW^^    :  >       ^  '  ■■'  '  \.    ■  • 

■  ■  (2)  We  fear  t«at  tesf  quality  .wi1V<tetei5l  orate  since  It  way  not  be    "  ^   '      "  S 
wssibll S '™int?"n  the  prSsent^uaJI^  aViOslu^^of  the  test:as .an  a  d  , 
-  rr  S?«nWk1n9>for  silent  ajslmlsslons:  "1/  d1srt«ur§,  of  test  fi^t\t>m  ;  , 

v:JindvanSWeif^iS  nSai^datedj  ;-  .  ,  "  ■  .;  \  «  r.. 

'te»t1nl'c»t|iy  ls'f?fe#d  W  continually '>ep|^e  ^t^lsed  teitsj        . ,         .  ^  . 


'I. 
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rtbnorable  Carl  U.  PerJclns'^  '  a 
Octiber  19,  1979  I 
PagT  2  f 


(4)^We  fear  that  the  proposed  legislation  will  result  in  fewer  te$t 
administrations,  thereby  decreasing  access  to  taking" the  test  for  the 
student^  In  short,  a  decrease  of  service  to  ^he  »tudent^ 


\ 
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UNIVERSITY  OF  MIAMI 
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llATCICHOOL 


...    ■  V 

The  Hooonble  Edward  0.  Stack 

S.  Houst  of  Reprt$tntit1vt$  ^ 
Washington^  D.C,  20515  ^    ,  , 

Dear  Hr.  Stack:.  ^  ^ 

^1  am  wrUlrw  to  e^fittS^  conderns  about  the  $p-c;]led  nruth  in  Jesting"  . 
him-  naielv   thelfelssBIll  (H.R.  4949  and  the  Gibbon?  BIIV  (H.R.  3564). 

S^or^n?^^^  • 
dlsclosurTof'an  questions  on  the  test  together  with  the  correct  answers. 

Miirh  tiae  and  money  is  dedicated  to  the  construction  of  these  tests  to  Insure  . 
?hSlr  cSpara^^^^^    a?  different  t1*es  an4  In  d1ff*|:wt  places  ""d  to  develop 
in  thJiThloh  degree  of  reliability  Insofar  as  their  predtctlve  value  1$ 

d^rease*  their  cost  will  Increase,  and  the  times  at  which  they  can  be 
adBlnlstered  will  decrease. 

Th«  Graduate  Record  Exanlnatlort  1$  Important  In  the  selection  of  gradi|ate 

hJw  dlffkuU;  In^ScIni  I  fttii^.ctory  dlss.rt.t1w..  th«1r  p.rfonwnc.  on 
th«  6r.du.t«  Record  ExMln.tlon  has  Mn  Mrgln.1. 

I  nlninufn. 

N share  tH?s  letter  with  other  members  of  the  House  of  Education  and  Labpr 
Thajrik  you  for  your  attention.  '      .  ^ 

,  Sincerely  yours, 

C.  gV  Stuckwisch  . 
Dean  for  Graduate  Studies 
and  Research 

'cc:'15r.  Michael  J.  Pelmr 

Council  of  Graduate  Schools  .  ^ 

Or.  James  0.  Hudson,  President 

Council  of  Soutbenr^^^  v  ^ 
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■1    ^eASHlNGTON  STATE  UNIVERSITY  SEP  24 1979 

•     roiXMAN.WASHINGTOK  •«»•  ■       .    .  ' 

im  CBAOHAII  XHOOt  'a'.- 

■   :.         '  ■  '  '.       ■  . 

8^pt«ab«r  X9,  1979  f 

I  ■       '      .  .     -      '  ■        "  '  .   ■  > 

,  41 ■  .  ■ 

•-./•;..'       •  .      .  ' .  X  ■ 

MlchMl  J.  P«lc««r,  Jr»    /  .  ^ 
PtMldmt 

CotBCll  of  GrtduAU  Sch^ls  in  tb«  U*S*  ^ 
OM  Dupoot  drcU 
UathlDgtoa»  D»C»  200^^^ 

Dtar  Pr.  P«le*«r; 

Ibaok  foo  for  th«  ^iguit  17  pacfc«|«  outlining  pending  UgUUtloo  * 
at  ttaodnrdlxtfd  c«%t«.    I  •hpn  your  cooc«inf  about  th«  lagiolatloot 
wlitt  lt»  on  itio  ni»rfnc«»  m  •dalrtblo  nttMpt  to  totem  tooting  ogfftcloo 
to  Inform  "iJonouHito"  of  th«  <top#  la  «n  laportint  scadotilc  proc«»«  will 
In  fnct  dio\roy/tho  cowm  uao  of  •tand*rdliod  Uoto.    For  many  of  our 
dMartMoto%  BIA  oMlAotloos  oro  li^ortant  oUaAt^  to  tho  adaiooion 
procaaa*    Althougli  all  of  ua  rocogniaS  that  abaodardliad  axaM  arc  no^  ^ 
^       parfact.  thay  cartalnly  ara  halpful  ladlcatQta  of  an  appUc«t»a  potantlal  .  . 
V    whan  cooaid««^d  irith  othar  cAtatla.    Loaing  tha  ua«  of  atandardliad  taau 
«lll  Mka  adiiiaalooa  dadalpna  .aora  difficult* 

•  ■      ^  '     "  i 

Oartainly  wa  ahall  loa«  tha  uM  of  tha  asaaa  to  a  ;graat  axtantJ  M  ••▼•'•^ 
of  tha  lagial^tToo'a  oppooaata  hava >oinUd  out,  th«  coat  of  tha  auaa  will 
iBdmibtadly  riaa  draaattcnlly  and  tha-'quaUty  of  tha  u 
gaeauaa  of  tha  hlghar  coaiJ  pf  tha  axaai,  ffwar  atudanti  will  taka  it.  Many 
dapardMOt^  will  no  doiibt  raact  to  ^a  hlghar  coat  by  no  loogar  raquirlng  ^ 
tha  axM»  -^facauaa  tha  yaUdity  of  tha  ajuai  will  ba  aaiflouily  coapr<»iaad 
by  continual  total  rayiaiOQ,  f«(w  dapartaaoU  illll  wlah  to  uaa  It. 

Ha  ara  not  aflva.    I  Mpaat,  waJMr  that  tha  ptMaot  aat  of  atandardlaad 
'axaM  ara  not*parfact;  cooaaqu^n!^  wa  do  not  uaa  raaulta  ffoa  thoia  axaaa- 
axclualvaly  for  a^olona  dadalcM*    tut  tha  axaaa  ara  a  uaaful  tool  lAan 
'uaad  in  coojwction  with  othar  uaaful  itaaa.    Ju^t  aa  a  carpantar  la  not 
candarad  co«)lataly  inaflactlira  if  ona  tool  ia  raaovad  froa  hla  box,  ao 
wiU  our  adalaaiooa  cowlttaaa  not  collapaa  eoaplittly  without  atandardlaad 
Uau;  howav.r,  Ilka  tha. carpantar,  oor.coiiattaaa  will  notVork  ai  affactlvaly 
aa  thay  would  wire  thay  Allowad  to^ua#  all  of  thal.r  toola.  ' 

t>i^  Plaaaa  racord  ua,  than»^«i  balng  oppoaad  to  tha  Walaa  and  Oibboot  bllia. 
Sincaraly;  * 

UchAtd  0;  Jul  ton  .  . 
iailatant  to  tha  Otao 


r 
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THE  UNIVCRStrVpt^,  ALABAMA 
TMEOMADUAir 
posiorrici 

■  UNrVERStlV. 

■  > 

August  31,  i 


The  Honorable  John  BuChenan 
'  United  States  House  ol  Reprutentatives 

2159  Rsyburrir  House  Office  Building 
WaAhlnglo^»_i2.  C.    2Q51^  ;  .  C 

boar  Mr.  Buchanan:  '  . 


V  I  iim  taklifg  thls/oppJ^lunlty  to  express  to  you  nSy  opinion 


eiss 


prppoaed  legislation  aimed  nt  standard  education  tests,  7  —  ^  • 

bill  (HM949)  and  the  Glfcg^ons  bill  (HR3564)  the  so-called  "trW^h^ln- 
tostlngi*  bills  vvht^h  are  being  considered  by  the  fto^se  EHucatl^ 
snd  l^bor  C6miViiih%^^  #  t  '  ■  .  " 

Although  the  pr^islons  o(  these  bills  might  seotfi  i)oncoiitro-\ 
verslalf  they  could  Imve' draitlc  effects  upon  students  and  graduate 
programs.    Principally  these  would  bet 

1.  Costs  to  the  test  agenclee  and  eventually,  to  stndunts 
would  rlae  dramatically  slnce^  Completely  nuw  t«st 
^woul'd  have  iQ  be'diiv eloped  tof^ each  examination,  date  ^ 
.  and.the  existing  method  of  pretesting  or  valldatfcg  * 

futile  questione  would  have  to  be  replaced  with  a  more 
.   expensive  system*   I  am  sure  that. the  mechanisms- of 
.  these  cl<rcumstaAces  ftave  been  brought  to  your  attention. 

2.  Studente  will  have  f#we>*opportunltles  to  take  the  exam- 
inations since  Increased  difllculty  lii  cohsiructlng  the 
tests  and  the  impossibility  of  reusing  questions  will 
greatly  restrict  the  number  of  tlmea  during  (he  year 
that  the  e^caminatif  n  can  be  adminUtex'ed.   For  example, 

•  .  to  accommodatfi  f^tiidant  demand,  the  Graduate  Record 
Examination  ia  otfared  hlx  times  per  year.    A  reduction 
In  number  of  times  offered  to  tWo  -  a  meaningful 
probability  -  would  algnlficantly  reduce  student  freedom 
an^  impair  a  nationally  established  gradu/te  school 
admission  process*  ^ 


\ 


■  1 
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■'/    .    3.     Qiinlity  of  ihe  uK;itiihi;iiMii)i  womUI  <Ii-U  tIoimIo.    Tli'  ro- 
.  U  a  11  mil  to  ll»o  Iiuiit1>t:r  of  untMl  «|m*Hnniia  wliiih  r.iii  be 

^*  ()cvclo))i-d  and.vaUd.ilcc),  and  ••  ibc  (pi.ilily  of  llic  luat 

i|.)cKt'HiiiH  jlfcHne  the  v.tluo  of  llio  o.\.iniiii.i<ion  ,ih  a 
*  i^Mn|iuiK  iU  of  Iho  iii\Hmi»l1i  ailinlssioiiH  |irtu  oi.il  NviII  bo 

liinllc'd.  .  ' 

J    ■  ■        ■  .  ■ 

.4.     The  Tcui  of  Engllah  at  «  Foreign  Mnauigc,  a  "slandard- 

iv.ril  ii'st/'  is  iisi'd  widely  lo.dcU'rniliio  i)ic  ;il>ilily  of  foreign 
Hiudcnti  to  ulln/.o  Ihc.  KiiellBh  langu.iBc  in  Ajihtm  an  univcT' 
fcilloi.    Al  a  llmo  wlicn  Unllt'd  Sinlcs  iMghor  iMhiralion  is 
"W^tng  called' upon,  Incroaslngly;  lo  nlucaie  slii'l*;"***  of 
other  co;intrica»  'a  coin|iroinl»,e  of  llu:  cffi'dis'^-ih-tJii  or- 
v^iUdlty  fif  lliia  cNHiiilivilion  co.ild  rvuxiU  iu  .mm-  iiiiivrrHilii'S 
adniitllng  ttliidenla  willioul 'Irucly  .MliM|U«le  Vin;li«h,coinpc- 
lency,  lima  coi.npronil/lng'lhc  loacliiiiB  and  learning 
cnvlroMiiiont.for  tho  foreign  atudcnU  :\nd  our  own  English 

vpeaklng  atudonta.'.  ^ 

•  ,      .  '  ■  .t, 

5.     With  liije  wldo  variation  In  academic  jnogranis  ;iihI  y fading 
tfytftcmi^>Ni8tlng  Ihroughoul  the  country,  il  i^  cibmliirfil 
that  aoino  form  of  frequ«nCly  adininUtered,  VvrJI  v.iMdatod 
national  oxanrilnailqn  be  available  for  use  In  the  nrad««tc 
.ithnlsHiuna  ppocoss.    Like  oUier  schools.  The  Hnlvirslly'  - 
of  Alabaiiia  dope  not  rely  on  national  cxaminritiong  alone, 
but  they  are  ftn  Irnporinnt  Itom  In  the  total  group  of 
f.acto|-a  whfch  ure  considered  In  dotermlnlng  which  sli^K'i^ts 
have  the  potential  to  sticceod  In  graduate  studies  and  Are 
'.      .lilriiitli'd  thereto.    Unfordinatoly,  no  suitable  buhsttlulo 
«  L'jcivts  at  ^ho  present  time  and  a  reduction  In  frequency 

and  qjality  of  these  well  ostabllshed  exaniiuMtloiis  would 
impiiir  our  ability 'to  asciess  a  siudcnt's  graduate  potentlsl. 
'  •    '  ■ 

.  i  hope  my  comments  may  be  of  spme  value  to  ynu  as  ynu  consldo 
HRj^5fi4  and  im4949,  anQ  I  would  be  beppy  to  provide  any  uAhiiti<inal 
inpi^Miatloh  you  might  require  on  this  subjuct>t 

«         .  Sincerely  yours, 


■  .^  WillliJirt  H.  Mi^cuiill.in 

,        ■    '  Dean  ..  '  '  ...   '  •{ 

AVHMtwm  '\  ■     .  ;  .  ^; 

bejc:  President  David  Mathewi 

Dr.  Richard  Thlgpen    ..>.^    •  ^ 
Colonel  Floyd  H.  -Maflfi     •  *  .  '  J.^ 

•  Mlphael  J..Pel«wir,  Jr^  •  .       .  *        '  •      •  * 
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OFFICE  OF  THE  DEAN 


^OI,LECE  OF  GRADUATE  STUDIES        MpNTAf^  STATE  UNIVERSITY.  BOZE^AAN  59717 


tepta^tt  13,  1979 


Congressmen  Pat  Williuw.  HontsnA   '  ^  i 

Houss  Education  and  Labor  Coaa^ttee 
U.Sr/Uouse  o£  Kep«MantatiVft  V>  ' 
Waahlngtbi^  D.C,  20515 

Dear  Cohgreasoan  VfllllaMt  ^  ? 

Having  9an&ed  two  bills  pending  before  Congress,  nearly  the 
Weiss  Bill  *(H.R.  4949)  and  the  Gibbons  Bill  (H.R.  3564).  I 
should  like  to  voice  ay  negetive  concern  abdut  both  of  them* 

We  here  feel  that  any  federel  overstgh.t  of  standardiaed  testing 
eposes  grave  dangers  to  the  entitf  integrity  of  tl^s  system.  Ibis 
kind  of  centralisation  and  regimentation  ia  boind  to  lisiit.  the 
frequency  of  teating  a^id  to  coap^miee  the  quality  of  the  ex- 
eminatione,  aince  the  Hsiaa  Bill  ca^a  for  diacloaure  of  ell  test 
'  forms. 

In  short,  vhile  edmirable  in  tkmit  atCe^»ta  to'asaure  falrneaa 
through  federal  regu).etiona/th«  bUla  aeem  iiire  tp  jeopardise 
the  reliabiiity  and  availability  oC  the  examinations  themeelves. 


Thanks  for  your  consideretiQn. 


YQura  -Very  Sincerely 

Hlchect  P.  ><al6ne 

t)ean  of  6radua|m  Studiea 


MFM/me 

cc 1   Michael  J.^Felcser 


ERIC  • 


ST  CLOUD'STATE  UNIVERSITY     .  : 

SCHOOL  OF  GRADUATE  STUDIES  # 

Gf»doawStudl«(6n)3SMn3  -  •        .  \  - 

InttmaUonalStiNNtf  (612)0554267.    '  ^ 
St  Cloud,  MlnntMU  56301  . 

!       >  *  '  <  ■  • 

-  Ai«U«t  24.  1979 


Mtii  HiclULtl  J..F»los«r,  Jr*.  '  •   

nre«id6Qt  .  , 
Oounoil.of  Oraduate  Schools 
Okie  Dupoot  Circle 

«ft«hiiif ton,       C.  20036  *  /* 

jDMsr  Mr  .  Mlosar  : 

Hy  QAM  !•  Lowell  ^Oill'ett.    I  an  Dean  of  the  Qraduate  School  at 
St.  Gloud  State  Unlvweity.    I  as  writins  to  ex^ireee  my  conoerne  relative 
to  the  so-called  '^ftiuth  in  Testiog**  Maeurei  that  vet  currently  under. 
coDsideratiOQ  by  the  Googress^  CH.R.  4040  and  H.R.  3864).    As  you  know* 
St.  Cloud  6tat/a  University  !•  a  state  euppor ted  inetitutioa.    At  the 
present  tiae.  we  do  not  restrict  adnissioo  to  our  craduate  echool 
procraM'  to  any  specified  nuiber  of  studente.    Ve  accept  all  who  qualify, 
with  this  dscisieo  based  on 'sevwal  factors:    past  acadesic  perfprsancei 
potential  perforMidce  (for  which  we  use  the  Qraduate  Record  Exaainatioo), 
or  proven  perfcrsance  in  a  profsss^ooal-ciipa9ity  in  which  we  seek  to 
obtain  evidence  that  the  stu||ent*s  coMbination'  of  ability  and 
■otivatioft  are  indeed  likely* to  result  in  succefsful  graduate  etudy^ 
Ciaduaie  education  is  expensive  and  ws  feel  thi^t  adnitting  to  graduate  ^ 
school  only  thosi  students  who  can  provide  evidence  of  poten^tial 
Buotfess  is  our  obligation  to  the  Uxpaying  public,    pur  philosophy  is 
to  provide  graduate  opportunities  to  all  who  can  denodetrate  their  . 
ability  to  profit  fros  Mtanced  etudy.    But  we  believe  that  we  ttuet; 
provide  every  possible  option  to  the  studeiit  to  deBooiitirate  that 
potential,  j  ' 

The  ^^Truth  in  ^ssting**  legislation,  if>  enacted;  wouid  undoubtedly^ 
render  etandardised  tests  such  as  the  Qrgduate  Heoord/ExaBinatioa*^  (ORB) 
relatively  useless  ap  a  MasUre  of  potential since  coaching  for  a 
teet,  using  actual  test  questions,  will  rendir  the  results  worthless. 
And  ws  will  no  .longer  uilline  this  option  if  ws  consider  tk\e  inf  oi^sation 
to  be  #Grthlees.y   On  ths  other  hand,  the  present  forns  of  coaching 
(which  appear  to  6av9  generated  Many  of  the  pressures  for  such  . 
legislation)/  appear  to  be  largely  ,foousi»d  upon  increaeing  the  student 'e 
facility  In.  ths  use  of  the  ftiglinh  languags  and  upon  iaproving  his/her 
MtheMtical  Skills  and  understanding.    Th^  higher  ecoree  reeult^ng  tron 
this  kind  of  coaching  ars  based  on  increasee  in  the  student's  knowledge, 
and  understanding  of  ths  subjects  which  are  the  foundation  of  all  \ 
for  Ml  learning.    Therefore,  these  are  effort^  that,  should  they  '  \ 
inoreiie  test  scorss  sufficisntiy  to  rssult  in  ths  adnission  of  students 
who  itmid  otherwiee  be^enied,  are  nsverthslnaa  truly  benef icial^to  . 
th^  studsnt*s  ac^ual^fucosss  in  graduate  study*    Ths  abilitiee  which 
«r'e  i^oved  are*  in  faoti  aaong  those  which  coo  tribute^  to  suoo^nnful 


SCSU  to  *n  c^uAl       lit"  II V  /.4rnrm|llM  KlkM  mplovM  mnI  to  In  CAnjntUfu-*  «Kiiti  .li 
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•     V.         .     ,  ....  .  •      ■  .  ■ 

Mr.  MichAol  J.  Polosar/^Jr. 
8«pteBb9r  24,-1979  n  . 

■    *  .  • 

ac4tdeaio  work.    In  May  respecti,  ^then,  tb«  preseot  coAohing  efforts 
•re  actually  bonoflcUl,  not  only  ta  the  student  ttirough  admission  to  *. 
graduate  school «  but  t(|  the  society.  .  «  •  . 

On  the  other  hand,. if  the  concern  is  that  the  present  coaching 
activities  benefit  only  those  whose  financial  neans  p^nit  their 
pir^cipatioo ,  surely  anV  legislation  which  seeas  certain  to  increase  the 
use  of  costly  ''coaching'*  progruM  will  further  reduce  the  access  to 

k  higher  education  of  lower  incoie  persons.    UnfcrtunateXyi  a  high 
proportion  of  t^ese  persons  are  members  of  iainority  groups.    Further  * 

■with' test  questions  available <  the  coaching  w&ll  certainly  stress  the  • 
test  questions  theBseW#8/rath«r  than  i^tteaptiiig  to  raise  the 
foundation  knowledges  and  akiUs  which  %re  necessary  for  academic 
success. 

In  Jy  twelve  years  as  Graduate  Dean,  I  could  cite  numerous  examples 
of  students  wlio  would  be  seriously  harmed  ^y  the  elimination  of  this 
valuable  tool,  that  is,  they  would  not  have  been  jicbepted  intp  graduate  ■ 
school.    But  my  persqnaX  case  Is  an  excellent  uample.    I  was  an 
immature' l#te-*bloomsr.    Uy  high  echool  record  was  modest.    I  was. 
admitted  to  Gustavus  based  soLely  oo  my  standardized  test  scores.  In* 
college,  I  had  atill  not  settled  down  and  my  academic  performance  was 
only  slightly  better  than  mediocre.    I  eventually  applied  for  admission 
to  graduate  school  at  the  University  of  Mlnnesotra^nd  was  denied.  I. 
persevered  and  was  ultimately  accepted  provisionally,  again  based  on 
my  performance  on  standardiassd  tests.    Without  thif  option  being 
available,  I  would  not  have  been  given  the  opportunity  to  pursuc^^graduate 
study*  . 

If  ire  are  to  provide  people,  the  opportunity  to  maximize  their 
produotlvli  potential,  we  need  all  the  evidence  possible  to  aBses0  the 
'  potential  of  eao^  applicabt.  *  The  individual  should  be  given  every 
opportunity  to  demonstrate  his/her  potential  for  success,  and  * 
standardized  tests  provide  a  useful  tcK>l  in  that  asseseiaent. 

I  urge  your  active  oppositioo  to  these  bills — bills  which  will  < 
seriously  reduce  or  eliminate. the  possibility  of  utilizing  standardized 
teste  productively.    As  with  so  many  things  which'  have  occurred  in 
modern  society,  I  can  confidently  predict  that  in  this  case,*the 
proposed  cure  will  dp  more  harm  than  the  disease. 

.Yours  very  truly. 


aES^II  R.  Oillett 

Dean ,  School  of  Graduate.  Studies 


aes 


Illinois  Sid  it:  oniyersity  ^ 


fMildtnt 


SfpUmbere,  1079 


•  1b«  RpoonUe  CarlD,  P6tiaiis»  Cbilrmtq 


BquM  UucaUoQ «iid litbor  CoinmiHejB   .  ,^ 
U«  8»  HoMM  d  BepreMDtittVfS  . ,  , 

WwriOi^toiit  D.  C.  '  90515 

My  puipoM  In  writtof  it  to  0|)|>0M  the  pibpoeed  Ifflslatlon  9!  Hm  Welsf  bUl^  . 
(fi.K         ind  TtiaJUbboni  bill  (H.R.  3564),  the  lo-ctllAd  ^Tnith  In  Testrng*'  le- 
gtoltUoA  tnd  ■ImlliiT  to  Olio. N«iir  York fitato  bOl  (B,6260.  LaVaUe  ot>l. )  mkioh  was 
.  rttoaotly  onactad. 

In  opiKNilnf  tbia  prapoaad  leflalation^I  am  not  unawara  that  aoma  mlajuae  of  atan- 
.  dardiifd  taatlng  doaa  ooObr,  Tha  aolutioo  to  tiba  problam  of  Improper  uaa  of  atan- 
danttaad  iaatai  bofwavar,  la  not  t^  anaot  laglalatlon  aa  propoaad  In  the  Walaa  and 
Qlbbooa  bOU..  Hi*  dUadvantagaa  of  tbaaa  two  bUla  far  outweigh  the  advantagea, 
Th%  dlaadvantagaa  era  atvaral,  avA  aacb  la  atibatantlva  aa  a  potantlil  dlaaarvjoe 
to  graduita  education  In-tbe  United  Btatea.  FIrat,  and  prlmaiy  la  the  thrtet  to  ^at 
qpiallly*  It  may  not  ba'^bMlUai*to  maintain  the  praaant  quality  and  valu^  of  the  teat 
aa  an  aid  for  deolalon-maUng  for  atudent  adraiaa^ooa,  Thli  la  KMVttoularly  true  for 
tha  tmmadlata  ftitura  whan  the  raqolremaot  for  diaoloaura  of  teat  questlopa  and  an- 
•ware  iirlll  raault  In  oompromlaadtaata.  ,   

Baoood,  the  propoaad  l^lalatloii»  If  aoaotedi  would  Incraaaa  atudent  ooa'ta.  The 
oonataht  developmefit  cl  .n«w  taatai  which  la  extramaly  dlffldult,  la  expenalve. 
tliird,  the  inopoaed  lagialatioa  would  probably  raault  lA  fewer  teat  admUilatratlooa, 
tbara^  daoraaalng  aooaaa  tf  taking  the  teat  foMia  atuinmt*  .Thia  could  ^dvaraely 
affaot  admlaalona  propaaaaa. '  } 


Your'oonalderatldn  ctf  theae  dlaadvantagaa  In  the  bearlnga  on  Odtobar  10  and  24  will 
.be  i^ppreolated.  In  my  oplnlooi  the  legtalatlon  Should  not  be  enacted,  ' 


Sinoaaaljri 


ilvKfi  l  WaUdna 
Pi^ldaiit 


Npwwl  iloowtnf  100.  llllnoH 
HKme:>f/43»-S«77, 


LlW/go 


.4 


NovtyJN 

Normiljtltholi  ftlrfti  ' 
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AUBURN  UNIVERSITY 


TNI    OVADUATI    ICHOOl  • 


SsptflBbei:  14».m9 


ATM  Cod*  303 


TlM  Hooorsbls  j^lll  Nlcholp  '  ' 

2417  Myburn  Building  . 
VMhin|toni  DC  ^20515 

Dear  BlllJ  * 

I/m  d«i^ply  conceited 'about  two  BlUt  presently  under  coiieldetetlon 
by  the  Houee  (kwlttee  on  Educe  t Ion  fnd  Lebor.    Theee  erei'  The 
Educetlonel  Teetlng  Act  oll979  (H.R;  A9A9)  end  the  Truth  In 
Tteetlng  Act  of  1979  (H.R^3564).    So*e  of  the  InforMtlon  requested 
j[  in  these  Bills  will  certeinly  b«  helpful  to  epplicents  required  to 
subait  scorss  on  stsndsrdised  tests  for  sdaission  to  undergreduate 
^nd  greduete  progreau  in  inetitutions  of  higher  education.  .la 
fect>  dt  ie  my  lapreeeion  that  wuch  of  thie  inforaetion  ie  already 
eveileble.    Som  of  the  provieione  constitute  whet  X  believe  to  be 
'loforM^ion  overkill,  "That  ie  to  say  ths  infonaation- might  be 
interef ting»  but  it  ie  not  criticel  to  the  objectlvea  of  the 
legiaHetion^  and' it  would  lapoiae  en  edditionel«  unileceaeery  burden 
on  thoee  effected  by  the  legitletion.    And  pert^  of  the  propoaed 
.legialetion  will  ceuae  unil^eraitiee  greet  difficulties  With  the 
alreedy  difficult  teek  of  luUng  edaieeion  dedeiona.    This  ie 
•epecielly  true  under  Section  5  of  Houee  Bill  4949*    Thie  legiala- 
ti^on  will  require  that  agenciee  offering  efenderdised  teeta  releese 
copiee  of  all  ,teet  queetione  and  anawere  to  the  public  within  3(( 
deye  a'iter  the  reaulte  of  the  teat,  are  releaaed. 

htt  me%Bake  aeverel  points  to  undsrsCors*  ths  difficulties  caused 
\y  thie  eecti^^of  the  propoeed  Bill,    Univereitiee  er^eced  with 
t^o  rfltemetlves  in  asking  adaieeion  decieione.    They  cen  edopt  en 
open  adaieeion  policy  end  ^dait  all  peraona  ^hat  iapply  to  graduate  ^ 
and  undergradMeta  prograaaY  or  they  cen  etteapt  to  limit  edaiaaion 
•  to  tlibae  etudente  that  appear  to  have  the  beet  eptitude  and  chance 
of  aucceee  in  prograaa  of  higher  edu6aitlon*    Hoat  univarsitiss  in 
tbia  country  have  opted  for  the  eecpnd  epproech  beceuee  limited  . 
resourcss  require  thst  sdaission  to' a6st  of  thsir  prograaa  be  y 
raatricte4.  in  eome  way  and  beceuee  the  quel^ity  of  graduate  and 
iindergred^ete  prograaa  ie  ditlictly  dependent^  upon  the  apedeaic 
ability  pf^the  etudente  enrollad  iiv  thoee  programa* 

.  \  ■       '        »     ■        ■  • 


A    I  A  N  O  .  O  a  A  M  T  "'jU  N  I  y  K  I  1 1  T<V 
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norablA  Vlll  Mlcbols 
8«fltMlMr  14 1  1979  . 

#/TIm  quaatton  of  critaria  to  U  uaad  in  •iklol  adalaalon  dacialona 
!•  In  ItMlf  •  vary  difficult  ^foblMi.    BMlcally  unlvaraltlaa 
dapaiMl  on  grada-polnt  avaragM,  aeotfta^on  atandardltad  taata,^ 
aUteh  additlooal  Itaaa  aa  lattara  of  raconndatlon  and  Intarvlava^  . 
Aa  you  ara  wall  avarai^  tha  yalua  of  a  grada^polnt  av.ai:a$a/aa  a 
etltarlon  for  adalaaion  la  diractly  raUt^  to  tha  quality  of  tha 
achool  whara  tha  grada-polnt  avaraga  la  aarnad.    It  la  lapoaalble 
to  aVandardlsiT  grada-polnt  avaragaa^  and  I  hardly  naad  tell  you 
about  tfia  aubjaetliHp  natura  of  lattara  of  raco«aandatlon  and 
Intarvlavf.    So  tMonly,  tool  cvallabla  to  univaralty  adalaalon 
off Icara  that  ^farfe  fo«a  objacUya  baala  of  coaparlaon  batvaen 
tha'varloua  candldatea  applying  to  tha  unlvaralty  are  atandardlxad 
taeu  auch  aa  tha  Graduate  Record  Exaalnatlona  (GRE)  used  by  many 
greduate  ecboole..  '  ^ 

The  CRB  le  adalnletarad  to  thouaanda  of  etudente  each  year  and  ea 
I  noted  above,  of fere  en  objective  baele  on  Which  to  coapara  e  . 
etUdent'e  eptltude  for  greduate  etydy  on  e  netlonal  ecela, 
rurtharwora,  the  airtituda  teeu  of  th#  Gig  aeaeure  euch  ekllla  aa 
reading  coaprehenalon,  baelc  BatheBatlcei  deu  lnterpretetlon« 
logical  enalyale^'and  eblUcy  Co  conprehend  relatlonehlpe, 
r^rthervore,  thaea  eptltude  teete  have  been  ehovn  through  e  nuabar 
of  etudlee  to  be  raaeonabla.  predletore  oF  tucceee.  in  eced^lc 
prograMa'.    It  ehould  eleo  be  pointed  out  .that  »6et  unlyneltlae 
jueo  thaee  teate  In  conjunction  vlth  other  Information  euch  ee 
greduate  greda-polnt  averegee  and  lettera  of  recOaaendetlon  vhan  . 
■aking  edaieelon  daclelona.   At  Auburn  ve.have  found  .thet  there  le 
e  raaaonably  good  'correletlon  betveen  eucceee  In  gredueta  echool 
ee  aa^euri^  by  graduate  grade-point  averegee  end  a  valghtad 
adaleelori  ec^ore  derived  from  GRE  ecoree  end  undargreduete  grede- 

•  point  averegee.    I  don*t  v^nt  to  belabor  thle  point,  but  I  do  vent 
you  to  undaretend  %^  laportence  of  etandardlsad  teete  laaaklng 
aitelaeiontl^ecialone  in"  unlverelTtia.  ! 

In  order  to  etandardlse  theet  teeH^  they  ere  given  to  Jerge 
m^ere  of  a^ente  In  different  locatlona  end  the  queetlone  ueed 
are  carefuj^  conaVruCtad^  avalueted,  end  pra-teeted  before 
lncluelon4n  the  ragular  axaftlnatlon.    Thle  le  e  tlaa-coneualng  ' 

•  and  aiipMalve  proJKe.    If,  foUotf^g  eech  edalnletretlon  of  the  ' 
*    examination.  It  bacoaae  npceeaary  to.releaM  ell  tha  queetlone 

ueadT and  the  aniware,  then  the  teetlng  egendea  vlll  have  m 
.prepare  completely  i^ev  queetlone  for  each  examination.  Thla»wl.ll 
heve  aaverel  effacce.    It  will  greatly  Incraaee  the  coet  of  tha« 
axmelnatlone  to  proepectlve  etudente.    It  vlll  dacreeee  the 
ptecfalon  eiul  quality  of.  tha  queetlone  Included  In  the  examina- 
tion*   It  nill  likely  lead  to  fever  adminl^tvatlone  of  the  . 
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tiM  Honorable  Bill  Mlcholi 
8«pCMb«r  U,  1979 
f W  3 


•XMifUiClont— grMCly  Inconv^nleiielni  Moy  appllcancs  for  gttduate 
and  profMtlonsl  prograas*.  And,  It  will  aotC  miraly  decrease  cjN« 
rall^lllcy  and  Validity  of  the  etandArdlsed  (aeCa. 

X  aek  your  careful  confldaracion  of  Chec*  factors  as  you  deten^ne 
ybur  pQsiCioo^n  these  tvo  places  of  laglslatlon*    If  I  can  bi^of 
■ealstance  td  you  In  your  dtfllberaklons,  pleass  call  on  ae«  Thank 
yoii  for  your  continued  support  of  higher  education  In  the  State 
AlabsM* 


Slncsraly» 


P^l  F.  Parks 
in 

pypisM 
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'  Howard  UNiVBRsiry 


I  •NAOOATt  •CMOet  or  MTt  A»fO  •CICHCM 


Stpttii<>«r  Ui  1979 

Dr.  HIcMtl  0.  P^lcMr,  Jr.    '  .    /  / 

Prtsldtnt  - 
Council  of  GradulUF  Schools  In  tht.U.S. 
.  Ont  Dupont  CIrcU 
Mtshlnston,  D.C.  20036 

DMf  Dr.  Polczar:       .  ;  « 

Your  OMMjnlcatloS  conctmlntt  Truth-ln-Ttstlny  Itglslft^ 
r«ct1vtd.  Tfw  GraduaU  School  of  Arts  and  JScltncts  Is  comTti 
tht  propostd- bills  tvtn  thoadirtht  rtsults  of  standardized  tutf  art. 
utad  at  Howard  Ual varsity' priMrlly  for  diagnostic  and  rtsaarch  pur- 
posts  rathtr  than  for  admissions. 

Our  analysis  of  tht.prbpostd  Itglslatlon  andrtlattd  mattrl^it; 
can  bt  suMMr'tztd  In  tht  folloMln^-Mnntr: 


ADVAKTAGES  OF  TRUTH- IN-TEStING  LEGISLATIOH 

1.  Passagt  of  «uch  W  Might  bt  htlifful  In  tnllghttntng  studthts,- 
.    and  partnts  and.  reducing  prtstnt  Ij^oranct  about^such  ttsts. 

2.  Such  Itglflatlon  night  cautt  publlshtrt  and  adnlnlstrators  of 
thttt  ttsts  to  U  nort  c1rcui»ptct  In  thtin  construction  and 
Inttrprttttlons  of  standardlitd  tests. 

^  • 

3.  Educational  Institutions  •Ight  mve  In  tht  direction  of  In- 
creasing tht.Mlght  given  to  6ther  factors  In  th*1r  adnlsslons 
processes.    .  '  • 


1. 
2. 

3. 


pISAMANTAfiES  OF  fItlffH-IH-TEStiNG  LEGISLATION 

The  bost  for  students  iHlf  Incf^ase  sUbsUhtlallyi  ^ 

The  iuriber  of  students  taking  thenest  and  the  nuri>er  'of 
Institutions  rtqulelhg  It      decretse  considerably. . 


denands placed  on  Uiling 'agencies  art  sti  great 
nui^er  of  annual  tesf1n(^  aftalnl  strati  ons  Miy> 


The 
th«t 

Markedly  rtductd. 
adversely 


The  .quality  of 

■  ^ 


the  tests^RH^  be  affect(Kt 
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DlSADVANtASES  (continued) 


4. 


ctdum*  thd  wllciblHty  of  rwylU.  ^ 

5.  Most  of  thft  propost<r-l«w.  hivi  not  provided  sufficient  time 
before  voting  fdr  public  cpnsideration  end  reaction. 

Pesseoe  oT  these  lews  mijhtvresult  in  fe»fer  disadvantaged 
^  students  teking  the  test,  /• 

Af^he  eboVe  indicete,  our  current  belief  is  that  the  proposed 
TrutK-ln-Tejting  legisletion  contains  laore  di|idvantaj)e$  than  advan 
'teges  to  higher  end  professionel  educetion. 


«  Sincerely, 


it 


Dean 


EUH/jeh 


THE  UNIVERSITY  OF  NORTH  CAROLINA 

AT  GREENSBORO  " 

V        ,  ■  •    ,     ■  /  ■ 

•  '  ■     ■    ■      —       ^     .         "  > 


Siptmth  26.  1979 


^IdMol  of  HoJili^  Pkyiical  Education 
.  -*.;      and  RfCffiCifla  ■ 
■    Offieo  of  thrDMA 

.  Xht  Honora^l*  Ika  Fv  Aiw^rew*  , 
■  U;*^,  H^f#  of  Reprel^fertUW^^  • 
•  >  Wtihlnflton;  0.  C.  •  20515  flif^r 

v\,-    '    1  f«  writing  to  axpilMt^ ivy.  c<^C«Vq  ovtr  tht  ptnding  legltlatloh  kimed 
:  '«t.)itind«i^  tMt</,  lt,*t4,';>flthov>i'qutl||tlon.  trut  that  the  U0ls1«tl6n  would 

•    -.v:^i  .     .^^       pjitriibih*  Involyed-  .  1^  grMtor'<onctrn.  however,  rplftts  to 


-.    ; '/ 
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The  University  of  Vermont 

OFPlCf  OP  THI  OCAN.  OAAOUATC  COLLEOS 
WATI  RMAN  •UILOINO,  •UALINOTON,  VI9IMONT  05401 

■  ■  ;  ■  ■  - :  .   -  ■ 

:    Septertiber  24.  W9 


Tilt' iiiinorable 'James  H,  Jef for dis  . 
U.S.  House  ofikepresentattves 

Washington ;Jfc,    Z051S  .  -  . 

'  .  »         ■  ■ 

Itear  Mr.  Jeffords:/   •  •  ^  \ 

.1  am  writing  to  Express  iny  reservatlqns  about  the  proposed  bill 
H,R.  4949.  The  Weiss*b111  ^nd  companion  proposals,  to  requlrje  certaTin 
IhfornMtion  be  provided  to  individuals  v<ho  take  standarillied  educational 
admls&lons  tests.   W  reservations  are  base^i  on  the  following 
observations:  41  - 

.Such  l^lslatlon  as  proposed  above  will  Increase  ,  . 
*  '  *the  costs »  primarily  to  those  taking  the  tests, 
4nd.  more  Importantly  may  exhaust  the  various  ways 
in' which  a  specific  set  of  Uems  related  to  an  /. 
^Important  conceal  or  skin  can  be  expressed.   For      •  ^ 
example.  questlA»  dealing  with  spatial  relations, 
sequential  reasoning,  amj  transferability  of  Information  • 
from  one  specific  situation  to  another  can-be         .  . 
.  f rained  .In  a  finite  and  small  fiumber  of  questions  ^ 
wljthout  giving  away  the  potential  discrlmlnablllty  • 
of  the  Item, 

.Results  from  standardized  tests  malce  up  only  ond- 
component  of  the  admlsslonis  file. of. an  applicant _ 
to  graduate  or  professional  schools.   The  extent  to 
which  academic  gra<Jes  and  standard  test  scores  are  • 
congruent  provide  degrees  of.  confidence  In  an  .admlSMons. 
decision  that  would  be  compicomlsed  If  such  test  Items 
'  became  available  to  potential  applicants.    I  suspect 
the  relationship  between  grades  9nd  test  scores  will 
beciSme  Increasingly  Important  to  decisions  on  admissions 
"   .  as  the  Interval  between  completion  of  undergraduate  ' 
educatloh  and  appllcatlon  to  graduate  or  professional 
schools  .Increases  as  has.  been  the  cdse  In  recent  years. 

'  .There  are  a  number  of  tutoring  techniques  and  procedures 
available  in  preparing  for  standardized  admissions  test$ 
^       which  appear  to  Influf^nce  (albeit  modestly)  test  performance. 


Kfj'itii'l  Oitjiorluuil V  Kmu  Vov.  i 
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Ifesplte  such  modest  changes  of  test  performances,  one 
of  the  objectives  of  standardized  admissions  tests 
'lis  to  assess  potentials  and  aptitudes  fiishloned  from 
the  previous »  and  cumulative  educational  experiences 
extending  over  years  of  prior 'education.  Accordingly,, 
i       .  ,     the  availability  of  test  Items  may  Indeed  comproftitse 
I  an  liportant  Index  of  such  aptitudes  and  potentials, 

I  ask  you  not  to-support  the  above  legislation  or  comparable 
proposdls.  I  will  be  glad  to  answer  arty  questions  about  the  above 
upon  your  request   (802-656*3160);  / 

Hy  bust  MUhes  to  you. 

'  ■  ■       •  •  •    •  . 

^       Slncev^ely  yours«  .  , 


\ 

RBL:lbffl 


■  ,  Robert  B.  Lawson. 

'  Associate  Vice  President ^ for  Research 

c  ^  »     and  Dean  of  the  Gt'dduate  College 


cc:   President  Lattl0  Coor 
Unlvers-lty  of  Vermont 
ypAsldent  H.  P|iUar»  COS 
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jfniV  WfiBX'X'  T 


Omca  or  QtUOUATI  trUCNIt  ANO  UNtVllltlTV  RVMAIICH 


OCT  51 1979 

OctoW.r*3,  1979 


^Gongressouin  Butltr  Derrick 
United  States  House  of  Representatives 
Washington^  D..C.  2051^ 

Dear  Butler: 

.     «  I  c^lT&lniy  enijoyed  yojur  remarks  to  the  Sertomal  Club 
yesterday.*'    Everypne  appreciated  the  candor  with  whi/ch  you 
addrui^aed  each.  Issue, 'Including  your  pay  raise. 

.  The  "Truth  In  Testing'^  legislation  presently  ptoposed  by 
twi>  ri.Us,  HR  3jS64  and  HR  4949  Is  of  grsat  concern  to  the 
hl^itifr  education  coMunlty«    I  aentloned  to  Mike  thjat  I  would 
senU  yuu  several  iteas  froa  ay  file  on  this  subject!  fot  your  •/ 
ruvttw.    In  ten  words  or  less,  It  Is  bed "legielatlbn  and  will  : 
ihavi-  a  iJevastat^ng  aifect  on  undergrAduets  and  graduate  « 
adiulriHiuiiB  In  colleges  sverywhere.    The  titi^erlencef  that  Niew  < 
^uik"Statf  Is  having  should  be  eimlned  cars ful^y /before  such 
cliau.»"t:.  allowed  to  sprasd  across  the  entire  nation. 

•  •  *    '  ^  ■ 

'finc^ossid  Is  Inforvation  ota  the  New  York  State  legislation 

,  aiij  Homo  of  the  reaction  to  it.    Also  etteched  aye  the  two  House 
hUiH  along  with  testlvony  given  before  the  sObcOnnlttee  and  a 
ietrcL'  from  iyle  Jones,  Vice  Chancellor  of  theVuolverslty  of 
.Notth  Carolina. 

.  '  ♦ 

I  hope  you  ifill  agree  that  t'fU  legJLslatlon  .ls  111-concelved 
and  Is  not  In  the  i^est  Ihterfst  of  quslltyi'higher  education.  * 
Any  action  y9u  c#n  take  to  defeet  thtee  bills  would  be  a  worthy  j 
servi^^to  the  educatioiial.  coenudlty.  .     .  '  ^  . 


Since: 


r^C^chwerts 
De<en  of  Graduate  Studies 
anil  University  Research 


At£S:diu 
Attaclyaents 


ccs:    President  Bill  L.  Atchley      ^    ;  ' 
»Dr.  Michael  J.  Pelcsar,  Jr.  »^ 
.  President*  Council  of  Graduate -Schools  In  the  U.S. 


CUMtOKlOUni(VMOUNAHto1«Tt^^  ' 
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BQ$|onCdle8e,qbstnuHilt,Massach^         Telephone  (61 7) 


^Craduaie  School  b(  Am  and  Sciences 
.  OMctofiwDMn  / 


Oc|tober  22,  1979 

■  /     •  ■'  ■  . 

The  Honorable  Carl  D.  Perkins 
Committee  on  Education  and  Labor 
Subcomnlttee  oh  Elementary.  Secondary  & 
Vocational  Education 
B-346C  Raybum  House  Office  Building  . 
Washington.  D.C;  20515 

Dear  Mr,  Perkins: 

In  respons««ip^your  kind  Tetter  of  October ^Ith  Indicating  that  you  would 
be  pleased  to^accept  a  written  statement  fran  me  for  Inclusion  In  the 
hearing  record  In  opposition  to  the  two  bill  i  dealing  with  standardized 
.testing.  H>R/4M4.  and-HfR:  4949,  currently  ©fore  y^pur  SubcomnHttee. 
may  I  associate      "  ----  ^  .    ^        .  _  - 


n\yself  with  ttie  position  taki  n  by  the  Association  of 
Graduate  Schools  in  American  Universities  anj.the  letters  of  countless 
graduate  deans  to  your  Subcommittee.  ^ 

All  of  these  without  exception  urge  that  acti 
verV  minimum  be  deferred  untfl  we  may  have  ths 
under  the  recent  testing  legislation  adopted 


•As  presently. drawn,  these  bills  are  both 
should  not  be  passed^ 


sc 


^  ■ 


)n  upon  l!hese  bills  at  a 
I  benefit  of  the  experience. 
>y,  New  York  State  ^  . 


and  defective. arid 


ly  yours.  < 
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i^tional  asHQciationof  college  admissions coupselqrs  / 

•0933  Uwl«f  AvwiM,  Suite  000, 8kokl«»  llllnolt  00077;  Ttl.  312A7fr0600'  ' 


pctober  23,  1979 


pjr65f!?i!ff?(fftii » 


ftnm'rmirintii 


The  Honorable  Carl  D.  Perkins 
The  House  of  Representatives 
2365  Rayburn  House  Office  Building 
Washington,  D.C.  20515 

Dear  Mr.  Perkins: 


We  are^ntlng  on  behalf  of  the  National  Association  of  College  ' 
Admlssans  Counselors  to  express  our  dfep  concern  with  leglslAtlvtf^  * 
proposallv  H.R.  3564  and  H.{\.  4949.   The  subject  of  these  two 

R reposals  wa$  debated  by  1300  members,  at  our  recently  concluded 
atlQpal  Conference..  We  are  especlapy^concenued  with  how  these 
bllls^ll  affect  the  student  or  the  education  consivner. 

It  Is  with  the  following  purpose  In  mind  that  we  ask  your  connlttee 
to  withhold  a  decision  on  these  bills  until  the  next. session  of  . 
Congress  for  the  reasons  listed  below. 

NACAC  Is  a  not-for-profit  association  of  3,000  high  school  counselor 
and  colle9e  admissions  officers.  One  of  our  artlclcts  of  incorporan 
Is  '*to  serve  students,  parents,  secondary  schools,  postse<;ondary 
educational  Institutions  and  related  educational  organizations  and 
agencies  by  considering  the  whole  range  of  influences  on  a  studer\t's 
transition  from  secondary  school  tb  further  education  without  regard 
to  race,  creed,  sex,  political  affiliation  or  national  origin." 

Specifically:  •    .  '  *  ^  . 

1.  .While  HACAC  fully  efMqrses  students^  rights  to  free  and 
Tull  infonaation,  we  are  corfberned  .that  such  access  not 

,   result  in  either  Uniting  a  student's  educational  oppor- 
tuoities  or  drwaticaily  increasing  the,co$ts  of  tests". 
•    to  students. 

2.  The  impact  of  state  laws  on  the  testiiH^issue  (especially 
New  York  State)  Itas  not  had  an  opportunity  to  be  fully 
"tested".   There  sholld  be  sufficient  lead  time  to  pre- 
pare for  changes  before  national  laws  are  imposed  upon  the 
adelsslons  process.  Consideration  must  be  giveti  to  the 
ramifications  these  bills  will  have,  if^enactecf. 


md  nimaM  AM  Offimn  imfh§  mnimit 
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.Honorable  C«rT  D.  Perkins 

^r^^''"^,  •■■  :•■ 

•  In  July,  two  ma3or  testing  agencies  stopped  administering 
tests  In  New  York,  State  and  It  now  appears  that  twenty 

•  iwVje  test) sponsors  i!«111  follow  suit.   The  College  Board 
recently  revised  Its  1980  schedule  for  administering  the. 
SAT  in  the  same  sUtfi,   The  result:   fewer  tests  and  higher 
costs  to  the  student.   Further,  New  York  State  has  mo>ed 
up  the  date  for  Implementing  Its  new  law  to  JuTy  1*  1980 
Instead  of  January  1  as  previously  scheduled.  Reason  for 
the  action  Is  to  give  the  New  York  State  Assembly  an 
opportunity  to  again  review  and  revise,  If  necessary,  the 
approved  legislation. 

« 

3.  The  secondary,  school  counselor  will  bear  the  burdeh  of  - 
ar\y  changes^  In  the  law  as  will  the  student.  Federal  >. 

-      regulation  Is  not  needed  at  this  time  on  a  system  that 
is  already  overburdened  with  the  new  laws  and  pro<fedurcs 
on  financial  aid  and  the  Privacy  Act. 

4.  If  enacted  as  written,  the  nw  law  would  require  more 
counseling  on  behalf  of  the  student  at  a  time' when. m5st 
local  school  budgets  are^  being  cut  back  In  the  area  of 
student  counseling  sinHces.  ' 

5.  The  Iq^lcal  approach  to  correcting  test  abuse  Is  through 
eduoatlon  rather  than  through  legislation*   Training  all 

.  counselors  and  acftnlssions  officers  who  use  tests  each 
day  to  help  or  make  decisions'  on  behalf  of  students  Is  a 
national  necessity.  Professional  associations  like  NACAC 
see  this  education  process  as  a  form  of  self  regulation; 

6.  Our  society  needs  to  deeiQphasIze  the  use^of  tests  In  the 
admissions  decision  process.  The  proposed  laws  tef>d  to 
highlight  testing  and  take  It  out  Of  perspective  In  the 

•  admissions  process. 

7.  If  enacted,  the  law  will  Increase  \he  opportunity  for 
nonprofessionals  to  profit  from  questionable  serviced  , 
regarding  test  taklM. 


uAyou 


We  have  stated  these  seven  reasons  because  we  do  not  be; 
conmlttee  has  received  ai\y  test1mor\y  from  the  profess lol 
work  with  Itudents  and  parents  on  a  dally  basis. 

Before  ariy  bill  Is  sent  to  the  full  committee*  NACAC, representing 
the  professional  counselors  at  both  the  secondary  and  postsecondary 
levels,  stands  ready  to  work  with  you  and  your  colleagues  on  how 
new  testing  laws  can  be  written  to  enhance  the  educational  value 
of  the  tests  and  enable  students  to  have  free  and  full  Information 
on  test^.»  ^. 
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Honiarible  Carl  0.  Perkins. 
October  1979 


*  •     •  ■     **       ■  . 

Enclosed  are  three  HACAC  documents  fo^  your  Information  -  * 
Statanent  of  Students'  Rights  and  Responsibilities  In  the  College 
Adilsslons  Process,  Statement  of  Principles  of  Good  .Practice,  and 
.the  Honltoring  Procedures  ^ these  statements. 

L  4      *  sincerely  yours,  * 


Delwin  K.  Gustafson 
President 


CAH2 


Charles  A.'Marshall 
I       Exdiutlve  Director 

Enc.  ' 

zci   Members  of  Subconnlttee  on  Elonentary,  Secopd(ry  and 
Vocational  Education 

Representatives  tfetss,  Jill ler  and  Chlsholm 
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MINONITV 


!bNGI«ES^  QF  THE  UNITED  StATES 
I  HOUSE  OF  REPRESENTATIVES 

f    COMMITTEE  ON. EDUCATION  AND  LAtfOR 
SUBCOMMITTEE  ON  P05T8EC0NDARV  EDUCATION. 
OIIHOUSKOr^iCKBUILOlNOANNKXIl  , 
.  WAtHINaTON.O.c;  toils 

October  24,  1979 

■  /  ■ 


MICKKT  lOHfAHDl.  OKLA. 
TMOWM  i.  TAMIf .  WWA 

TMOMA*  «.  rrmi.  wi*. . 


.1  


Honorable  Carl  D,;  Perkins  .  .  ^ 

Chairman .  *  ■  *  . 

Subconalttea  on  Elenentary;  Secondary 

and  Vocational  Education 
B-346-C  Faybum  HOB 

Waahlngton,  D.C,    20515  •  "  . 

Dear  Mr.  Chairs^: 

•Aa  the  ranking  Member  of  the  Subconalttee  on  Klenentary,  Secondary  , 
and  Vocational  Education,  and  the  Chairman  of  the  Subconmlttee  f 
on  Poatfcecdndary  Kducatlod,  I  have  received  conalderable  correspondence 
on  H-R.  3564  and  H.R.  4949,  which  jftddrese  the  Issue  of  educatloival 
tasting.  »  • 

Of  the  correspondence  i  have  received,  tha  attached  letter  from 
Dr.  Ira  Polley^  AssAtant  Provost  for  Admlsalona  and  Recorda  at  • 
Michigan  State  University,  was  particularly  enlightening-    Dr.  Polley 
■akcB  several  excailent  points,  WhlTch  I  would  like  to  share  with 
you  and  have  included  in^  the  hearing  record  for  theaJ  two  l)ills. 

I  ♦  '  ■ 

I  am  aure  you  will  also  find  his  obsewstions  most  helpful  in 
your  analysis  of  the' legislation.      ^  ^ 


Vith  kind  regards,  I  am 


Sincerely, 


WILLIAM  D.  FORa 
Chairman 


VDPirsn 
I  Enclosure 


ccj    Dr,  Ira  ?olley. 
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MICHIGAN  STATE  UNIVERSITY 


o»nci  or  THcmovosT 


'October  12.  1979 


CAST  UNSINC  •  MICHIGAN  •  4IU4 


The  HonoVable  William  D.  Ford 
Hou>e  of  Representatives 
236d  Rayburn  Hojuse  Office  Budding 
Washington,  D.C.  20515 

bear  Bill: 

'      .■■  ' 

As  a  member  of  .the  Subconinlttee  on  Elementary,  Secondary  and  Vocational  Education, 
House  Cownlttee  on  Education  and  Labdr,  you  may  be  interested  in  thp  reactions  . 
that  i  have  to  H.R.  3564  (the  Gibbons*  bill)  and  H.R.  4949.  (the  bill  inti^oduced  by 
Hr.  Weiss  for  Wmself  ^  Mr^. '.Chlsholm  aiijUHr.  Miller  of-California). 


I  can  understand  some  of  the  concerns  that  have  led  a  number  of  fj^/people  to 
believe  there  are  grave  problems  with  admissions  tests  that  can'oe  corrected  only 
with  national  testing  legislation.   But  i^n  r\y  mdftyy^^rs  in  educational  posts  of 
one  kind  of  another,  I  really  have  n<yt  seen  conVincin*  evidence  that  there  are  * 
abuses  that  victimize  students  and  parents.    It  may  fcfe  that  a  few  higher  education- 
al institutions  place  too  much  reliance  on.  some  test?,  but  very  few  universities 
or  collies  make  decisions  on  admissions  by  according  great  weight  to  national 
tests.   We  at  Michigan  State  University  do  use  the  SAT>and  the  ACT  tests,  but 
neither  plays  the  decisive  role  In  our  work.   High  school  gVades  in  academic  sub- 
jects, the  nuirtber  of  "solid"  subjects  taicen,  and  the  trend  in, the  grades  are  the 
decisive  factors.    If  a  few  colleges  do  place. inordinate  reliance  on  national  tests 
\parents  arid  students  have  a  remedy:    That  is,  since  there  is  fuch  a  larrgft  2""*®'', 
■of  excellent  public  and  private  universities  and  colleges*  no  one  lias   to  do  busi- 
ness" with  any  college  that  may  believe  tests  give  infallible  guitfeJ.    Ksy  matlter 
of  fact,  I  personally  know  of  no  university  or  college  that  operates  on  'the  assump- 
»t1on  that  test  results  aA  the  decisive- element  in  the  decision-making  process. 

The  Gibbons'  bill,  as  you  know,  provides,  in  part,  that  everywe  who  takes  the  . 
te&t  is^to  be  informed  of  "the  score  which  is  generally  required jfor  admission  to 
institutions  of  higher  education".    There  is  here  an  assumption  fhat  is  bas^d  on 
no  facts  at  all.   As  ii\y  earlier  coninents  have  suggested,  the  system  of  higher  ed- 
ucation In  America  is  a  pluralistic  one^  There  is  no  test  5core  that  aii/">tl- 
tutlorts,  fifty  percent  of  the  Institutions*  or  even  three  percent  of  the  institu- 
tions use.    Indeed  a  sing*!©  institution  looks^t  t^&t  scores  along  v<ith  many  othet* 
■factors,  and  accordingly  has  established  na  score'that  guarantees  admission  or  ^  ^ 
that  results  In  a  denial.     •  , 
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The  Honorable  William  0.  Ford 
Page  2         '  * 
October  12.  1979 

■    ^ .' 

Let  me  say  a  few  wordsion^ne  feature  of  the  bill  Introduced  by  Nr.  Weiss  and  . 
others.    It  contemplates  that  any  one  who  takes  a  test  ha;»  the  right  to  a  copy 
of  the  test  and  the  correct  answers.   This  provision  Is  rilled  w>th  mischief. 
Some  of  the  clear  consequences  are  as  follxms.    First.  Its  operatlort  would  make 
dlfflcult^the  Improvement  of  tests.    I  recall  from      days»  years  ago,  as  a 
teaching' assistant  In  Political  Sclftce  at  the  University  of  Kinnesota.    In  the 
large  American  government  courses;  with  enrollments  of  a  few  thoMsand,  multiple 
choice  questions  were  used.   We  had^asslstance  from  a  testing  office  In  the  Uni- 
versity to  do  validity  studies,  so  that  Imperfect  questions  Including  those  that.  ' 
do  not  discriminate  could  be  eliminated.    For  example,  If  95  percent  of  the  stu- 
dents know  that  Congress  Is^a  blcamet^al  body,  that  question  Isn't  of  much  vafue 
(it  does  not  discriminate) i   Or  if  only  five  percent  orthe  students  can  Identify 
1930  as.  the  date  of  the  Norrls-LaGuardIa  Act,  again- that  question  may  not  be  suit- 
able. 'To  return  to  the  Weiss  bill,  I  do  not  see  how  validation  studies  and  test 
improvements  could  be  prosecuted;  If  all  tests  and  right  answers  are  to  be  pub-  ' 
lished.   And  this  leads  me  to  )y|y  second  point.   The  tests ^^and  answers  would  Indeed 
become  published  by  tutoring  organizations  that  would  be  giving  assurances  that 
they  can  guarantee  your  youngster  will  perform  magnificently  on  a  test.    In  this 
connection,  please  see  the  excellent  letter  (copy  enclosed)  that  Or.  Kenneth  B. 
Clark,  the  author  of  Dark  Ghetto,  wrote  to  the  New  York  Times.  '  \ 

I  have- a.  third  observation  about  the  Weiss  bill.    If  It  Is  passed,  the  people  who  ' 
will  suffer  are  the  parents  and  the  students  who  will  have  to  pay  substantially 
more  for  national  tes^ 

To^suSriDarize,  it  is  iny  profound  conviction  ^hat  there  are^  convincing  reasons 
why  Congress  shpuld  enact  nationa^  testing  legislation.  ->Ar^  matter  of  general  ^ 
philosophy,  I  share  maryy'of  the  vfews  that  Nr.  leader  has.   But  I  do  not  believe 
that  either  the  Gibbons  or  the  Weiks  bill  should  be  supported  on  the  mistaken 
idea  that  it  Is  an  enlightened  example  &f  a  measuVe  /(d^  protect  consumers.    It  most 
certainly  will^Qt  benefit  parents  ^nd  students  who  seek  \o  enter  undergraduate 
or  graduate  programs. • 

If  iny  Jonnents  provoke  questions  in  your  mind,  I  wijl  be  happy  to  respond.  Or  if 
your^&taff  colleagues  wish  to  pur^e  any  of  the  points  I  have  tried  to  make.  Til 
be  happy  to  assist  them. 

All  best  wishes.       .     ^     •  .\ 

^Stiicere>y.    .  .     .  ' 

.....  .  .  -  '     .  .  - 

Ira  Pblley  ^  • 

Assistant  Provost  for  Admissionls  and' Records      ^  -    -  , 

Enclosure         .  '  ;  ' 


11 
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[From  the  New  Tprk  Tim^Augy^t  18.  1979] 


'This  So-Called  Truth-in-Testirig  Law  Is  ijTlacebo' 


;TQtK<%4i(or: 

On  July  31.,  The  limes  uncriliraUy 
<n(toned.ihe  viniih.in.iwiins''  lecis.  ^ 
lation»  .which  ^as  sifmcd  by  Go\'cmur 
Carc)'.  Your  eiSitonjii  sta(t<)  that  this 
amciHlment  to  tl 
would  take  "the  mv 
teilinfV  and  that 
know  how  they  are 

Judged.;     .  .  •     .  , 

In^piteof  (K^«k2  inicnlions  of  youf 
editorial,  it  was  m'slead^j.  So  *a$ 
Ralph  Nader's  assenicn  in  an  Aug.  3 
.  letter.' thai  the  l9s:slaCion  wil)  rcq'Jirc 
test  companies  "to  explain  td  students 
uhat4he  scores  mean  and  how  ihey 
will  •  reported,  to  schools."  And 
Nader's  claini  ihii  objections  to  this 
•  legislation  reflect  only  the  -corporate  ' 
style  loMyins  efforts  of  te^tin|  terv- 
ices"  IS  inaccurate'; 

The  Board  of  RtstsuTard  Ui;  Com-: 
missioner  of  Educal:6n  cf  the  Stat^! 
New  York,  independently  advised  the 
GoverTMr  afairut  signing  this  legtsla- 
tiofi.  ft  is  iby  contention  that  (his  so> 
called  tnith-in«testthg  law  is  a  place- 
bo, 

However  laudabte  US inte^ions.  this  ' 
law  cannot  force  test  compan:eno  ex>^ ' 
p:ain  the  meanir/:  of  test  scores  to  s:u. 
dents:  ar.d  c«.i3inly  (his  law  cacjiot 
deal  with  (he  cciT.p:ex  issuesof  testVa* 
lidity  and  the  rele  of  cultural  factors  in 
inQuencin;  (es:  r esulu.. The  cqr^^t ruc- 
tion, evaluation  and  mrerpretation  of 
tests  ire  highly  teshnicat  natters 
which  must  be  dealt  with  by^ongoing  ^ 
research  by  those  who  are  trained  in  ^ 
rtiis  specialty.  The  important  problem 
of  the  us^  and  ab)^  oi  standardized 
tests  cannot  be  resolvedby  i  simplfs- 
tic  law  which  confuses  this  issue  with 
consumer-protection  problen^. 


Admission  tests  measure  the  abil' 
Ities  4cvo|oped  by  individuals  over  a 
rpng  pcnod  cf  time,  both  m  and  out  of 
I^ch03l.  The  %'aiue^f  tesv  results  is  di< 

^rectly  related  to  (he  equality  of  oppor* 
tunity  afforded  to-thtf  candldnt^  tak< 
Ins  a  pani^ular^test.  The  assumption 
that  a  candidafe's  examination  of  a 
test  already  takep  will  somehow  im< 
prove  scores  or  reduce  the  chances  of 

k  abuse  Is  highly  questionable.  One  cap 
further  assume  that  only  (he  more 
pnvileged  students  will  avail  them- 
selves of  the  oppor:u2^ty  to  e.xamine 
th^  test  materials.  These  students  will 
seek  private  tutoring  on  the  assumjv 
ticn  that  thiswill  increase  their  future 
test  scores.  Those  individuals  who  can- 
not afford  this  privilege  will  certainly 
net  tmprove  Iheir  test  scores  by 
merely  examning  the  Usi  questions 
at^d  scores.  Thrs  is  a  deceptive  and 
meaningless  exercise.  .  . 


'  9 


-i 


The  New  York  State  version  ^1  Ojk 
iruth-irvtesting  law  is  misleading  iflw 
confuses  ihe  public  It  will  not  benefit 
mtr/7nty  and  poor  students.  It  could, 
in' fact,  be  deinmoental  to  alreadV'^is.  . 
advantaged  Indivtdualsr.  Appropriate 
legislation  in  the  genej;al  arei  of  the 
abuse  and  the  premature  exclusionary 
use  tt  standardised  (ests  might  be 
desirable.' but  such  legislation  should 
be  the  culmination  of  serious  Inquiry 
rather  than  a  political  gesture.^     <  " 

.11  Is  my  firm  belief  that  this  Is  such 
an  lmportu|  matter  that  (he  New 
York  State  Bglslature  should  hold  a 
series  of  heaKigs  with  concenied  pro- 
fessionals fwthe  purpose  of  amending  ■ 
this  law^  wfllcn  promises  much  more 
'  than  it  can  Dossibly  deliver. 

Kenneth  B.<^L^RK 
^  C  Member.  Doard  of  Regents 

New  York.  Aug.  7. 1979 


1175 


1172 


October  24,  1979  '  I 


#  '     ■  ■  -  •  , 

The  ^notable  Carl  E,  Perkins     .  .  ^  \ 

dhalrman.  Elementary,  Secondary  and*.  • 
.    Vocatvional  Education  Subconmlttee,  •  '{r 

House  Education  and  Latidr  Coiomlttee  .  * 
9-346  C  Labor  and  House  Office  Building  ^  ^     -  m 

Washington,  DC   20515       ,  ,  V  "  f  ^ 

-  ■  ■  .  '  ..  ,  , 

Dear  Mr.  Perkins}  J  -o. 

As  wt  your  letter  of  pctober  9^,;  1979,  I  am  writing  several  state*^* 
ment^  in  response,  to  two  bills  dealing  with  sUndardlsed  testing. 
Htf  K.  3564  and  4949.    Ify^pl^ilans  are  my  o^  and  have  been  formulated 
by  my  working  with  standardized  testing  programs  for  six  years.  My 
pbsttion  lb  Coordinator  of  Testing  at. Miami-Dade  Community  College,  *^ 
North  Campus.    I  administer  one  of  the  largest  testing  npograms  (over 
50  jitandardized  tests)  in  the  United  Statea  for  the  ^a;t^nal  Lasting 
agencies  (Educational  Testing  Service,  American  College  Testing  .  * 
:  program  and  Psydiologlcal  Corp^atlon)  •  /  ^ 

Ivwill  sumnarlse  my  opinions  in  a  series  of  stattaents:  ^ 

.^1.    I  felBl  that  the  passage  of  the  bills  will,  not.  be  in  the 
best;  interj^t  of  the  population  they  Intend  to  serve. 
■.  '   ■  ^  I  ■  •  '      .  ■ 

2.    Jhe  postr  of  the  admllBiaion  tests  irlll  be  Inbreased  greatly, 
thtis.  reducing  access      colleges*  and  prof esslonal  programs 
by  several  categories  of  students.    Xhe  testing  agencies 
will  simply  reduce  the  number  of  test  sessions,  thus' causing 
the  test  centers  to  increase  the  capacity  6f  testing  sessions. 
Many  schools  aniil  universities  will  nofi  be  able  t^accoomoda^ 
^    this  increase.  .  *^ 

V         '    '  ■ 

f.3.    Aq  a  profjessor  teaching  graduate  courses  in  tests  and 

measi^remen^,  I  cannot  see  the  benefits  that  wou^d  be  senfed' 
by'  sending  original  answer  sheets  and  copies  of  test  items 
^    to  students^    ReA'fearch  studies  have  %iown  some  fluctuation 
\  in  scores,  but  within  certain  limits,'  1  think  the  tests  . 

'  #  are  valid  pri|41ctors  of  su.ccess  in  college  and  professional' 

programs.  * 
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Mr.  Carl  E.  Perkln9 

October  24,  197$  # 


4.    I£  nonltoting  of  standardised -testing  programs  Is  necessary, 
I  propose  rtiat  this  te  done  by^the  newly**created  Depai;tment 
of  Education^    The  testing  agencies  abide  by  certain  con- 
.  straints  with  respect  to  Itemg  and  Item  pools.  Professional 
admldsloh  councllcs  monitor  th^  programs  now.    Research  Indi- 
cates that  there  is  a  high  Arrelatlon,  generally/  between 

^  test; V scores  and  success  in  colleges  and  graduate  studies, 

*  ,       '         •<  .    ■  ■      .  . 

5#    Finally,  I  wonder  if  the  testing  (Agencies  can,  within  the 
time  frame  specified,  produce  entirely  different  forms  of 
standardized  admission  tests,  equate  and  norm  them  for 
comparability,  of  scores.  .The  fact  that  students  have  access 
to  the  actual  test  items  will  change  certain  factors  in  the 

[      process  of  ^standardized  l^^ting.         '    ^  '    .  I 

6.   "Before  these  bills  are  acted  upon,  I  think  some  research 

^   studies  need  to  be  done  in  New  York  State,,  showing-  the 
*     'implieations  of  this  type  of  legislation. 

Thank  yo^  for  your  time  in  this^matjter. 
Sincerely,  ^  *   I  :    .  ». 

ohn  R.  Scetba,  Ph;  D.       •     .      •  ,  . 

11822  N.  B.  12th  Court  ;  ^ 

North  Miami,  Florida  33161  ' 
(305)  685-4412  ^ 

•    ■'  t 

JRS/ec 

cc:    Congressman  Gibbons- . 
—    Congressman  ^eisa 

Attachments 
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•7fi  NOllfH  MICHIGAN  AVENUCt  SUIH  IBM.  JQHN  HANCOCK  ONTEa  CHlCAdOi  ILUN(H|^OSH  j  (312)  787-2072 

CUTIVE  OFFICE 


October  30,  1979. .  * .  .  '  *  ■• 


•  .  •     ■     ■  • .  ■ "       ■  ■  ^ ■■  •   ■    . ■  • 

^Honorible  Cerl  D.  Perkine,  Cha'itman  . 

XSomattfe  on\Bducat4>on  and  taboi;      :  ,  ^ 

U.3*  polite  of  Represente^lveB  .  . 
•'•2181  RBOJ  .     ;  .  •    ■  ■■.  V  '.  .  \ 

WMljlngton,  D.C.    20515.  .       '  ' 

jDeer  Mr «  Perkins: 

In  bfh^Xf  of  .the  23»000  Miri>erk'oir  the  AiaeTlcan  Hedlcal  Record  Association,  (AMRA) , 
I  ttte  this  opportunity  to  coanent  on  th.f  P^ilillnp  proposed  federal  test  legislation 
^^ff.llk^3$64  and  H.RV  4949.    I  understand  that  hesrlngs  were  held  recently  on  this 
'  legislation  and»  X  wish  to  enter  these  reaarke  as  p§rt  of  the  Conmittee.  h^rltlt  . 
.ptp&eedlngs.  .  *  , 

first  ^  AMRA  jiuppoirts  the  Institution  of  stsndsrdlsed  testing  and  the  concept  of 

fair  repotting  practices  to  cGmsuarfrs.    We  are'  In  support  of  requlreBshts  of  R.R« 
■   35^4  end  H.R.  4949  to  requlrst    descrli>tlon  of  the  test  purposs,  description  of  . 
>ubJiBicts  to  be.testVa^  MrglxH of  error 'end.  extent  of  rellsblUty,  dlstrlbuti^  of  \ 

.tiasti  scores »  sppUcants  rights  to  obtsln  teat 'scores  and  detslls  of  such  disclosure* 
'  •Thefe'^^  procedures  are  sound  prsctlces  whlc^the  Aijierlcao  Medlcsl*  Record  A88oclat;toi:| 

currently,  follows  in  Its  Nstlonal  ceirtlf^atlon  fcesjting,prograQ« 

8iicondly»  AMRA  recognlces  and  supp'ertto  t;he  prlyste  sector  natlonaXly  endorsed 
it«)idard|i»  ssfagusrds'»  snd  procedilres  sstabllshed  for  standardized  test  develtipoent 
itod  eiuknlstritlon.    Such  standstds  haVe  been  set  by  prof esslonsl  testing  an^ 

•  MiBureaent  •pedallsts  and  hfVrssulUd  In  reliable  test  lnsttuaents,«    He^svor  - 
■aintfalAing  private  sector  dbfitral  over  testing  developoent  snd  procedures  Tfid 
opppse  ths  subaisslon  of  test  questlpnsp  scores,  and  scoring  procedures  to  tA 

.'■  U.S..  'CoaBifsloner  of  Bducatlom;  •  We  oppose  aptry  of  th6  federal  .g^vemaent  Into 

*  (^ajM  procedures,  ss  ^hls  will  lead  to  .gqV^r^nt  control  of  educstlonal  testing 
ih-th^  United  States.     '.  ^  \  ♦      «  / 

■    ■  '     *  ■         '    •  ■  ■     .  ' 

Third*  AMRA  oppdies  any  .legislation. that  would  nandata  dljiclosure  of  queetlone  and 
anaw*rs  of  standardized  tests  to  the  pubj|,c  or  test  sppllcant*    We  Op0ps>. releAde 
'pf ,  this  Inforaation  because t.  ^  '  ^^i'- 
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»        ■    ■  ■'.*".  » 

*         .1)  .Thft  value  of  8taiidar<^sed  test  queatlona  used  acroas^tlnle  will  be  , 
lOit.  ■  / 

2)  The  "po^Jl"  of  taat  q\ie%ticma,  eapeclally  for  speclalired  academic 
areas,  would  dinlniah.  over  tind;  and,  the  availability  of  the 
queation   pool  in  the  public  arena  would  provide  unfair  advantage 
to  applicant •  with  ready  access  to  the  "pool".    Thus,  the  high 
reliability  of  standardised  tests  to  teat  knowledge  or  ability  * 
would  diainish.  •  ' 

3)  The  cost- of  testing  wlU  increas^  due  to  the  necessity  to  prepsre, 
co^letely  new  tests  esch  time  s  test  is  ^iven,—  In  nliny  instances 

.         .  ♦      several  tiae.s  s  year.  ; 

,  In  auMury,  AKMl  supports  fair  .testing  develqpaeni  and  adnlnistrsdLon  proqedures 
which  have  been  developed  by  the  private  sector  a^id  wfiich  sre  su^f^ted  in  H*R. 
.3564  and  H^R.  49^9.      ^         .  •  . 

Ve  stand  opposed,  vhowever,  to -the  submission  of  test  . questions  and  answers  to  the 
federal  governmentknd  test  ^ppli6ants. 

Thank  you* for  the  oppprtunify  to  submit  these  consents  for  the  record. 
^^Sincerely, -  .  .  ' 


Carolyn  Csve,  Ph.D.,  RRA 

Executive  Director 

AMBRIG^  MEDICAL  RECORD  A880CUTXON 
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ED  BETKUNE 

IHO  DittfflCT,  AflKANSAS 


WMHirMTON  orncct 

IfM  LONOWOiVTH 
HPUW  OfFtCC.auiLCMNO 
WMHiNOTON.  0,C.  1081 B 
(tot)  22»^a80« 


CongtetSflS  of  tfie  Vniteb  i^tateiK 


.1- 


■Mtington,  20319 


oirriucT  orpicKi 

tM7  rtOtMAL  BUIUOtNO 

700  wcsT  Capitol 

UTTUK  rock,  ARKAMtAS  7^01 
(SOI)  S7I-8941 


October  31,  1979 


The  Honorable  Cajrl  <).  Perkins 
-    Chaivman,  ^lement2i/y,  Secondary  and  .     .  ^ 

Vocational  Education-  Subcommittee  /  ,  " 

House  Education  and  Labor  Committee  ' 
.    B346C  Rayburn  House  Office  Building  . 

Washington,  D.C.  20515 

Dear  Mr.  Chairman: 

>     Enclosed  are  copies -bf  letters  I  received  from  Dr, 
James  J.  Hudson,  Dean  of  the  University  of  Arkansas 
Graduate  School,  and  Carl  S,  Whillock,  President  of 
*  Arkansas  StatiB  University,  advising  me  of  their  corfcerns 
•    about  the  "truth  in  testing"  bills,  H,R,  4949  and  H.R 
3564, 

,       «       .         .  •  . 

I  understand  both  measures  are  before  the  Subcom- 
mittee for  hearings,  and  I  wonder  if  yoif  would  be  kind 
enough  tf>  review  and  retain  Dr,  Hudson's  and  Mr,  Whil- 
lock* s  correspondence  as  part  of  your  permanent  record 
of  public  comment  on  this  issue.  I'm  sure  their  thoughts 
will  prove  valuable  to  the  Subcommittee ^as  hearings  pro- 
gress, 

.        Your  consideration  |tf  and  attention  to  these  viewd 
are  sinceirely  appreciatea* 


EBtabb 
Enclosures 


Ed  Bethune 

Member  of  Congress 
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Arkansas  State  University  ^^s;^ 


OFFICE  OF  THE  PRESIDErJT 
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: October  I,  1979 


the  Honorable  Ed  Bethune 

U,  S.  Congressman  '  \ 

boiise  Office  Building  '  o  . 

Washington,         ?0510  ■      .\  .  . 

*  ■  . 

Dear  Ed:  ■  \ 

PleasjB  give  your  most  careful  attention  to  the  legislation,  proposed 
in  H.  R.  3564  and  H.  R.  49A9  which  relate?  to  the  standardized  test- 
Ing  programs  that  are  Vi.tffl  to  American  education*    This  legislation 
would  seriously  damage  the  systems  of  measurement  and  evaluation  that 
are  essential  to  our  determination  of  the  strengths  and  weaknesses  of  •  ^ 
persons  seeking  admipsion  to  various  higher  educaticfn  programs^he 
quality  of  our  programs  and  their  effectiveness,  and  the  leva|H| 
attainment  in  knowledge  and  ability  by  those  people  completiif^»r 
programs  and  entering. the  many^fidlds  of  emplayment  throughoutTthe  / 
American  society..    We  strongly^request  your  assistance  in  defeating 
these  proposals,  • 

Should  .you  desire  specific  information  about  the  proposals  and  the 
liapact  that  would  result  from  their  adoption,  we  suggest  that  you  con- 
tact the  Council  of  Graduate  Schools  in  the  United  States,  the  American 
Association  of  State  Colleges  and  Dniversities,  or  the  National  Associ- 
ation of  State  Universities  and  Land-Grant  Colleges,  all  of  whom  have 
offices  at  One  Dupont  Circle  in  Washington,  i)..  C,      ,  . 

Your  assistracCL  wit^i  this  important  matter  wiU  be  greatly  appreciated.^ 


Carl  5.  WhlUock  ^ 
President. 


CSW:ph 


erIc 
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UNIVERSITY  OF  ARKANSAS  •  Graduate  School 


■•^  0FPIC£0PTME0EAK 
316  Administration  Buiidinc 
(501)575^01 
pAyBlt«vl(l«.  AiKmms  7270^ 


/  October  3,  1979 


The  Honorable  Edwin  Bethxine 
/        U.S.  House  of  Representatives 
,  Washingtoni  D.C.    20515       ,  . 

.  !  ■    ■  ./  ■. 

Dear  Congressman  Bethune: 

f  .  ■ 

As  Dean  of  the  Graduate  School  at  the  University  of  Arkansas  and- President 
'  of  the  Conference  of  Southern  Graduate  Schools,  I  am  concerned  about  the  "Troth 

in  Testing**  legislation  aimed  at  standardized  tests.    Although  Chd  intent  of 
'  the  proposed  legislation  appears  unassailable  on  the  surface, - deeper  analysis 
,       V  reveal  reasons  for  co'ncei:ni  .  ' 

Pne  of  the  key  elements  of  the  Weiss  bill  (H.R.  V9^9)  is  the  require- 
ment for  disclosure  of.  all  test  forms — all  que^^tions  oh  the  test,  together  .  . 
with  the  borrect  answers.    This  requirement  is  counter  to  the  manner  in 
which  such  tests  as  the  Graduate  Record  Examination  are  developed  in  order  ^ 
to  provide  assurance  that  they  are  not  compromised ' and  to  provide  assurance 
that  test  results  tfaken  at  different  times  and  places  have  comparability. 
Great  value  is  placed  upon' these  features  of  the  test  and  considerable 
'        effort  in  time,  talent,  and  money  are  dedicated  to  this  cause. 

Standardized  test  scores  represent,  one  of  the  relatively  few  meaningful 
.criteria  for^  evaluating  students  for  admisaipn  to  colleges  or  graduate  and  *■ 
^     .professional*  schools.    Admissioti  decisions  based  on  fewer  criteria'are 

iDore  likely  to  result  in  unsOccessful  experiences  on  the  part  of  students,' 
leading  to  frustration  and  disappointment  and  wabteful  utilization  of  the 
^    resources  by  the  institution.    Consequently,  every  effective  evaluation  tool 
'  needs  to  be  employed  in  tlie  search  for  qualified  students  #  * 

'    Although  standardized  teits  have  been  criticized  for  possible  cultural 
bias  against  minorities,  the  elimination  of  standardized  tests  would  be  ^- 
'    :      detrimental  to  the  minority  student  who  has  strong  innate  ability  but  who 

graduates  |rom  a  lees  prestigious  undergraduate  school.    Rather  than  taking 
4k    action  Which  will  weakm  or-  destroy  standarclieed  exatDinatlons,  a  toore  benefi- 
cial qourse  of  action. would  be  to  eliminate  cultural  bias  from  such  tests. 
I  understand  the  Educational  Testing  Service  (the  producers  of  the  C.R.E. 
and  several  other  popular  standardized  tests)  is  taking  action  to. solve  this 
bias  prio'blem* 


Tht  un'wtmiy  ot  AUioiti  is  in  tquil  oppoflu»»itir/iHirmiti«»  teliofi  iniiiivMon 


■  :1179 

»* 

Conj^ressmai^  Bethune  ^ 


1     I  strongly  urge  degeat  of  the  Weiss  bill  and  the  similar  Gibbons  bill 
(H.R.  3564)  and  encourage  support  of  Accessary  legislaticAi  to  remove  cultural 
.and  sthnlc  biases  from  standardized  tests  used  in  admission  criteria  fdr 
educational  programs.  m      \  ■ 

■       ^  '    ,    ■  ^  Sincerely,  . 

'  ■"     ■  r^.  ' 

*  •         ■  ■  k 

.'.James  J.  Hudson 

•  'Dean      ^    .  ^     ,  \ 

ct  ■■■  ■  •  ■■    '  ■ 


I 
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■         ■■■1180  --r- 

EMORY  UNIVERSITY  SCHOOL  OF  UW  • 

OAMmiaHAU  ATI:AMrA.OfOMlA  90823 


TO:     .C6tigrMt««n  Carl  l^rklnt,  Chalnon.  ' 

SubcoHBltttt  on  BIintntAry»  Secondary  and  Vocation^  Education.. 

nuOMt  .  Harold  U  iiar^ult^  itotlng  Daan 

DATE:  *HDVMber  5,  1979  ,  •  ^ 

'       .  »' 
RB:     '  StatiMnt  for  antry  into  tha  racord  of  the  haaring's  on  Fadaral 
Adalssfons  last  Bills  HR  3564  and  HR  4949 

.  •  *  '  •■  ■ 

Tha  Bills  currently  under  consideration  posa.^  serious  threat*  to 
tha  contimiatloi^of  - tha  practice' of  standardised  testing,  of  lav  school 
applicants.    The  aasdnisttative  difficultiifes  and  legal  pitfalls  facing 
tha  test  adMlhistratprs  und^r  these  Bills  nay  veil  result  in  the      4  ' 
abolition  of  the  Lav  School  Admissions  Jest.    Mot- only  vould  such  a  ^ 
consequence  ,  result  in  the  loiia  to  owst  lav  schools  in  the  United  SUtes 
of '^a  proven  valuable  predictor  of  likely  lav  school  perfomance  hut 
also  it  vould  Man  a  return  to  the  previous  practice  of  evaluating  0 
Ifirge  numbif)ia  of .  applicants  fojr  adnission  oA  the  >a8is  of  undergraduate 
jr^cord  and^rsonal  references  alone.  • 

.  The  underlying  assunption  of  these  Bills  sesiM  to  be  that  there  . 
are  major  defects  In^  the  pre-professlonal  testing  of  applicants  vhieh 
need  governnental  attention.    This  a«suapti^  'appears  to  be  based  upon 
a  Bisundarstanding  of  the  nature  of  the  standardised  test  and  the  use  ,^ 
to  vhich  it  is  put.    The  llnltad  purpose  of  the  t$AI.is  to  provide  ^ 
Admissions  personnel  with  a  predictor  of  perfomance  in  a  lav  school  ^ 
setting*    As  such  a  predictor  it  is  hi$hly  usAful  and  studies  by  BTS 
have  d«aonstrated  a  fairly  high  correUtion  betveen  L8AI  scores  and 
performance  in  laif  school,  for  all  applicants.    Even  so»  it  is  not  the 
only  factor  to  be  considered  in  the  Admissions  decision.    Many  factors 
go  into  that  decision  and  no  applicant  should  be  admitted  to  lav  school 
unless  his  vhole  record .  including  his  I3AT  score  indicates'  that  he  is 
likely  to  be  able  to  complete  the- lav  ichool  progrsn.    ieioving  the 
only  standardised  predictot  from  this  process  voiild  mean'  Oiat  Admissions 
personnel!  f#ced  vith  hundreds  of  applicants  of  varied  backgrounds  and  * 
experiences,  would  bf  more  likely  to  make  inaccurate  cci^atative  evaluations* 
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#2  ^  CoWi^taim  Carl  Birkina.  Ch^irwrnnf  -  Kovwibw  1979 

.    •  '  ■-■  ■        '     >  ' 

Qius  th«  thwKti  of  Advitting  itudentt  unabl«  tq  conplete  tht  law  tchool 
prograii  or  dcDyiog  Adialtilon  to  ttudantt  vho  Might  vtll  parforn  Mtif-      '  . 
•fl^rily  vould  b«  tubs tuit tally  IncrMftd.   Mpraover,  th«  lott  of  tha 
Vuikrardlaad  pradlctor  irauld  ba  llMaly  to  vork  to  tha  dcttl«ant  of  ttudantB 
hkviog f  aaturat  in  thair  pra<*application  background  which  9aka  thair 
cradantiaU  difficult  to  avaluata.    For  axai^>la«  foma  ttudanti  may  hava 
apap^  iavAal  yaari  at  hoaa  or  out  in  tha  work  f^gca  aftar  conplation 
of  thair  undargrwluata  aducation.   Otiiart  nay  haVa  graduatfid  from  collagap 
wfaoaa  raputation  it  not  wall  known  to  tha  AdmitfioAa  Cooaittaa,  Without 
thi  aaaittanca  of  tha  L8AT  m  f  pradictor  df  likaly  parformanca  in  law 
a^hool,  it  will  ba  axfir«Mly  difficult  t6  accurately  aiiaai  tha  potential 
of  thoia  Upplicantt 4b^Uw  ttudanti. 

In  ra,  wa  at  teory  Unr  School  baliava  thkt  tha  L8AT  ia  a  raliabla 
and  accurata  davica  for  pradicting.  law  ichool  paVformanca.    It  if  not 
tha  only  pradictor  <but  it  hat  provan  iti  uiafulnaaa.    Had  tha  Admltaiona 
Cowlttaa  at!  BK>ry  Law  School  baan  diffatiffiad  with  tha  tatt  or  had 
raaion  to  quaitioD  ita  validity  aa  a  pradictor,  than  ita^uta  would  have 
baan  diicontinuadfi   Wa  urgai  that  thaaa  naafuraf  which  may  ratult  in  tha, 
loia  of  that  pradictor  and  tha  lubiaquant  undarmining  of  afforti  to  fairly 
and  accurately  avaliiata  candidatap  for  admiiaion  to  law  tchool,  ba  rajactad 
>y  the  Conaittaa. 


Harold  I4.  Marquia^ 
Acting  Daan 


cjopy  tot  Congraitaah  Wycha  Fowlar  f 
I         -  -  CongraiMan  Bllidtt  Lfvitaa 


\  ■     ■  ■  - 


IT'  • 


.    ■  .'        •  .1182  -        ,  V 

■    . .   ■'  Testimony  in  Favor  of  Passage  op  H.R.  4949 

As  a  public  school  teacher  a^administrsftor  for  thirty  years/ 1  give  my  enthusias- 
tic support  to  the  passage  of  ^IB.  4949.  the  Federal  Truth  in  Testing  legislation. 

There  is  no  question  in  mv  mmd  that  students  should  have  the  clear  cut  right  to 
examine  the  questions  on  wnich  they  are  judged  and  see  their  corrected  responses.. 
Tests  with  this  potential  for  control  of  lives  should  not  be  shrouded  in  secrecy— 

erticularly  when  they  are  corrected  by  machines  subject  to  mechanical  error  fed 
^  attendants  subject  to  human  error. 

I  saw  the  possible  devastating  effect  of  standardized,  machine  scored  test  error 
first  hand  recently.  Wheft  the  medical  school  admission  tests  were  administered  to 
27,300  students  on  April  15,  1978,  90  percent  of  them  received  scores  lower  than 
they  should  have.  My  son  was  one  of  those  takihg  the  test.  \ 

The  error  was  found,  however  and  medical  schools  were  notified  by  the  testing 
company  to  ignore  the  original  scores— as  were  tne.  students  who  took  the  test. 
While  the  net  result  was  ixwitive,  ''Three  Mile  Island**  possibilities  existed  in  the 
secretive  process.  v  '  * 

Test  secrecy  is  perhaps  the  last  majo)  tyranny  sanctioned  by  our  Government.  It 
should  be  lifted— and  H.R.  4949  is  a  good  vehicle  fordoing  so. 
Sincerely, 

y  William  D.  Corbett.  ^ 


118/;  :■ 
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niMMolltHV*  fM         \  Itn  edkPMbiM  olrelt  -  new  yodi,  new  yoiK  10019  •  M  -SM-IOn 


December  18,  1979 


Hon..  Carl  D.  Perklne  .  •   <       •  ' 

ChAirman,  Committee'  on  Education  and  Labo/ 
Subcommittee  on  IHementary,  Secondary  and  • 

Vocational  Educatioi^        r  . 
Rayburn  Houett  OUlce  Building,  Room  346c 
Waehlngton,  D.C.  20515 

Dear  Mr.  Perldne:     -       '      «  '  : 

The  National  Lea(^0  for  Nursing  U  a  coalition  of  nutBe*/-.  other  health  » 
prolteeeionaU,  co1»^mere  and  health  agenciec  --17,  OOCMndividual  memberi 
and  1,300  agencies      working  together  to.  help'meet  conimunity  nureing 
neede  and  to  a^eeure.  high  qualitynureipg  education.   Among  ite  obany  function*, 

provides  preadmleeion  and  achievement  tect  eervicee  to  state -approved 
•  cboolt  preparing  registered  and  practical  nureee,    the  League  alto  ierves 
at  the  teet  service  agancy  for  the  State  Board  Test  Pool  Examination  for 
'both  registered  and  practical  nur a e  licenaure. .  ^ 

We  would  like  to  express  our  views  on  the  Truth'in  Testing  legislation  that 
was  the  subject  of  hearings  held  by  your  Elementary,  Secondary  and 
Vocational  Education  Subcokn^ttee  last  session.  • 

We  oppose  the  QlBbons  and  Weiss  proposals  for  a  number  pf  reasons,  not 
the  least  of  which  are  the  technical  and  administratiye  difficulties  which 
would  result  from  having  to  disclose  teet  questions  and  answers  to  test  takers. 
.  Thih  provision,  however,  IS  likely  to  have  the  most  hardfelt  impacron 
-  testing  candidates.  ^  ^.  .  • 

Methods  of  scoring  and  reporting  of  results  would  have  to  be  changed;  in 
addition  to  the  extra  time  and  staff  resources  that  would  be  needed  to 
compose. new  tests  for  each  administration.   The  League  has  conservatively  . 
estimated  that  changes  Of  thlTlQiture  would  cost  approximately  $100, 000 
annually.  .  • 


' .  >  •  membsfthip  orgi|niz8)i(^edicate<J  to  0)881100  the  health  neede  of  ]he  people  by  irtiproviria  nyrsihg  education  and  nuftrng  service- 


fi 


( 
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^  v'  ' ' 

Yet,  the  brimt  oithtb  negative  reiulti  that  would  occur  from  enactment  of 

>ucti  a  .law  would 'be  on  proipective  teit  candidate  i.  Fir  it  of  all,  the 

previous  flexibility  of  test  agencies  in  administering  makb-up  exataitoatiOns 

a:nd  scheduling  alternative  dates  fpr  handicapped  and  religious  Sabbath  ' 

observing  students  will  no  longer  be  teas'ible  because  of  the  extra  cost. 

TMs  is  precisely  the  sltuaUon  wUch  has  Secured  in  New  Yt>rk  SUte  with 

th^  passage  of  the  X^Valle  AcV  .      •  ' 

The  enactment  of  this  legislation  in  New  York  Stateihas  poaed  other 
formldlble  problems.  Presently,  twenty  of  the  twenty-six  test  programs 
threaten  io  be  withdrawn  from  use  in  New  York  State.   The  main  reason  is 
that  many  of  these  tests  are  administered  to  small  numbers  of  candi^tes 
and  test  agencies  wi^  not  be  able  to  absoij^b  excessive  new  adUxUniitifiive  and 
personnel  costs.  U  these  tests  are  withdrawn,  the  greatest  damage  will  be 
to  programs  with  highly  competitive  Admission  procedures,   loss  of  tests 
will  not  hurt  the  elite  students  from  the  most  prestigious  colleges:  it  is  very 
easy  for  deans  to  select  only  the  top  stucfents  from  Uie  top  undergraduate 
programs.  ManyiSchools  review  the  applications  of  ^matty  other  individoals 
who  would ^ot  have  been  considered  except  for  their  good  pe'rformance  on  the 
admissions  tests*  This  group  very  often  includes  the  eeonomically  disadvantaged  .. 
studeht  who  was  forced  to  attend  a  less  prestigious  college  or  the^student  who 
'  obtained  lower  grades  iaihe  first  year  or  two  of  collage  because  of  a  dlsadvaiitaged 
background.\  Although  UIM  hap  not  discontinued  ourlestln^  services  in 
New  York,  ae  a  result  of  the  LaValle  Act,  we  h|tve  old  to  ^aise  our  fees  and 
decresse  services  to  some  extent. 

W#  feel  strongly  that  t)&  institution  of  sUndardiaed  testing  should  be  Mpheld 
as  a  tool  for  the  guidance  and  placement  .of  ap^plica&tf  to  educational  insti- 
tution^. NlK^s  preadmission  tests  haVe  bt^tk  used  very  succef  sfully  as  ^ 
predictors  of  future^performance  In  schools  of  nursing.  -  *  ' 

Finally,  we  urge  you  to  examine  the  severe  financial  repercussions  and 
other  disruptive  consequences  of  the  LaValle  Act  in  New  York  State  before 
considering  thie  matter  at  the.  national  level.  .    ^  .  ^ 

.  ■         .•  ^ 

We  w«uld  be  happy  to  discuss  thia  topic  with  you  at  some  future  date  and 
^answer  any  questions  you  might  have.  ^ 

Since^relyf  ' 


•'J 


Pamela  Maraldo 
;Public  Affairs  Director 

PM:fw 
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'New  York  State  Department  of  Civil  Service 

=   THE  STATE  OFFICE  BUILOING  CAMPUS  *  ALBANY;  NEW  YORK  13330  ^ 


COMMISSION 

Victor  S.  Bihou 


John  J.  Moonty 

AOMINISTRATIVK  DIRKCTOfT 


PflKflOKNT 
JoMpMnt  L  Gn^binp 
.  JtmtsT.  McFirlfnd 


December  20,  1979 


Hon. Carl  Perki 

Qhalnnan,  Houpb  Subcoraittee  on 

•  Elenentary,  Sebondary  and 

'  Vocational  Education  . 
8-3460  Rayburn  dff Ice  BuUdlhg 
Washington,  D.C.  .  20515  • 

Dear  Mr*  Chaimant 

■         ■   ^  t 
In  view  of  the  conflicting  and  often  confusing  viewpoints 
being  presented  in  the  area  of  "Truth  in  Testing,"  it  stillKseems 
important  that  those  involved  in  setting  policy  or  designing  legisla- 
tion should  be  aware,|Of  an  ittforraation  Aystem  in  effect  in  New  York 
State.    The  attached  "Examination  Review"  is  a  summary  of  this  system 
and  highlights  the  procedures  in  use  today*    ^hese  have  been  ' 
.developed  over  a  number  of  ^ears*  ^ 

•  ■  \  . 

The  system  we  use  ensures  that  two  objectives  of.  testings  * 
are  meti     (a)  The  system  is  job  related.    Individual  test  takers 
can  review  the  test  mater:(als  (but  they  may  not  keep  them)  to 
HSetemine  w)\ei:her  the  questions  and  answers  are,  in  effect,  job  # 
related.    Following  this . step  a  second  check  takes  placer  namely^ 
(b)'the  individual  test  takers  can  toee  and  compare  their  answers  to 
the  correct  od[mode^.  answer i  ensuring'  that  the  system  has  b^en  applied 
correctly*    Tlfts  double  checking  would  identify  any  mistakes  made  in 
scoring  or  ttensferring  of  sooresr  etc*,  made  when  the  scoring  system 
was  applied  to  individual  answer  sheets.    Individuals  want  to  know 
whether  they  have  been  treated  fairly  and  our  system  provides  them  . 
with  an  opportunity  to  determine  this  for  themselves. 

You  will  note  fr.om  th<^  charts  and  graphs  prepared  as  part 
of  the  statistical  information  We  have  gathered  that  the  nui^ber  of 
requests  for  this*  information  is  qtUte  modest*    Thus r  it  is  ^ssible 
that  the  issue,  while  an  impoiptant  one,  has  been  blown  clear \>ut  of  ' 
proportion.    If  our  experience  in  the  employment  setting  generalizes 
to  oth<|r  settings^  it  irould  Appear  that  only  A  few  IndividualsXwill 
fqiLlow  up  and  obtain!  the  information  desired,  thus  keeping  ooste  at 
nihimum*    In  one  of  the  inktanceflA-Sttcite  only  3/4  of  one  perpent 
the  test  takers  for  a  part4.c^]:ar^  examii^tion  found  fault  and 
^eoted  to  any  of  the  questions*    Note  thaKwe  do  not  give  any  t^st 
berials  away,  father  that  Jttiese, are  reviewedTlmr^ceral  locatioiJ^ 
untter  controlled  conditio|vst  and^within  a  reasonebliftlsML  P^^iod, 
after  which  th^  review  q^^rtunity  is  over  and  aXl  mVterDUs  are 
returned  to  us* 


■  V  ■  ■ 


'  ■■  '  '     ■    :/  118?) 
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•  •       Let  US  know  it  wt.cap  he  ei  addlitlonal  help  or  if  you 
ifould  like  any  of  ibha  point*  Glarj,flod.    Z  wj.ll  be  happy  to.talk 
with  youf  or  you  nay  contact  our  Aaslstant  Administrative 
Director,  Mr.  John  }\,  Ke^fe,  for  Information  on  Administrative 
concerns.    He  can  be  reached  at  (518)^457-6203.    My  telephone 
nunber  16.(518)  4^7<-5358. 

/.  ^  sfnkerely, 

/Grace  H.  Wright,  Ph. 
0.  I  Research  Psychologist  . 

.;       ^  .  Director,  Validation  Program 

AJ^tachnents  '    .  .  *  ^  " 


*.  EXAMINATION  REVIEW 


The  Department  of  Ctyll  Service  accepts  the  responslbllfty  to 

•  maintain  security  and  integrity  In  the  examination  process.   This  calls 
for  fail*! treatment  of  all  candidates  and  for  controls  to  insure  meetlhg 
these  objectives.   To  make  certain  that  no  one  candidate  can 'benefit  from 
unauthorized  accesi?  tp  test  materials,  we  enforce  measures  to  p^tect^ 
those  test  materials  at  each  step  in  the  examination  procedure.  ^ 

After  an  examination  is  administer^,  all  papers  are  ^turned  / 
from  the  testing  centers  to  Albany  for  rating.   When  the  papers  arrive, 
^vi.-they  must  be  accounted  for  and  checked  for  discrepancies.   This  is-  an 
important  initial  step  in  maintaining  tight  security  and  preserving  the 
integrity  of  the  entire  examination  process. 

*  .      A  rating  key  njust  be  prisp^ared  for  use  In  the  preliiiffwry  s<|fr1ng 

of  answer  sheets.   The;  answer  sheets  are  scanned  for  double-  answers, 

extraneous  marks  and  m&sy  erasures.    If  thia  is  not  done,  scorjpg  errors 

*     .  ^   ■  . .  ■ 

will  dccur.  ^  '    .  .  ^ 

In  many  examinations,  we  invite  candidates  to  return  at  a  later 
\   date  to  review  th6  questions  and  the  tentative  key  (correctr  answers. 
/  (See  A|b|||^p|nt;$.)   At  the  pre'^ra  candidate/is  provided  a 

-tes^flWdklTO  and^^  ^  answer  key  f/hich  are  reviewed  in  the  presence 

Of  monitors.  Th6  written  objections  received  from  all  candidates  who  cj)ppse 

*  .         ■  *     i       .  ■     "    ■        ■      '  .  ■■"      *  , 

^  to  make  thiS  reyicw  ar^  analysed  Yn  djepth  by  th^  examining^staff.  Irt 

^ addition,  the  answer  sheets  Jar?  rateKaN  responses  to  each 

question  are  tallied*  StrU^  coifl^l  is  $tilf  e*icerc1sed')at  this^  point  to 

maintain  exam  secuirity.   Although  legitimate  candidates       review  the     ,  ^ 

questions- and  tentative  keyl,  they  must  leave  all  copiiesWf  these  questions/ 
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and  keys  in  the  rtevleW  centef .  Thi^  prevents  Itakage  of  the  contents  of 
the  test  to  individuals  who  might  take  a  siinilar  test  l.iilthe  future  .in  which 
the  same  oi^'  similar*  questions  may  be  used,. 

''v The*  responses  are^ reviewed,  |i]ong  with  the  candidaties'  objections, 
to.  d^terjiine  whether  there  is-  re*ason  to  suspect  the  correctness  of  aijy 
tentative  key  ansWer.  Jh1$  r^iew  process  aj^a  helps  to  reveaV fa|iUy  or 
ambiguous  questions  and  ensyres  that  no  cancjidate  is  harmed  because  a  poorly 
constructed  questi  on  was 'used.  .    .    '  \^  ■  ''  ' 

The  results  of  this  revie^rf  are  trapsmitted  with  recommendationf  . 

to  a  consultant.*,  The  consultant,  in  turn,  analyzes  the  record,  and  m&y  * 

request  information  or  discuss  certain  (juestions  with  the  examining  staff.  , 

The  consultant  then  submits  a  report  and  reconmendations  to  a  committee 

off  the  Cjvil  SeWice  Conimisslon.   The  recomniendaiions  o^he.  committee  are 

then  considered  af%acted  upon  by  the  ^ivil  Service  Commission.   This  arduous 

procedure  is  desjgned  to  perfect  the  ratingjcey  whici)  is  then  uniformly 

■  .  "  .    r       .  ' 
applied  to  all  papers, 

A  {frequency  tJIstri'buti on  is  next  prepared  showing  raw' scores  for 
all  Iftdldytes.   For  example,  the  distribution  might  show  ttAt'W  candidate 
in  a  90-c/iestion  test  had  84  correct  '^'i[10nS?^ii  81  CQrrectI responses, 

.  and  so  on  roiiaTl^andidates..  Jhis  distribution  fomi  carries  a  great  deal 
♦  of  data  pertinent  to  the  examination  and  to  the  positions  toVbe  filled.  • 


V 


The  distribution 'fgrm     analyzed^^  discussed  by  the  respons1bl4 
examlnm.   Where  necessary,  conferences  are  held  with  Informed  persons  who 


dan  hel||jreach' decisions  about  the  difficulty  level  of  the  test,  the  quality 
Qf  the  competition  and  the  kinds  o^  persons  needed  to  p^rfprm  effectively  ; 

•  ■      '  ■     ....  r\l-  . 


• 


In  the  positions  to  be  filled.  The  passj^ig  point  in  the  eximination  is 
1^  then  set. as  Is  the  formula  to  be  u|^ed  in  converting  the  raw  test  scores 
.  ,  to  final  scqre^.   Not  until  fin^  scores  are  compute/do  we  initiate  the 

procedure  which-,  reveals  the  ildentf 

^    -       TIfje  computatioMl  review  takes  place  after  the  final  answer 
.  key  has  been  established.    At.  thts  review  the  candidate  is.  provided  a 
.   copy  Of  the  final^fiswer  kpy  and  his  iown  test  answer  sheet  whose  surface 
'.■  has  been  waxed/to  prevent  tarnpering.   The  candidate  may  then  determine  > 
whether  the  final  answer  key  has  been  appl.\ed  correctly  t;p  his  own  answer 
sheet  and  whether  any  other  procedures^  such  as  weighting,  have  been 
performed  correctly.   These  materials  also  are  reviewed  under  the  close 
supervision  of  a  monitor,  ' 

Pos t- rati nfg  reviews  are  a  combination  of  the  pre-rating  and 
computatlonar  re  views,   these  allow  candidates  to  review  botlithe-quality 
of  the^r^atijfig  given  their  responses,  as  in  a  subjectively  scoreJl^ree- 
response  type  essay,  as  well  as. the  accuracy,  of  the  calculations  made  in 
arriving  at  the  final  score.    These  procedures  provide  candidates  with 

Information  about  the  test,  abqut  their  performance  on  the  test,  and  how 

.  t  *  . 

their  final  scores  were  determined. 

.    .When  the  examining  staff  has  finlshq^  its  ^ork,  materials  jn 
most: examinations  must  th^n  be' processed  .through  computer  equipment  for 
preparation  of  the  official  list  of  successful  candidates^  notices  to  all 
^    capdidates  of  the  result  of  the  examination,  and  other  relate^  documents.. 
i    with  the  exception ^f  anjilyses  and  other  technical  material  which  go  into 
the  permanent  examination  file,  for  use  in  developing'a.new  test,  this 
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completes  the  examination  process  as  it^relates  to  the  candidates.  The 

t  ■  . 

reviJBW  results  are  filed  with  the  other  materials  used  in  developing  the 
test  and  are  consulted  when  other  exams  are  developed  which  may  use  the  . 
same  or  similar  questions.  •  ,      -  , 


October,  1979  • 

New  York  State 

Department  of  Civil  .Service 
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TABLE  1 

J'  ■ 

Number  of  Ekaml nation  Questions  by  Type. with  Rate  of  Appeals 
Examinations  Serviced 

;  ★  ■     —  ■ 

and  Number  of 

•               ;  Activity 

1975-76 

1976-77 

'1977-78 

1978-79 

■  * 

"      Examinations  held  Involving 

written  tests  (State,'  Local  • 
and  OCA) .                .  '  • 

4,201 

.  1 

..'  4,080 

'  4,306 

4,955 

Test  questions  :used 

34»876 

36,618 

34,052. 

.45,1^3 

Questions  from  files  -  Not 
revised  * 

Questions  from  files  -  revised 

25,894 

28,807 
T,500 

28»259 
2,518. 

35,904 
3,025 

New  qitestlons  -  outside  Sources 

1 ,975 

«  ■. 

1 ,790 

1,611  ; 

2,975 

New  questions  -  staff  written 

3,115  ■ 

2,521 

1,664  ' 

3,237 

Essay*  design!  drawing  questions 

301 

75  . 

33 

44 

^       Appealed  multiple  choice  qu^ions 

■  .    ■   ■  V       ♦  ■ 

t  of  multiple  choice  questions  .' 
appealed                      .  . 

2,440 

.2,139 

2,469 

3.147 

<  ■ 

% 

5.8X 

7.2X 

7%  • 

— -t 

i 

f  . 

»  4 

\ 

lit  0 
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Set)tember;  1979 


ERIC 


/V 


1192 


TABLE  2 


Conputatlonal  and  Post  Rating  Review  Activity  by  Month^for  k  51.x  Month- Period  In  1979 


1979 


Jurisdiction  - 

Harch • 

April 

May 

dune 

July 

August 

state" 

CompJ  Post 

ConpJPost 

Comp.|Pds.t 

Cotnp.l  Post 

Comp.l  Post 

Comp.l  Po^ 

«  Requests' filed 

1 

734  j 

5 

I 

637  [..1  . 

1 

423  j  2 

'  1 
435  [ 

1 

1 

'560  [ 

b 

1 

579  j 

0  . 

Failed  to  appear 

1 

184  1 

117  j  1 

48  1 

0 

*  137  j 

1 

1  • 

Object  received 

5 

6  j  ''O 

•■  ^.1 

0 

■■io| 
1 

0 

1 

0  • 

LOCAL  • 

1 
1 
1 

.  T  • 
1 

,  1 

1    .  • 

I  ■ 
1 

1 
1 

■      •  1 

1 
1 

1 

*  Requests  filed 

227  j  , 

5 

123  1  .9 

100  j    9  . 

225  [ 

4  ' 

123.  j 

6 

135 

10- 

Failed  to  appear 

44  ]  . 

0 

16  j  0 

76 '[--0- 

1  .. 

"1 

3 

137 

Object  recel  ved 

■;  ^ ! 

4 

.     4  1  0 

2  [  6 

^! 

6 

3 

> 

L 

1 

r  . 

1 

1 

■ 

Note.   These  figures  reflect  a^lvlty  In  the  Central  Files  Unit  during  gWen  periods  of  . 
TTme  and  do  not  necessar'lly  Inter-relate  to  each  other  on  an  exam  series  bas1s<  For 
example,  the  132  people  w|io  failed  to  appear  for  State  computational  review  In  March  are 
probably  not  Included  In  the  734  people  who  requ^s.ted  a  review  during  March,  nbr  can  It 
be  sala  thit  the  184  people'vJho  failed  to  appear  In. April  are  from  that  group  of  734. 

Computational  review  Is  limited  to  a  check  to  see  that. papers  have  been  scored  correctly 
against  a  final  key  and  does  not  allow  appeals  regarding  the  correctness  of  the  key. 
Some  appeals  result  from  the  candidate's  failure  to  understand  the  scoring  formula  and  • 
not  as  a  result  of  an  incorrectly  scored  (faper. 

•  Post-rating  review  allows .objections  to  the  ratings,  given  to  a  candidate's  response 
(usually  of  the  free  respdnse  typeressay  or  drawing,  etc  )  as  well  as  to  the 'accuracy  ot 
the  calculations  niade  In  arriving  at  the  final  score. 

Examinations  are  held  on  about  15  scheduled^dates  a  year  (usually  SaturdaysKat  38  State- 
and  more  than  100  local  test  centers.    In  recent  years,  more  than  600  State  and  more  than 
3,000  local  written  tests  were  conducted  annually.    As  many  as  30,000  candidates  have  been 
tested  In  a  single  day*    In  1978,  tests  for  220,000  candidates  were  processed. 


NEW  YORK  STATE  DEPARTMENT  OF  CIVIL  SERVICE 
September,  1979 
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.  Candidate  Review  Experience  for. a  Recent  Writteh  Multiple  Choice  Test 


Category 

— 

Fifequency 

Candidates  filing  for  test 

22,679  .  . 

Candf9ates  taking  test 

14,«T7  ' 

Candidates  reviewing  test  questions  > 
and  tentative  key  answers    •     .  ^ 

355  ' 

*  ■ 

Candidates  not  submitting  objections 
to  any  tentative  kety  answer^ 

.  241 

Candidates  submitting  objections 
to  some  tentative  key  answers 

V  .                              -  ■ 

.114       .  ' 

\ 


Note.   A  total  of  330  objections  were  received  for  this  90  question  test.   Of  these 
9Squest1ons»  61  received  objections.    Resolution  Is  expected  to  take  an  additional 
8  to  10  weeks.   The  large  nimber  of  appeals  wa$  ascribed  to  the  ijrge  and 
heterogenous  nature  of  the  candidate  group  and  was  not  typical  <}f  eXams  In  general. 
Even  so,  of  those  appealing  (355),  somewhat  less  than  two-thirds  (241)  did  not 
submit  an  objection  after  reviewing  the  test  question.  '  ^ 
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Figure  1.    Candidate  Review  Experience 


Note.    Of  the  caiidldates  who  filed  for  a  test  <22,679),  approidmately  one-third  (7,862)  did 
noFshoM  up  to  t^ke  the  test/  .Of  those  who  did  (14»817),  only  3/4  of  U  (.00769)  have  f11ed^ 
appeals »  not  being  satisfied  with  the  Infonuitlon  provided  dt^rltig  the  review.   This  small 
group  challenged  sixty-one  of  the  ninety  questions  in  the  test.   (No  demographic  Information  Is 
taken  or  kfept  of  Ithe  characteristics  of  candixlates  who  review  kerns  or  of  those  who  eventjially 
<11e  appeals.)  .  .  -     '  k  ^  .  * 
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